2024-05-10T10:32:07.897 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-10T10:32:07.897 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_dparmar@teuthology --archive /home/teuthworker/archive/dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700915 --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} --name dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi --verbose -- /home/teuthworker/archive/dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700915/orig.config.yaml 2024-05-10T10:32:07.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T10:32:08.056 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700915 branch: wip-63896-from-wip-rishabh-testing-20240501.193033 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} email: null first_in_suite: false job_id: '7700915' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-63896-from-wip-rishabh-testing-20240501.193033 ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: d39fa08867836ac070c47cb66c782fa559fd480b subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: d39fa08867836ac070c47cb66c782fa559fd480b kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync rbytes: false syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-63896-from-wip-rishabh-testing-20240501.193033 sha1: d39fa08867836ac070c47cb66c782fa559fd480b owner: scheduled_dparmar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1698 sha1: d39fa08867836ac070c47cb66c782fa559fd480b sleep_before_teardown: 0 subset: 434/512 suite: fs suite_branch: wip-63896-from-wip-rishabh-testing-20240501.193033 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d39fa08867836ac070c47cb66c782fa559fd480b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d39fa08867836ac070c47cb66c782fa559fd480b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMV5MEjPhTQSzUUTIHUiqBqyM+uEu7jb5JArOrBnXiUPr1WlVYdSLjfG4nuKOcVjcaCyTWACEavhnQJPKp/s1AM= smithi184.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDMNR7AHP1fiDIHr+z43RNTJmurZbAU2HN7ZBk+CiEsmBMuvyLdI2hCYloNqYZ5jRfwT4RgcK1iunpz0b1jjFCc= smithi196.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNJ0lfv2iwCKuQZSKwTLyZiQAGuO46l5lQW9AzIdTyjpyfduPrvpXNhNQdVWwOC5n73BXwdXRGdYTWUleZhjq/M= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-10_07:35:43 tube: smithi user: dparmar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-10T10:32:08.056 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d39fa08867836ac070c47cb66c782fa559fd480b/qa; will attempt to use it 2024-05-10T10:32:08.057 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d39fa08867836ac070c47cb66c782fa559fd480b/qa/tasks 2024-05-10T10:32:08.057 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-10T10:32:08.058 INFO:teuthology.task.internal:Checking packages... 2024-05-10T10:32:08.083 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd39fa08867836ac070c47cb66c782fa559fd480b' 2024-05-10T10:32:08.083 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-10T10:32:08.083 INFO:teuthology.packaging:ref: None 2024-05-10T10:32:08.083 INFO:teuthology.packaging:tag: None 2024-05-10T10:32:08.083 INFO:teuthology.packaging:branch: wip-63896-from-wip-rishabh-testing-20240501.193033 2024-05-10T10:32:08.083 INFO:teuthology.packaging:sha1: d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T10:32:08.084 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-63896-from-wip-rishabh-testing-20240501.193033 2024-05-10T10:32:08.231 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3449.gd39fa088 2024-05-10T10:32:08.232 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-10T10:32:08.238 INFO:teuthology.task.internal:no buildpackages task found 2024-05-10T10:32:08.238 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-10T10:32:08.265 INFO:teuthology.task.internal:Saving configuration 2024-05-10T10:32:08.285 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-10T10:32:08.299 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T10:32:08.324 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 10:26:46.583473', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMV5MEjPhTQSzUUTIHUiqBqyM+uEu7jb5JArOrBnXiUPr1WlVYdSLjfG4nuKOcVjcaCyTWACEavhnQJPKp/s1AM='} 2024-05-10T10:32:08.347 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 10:26:46.580457', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDMNR7AHP1fiDIHr+z43RNTJmurZbAU2HN7ZBk+CiEsmBMuvyLdI2hCYloNqYZ5jRfwT4RgcK1iunpz0b1jjFCc='} 2024-05-10T10:32:08.371 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 10:26:46.582095', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNJ0lfv2iwCKuQZSKwTLyZiQAGuO46l5lQW9AzIdTyjpyfduPrvpXNhNQdVWwOC5n73BXwdXRGdYTWUleZhjq/M='} 2024-05-10T10:32:08.371 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-10T10:32:08.384 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-10T10:32:08.384 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-10T10:32:08.384 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-10T10:32:08.384 INFO:teuthology.run_tasks:Running task console_log... 2024-05-10T10:32:08.507 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7ef2ff20d0>, signals=[15]) 2024-05-10T10:32:08.508 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-10T10:32:08.514 INFO:teuthology.task.internal:Opening connections... 2024-05-10T10:32:08.514 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-05-10T10:32:08.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T10:32:08.592 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2024-05-10T10:32:08.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T10:32:08.668 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2024-05-10T10:32:08.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T10:32:08.745 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-10T10:32:08.752 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-05-10T10:32:08.770 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-05-10T10:32:08.771 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-05-10T10:32:08.828 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-05-10T10:32:08.828 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2024-05-10T10:32:08.828 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-05-10T10:32:08.828 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-05-10T10:32:08.828 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2024-05-10T10:32:08.829 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2024-05-10T10:32:08.829 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-10T10:32:08.829 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-05-10T10:32:08.829 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2024-05-10T10:32:08.829 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-10T10:32:08.829 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-05-10T10:32:08.829 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-10T10:32:08.829 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-10T10:32:08.829 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-10T10:32:08.830 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-05-10T10:32:08.856 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2024-05-10T10:32:08.875 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2024-05-10T10:32:08.876 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-05-10T10:32:08.933 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2024-05-10T10:32:08.933 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="9" 2024-05-10T10:32:08.933 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2024-05-10T10:32:08.933 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2024-05-10T10:32:08.933 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="9" 2024-05-10T10:32:08.933 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el9" 2024-05-10T10:32:08.933 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-10T10:32:08.933 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2024-05-10T10:32:08.933 INFO:teuthology.orchestra.run.smithi184.stdout:LOGO="fedora-logo-icon" 2024-05-10T10:32:08.933 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-10T10:32:08.933 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2024-05-10T10:32:08.933 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-10T10:32:08.934 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-10T10:32:08.934 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-10T10:32:08.934 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-05-10T10:32:08.964 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-05-10T10:32:08.982 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-05-10T10:32:08.982 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-05-10T10:32:09.039 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-05-10T10:32:09.039 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-05-10T10:32:09.039 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-05-10T10:32:09.039 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-05-10T10:32:09.039 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-05-10T10:32:09.039 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-05-10T10:32:09.039 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-10T10:32:09.040 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-05-10T10:32:09.040 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-05-10T10:32:09.040 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-10T10:32:09.040 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-05-10T10:32:09.040 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-10T10:32:09.040 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-10T10:32:09.040 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-10T10:32:09.040 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-05-10T10:32:09.064 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-10T10:32:09.074 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-10T10:32:09.107 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-10T10:32:09.107 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-05-10T10:32:09.110 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2024-05-10T10:32:09.112 DEBUG:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2024-05-10T10:32:09.128 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-10T10:32:09.161 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-10T10:32:09.161 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-05-10T10:32:09.166 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2024-05-10T10:32:09.169 DEBUG:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2024-05-10T10:32:09.251 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-10T10:32:09.332 INFO:teuthology.run_tasks:Running task kernel... 2024-05-10T10:32:09.347 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-05-10T10:32:09.347 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-05-10T10:32:09.347 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-05-10T10:32:09.347 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T10:32:09.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T10:32:09.364 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-05-10T10:32:09.422 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-437.el9.x86_64 2024-05-10T10:32:09.423 INFO:teuthology.task.kernel:Running kernel on smithi107: 5.14.0-437.el9.x86_64 2024-05-10T10:32:09.423 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum install -y kernel 2024-05-10T10:32:12.563 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.1 MB 00:01 2024-05-10T10:32:15.080 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-05-10T10:32:19.406 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 8.5 MB/s | 6.2 MB 00:00 2024-05-10T10:32:21.015 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 16 kB 00:00 2024-05-10T10:32:22.574 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-05-10T10:32:27.799 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-05-10T10:32:28.002 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:01 ago on Fri 10 May 2024 10:32:27 AM UTC. 2024-05-10T10:32:29.780 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-10T10:32:29.780 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-10T10:32:29.870 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-05-10T10:32:29.878 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-05-10T10:32:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-05-10T10:32:29.879 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-05-10T10:32:29.879 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-05-10T10:32:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-10T10:32:29.879 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-05-10T10:32:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-10T10:32:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-10T10:32:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-10T10:32:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:32:29.879 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-05-10T10:32:29.879 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-05-10T10:32:29.879 INFO:teuthology.orchestra.run.smithi107.stdout:Install 4 Packages 2024-05-10T10:32:29.879 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:32:29.879 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 78 M 2024-05-10T10:32:29.880 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 123 M 2024-05-10T10:32:29.880 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-05-10T10:32:30.654 INFO:teuthology.orchestra.run.smithi107.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 728 kB/s | 484 kB 00:00 2024-05-10T10:32:42.148 INFO:teuthology.orchestra.run.smithi107.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 1.3 MB/s | 15 MB 00:12 2024-05-10T10:32:58.812 INFO:teuthology.orchestra.run.smithi107.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 1.0 MB/s | 28 MB 00:28 2024-05-10T10:33:06.044 INFO:teuthology.orchestra.run.smithi107.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 963 kB/s | 34 MB 00:36 2024-05-10T10:33:06.045 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-05-10T10:33:06.045 INFO:teuthology.orchestra.run.smithi107.stdout:Total 2.2 MB/s | 78 MB 00:36 2024-05-10T10:33:06.724 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-05-10T10:33:07.054 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-05-10T10:33:07.054 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-05-10T10:33:07.991 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-05-10T10:33:07.992 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-05-10T10:33:10.399 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-05-10T10:33:11.094 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-10T10:33:11.178 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T10:33:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T10:33:13.981 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T10:33:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T10:33:18.808 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-10T10:33:23.566 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T10:33:53.012 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T10:33:53.049 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-10T10:33:53.377 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-10T10:33:53.377 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-10T10:33:53.377 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-10T10:33:53.378 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-10T10:33:54.104 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-10T10:33:54.104 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:33:54.104 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-05-10T10:33:54.104 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-10T10:33:54.104 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-10T10:33:54.104 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-10T10:33:54.105 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-10T10:33:54.105 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:33:54.105 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-05-10T10:33:54.448 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-05-10T10:33:54.524 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-10T10:33:54.524 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-10T10:33:54.524 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-10T10:33:54.525 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-10T10:33:54.525 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-10T10:33:54.525 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-05-10T10:33:54.525 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=None, version=distro) 2024-05-10T10:33:54.525 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-05-10T10:33:54.574 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-10T10:33:54.575 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-10T10:33:54.575 DEBUG:teuthology.orchestra.run.smithi107:> sudo rpm -qi grub2-tools 2024-05-10T10:33:54.614 INFO:teuthology.orchestra.run.smithi107.stdout:Name : grub2-tools 2024-05-10T10:33:54.614 INFO:teuthology.orchestra.run.smithi107.stdout:Epoch : 1 2024-05-10T10:33:54.615 INFO:teuthology.orchestra.run.smithi107.stdout:Version : 2.06 2024-05-10T10:33:54.615 INFO:teuthology.orchestra.run.smithi107.stdout:Release : 68.el9 2024-05-10T10:33:54.615 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: x86_64 2024-05-10T10:33:54.615 INFO:teuthology.orchestra.run.smithi107.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-10T10:33:54.615 INFO:teuthology.orchestra.run.smithi107.stdout:Group : Unspecified 2024-05-10T10:33:54.615 INFO:teuthology.orchestra.run.smithi107.stdout:Size : 8264254 2024-05-10T10:33:54.615 INFO:teuthology.orchestra.run.smithi107.stdout:License : GPLv3+ 2024-05-10T10:33:54.615 INFO:teuthology.orchestra.run.smithi107.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-10T10:33:54.615 INFO:teuthology.orchestra.run.smithi107.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-10T10:33:54.615 INFO:teuthology.orchestra.run.smithi107.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-10T10:33:54.615 INFO:teuthology.orchestra.run.smithi107.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-10T10:33:54.615 INFO:teuthology.orchestra.run.smithi107.stdout:Packager : builder@centos.org 2024-05-10T10:33:54.615 INFO:teuthology.orchestra.run.smithi107.stdout:Vendor : CentOS 2024-05-10T10:33:54.615 INFO:teuthology.orchestra.run.smithi107.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-10T10:33:54.616 INFO:teuthology.orchestra.run.smithi107.stdout:Summary : Support tools for GRUB. 2024-05-10T10:33:54.616 INFO:teuthology.orchestra.run.smithi107.stdout:Description : 2024-05-10T10:33:54.616 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:33:54.616 INFO:teuthology.orchestra.run.smithi107.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-10T10:33:54.616 INFO:teuthology.orchestra.run.smithi107.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-10T10:33:54.616 INFO:teuthology.orchestra.run.smithi107.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-10T10:33:54.616 INFO:teuthology.orchestra.run.smithi107.stdout:hardware devices. 2024-05-10T10:33:54.616 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:33:54.616 INFO:teuthology.orchestra.run.smithi107.stdout:This subpackage provides tools for support of all platforms. 2024-05-10T10:33:54.617 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-10T10:33:54.617 INFO:teuthology.task.kernel:Updating grub on smithi107 to boot 5.14.0-444.el9.x86_64 2024-05-10T10:33:54.617 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-10T10:33:55.246 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2024-05-10T10:33:56.665 INFO:teuthology.orchestra.run.smithi107.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-10T10:33:56.696 INFO:teuthology.orchestra.run.smithi107.stderr:done 2024-05-10T10:33:56.698 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-05-10T10:33:56.714 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.lwY5xKLSTJ 2024-05-10T10:33:56.714 DEBUG:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.lwY5xKLSTJ 2024-05-10T10:33:56.780 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.lwY5xKLSTJ 2024-05-10T10:33:56.915 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.lwY5xKLSTJ is 6KB 2024-05-10T10:33:56.963 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.lwY5xKLSTJ 2024-05-10T10:33:56.978 DEBUG:teuthology.orchestra.run.smithi107:> sudo /bin/ls /boot/loader/entries || true 2024-05-10T10:33:57.039 INFO:teuthology.orchestra.run.smithi107.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-10T10:33:57.039 INFO:teuthology.orchestra.run.smithi107.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-10T10:33:57.040 INFO:teuthology.orchestra.run.smithi107.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-10T10:33:57.040 INFO:teuthology.orchestra.run.smithi107.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-10T10:33:57.041 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-10T10:33:57.193 DEBUG:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2024-05-10T10:34:27.196 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-10T10:34:27.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-10T10:34:27.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T10:34:45.662 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-05-10T10:34:54.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-10T10:34:54.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T10:34:57.726 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-05-10T10:35:09.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-10T10:35:09.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T10:36:09.840 DEBUG:teuthology.orchestra.remote:timed out 2024-05-10T10:36:24.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-10T10:36:24.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T10:36:25.164 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-05-10T10:36:25.507 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-10T10:36:25.507 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-444.el9.x86_64"... 2024-05-10T10:36:25.507 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-05-10T10:36:25.523 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-444.el9.x86_64 2024-05-10T10:36:25.523 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-10T10:36:25.523 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-10T10:36:25.523 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-10T10:36:26.524 DEBUG:teuthology.parallel:result is None 2024-05-10T10:36:26.524 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-10T10:36:26.532 INFO:teuthology.task.internal:Creating test directory... 2024-05-10T10:36:26.533 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T10:36:26.535 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T10:36:26.538 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T10:36:26.556 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-10T10:36:26.569 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-10T10:36:26.618 INFO:teuthology.task.internal:Creating archive directory... 2024-05-10T10:36:26.618 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T10:36:26.620 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T10:36:26.622 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T10:36:26.934 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-10T10:36:26.940 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-10T10:36:26.940 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T10:36:26.958 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T10:36:26.958 DEBUG:teuthology.orchestra.run.smithi196:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T10:36:26.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T10:36:26.975 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T10:36:26.977 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T10:36:27.001 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T10:36:27.040 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T10:36:27.053 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T10:36:27.070 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T10:36:27.088 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T10:36:27.098 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T10:36:27.119 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T10:36:27.121 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-10T10:36:27.128 INFO:teuthology.task.internal:Configuring sudo... 2024-05-10T10:36:27.128 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T10:36:27.131 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T10:36:27.133 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T10:36:27.160 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-10T10:36:27.169 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-10T10:36:27.169 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T10:36:27.201 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T10:36:27.203 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T10:36:27.220 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T10:36:27.301 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T10:36:27.349 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T10:36:27.431 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T10:36:27.473 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T10:36:27.473 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T10:36:27.539 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T10:36:27.582 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T10:36:27.636 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T10:36:27.721 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T10:36:27.761 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-10T10:36:27.762 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T10:36:27.828 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T10:36:27.872 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T10:36:27.923 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T10:36:28.006 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T10:36:28.048 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-10T10:36:28.048 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T10:36:28.114 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-05-10T10:36:28.116 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2024-05-10T10:36:28.119 DEBUG:teuthology.orchestra.run.smithi196:> sudo service rsyslog restart 2024-05-10T10:36:28.163 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T10:36:28.164 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T10:36:28.191 INFO:teuthology.orchestra.run.smithi196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T10:36:28.678 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-10T10:36:28.686 INFO:teuthology.task.internal:Starting timer... 2024-05-10T10:36:28.686 INFO:teuthology.run_tasks:Running task pcp... 2024-05-10T10:36:28.721 INFO:teuthology.run_tasks:Running task selinux... 2024-05-10T10:36:28.770 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-10T10:36:28.770 DEBUG:teuthology.orchestra.run.smithi107:> sudo service auditd rotate 2024-05-10T10:36:28.837 INFO:teuthology.orchestra.run.smithi107.stdout:Rotating logs: 2024-05-10T10:36:28.839 DEBUG:teuthology.orchestra.run.smithi184:> sudo service auditd rotate 2024-05-10T10:36:28.912 INFO:teuthology.orchestra.run.smithi184.stdout:Rotating logs: 2024-05-10T10:36:28.914 DEBUG:teuthology.orchestra.run.smithi196:> sudo service auditd rotate 2024-05-10T10:36:28.997 INFO:teuthology.orchestra.run.smithi196.stdout:Rotating logs: 2024-05-10T10:36:29.002 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-10T10:36:29.002 DEBUG:teuthology.orchestra.run.smithi107:> /usr/sbin/getenforce 2024-05-10T10:36:29.024 INFO:teuthology.orchestra.run.smithi107.stdout:Permissive 2024-05-10T10:36:29.024 DEBUG:teuthology.orchestra.run.smithi184:> /usr/sbin/getenforce 2024-05-10T10:36:29.053 INFO:teuthology.orchestra.run.smithi184.stdout:Permissive 2024-05-10T10:36:29.054 DEBUG:teuthology.orchestra.run.smithi196:> /usr/sbin/getenforce 2024-05-10T10:36:29.080 INFO:teuthology.orchestra.run.smithi196.stdout:Permissive 2024-05-10T10:36:29.080 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi107.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi184.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi196.front.sepia.ceph.com': 'permissive'} 2024-05-10T10:36:29.080 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-10T10:36:29.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T10:36:29.109 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-10T10:36:29.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T10:36:29.137 DEBUG:teuthology.orchestra.run.smithi196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-10T10:36:29.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T10:36:29.165 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-10T10:36:29.165 DEBUG:teuthology.orchestra.run.smithi107:> sudo /usr/sbin/setenforce permissive 2024-05-10T10:36:29.191 DEBUG:teuthology.orchestra.run.smithi184:> sudo /usr/sbin/setenforce permissive 2024-05-10T10:36:29.223 DEBUG:teuthology.orchestra.run.smithi196:> sudo /usr/sbin/setenforce permissive 2024-05-10T10:36:29.251 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-10T10:36:29.260 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-10T10:36:29.267 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-10T10:36:29.395 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-10T10:36:29.410 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-10T10:36:29.412 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi107.front.sepia.ceph.com,smithi184.front.sepia.ceph.com,smithi196.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-10T10:40:49.601 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi107.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com'), Remote(name='ubuntu@smithi196.front.sepia.ceph.com')] 2024-05-10T10:40:49.602 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-10T10:40:49.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T10:40:49.680 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-05-10T10:40:49.765 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-10T10:40:49.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-05-10T10:40:49.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T10:40:49.841 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-05-10T10:40:49.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-05-10T10:40:49.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-05-10T10:40:49.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T10:40:49.997 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-05-10T10:40:50.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-05-10T10:40:50.038 INFO:teuthology.run_tasks:Running task clock... 2024-05-10T10:40:50.049 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-10T10:40:50.049 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T10:40:50.049 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T10:40:50.052 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T10:40:50.052 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T10:40:50.054 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T10:40:50.054 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T10:40:50.079 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-10T10:40:50.081 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-10T10:40:50.093 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-10T10:40:50.094 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-10T10:40:50.109 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-10T10:40:50.116 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: ntpd: command not found 2024-05-10T10:40:50.117 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: ntpd: command not found 2024-05-10T10:40:50.123 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-10T10:40:50.127 INFO:teuthology.orchestra.run.smithi107.stdout:506 Cannot talk to daemon 2024-05-10T10:40:50.128 INFO:teuthology.orchestra.run.smithi184.stdout:506 Cannot talk to daemon 2024-05-10T10:40:50.141 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-10T10:40:50.142 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-10T10:40:50.147 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: ntpd: command not found 2024-05-10T10:40:50.154 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-10T10:40:50.155 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-10T10:40:50.157 INFO:teuthology.orchestra.run.smithi196.stdout:506 Cannot talk to daemon 2024-05-10T10:40:50.171 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-10T10:40:50.184 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-10T10:40:50.208 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-05-10T10:40:50.212 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T10:40:50.212 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-05-10T10:40:50.212 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T10:40:50.212 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T10:40:50.212 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T10:40:50.212 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T10:40:50.213 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-05-10T10:40:50.215 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T10:40:50.216 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-05-10T10:40:50.216 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T10:40:50.216 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T10:40:50.216 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T10:40:50.216 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T10:40:50.238 INFO:teuthology.orchestra.run.smithi196.stderr:bash: line 1: ntpq: command not found 2024-05-10T10:40:50.242 INFO:teuthology.orchestra.run.smithi196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T10:40:50.242 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================== 2024-05-10T10:40:50.242 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T10:40:50.242 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T10:40:50.242 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T10:40:50.242 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T10:40:50.243 INFO:teuthology.run_tasks:Running task install... 2024-05-10T10:40:50.252 DEBUG:teuthology.task.install:project ceph 2024-05-10T10:40:50.252 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b'}} 2024-05-10T10:40:50.252 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b'} 2024-05-10T10:40:50.253 INFO:teuthology.task.install:Using flavor: default 2024-05-10T10:40:50.258 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-10T10:40:50.258 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-10T10:40:50.259 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b', 'tag': None, 'wait_for_package': False} 2024-05-10T10:40:50.260 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T10:40:50.262 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b', 'tag': None, 'wait_for_package': False} 2024-05-10T10:40:50.262 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T10:40:50.263 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b', 'tag': None, 'wait_for_package': False} 2024-05-10T10:40:50.263 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T10:40:50.413 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/ 2024-05-10T10:40:50.413 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3449.gd39fa088 2024-05-10T10:40:50.417 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/ 2024-05-10T10:40:50.417 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3449.gd39fa088 2024-05-10T10:40:50.493 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/ 2024-05-10T10:40:50.493 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3449.gd39fa088 2024-05-10T10:40:50.585 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-10T10:40:50.954 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-10T10:40:50.954 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-10T10:40:50.959 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-10T10:40:50.960 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T10:40:50.960 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-10T10:40:50.960 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-10T10:40:50.960 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-10T10:40:50.960 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-10T10:40:50.984 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-10T10:40:50.984 DEBUG:teuthology.orchestra.run.smithi184:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d39fa08867836ac070c47cb66c782fa559fd480b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-10T10:40:50.991 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-10T10:40:50.991 DEBUG:teuthology.orchestra.run.smithi107:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d39fa08867836ac070c47cb66c782fa559fd480b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-10T10:40:50.991 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-10T10:40:50.991 DEBUG:teuthology.orchestra.run.smithi196:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d39fa08867836ac070c47cb66c782fa559fd480b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-10T10:40:51.053 DEBUG:teuthology.orchestra.run.smithi184:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-10T10:40:51.059 DEBUG:teuthology.orchestra.run.smithi196:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-10T10:40:51.060 DEBUG:teuthology.orchestra.run.smithi107:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-10T10:40:51.129 DEBUG:teuthology.orchestra.run.smithi184:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-10T10:40:51.137 DEBUG:teuthology.orchestra.run.smithi196:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-10T10:40:51.138 DEBUG:teuthology.orchestra.run.smithi107:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-10T10:40:51.193 INFO:teuthology.orchestra.run.smithi184.stdout:check_obsoletes = 1 2024-05-10T10:40:51.195 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum clean all 2024-05-10T10:40:51.201 INFO:teuthology.orchestra.run.smithi196.stdout:check_obsoletes = 1 2024-05-10T10:40:51.202 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum clean all 2024-05-10T10:40:51.203 INFO:teuthology.orchestra.run.smithi107.stdout:check_obsoletes = 1 2024-05-10T10:40:51.205 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum clean all 2024-05-10T10:40:51.422 INFO:teuthology.orchestra.run.smithi184.stdout:54 files removed 2024-05-10T10:40:51.431 INFO:teuthology.orchestra.run.smithi196.stdout:54 files removed 2024-05-10T10:40:51.435 INFO:teuthology.orchestra.run.smithi107.stdout:54 files removed 2024-05-10T10:40:51.449 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-10T10:40:51.457 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-10T10:40:51.462 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-10T10:40:52.113 INFO:teuthology.orchestra.run.smithi196.stdout:ceph packages for x86_64 212 kB/s | 84 kB 00:00 2024-05-10T10:40:52.190 INFO:teuthology.orchestra.run.smithi184.stdout:ceph packages for x86_64 175 kB/s | 84 kB 00:00 2024-05-10T10:40:52.190 INFO:teuthology.orchestra.run.smithi107.stdout:ceph packages for x86_64 186 kB/s | 84 kB 00:00 2024-05-10T10:40:52.497 INFO:teuthology.orchestra.run.smithi196.stdout:ceph noarch packages 35 kB/s | 12 kB 00:00 2024-05-10T10:40:52.533 INFO:teuthology.orchestra.run.smithi107.stdout:ceph noarch packages 41 kB/s | 12 kB 00:00 2024-05-10T10:40:52.557 INFO:teuthology.orchestra.run.smithi184.stdout:ceph noarch packages 37 kB/s | 12 kB 00:00 2024-05-10T10:40:52.848 INFO:teuthology.orchestra.run.smithi196.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-05-10T10:40:52.882 INFO:teuthology.orchestra.run.smithi184.stdout:ceph source packages 6.5 kB/s | 1.9 kB 00:00 2024-05-10T10:40:52.950 INFO:teuthology.orchestra.run.smithi107.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-05-10T10:40:53.773 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - BaseOS 9.1 MB/s | 8.1 MB 00:00 2024-05-10T10:40:53.950 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - BaseOS 7.8 MB/s | 8.1 MB 00:01 2024-05-10T10:40:54.209 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.1 MB 00:01 2024-05-10T10:40:58.226 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - AppStream 6.0 MB/s | 19 MB 00:03 2024-05-10T10:40:58.368 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 19 MB 00:03 2024-05-10T10:41:03.751 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.2 MB 00:01 2024-05-10T10:41:05.160 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 16 kB 00:00 2024-05-10T10:41:05.643 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 1.7 MB/s | 6.2 MB 00:03 2024-05-10T10:41:06.403 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-05-10T10:41:07.977 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-05-10T10:41:10.089 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-10T10:41:11.562 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-05-10T10:41:11.605 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:16 2024-05-10T10:41:13.864 INFO:teuthology.orchestra.run.smithi184.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-10T10:41:13.864 INFO:teuthology.orchestra.run.smithi184.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-10T10:41:13.875 INFO:teuthology.orchestra.run.smithi184.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-10T10:41:13.876 INFO:teuthology.orchestra.run.smithi184.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-10T10:41:13.877 INFO:teuthology.orchestra.run.smithi184.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-10T10:41:13.878 INFO:teuthology.orchestra.run.smithi184.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-10T10:41:13.879 INFO:teuthology.orchestra.run.smithi184.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-10T10:41:13.882 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-10T10:41:13.882 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-10T10:41:13.944 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-05-10T10:41:13.961 INFO:teuthology.orchestra.run.smithi184.stdout:======================================================================================= 2024-05-10T10:41:13.961 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-05-10T10:41:13.961 INFO:teuthology.orchestra.run.smithi184.stdout:======================================================================================= 2024-05-10T10:41:13.961 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-05-10T10:41:13.961 INFO:teuthology.orchestra.run.smithi184.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-10T10:41:13.961 INFO:teuthology.orchestra.run.smithi184.stdout: ceph x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 6.6 k 2024-05-10T10:41:13.961 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 5.4 M 2024-05-10T10:41:13.961 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 890 k 2024-05-10T10:41:13.961 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 145 k 2024-05-10T10:41:13.962 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 1.5 M 2024-05-10T10:41:13.962 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 142 k 2024-05-10T10:41:13.962 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 3.5 M 2024-05-10T10:41:13.962 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 7.4 M 2024-05-10T10:41:13.962 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 49 k 2024-05-10T10:41:13.962 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 11 M 2024-05-10T10:41:13.962 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 49 M 2024-05-10T10:41:13.962 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 273 k 2024-05-10T10:41:13.962 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 763 k 2024-05-10T10:41:13.962 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 225 k 2024-05-10T10:41:13.962 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-shell x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 27 k 2024-05-10T10:41:13.962 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 18 k 2024-05-10T10:41:13.962 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-10T10:41:13.963 INFO:teuthology.orchestra.run.smithi184.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-10T10:41:13.963 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-10T10:41:13.963 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 32 k 2024-05-10T10:41:13.963 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 746 k 2024-05-10T10:41:13.963 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 127 k 2024-05-10T10:41:13.963 INFO:teuthology.orchestra.run.smithi184.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-10T10:41:13.963 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-10T10:41:13.963 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-10T10:41:13.963 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-10T10:41:13.963 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-10T10:41:13.963 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-10T10:41:13.964 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 161 k 2024-05-10T10:41:13.964 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 321 k 2024-05-10T10:41:13.964 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 298 k 2024-05-10T10:41:13.964 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 99 k 2024-05-10T10:41:13.964 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 85 k 2024-05-10T10:41:13.964 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.1 M 2024-05-10T10:41:13.964 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 170 k 2024-05-10T10:41:13.964 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-10T10:41:13.964 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2024-05-10T10:41:13.964 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-10T10:41:13.964 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-10T10:41:13.964 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-10T10:41:13.965 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-10T10:41:13.965 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.4 M 2024-05-10T10:41:13.965 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.1 M 2024-05-10T10:41:13.965 INFO:teuthology.orchestra.run.smithi184.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-10T10:41:13.965 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-10T10:41:13.965 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-05-10T10:41:13.965 INFO:teuthology.orchestra.run.smithi184.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-10T10:41:13.965 INFO:teuthology.orchestra.run.smithi184.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-10T10:41:13.965 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-10T10:41:13.965 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 21 M 2024-05-10T10:41:13.965 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 34 k 2024-05-10T10:41:13.966 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 2.4 M 2024-05-10T10:41:13.966 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 274 k 2024-05-10T10:41:13.966 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 4.7 M 2024-05-10T10:41:13.966 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 17 M 2024-05-10T10:41:13.966 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 16 k 2024-05-10T10:41:13.966 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 25 k 2024-05-10T10:41:13.966 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-10T10:41:13.966 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-10T10:41:13.966 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-10T10:41:13.966 INFO:teuthology.orchestra.run.smithi184.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-10T10:41:13.966 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-10T10:41:13.966 INFO:teuthology.orchestra.run.smithi184.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-10T10:41:13.967 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-10T10:41:13.967 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-10T10:41:13.967 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 163 k 2024-05-10T10:41:13.967 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-10T10:41:13.967 INFO:teuthology.orchestra.run.smithi184.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-10T10:41:13.967 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-10T10:41:13.967 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-10T10:41:13.967 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-10T10:41:13.967 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 500 k 2024-05-10T10:41:13.967 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-10T10:41:13.967 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 5.4 M 2024-05-10T10:41:13.967 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-10T10:41:13.967 INFO:teuthology.orchestra.run.smithi184.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-10T10:41:13.967 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-10T10:41:13.968 INFO:teuthology.orchestra.run.smithi184.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-10T10:41:13.968 INFO:teuthology.orchestra.run.smithi184.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-10T10:41:13.968 INFO:teuthology.orchestra.run.smithi184.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-10T10:41:13.968 INFO:teuthology.orchestra.run.smithi184.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-10T10:41:13.968 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-10T10:41:13.968 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-10T10:41:13.968 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-10T10:41:13.968 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-10T10:41:13.968 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-10T10:41:13.968 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-10T10:41:13.968 INFO:teuthology.orchestra.run.smithi184.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-10T10:41:13.968 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-10T10:41:13.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-10T10:41:13.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-10T10:41:13.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 45 k 2024-05-10T10:41:13.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 135 k 2024-05-10T10:41:13.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-10T10:41:13.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-10T10:41:13.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-10T10:41:13.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-10T10:41:13.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-10T10:41:13.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-10T10:41:13.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-10T10:41:13.969 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-10T10:41:13.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-10T10:41:13.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-10T10:41:13.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-10T10:41:13.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-10T10:41:13.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-10T10:41:13.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-10T10:41:13.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-10T10:41:13.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-10T10:41:13.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-10T10:41:13.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-10T10:41:13.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-10T10:41:13.970 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-10T10:41:13.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-10T10:41:13.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-10T10:41:13.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-10T10:41:13.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-10T10:41:13.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-10T10:41:13.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-10T10:41:13.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-10T10:41:13.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-10T10:41:13.971 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-10T10:41:13.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-10T10:41:13.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-10T10:41:13.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-10T10:41:13.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-10T10:41:13.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-10T10:41:13.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-10T10:41:13.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-10T10:41:13.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-10T10:41:13.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-10T10:41:13.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-10T10:41:13.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-10T10:41:13.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-10T10:41:13.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-10T10:41:13.972 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-10T10:41:13.973 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-10T10:41:13.973 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-10T10:41:13.973 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-10T10:41:13.973 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-10T10:41:13.973 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-10T10:41:13.973 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-10T10:41:13.973 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-10T10:41:13.973 INFO:teuthology.orchestra.run.smithi184.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-10T10:41:13.973 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-10T10:41:13.973 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-10T10:41:13.973 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-10T10:41:13.974 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-10T10:41:13.974 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-10T10:41:13.974 INFO:teuthology.orchestra.run.smithi184.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-10T10:41:13.974 INFO:teuthology.orchestra.run.smithi184.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-10T10:41:13.974 INFO:teuthology.orchestra.run.smithi184.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-10T10:41:13.974 INFO:teuthology.orchestra.run.smithi184.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-10T10:41:13.974 INFO:teuthology.orchestra.run.smithi184.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-10T10:41:13.974 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-10T10:41:13.974 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-10T10:41:13.974 INFO:teuthology.orchestra.run.smithi184.stdout:Installing weak dependencies: 2024-05-10T10:41:13.974 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-10T10:41:13.974 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-10T10:41:13.975 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-05-10T10:41:13.975 INFO:teuthology.orchestra.run.smithi184.stdout:======================================================================================= 2024-05-10T10:41:13.975 INFO:teuthology.orchestra.run.smithi184.stdout:Install 148 Packages 2024-05-10T10:41:13.975 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 8 Packages 2024-05-10T10:41:13.975 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-10T10:41:13.975 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 226 M 2024-05-10T10:41:13.975 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-05-10T10:41:14.688 INFO:teuthology.orchestra.run.smithi184.stdout:(1/156): ceph-19.0.0-3449.gd39fa088.el9.x86_64. 36 kB/s | 6.6 kB 00:00 2024-05-10T10:41:14.989 INFO:teuthology.orchestra.run.smithi184.stdout:(2/156): ceph-fuse-19.0.0-3449.gd39fa088.el9.x8 2.9 MB/s | 890 kB 00:00 2024-05-10T10:41:15.064 INFO:teuthology.orchestra.run.smithi184.stdout:(3/156): ceph-immutable-object-cache-19.0.0-344 1.9 MB/s | 145 kB 00:00 2024-05-10T10:41:15.153 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-05-10T10:41:15.206 INFO:teuthology.orchestra.run.smithi184.stdout:(4/156): ceph-base-19.0.0-3449.gd39fa088.el9.x8 7.7 MB/s | 5.4 MB 00:00 2024-05-10T10:41:15.389 INFO:teuthology.orchestra.run.smithi184.stdout:(5/156): ceph-mgr-19.0.0-3449.gd39fa088.el9.x86 8.3 MB/s | 1.5 MB 00:00 2024-05-10T10:41:15.648 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-05-10T10:41:15.673 INFO:teuthology.orchestra.run.smithi184.stdout:(6/156): ceph-mds-19.0.0-3449.gd39fa088.el9.x86 3.9 MB/s | 2.4 MB 00:00 2024-05-10T10:41:15.865 INFO:teuthology.orchestra.run.smithi184.stdout:(7/156): ceph-mon-19.0.0-3449.gd39fa088.el9.x86 9.9 MB/s | 4.7 MB 00:00 2024-05-10T10:41:16.515 INFO:teuthology.orchestra.run.smithi184.stdout:(8/156): ceph-common-19.0.0-3449.gd39fa088.el9. 11 MB/s | 21 MB 00:02 2024-05-10T10:41:16.582 INFO:teuthology.orchestra.run.smithi184.stdout:(9/156): ceph-selinux-19.0.0-3449.gd39fa088.el9 378 kB/s | 25 kB 00:00 2024-05-10T10:41:16.891 INFO:teuthology.orchestra.run.smithi184.stdout:(10/156): ceph-radosgw-19.0.0-3449.gd39fa088.el 10 MB/s | 11 MB 00:01 2024-05-10T10:41:16.999 INFO:teuthology.orchestra.run.smithi184.stdout:(11/156): cephfs-mirror-19.0.0-3449.gd39fa088.e 2.0 MB/s | 225 kB 00:00 2024-05-10T10:41:17.058 INFO:teuthology.orchestra.run.smithi184.stdout:(12/156): cephfs-shell-19.0.0-3449.gd39fa088.el 464 kB/s | 27 kB 00:00 2024-05-10T10:41:17.119 INFO:teuthology.orchestra.run.smithi184.stdout:(13/156): libcephfs-devel-19.0.0-3449.gd39fa088 545 kB/s | 32 kB 00:00 2024-05-10T10:41:17.198 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 16 kB 00:00 2024-05-10T10:41:17.258 INFO:teuthology.orchestra.run.smithi184.stdout:(14/156): libcephfs2-19.0.0-3449.gd39fa088.el9. 5.1 MB/s | 746 kB 00:00 2024-05-10T10:41:17.334 INFO:teuthology.orchestra.run.smithi184.stdout:(15/156): libcephsqlite-19.0.0-3449.gd39fa088.e 2.1 MB/s | 163 kB 00:00 2024-05-10T10:41:17.409 INFO:teuthology.orchestra.run.smithi184.stdout:(16/156): librados-devel-19.0.0-3449.gd39fa088. 1.6 MB/s | 127 kB 00:00 2024-05-10T10:41:17.501 INFO:teuthology.orchestra.run.smithi184.stdout:(17/156): libradosstriper1-19.0.0-3449.gd39fa08 5.3 MB/s | 500 kB 00:00 2024-05-10T10:41:17.504 INFO:teuthology.orchestra.run.smithi107.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-10T10:41:17.504 INFO:teuthology.orchestra.run.smithi107.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-10T10:41:17.515 INFO:teuthology.orchestra.run.smithi107.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-10T10:41:17.516 INFO:teuthology.orchestra.run.smithi107.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-10T10:41:17.517 INFO:teuthology.orchestra.run.smithi107.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-10T10:41:17.518 INFO:teuthology.orchestra.run.smithi107.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-10T10:41:17.519 INFO:teuthology.orchestra.run.smithi107.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-10T10:41:17.521 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-10T10:41:17.522 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-10T10:41:17.583 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-05-10T10:41:17.607 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-05-10T10:41:17.608 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-05-10T10:41:17.608 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-05-10T10:41:17.608 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-05-10T10:41:17.608 INFO:teuthology.orchestra.run.smithi107.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-10T10:41:17.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 6.6 k 2024-05-10T10:41:17.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 5.4 M 2024-05-10T10:41:17.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 890 k 2024-05-10T10:41:17.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 145 k 2024-05-10T10:41:17.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 1.5 M 2024-05-10T10:41:17.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 142 k 2024-05-10T10:41:17.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 3.5 M 2024-05-10T10:41:17.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 7.4 M 2024-05-10T10:41:17.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 49 k 2024-05-10T10:41:17.609 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 11 M 2024-05-10T10:41:17.609 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 49 M 2024-05-10T10:41:17.609 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 273 k 2024-05-10T10:41:17.609 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 763 k 2024-05-10T10:41:17.609 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 225 k 2024-05-10T10:41:17.609 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-shell x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 27 k 2024-05-10T10:41:17.609 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 18 k 2024-05-10T10:41:17.609 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-10T10:41:17.609 INFO:teuthology.orchestra.run.smithi107.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-10T10:41:17.609 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-10T10:41:17.609 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 32 k 2024-05-10T10:41:17.609 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 746 k 2024-05-10T10:41:17.609 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 127 k 2024-05-10T10:41:17.610 INFO:teuthology.orchestra.run.smithi107.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-10T10:41:17.610 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-10T10:41:17.610 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-10T10:41:17.610 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-10T10:41:17.610 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-10T10:41:17.610 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-10T10:41:17.610 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 161 k 2024-05-10T10:41:17.610 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 321 k 2024-05-10T10:41:17.610 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 298 k 2024-05-10T10:41:17.610 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 99 k 2024-05-10T10:41:17.610 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 85 k 2024-05-10T10:41:17.610 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.1 M 2024-05-10T10:41:17.610 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 170 k 2024-05-10T10:41:17.610 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-10T10:41:17.611 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2024-05-10T10:41:17.611 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-10T10:41:17.611 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-10T10:41:17.611 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-10T10:41:17.611 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-10T10:41:17.611 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.4 M 2024-05-10T10:41:17.611 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.1 M 2024-05-10T10:41:17.611 INFO:teuthology.orchestra.run.smithi107.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-10T10:41:17.611 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-10T10:41:17.611 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-05-10T10:41:17.611 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-10T10:41:17.611 INFO:teuthology.orchestra.run.smithi107.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-10T10:41:17.611 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-10T10:41:17.612 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 21 M 2024-05-10T10:41:17.612 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 34 k 2024-05-10T10:41:17.612 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 2.4 M 2024-05-10T10:41:17.612 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 274 k 2024-05-10T10:41:17.612 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 4.7 M 2024-05-10T10:41:17.612 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 17 M 2024-05-10T10:41:17.612 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 16 k 2024-05-10T10:41:17.612 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 25 k 2024-05-10T10:41:17.612 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-10T10:41:17.612 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-10T10:41:17.612 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-10T10:41:17.612 INFO:teuthology.orchestra.run.smithi107.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-10T10:41:17.612 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-10T10:41:17.612 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-10T10:41:17.613 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-10T10:41:17.613 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-10T10:41:17.613 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 163 k 2024-05-10T10:41:17.613 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-10T10:41:17.613 INFO:teuthology.orchestra.run.smithi107.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-10T10:41:17.613 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-10T10:41:17.613 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-10T10:41:17.613 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-10T10:41:17.613 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 500 k 2024-05-10T10:41:17.613 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-10T10:41:17.613 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 5.4 M 2024-05-10T10:41:17.613 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-10T10:41:17.613 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-10T10:41:17.613 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-10T10:41:17.614 INFO:teuthology.orchestra.run.smithi107.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-10T10:41:17.614 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-10T10:41:17.614 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-10T10:41:17.614 INFO:teuthology.orchestra.run.smithi107.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-10T10:41:17.614 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-10T10:41:17.614 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-10T10:41:17.614 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-10T10:41:17.614 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-10T10:41:17.614 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-10T10:41:17.614 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-10T10:41:17.614 INFO:teuthology.orchestra.run.smithi107.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-10T10:41:17.614 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-10T10:41:17.614 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-10T10:41:17.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-10T10:41:17.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 45 k 2024-05-10T10:41:17.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 135 k 2024-05-10T10:41:17.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-10T10:41:17.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-10T10:41:17.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-10T10:41:17.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-10T10:41:17.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-10T10:41:17.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-10T10:41:17.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-10T10:41:17.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-10T10:41:17.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-10T10:41:17.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-10T10:41:17.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-10T10:41:17.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-10T10:41:17.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-10T10:41:17.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-10T10:41:17.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-10T10:41:17.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-10T10:41:17.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-10T10:41:17.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-10T10:41:17.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-10T10:41:17.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-10T10:41:17.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-10T10:41:17.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-10T10:41:17.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-10T10:41:17.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-10T10:41:17.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-10T10:41:17.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-10T10:41:17.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-10T10:41:17.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-10T10:41:17.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-10T10:41:17.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-10T10:41:17.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-10T10:41:17.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-10T10:41:17.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-10T10:41:17.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-10T10:41:17.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-10T10:41:17.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-10T10:41:17.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-10T10:41:17.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-10T10:41:17.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-10T10:41:17.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-10T10:41:17.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-10T10:41:17.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-10T10:41:17.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-10T10:41:17.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-10T10:41:17.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-10T10:41:17.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-10T10:41:17.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-10T10:41:17.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-10T10:41:17.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-10T10:41:17.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-10T10:41:17.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-10T10:41:17.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-10T10:41:17.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-10T10:41:17.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-10T10:41:17.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-10T10:41:17.619 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-10T10:41:17.619 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-10T10:41:17.619 INFO:teuthology.orchestra.run.smithi107.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-10T10:41:17.619 INFO:teuthology.orchestra.run.smithi107.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-10T10:41:17.619 INFO:teuthology.orchestra.run.smithi107.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-10T10:41:17.619 INFO:teuthology.orchestra.run.smithi107.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-10T10:41:17.619 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-10T10:41:17.619 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-10T10:41:17.619 INFO:teuthology.orchestra.run.smithi107.stdout:Installing weak dependencies: 2024-05-10T10:41:17.619 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-10T10:41:17.620 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:41:17.620 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-05-10T10:41:17.620 INFO:teuthology.orchestra.run.smithi107.stdout:======================================================================================= 2024-05-10T10:41:17.620 INFO:teuthology.orchestra.run.smithi107.stdout:Install 148 Packages 2024-05-10T10:41:17.620 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 8 Packages 2024-05-10T10:41:17.620 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:41:17.620 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 226 M 2024-05-10T10:41:17.620 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-05-10T10:41:18.118 INFO:teuthology.orchestra.run.smithi184.stdout:(18/156): librgw2-19.0.0-3449.gd39fa088.el9.x86 8.7 MB/s | 5.4 MB 00:00 2024-05-10T10:41:18.193 INFO:teuthology.orchestra.run.smithi184.stdout:(19/156): python3-ceph-argparse-19.0.0-3449.gd3 603 kB/s | 45 kB 00:00 2024-05-10T10:41:18.269 INFO:teuthology.orchestra.run.smithi184.stdout:(20/156): python3-ceph-common-19.0.0-3449.gd39f 1.8 MB/s | 135 kB 00:00 2024-05-10T10:41:18.344 INFO:teuthology.orchestra.run.smithi184.stdout:(21/156): python3-cephfs-19.0.0-3449.gd39fa088. 2.1 MB/s | 161 kB 00:00 2024-05-10T10:41:18.427 INFO:teuthology.orchestra.run.smithi184.stdout:(22/156): python3-rados-19.0.0-3449.gd39fa088.e 3.8 MB/s | 321 kB 00:00 2024-05-10T10:41:18.511 INFO:teuthology.orchestra.run.smithi184.stdout:(23/156): python3-rbd-19.0.0-3449.gd39fa088.el9 3.5 MB/s | 298 kB 00:00 2024-05-10T10:41:18.586 INFO:teuthology.orchestra.run.smithi184.stdout:(24/156): python3-rgw-19.0.0-3449.gd39fa088.el9 1.3 MB/s | 99 kB 00:00 2024-05-10T10:41:18.587 INFO:teuthology.orchestra.run.smithi107.stdout:(1/156): ceph-19.0.0-3449.gd39fa088.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-05-10T10:41:18.670 INFO:teuthology.orchestra.run.smithi184.stdout:(25/156): rbd-fuse-19.0.0-3449.gd39fa088.el9.x8 1.0 MB/s | 85 kB 00:00 2024-05-10T10:41:18.960 INFO:teuthology.orchestra.run.smithi196.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-10T10:41:19.087 INFO:teuthology.orchestra.run.smithi184.stdout:(26/156): rbd-mirror-19.0.0-3449.gd39fa088.el9. 7.4 MB/s | 3.1 MB 00:00 2024-05-10T10:41:19.279 INFO:teuthology.orchestra.run.smithi184.stdout:(27/156): ceph-osd-19.0.0-3449.gd39fa088.el9.x8 4.7 MB/s | 17 MB 00:03 2024-05-10T10:41:19.304 INFO:teuthology.orchestra.run.smithi184.stdout:(28/156): rbd-nbd-19.0.0-3449.gd39fa088.el9.x86 784 kB/s | 170 kB 00:00 2024-05-10T10:41:19.330 INFO:teuthology.orchestra.run.smithi184.stdout:(29/156): ceph-grafana-dashboards-19.0.0-3449.g 685 kB/s | 34 kB 00:00 2024-05-10T10:41:19.371 INFO:teuthology.orchestra.run.smithi184.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3449.gd39fa08 2.1 MB/s | 142 kB 00:00 2024-05-10T10:41:19.429 INFO:teuthology.orchestra.run.smithi107.stdout:(2/156): ceph-fuse-19.0.0-3449.gd39fa088.el9.x8 1.0 MB/s | 890 kB 00:00 2024-05-10T10:41:19.621 INFO:teuthology.orchestra.run.smithi107.stdout:(3/156): ceph-immutable-object-cache-19.0.0-344 756 kB/s | 145 kB 00:00 2024-05-10T10:41:19.989 INFO:teuthology.orchestra.run.smithi184.stdout:(31/156): ceph-test-19.0.0-3449.gd39fa088.el9.x 14 MB/s | 49 MB 00:03 2024-05-10T10:41:20.064 INFO:teuthology.orchestra.run.smithi184.stdout:(32/156): ceph-mgr-dashboard-19.0.0-3449.gd39fa 4.8 MB/s | 3.5 MB 00:00 2024-05-10T10:41:20.089 INFO:teuthology.orchestra.run.smithi184.stdout:(33/156): ceph-mgr-modules-core-19.0.0-3449.gd3 2.7 MB/s | 274 kB 00:00 2024-05-10T10:41:20.114 INFO:teuthology.orchestra.run.smithi184.stdout:(34/156): ceph-mgr-rook-19.0.0-3449.gd39fa088.e 989 kB/s | 49 kB 00:00 2024-05-10T10:41:20.139 INFO:teuthology.orchestra.run.smithi184.stdout:(35/156): ceph-prometheus-alerts-19.0.0-3449.gd 329 kB/s | 16 kB 00:00 2024-05-10T10:41:20.165 INFO:teuthology.orchestra.run.smithi184.stdout:(36/156): ceph-volume-19.0.0-3449.gd39fa088.el9 5.3 MB/s | 273 kB 00:00 2024-05-10T10:41:20.257 INFO:teuthology.orchestra.run.smithi184.stdout:(37/156): ceph-mgr-diskprediction-local-19.0.0- 8.4 MB/s | 7.4 MB 00:00 2024-05-10T10:41:20.282 INFO:teuthology.orchestra.run.smithi184.stdout:(38/156): cephfs-top-19.0.0-3449.gd39fa088.el9. 156 kB/s | 18 kB 00:00 2024-05-10T10:41:20.296 INFO:teuthology.orchestra.run.smithi107.stdout:(4/156): ceph-mds-19.0.0-3449.gd39fa088.el9.x86 3.5 MB/s | 2.4 MB 00:00 2024-05-10T10:41:20.307 INFO:teuthology.orchestra.run.smithi184.stdout:(39/156): cephadm-19.0.0-3449.gd39fa088.el9.noa 4.5 MB/s | 763 kB 00:00 2024-05-10T10:41:20.408 INFO:teuthology.orchestra.run.smithi184.stdout:(40/156): fuse-2.9.9-15.el9.x86_64.rpm 535 kB/s | 80 kB 00:00 2024-05-10T10:41:20.433 INFO:teuthology.orchestra.run.smithi184.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 195 kB 00:00 2024-05-10T10:41:20.446 INFO:teuthology.orchestra.run.smithi107.stdout:(5/156): ceph-base-19.0.0-3449.gd39fa088.el9.x8 2.4 MB/s | 5.4 MB 00:02 2024-05-10T10:41:20.483 INFO:teuthology.orchestra.run.smithi184.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-05-10T10:41:20.517 INFO:teuthology.orchestra.run.smithi184.stdout:(43/156): libgfortran-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 803 kB 00:00 2024-05-10T10:41:20.542 INFO:teuthology.orchestra.run.smithi184.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-05-10T10:41:20.567 INFO:teuthology.orchestra.run.smithi184.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-05-10T10:41:20.591 INFO:teuthology.orchestra.run.smithi107.stdout:(6/156): ceph-mgr-19.0.0-3449.gd39fa088.el9.x86 5.2 MB/s | 1.5 MB 00:00 2024-05-10T10:41:20.593 INFO:teuthology.orchestra.run.smithi184.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-05-10T10:41:20.609 INFO:teuthology.orchestra.run.smithi184.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-05-10T10:41:20.643 INFO:teuthology.orchestra.run.smithi184.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 5.8 MB/s | 1.2 MB 00:00 2024-05-10T10:41:21.069 INFO:teuthology.orchestra.run.smithi184.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 251 kB/s | 107 kB 00:00 2024-05-10T10:41:21.169 INFO:teuthology.orchestra.run.smithi184.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 215 kB/s | 21 kB 00:00 2024-05-10T10:41:21.314 INFO:teuthology.orchestra.run.smithi107.stdout:(7/156): ceph-mon-19.0.0-3449.gd39fa088.el9.x86 5.4 MB/s | 4.7 MB 00:00 2024-05-10T10:41:21.361 INFO:teuthology.orchestra.run.smithi184.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 943 kB 00:00 2024-05-10T10:41:21.386 INFO:teuthology.orchestra.run.smithi184.stdout:(52/156): automake-1.16.2-8.el9.noarch.rpm 869 kB/s | 689 kB 00:00 2024-05-10T10:41:21.445 INFO:teuthology.orchestra.run.smithi184.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-05-10T10:41:21.470 INFO:teuthology.orchestra.run.smithi184.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 300 kB/s | 33 kB 00:00 2024-05-10T10:41:21.562 INFO:teuthology.orchestra.run.smithi184.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 155 kB/s | 18 kB 00:00 2024-05-10T10:41:21.587 INFO:teuthology.orchestra.run.smithi184.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 95 kB/s | 11 kB 00:00 2024-05-10T10:41:21.680 INFO:teuthology.orchestra.run.smithi184.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-05-10T10:41:21.705 INFO:teuthology.orchestra.run.smithi184.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 387 kB/s | 45 kB 00:00 2024-05-10T10:41:21.872 INFO:teuthology.orchestra.run.smithi184.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-05-10T10:41:21.906 INFO:teuthology.orchestra.run.smithi107.stdout:(8/156): ceph-osd-19.0.0-3449.gd39fa088.el9.x86 13 MB/s | 17 MB 00:01 2024-05-10T10:41:21.964 INFO:teuthology.orchestra.run.smithi107.stdout:(9/156): ceph-selinux-19.0.0-3449.gd39fa088.el9 432 kB/s | 25 kB 00:00 2024-05-10T10:41:21.980 INFO:teuthology.orchestra.run.smithi184.stdout:(60/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 235 kB/s | 25 kB 00:00 2024-05-10T10:41:22.006 INFO:teuthology.orchestra.run.smithi184.stdout:(61/156): libtool-2.4.6-45.el9.x86_64.rpm 1.9 MB/s | 582 kB 00:00 2024-05-10T10:41:22.123 INFO:teuthology.orchestra.run.smithi184.stdout:(62/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.1 MB/s | 3.0 MB 00:00 2024-05-10T10:41:22.148 INFO:teuthology.orchestra.run.smithi184.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 283 kB/s | 47 kB 00:00 2024-05-10T10:41:22.173 INFO:teuthology.orchestra.run.smithi184.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-05-10T10:41:22.224 INFO:teuthology.orchestra.run.smithi184.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-05-10T10:41:22.249 INFO:teuthology.orchestra.run.smithi184.stdout:(66/156): openblas-0.3.21-2.el9.x86_64.rpm 350 kB/s | 35 kB 00:00 2024-05-10T10:41:22.458 INFO:teuthology.orchestra.run.smithi184.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-05-10T10:41:22.574 INFO:teuthology.orchestra.run.smithi184.stdout:(68/156): postgresql-contrib-13.14-1.el9.x86_64 7.6 MB/s | 911 kB 00:00 2024-05-10T10:41:22.675 INFO:teuthology.orchestra.run.smithi184.stdout:(69/156): postgresql-private-libs-13.14-1.el9.x 1.3 MB/s | 133 kB 00:00 2024-05-10T10:41:24.099 INFO:teuthology.orchestra.run.smithi196.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-05-10T10:41:24.289 INFO:teuthology.orchestra.run.smithi107.stdout:(10/156): ceph-common-19.0.0-3449.gd39fa088.el9 3.5 MB/s | 21 MB 00:06 2024-05-10T10:41:24.423 INFO:teuthology.orchestra.run.smithi107.stdout:(11/156): cephfs-mirror-19.0.0-3449.gd39fa088.e 1.6 MB/s | 225 kB 00:00 2024-05-10T10:41:24.482 INFO:teuthology.orchestra.run.smithi107.stdout:(12/156): cephfs-shell-19.0.0-3449.gd39fa088.el 464 kB/s | 27 kB 00:00 2024-05-10T10:41:24.932 INFO:teuthology.orchestra.run.smithi107.stdout:(13/156): ceph-test-19.0.0-3449.gd39fa088.el9.x 17 MB/s | 49 MB 00:02 2024-05-10T10:41:24.949 INFO:teuthology.orchestra.run.smithi107.stdout:(14/156): libcephfs-devel-19.0.0-3449.gd39fa088 68 kB/s | 32 kB 00:00 2024-05-10T10:41:25.066 INFO:teuthology.orchestra.run.smithi107.stdout:(15/156): ceph-radosgw-19.0.0-3449.gd39fa088.el 2.8 MB/s | 11 MB 00:03 2024-05-10T10:41:25.091 INFO:teuthology.orchestra.run.smithi107.stdout:(16/156): libcephsqlite-19.0.0-3449.gd39fa088.e 1.1 MB/s | 163 kB 00:00 2024-05-10T10:41:25.125 INFO:teuthology.orchestra.run.smithi107.stdout:(17/156): libcephfs2-19.0.0-3449.gd39fa088.el9. 3.8 MB/s | 746 kB 00:00 2024-05-10T10:41:25.183 INFO:teuthology.orchestra.run.smithi107.stdout:(18/156): librados-devel-19.0.0-3449.gd39fa088. 1.1 MB/s | 127 kB 00:00 2024-05-10T10:41:25.275 INFO:teuthology.orchestra.run.smithi107.stdout:(19/156): python3-ceph-argparse-19.0.0-3449.gd3 492 kB/s | 45 kB 00:00 2024-05-10T10:41:25.359 INFO:teuthology.orchestra.run.smithi107.stdout:(20/156): python3-ceph-common-19.0.0-3449.gd39f 1.6 MB/s | 135 kB 00:00 2024-05-10T10:41:25.384 INFO:teuthology.orchestra.run.smithi107.stdout:(21/156): libradosstriper1-19.0.0-3449.gd39fa08 1.7 MB/s | 500 kB 00:00 2024-05-10T10:41:25.518 INFO:teuthology.orchestra.run.smithi107.stdout:(22/156): python3-cephfs-19.0.0-3449.gd39fa088. 1.0 MB/s | 161 kB 00:00 2024-05-10T10:41:25.585 INFO:teuthology.orchestra.run.smithi107.stdout:(23/156): python3-rados-19.0.0-3449.gd39fa088.e 1.6 MB/s | 321 kB 00:00 2024-05-10T10:41:25.668 INFO:teuthology.orchestra.run.smithi107.stdout:(24/156): python3-rbd-19.0.0-3449.gd39fa088.el9 1.9 MB/s | 298 kB 00:00 2024-05-10T10:41:25.733 INFO:teuthology.orchestra.run.smithi184.stdout:(70/156): openblas-openmp-0.3.21-2.el9.x86_64.r 1.3 MB/s | 4.7 MB 00:03 2024-05-10T10:41:25.743 INFO:teuthology.orchestra.run.smithi107.stdout:(25/156): librgw2-19.0.0-3449.gd39fa088.el9.x86 8.7 MB/s | 5.4 MB 00:00 2024-05-10T10:41:25.769 INFO:teuthology.orchestra.run.smithi107.stdout:(26/156): python3-rgw-19.0.0-3449.gd39fa088.el9 541 kB/s | 99 kB 00:00 2024-05-10T10:41:25.794 INFO:teuthology.orchestra.run.smithi107.stdout:(27/156): rbd-fuse-19.0.0-3449.gd39fa088.el9.x8 682 kB/s | 85 kB 00:00 2024-05-10T10:41:25.869 INFO:teuthology.orchestra.run.smithi107.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3449.g 456 kB/s | 34 kB 00:00 2024-05-10T10:41:25.936 INFO:teuthology.orchestra.run.smithi107.stdout:(29/156): rbd-nbd-19.0.0-3449.gd39fa088.el9.x86 1.0 MB/s | 170 kB 00:00 2024-05-10T10:41:25.961 INFO:teuthology.orchestra.run.smithi107.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3449.gd39fa08 1.5 MB/s | 142 kB 00:00 2024-05-10T10:41:26.120 INFO:teuthology.orchestra.run.smithi107.stdout:(31/156): rbd-mirror-19.0.0-3449.gd39fa088.el9. 8.2 MB/s | 3.1 MB 00:00 2024-05-10T10:41:26.220 INFO:teuthology.orchestra.run.smithi107.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3449.gd3 2.7 MB/s | 274 kB 00:00 2024-05-10T10:41:26.266 INFO:teuthology.orchestra.run.smithi184.stdout:(71/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 1.1 MB/s | 4.4 MB 00:04 2024-05-10T10:41:26.346 INFO:teuthology.orchestra.run.smithi107.stdout:(33/156): ceph-mgr-rook-19.0.0-3449.gd39fa088.e 395 kB/s | 49 kB 00:00 2024-05-10T10:41:26.392 INFO:teuthology.orchestra.run.smithi196.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-10T10:41:26.393 INFO:teuthology.orchestra.run.smithi196.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-10T10:41:26.404 INFO:teuthology.orchestra.run.smithi196.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-10T10:41:26.405 INFO:teuthology.orchestra.run.smithi196.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-10T10:41:26.406 INFO:teuthology.orchestra.run.smithi196.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-10T10:41:26.407 INFO:teuthology.orchestra.run.smithi196.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-10T10:41:26.408 INFO:teuthology.orchestra.run.smithi196.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-10T10:41:26.411 INFO:teuthology.orchestra.run.smithi196.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-10T10:41:26.411 INFO:teuthology.orchestra.run.smithi196.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-10T10:41:26.446 INFO:teuthology.orchestra.run.smithi107.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3449.gd 165 kB/s | 16 kB 00:00 2024-05-10T10:41:26.458 INFO:teuthology.orchestra.run.smithi184.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 456 kB/s | 87 kB 00:00 2024-05-10T10:41:26.472 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-05-10T10:41:26.485 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================= 2024-05-10T10:41:26.485 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2024-05-10T10:41:26.486 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================= 2024-05-10T10:41:26.486 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-05-10T10:41:26.486 INFO:teuthology.orchestra.run.smithi196.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-10T10:41:26.486 INFO:teuthology.orchestra.run.smithi196.stdout: ceph x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 6.6 k 2024-05-10T10:41:26.486 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 5.4 M 2024-05-10T10:41:26.486 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 890 k 2024-05-10T10:41:26.486 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 145 k 2024-05-10T10:41:26.486 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 1.5 M 2024-05-10T10:41:26.486 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 142 k 2024-05-10T10:41:26.486 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 3.5 M 2024-05-10T10:41:26.486 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 7.4 M 2024-05-10T10:41:26.486 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 49 k 2024-05-10T10:41:26.486 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 11 M 2024-05-10T10:41:26.487 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 49 M 2024-05-10T10:41:26.487 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 273 k 2024-05-10T10:41:26.487 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 763 k 2024-05-10T10:41:26.487 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 225 k 2024-05-10T10:41:26.487 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-shell x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 27 k 2024-05-10T10:41:26.487 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-top noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 18 k 2024-05-10T10:41:26.487 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-10T10:41:26.487 INFO:teuthology.orchestra.run.smithi196.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-10T10:41:26.487 INFO:teuthology.orchestra.run.smithi196.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-10T10:41:26.487 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 32 k 2024-05-10T10:41:26.487 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 746 k 2024-05-10T10:41:26.487 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 127 k 2024-05-10T10:41:26.487 INFO:teuthology.orchestra.run.smithi196.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-10T10:41:26.487 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-10T10:41:26.488 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-10T10:41:26.488 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-10T10:41:26.488 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-10T10:41:26.488 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-10T10:41:26.488 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 161 k 2024-05-10T10:41:26.488 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 321 k 2024-05-10T10:41:26.488 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 298 k 2024-05-10T10:41:26.488 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 99 k 2024-05-10T10:41:26.488 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 85 k 2024-05-10T10:41:26.488 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.1 M 2024-05-10T10:41:26.488 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 170 k 2024-05-10T10:41:26.488 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-10T10:41:26.488 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrading: 2024-05-10T10:41:26.488 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-10T10:41:26.489 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-10T10:41:26.489 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-10T10:41:26.489 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-10T10:41:26.489 INFO:teuthology.orchestra.run.smithi196.stdout: librados2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.4 M 2024-05-10T10:41:26.489 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 3.1 M 2024-05-10T10:41:26.489 INFO:teuthology.orchestra.run.smithi196.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-10T10:41:26.489 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-10T10:41:26.489 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2024-05-10T10:41:26.489 INFO:teuthology.orchestra.run.smithi196.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-10T10:41:26.489 INFO:teuthology.orchestra.run.smithi196.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-10T10:41:26.489 INFO:teuthology.orchestra.run.smithi196.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-10T10:41:26.489 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 21 M 2024-05-10T10:41:26.489 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 34 k 2024-05-10T10:41:26.490 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 2.4 M 2024-05-10T10:41:26.490 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 274 k 2024-05-10T10:41:26.490 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 4.7 M 2024-05-10T10:41:26.490 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 17 M 2024-05-10T10:41:26.490 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3449.gd39fa088.el9 ceph-noarch 16 k 2024-05-10T10:41:26.490 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 25 k 2024-05-10T10:41:26.490 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-10T10:41:26.490 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-10T10:41:26.491 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-10T10:41:26.491 INFO:teuthology.orchestra.run.smithi196.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-10T10:41:26.491 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-10T10:41:26.491 INFO:teuthology.orchestra.run.smithi196.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-10T10:41:26.491 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-10T10:41:26.491 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-10T10:41:26.491 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 163 k 2024-05-10T10:41:26.491 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-10T10:41:26.491 INFO:teuthology.orchestra.run.smithi196.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-10T10:41:26.491 INFO:teuthology.orchestra.run.smithi196.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-10T10:41:26.492 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-10T10:41:26.492 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-10T10:41:26.492 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 500 k 2024-05-10T10:41:26.492 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-10T10:41:26.492 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2 x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 5.4 M 2024-05-10T10:41:26.492 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-10T10:41:26.492 INFO:teuthology.orchestra.run.smithi196.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-10T10:41:26.493 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-10T10:41:26.493 INFO:teuthology.orchestra.run.smithi196.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-10T10:41:26.493 INFO:teuthology.orchestra.run.smithi196.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-10T10:41:26.493 INFO:teuthology.orchestra.run.smithi196.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-10T10:41:26.493 INFO:teuthology.orchestra.run.smithi196.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-10T10:41:26.493 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-10T10:41:26.493 INFO:teuthology.orchestra.run.smithi196.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-10T10:41:26.493 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-10T10:41:26.493 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-10T10:41:26.493 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-10T10:41:26.493 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-10T10:41:26.493 INFO:teuthology.orchestra.run.smithi196.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-10T10:41:26.493 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-10T10:41:26.494 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-10T10:41:26.494 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-10T10:41:26.494 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 45 k 2024-05-10T10:41:26.494 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common x86_64 2:19.0.0-3449.gd39fa088.el9 ceph 135 k 2024-05-10T10:41:26.494 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-10T10:41:26.494 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-10T10:41:26.494 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-10T10:41:26.494 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-10T10:41:26.494 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-10T10:41:26.494 INFO:teuthology.orchestra.run.smithi196.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-10T10:41:26.494 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-10T10:41:26.494 INFO:teuthology.orchestra.run.smithi196.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-10T10:41:26.494 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-10T10:41:26.494 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-10T10:41:26.495 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-10T10:41:26.495 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-10T10:41:26.495 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-10T10:41:26.495 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-10T10:41:26.495 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-10T10:41:26.495 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-10T10:41:26.495 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-10T10:41:26.495 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-10T10:41:26.495 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-10T10:41:26.495 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-10T10:41:26.495 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-10T10:41:26.495 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-10T10:41:26.495 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-10T10:41:26.495 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-10T10:41:26.496 INFO:teuthology.orchestra.run.smithi196.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-10T10:41:26.496 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-10T10:41:26.496 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-10T10:41:26.496 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-10T10:41:26.496 INFO:teuthology.orchestra.run.smithi196.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-10T10:41:26.496 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-10T10:41:26.496 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-10T10:41:26.496 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-10T10:41:26.496 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-10T10:41:26.496 INFO:teuthology.orchestra.run.smithi196.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-10T10:41:26.496 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-10T10:41:26.496 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-10T10:41:26.496 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-10T10:41:26.496 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-10T10:41:26.496 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-10T10:41:26.497 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-10T10:41:26.497 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-10T10:41:26.497 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-10T10:41:26.497 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-10T10:41:26.497 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-10T10:41:26.497 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-10T10:41:26.497 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-10T10:41:26.497 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-10T10:41:26.497 INFO:teuthology.orchestra.run.smithi196.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-10T10:41:26.497 INFO:teuthology.orchestra.run.smithi196.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-10T10:41:26.497 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-10T10:41:26.497 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-10T10:41:26.497 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-10T10:41:26.498 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-10T10:41:26.498 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-10T10:41:26.498 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-10T10:41:26.498 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-10T10:41:26.498 INFO:teuthology.orchestra.run.smithi196.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-10T10:41:26.498 INFO:teuthology.orchestra.run.smithi196.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-10T10:41:26.498 INFO:teuthology.orchestra.run.smithi196.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-10T10:41:26.498 INFO:teuthology.orchestra.run.smithi196.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-10T10:41:26.498 INFO:teuthology.orchestra.run.smithi196.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-10T10:41:26.498 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-10T10:41:26.498 INFO:teuthology.orchestra.run.smithi196.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-10T10:41:26.498 INFO:teuthology.orchestra.run.smithi196.stdout:Installing weak dependencies: 2024-05-10T10:41:26.498 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-10T10:41:26.499 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-10T10:41:26.499 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-05-10T10:41:26.499 INFO:teuthology.orchestra.run.smithi196.stdout:======================================================================================= 2024-05-10T10:41:26.499 INFO:teuthology.orchestra.run.smithi196.stdout:Install 148 Packages 2024-05-10T10:41:26.499 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrade 8 Packages 2024-05-10T10:41:26.499 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-10T10:41:26.500 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 226 M 2024-05-10T10:41:26.500 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-05-10T10:41:26.529 INFO:teuthology.orchestra.run.smithi107.stdout:(35/156): ceph-volume-19.0.0-3449.gd39fa088.el9 3.2 MB/s | 273 kB 00:00 2024-05-10T10:41:26.638 INFO:teuthology.orchestra.run.smithi107.stdout:(36/156): cephadm-19.0.0-3449.gd39fa088.el9.noa 6.9 MB/s | 763 kB 00:00 2024-05-10T10:41:26.714 INFO:teuthology.orchestra.run.smithi107.stdout:(37/156): cephfs-top-19.0.0-3449.gd39fa088.el9. 243 kB/s | 18 kB 00:00 2024-05-10T10:41:26.822 INFO:teuthology.orchestra.run.smithi107.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 743 kB/s | 80 kB 00:00 2024-05-10T10:41:27.006 INFO:teuthology.orchestra.run.smithi107.stdout:(39/156): libgfortran-11.4.1-3.el9.x86_64.rpm 4.3 MB/s | 803 kB 00:00 2024-05-10T10:41:27.134 INFO:teuthology.orchestra.run.smithi184.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 738 kB/s | 1.0 MB 00:01 2024-05-10T10:41:27.148 INFO:teuthology.orchestra.run.smithi107.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-05-10T10:41:27.290 INFO:teuthology.orchestra.run.smithi107.stdout:(41/156): ceph-mgr-dashboard-19.0.0-3449.gd39fa 2.6 MB/s | 3.5 MB 00:01 2024-05-10T10:41:27.340 INFO:teuthology.orchestra.run.smithi107.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-05-10T10:41:27.476 INFO:teuthology.orchestra.run.smithi196.stdout:(1/156): ceph-19.0.0-3449.gd39fa088.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-05-10T10:41:27.484 INFO:teuthology.orchestra.run.smithi184.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 697 kB/s | 244 kB 00:00 2024-05-10T10:41:27.532 INFO:teuthology.orchestra.run.smithi107.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 556 kB/s | 106 kB 00:00 2024-05-10T10:41:27.682 INFO:teuthology.orchestra.run.smithi107.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 902 kB/s | 135 kB 00:00 2024-05-10T10:41:27.816 INFO:teuthology.orchestra.run.smithi107.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 2.3 MB/s | 1.2 MB 00:00 2024-05-10T10:41:27.826 INFO:teuthology.orchestra.run.smithi184.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 726 kB/s | 248 kB 00:00 2024-05-10T10:41:27.883 INFO:teuthology.orchestra.run.smithi107.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 623 kB/s | 125 kB 00:00 2024-05-10T10:41:27.934 INFO:teuthology.orchestra.run.smithi184.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-05-10T10:41:28.008 INFO:teuthology.orchestra.run.smithi107.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 1.1 MB/s | 215 kB 00:00 2024-05-10T10:41:28.035 INFO:teuthology.orchestra.run.smithi184.stdout:(77/156): python3-jsonpointer-2.0-4.el9.noarch. 191 kB/s | 19 kB 00:00 2024-05-10T10:41:28.175 INFO:teuthology.orchestra.run.smithi107.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-05-10T10:41:28.234 INFO:teuthology.orchestra.run.smithi107.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-05-10T10:41:28.292 INFO:teuthology.orchestra.run.smithi107.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 368 kB/s | 21 kB 00:00 2024-05-10T10:41:28.343 INFO:teuthology.orchestra.run.smithi184.stdout:(78/156): postgresql-server-13.14-1.el9.x86_64. 1.0 MB/s | 5.8 MB 00:05 2024-05-10T10:41:28.369 INFO:teuthology.orchestra.run.smithi184.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 516 kB/s | 172 kB 00:00 2024-05-10T10:41:28.376 INFO:teuthology.orchestra.run.smithi107.stdout:(51/156): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-05-10T10:41:28.452 INFO:teuthology.orchestra.run.smithi184.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 320 kB/s | 35 kB 00:00 2024-05-10T10:41:28.476 INFO:teuthology.orchestra.run.smithi107.stdout:(52/156): ceph-mgr-diskprediction-local-19.0.0- 2.9 MB/s | 7.4 MB 00:02 2024-05-10T10:41:28.502 INFO:teuthology.orchestra.run.smithi107.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-05-10T10:41:28.552 INFO:teuthology.orchestra.run.smithi107.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-05-10T10:41:28.602 INFO:teuthology.orchestra.run.smithi107.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-05-10T10:41:28.661 INFO:teuthology.orchestra.run.smithi107.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-05-10T10:41:28.694 INFO:teuthology.orchestra.run.smithi107.stdout:(57/156): bison-3.7.4-5.el9.x86_64.rpm 1.3 MB/s | 943 kB 00:00 2024-05-10T10:41:28.720 INFO:teuthology.orchestra.run.smithi107.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-05-10T10:41:28.803 INFO:teuthology.orchestra.run.smithi184.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 715 kB/s | 250 kB 00:00 2024-05-10T10:41:28.820 INFO:teuthology.orchestra.run.smithi107.stdout:(59/156): libtool-2.4.6-45.el9.x86_64.rpm 5.7 MB/s | 582 kB 00:00 2024-05-10T10:41:28.834 INFO:teuthology.orchestra.run.smithi196.stdout:(2/156): ceph-fuse-19.0.0-3449.gd39fa088.el9.x8 655 kB/s | 890 kB 00:01 2024-05-10T10:41:28.879 INFO:teuthology.orchestra.run.smithi107.stdout:(60/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.4 MB/s | 3.0 MB 00:00 2024-05-10T10:41:28.904 INFO:teuthology.orchestra.run.smithi107.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 304 kB/s | 25 kB 00:00 2024-05-10T10:41:28.937 INFO:teuthology.orchestra.run.smithi107.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 813 kB/s | 47 kB 00:00 2024-05-10T10:41:28.963 INFO:teuthology.orchestra.run.smithi107.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-05-10T10:41:28.997 INFO:teuthology.orchestra.run.smithi107.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-05-10T10:41:29.022 INFO:teuthology.orchestra.run.smithi107.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 600 kB/s | 35 kB 00:00 2024-05-10T10:41:29.047 INFO:teuthology.orchestra.run.smithi107.stdout:(66/156): librdkafka-1.6.1-102.el9.x86_64.rpm 1.8 MB/s | 662 kB 00:00 2024-05-10T10:41:29.110 INFO:teuthology.orchestra.run.smithi196.stdout:(3/156): ceph-immutable-object-cache-19.0.0-344 527 kB/s | 145 kB 00:00 2024-05-10T10:41:29.153 INFO:teuthology.orchestra.run.smithi184.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 635 kB/s | 222 kB 00:00 2024-05-10T10:41:29.273 INFO:teuthology.orchestra.run.smithi107.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 17 MB/s | 4.7 MB 00:00 2024-05-10T10:41:29.339 INFO:teuthology.orchestra.run.smithi107.stdout:(68/156): postgresql-contrib-13.14-1.el9.x86_64 13 MB/s | 911 kB 00:00 2024-05-10T10:41:29.345 INFO:teuthology.orchestra.run.smithi184.stdout:(83/156): python3-packaging-20.9-5.el9.noarch.r 402 kB/s | 77 kB 00:00 2024-05-10T10:41:29.432 INFO:teuthology.orchestra.run.smithi107.stdout:(69/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-05-10T10:41:29.445 INFO:teuthology.orchestra.run.smithi184.stdout:(84/156): python3-prettytable-0.7.2-27.el9.noar 423 kB/s | 42 kB 00:00 2024-05-10T10:41:29.457 INFO:teuthology.orchestra.run.smithi107.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 1.1 MB/s | 133 kB 00:00 2024-05-10T10:41:29.498 INFO:teuthology.orchestra.run.smithi107.stdout:(71/156): postgresql-13.14-1.el9.x86_64.rpm 3.5 MB/s | 1.6 MB 00:00 2024-05-10T10:41:29.566 INFO:teuthology.orchestra.run.smithi107.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-05-10T10:41:29.591 INFO:teuthology.orchestra.run.smithi107.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 951 kB/s | 87 kB 00:00 2024-05-10T10:41:29.683 INFO:teuthology.orchestra.run.smithi107.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-05-10T10:41:29.816 INFO:teuthology.orchestra.run.smithi107.stdout:(75/156): postgresql-server-13.14-1.el9.x86_64. 15 MB/s | 5.8 MB 00:00 2024-05-10T10:41:29.842 INFO:teuthology.orchestra.run.smithi107.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-05-10T10:41:29.879 INFO:teuthology.orchestra.run.smithi184.stdout:(85/156): python3-protobuf-3.14.0-13.el9.noarch 621 kB/s | 269 kB 00:00 2024-05-10T10:41:29.917 INFO:teuthology.orchestra.run.smithi107.stdout:(77/156): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-05-10T10:41:29.934 INFO:teuthology.orchestra.run.smithi107.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-05-10T10:41:29.951 INFO:teuthology.orchestra.run.smithi107.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-05-10T10:41:29.976 INFO:teuthology.orchestra.run.smithi107.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-05-10T10:41:30.009 INFO:teuthology.orchestra.run.smithi107.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 596 kB/s | 35 kB 00:00 2024-05-10T10:41:30.035 INFO:teuthology.orchestra.run.smithi107.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-05-10T10:41:30.068 INFO:teuthology.orchestra.run.smithi107.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-05-10T10:41:30.094 INFO:teuthology.orchestra.run.smithi107.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-10T10:41:30.127 INFO:teuthology.orchestra.run.smithi107.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 721 kB/s | 42 kB 00:00 2024-05-10T10:41:30.137 INFO:teuthology.orchestra.run.smithi184.stdout:(86/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 614 kB/s | 159 kB 00:00 2024-05-10T10:41:30.161 INFO:teuthology.orchestra.run.smithi107.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-05-10T10:41:30.195 INFO:teuthology.orchestra.run.smithi107.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-05-10T10:41:30.237 INFO:teuthology.orchestra.run.smithi107.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-05-10T10:41:30.262 INFO:teuthology.orchestra.run.smithi107.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 761 kB/s | 51 kB 00:00 2024-05-10T10:41:30.295 INFO:teuthology.orchestra.run.smithi107.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 916 kB/s | 54 kB 00:00 2024-05-10T10:41:30.354 INFO:teuthology.orchestra.run.smithi107.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 715 kB/s | 42 kB 00:00 2024-05-10T10:41:30.413 INFO:teuthology.orchestra.run.smithi107.stdout:(92/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 754 kB/s | 44 kB 00:00 2024-05-10T10:41:30.488 INFO:teuthology.orchestra.run.smithi107.stdout:(93/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-05-10T10:41:30.547 INFO:teuthology.orchestra.run.smithi107.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 618 kB/s | 36 kB 00:00 2024-05-10T10:41:30.596 INFO:teuthology.orchestra.run.smithi184.stdout:(87/156): python3-pyasn1-modules-0.4.8-6.el9.no 608 kB/s | 279 kB 00:00 2024-05-10T10:41:30.606 INFO:teuthology.orchestra.run.smithi107.stdout:(95/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 812 kB/s | 47 kB 00:00 2024-05-10T10:41:30.673 INFO:teuthology.orchestra.run.smithi107.stdout:(96/156): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-05-10T10:41:30.697 INFO:teuthology.orchestra.run.smithi184.stdout:(88/156): python3-pytz-2021.1-5.el9.noarch.rpm 511 kB/s | 51 kB 00:00 2024-05-10T10:41:30.732 INFO:teuthology.orchestra.run.smithi107.stdout:(97/156): uuid-1.6.2-55.el9.x86_64.rpm 993 kB/s | 58 kB 00:00 2024-05-10T10:41:30.805 INFO:teuthology.orchestra.run.smithi184.stdout:(89/156): python3-requests-oauthlib-1.3.0-12.el 496 kB/s | 54 kB 00:00 2024-05-10T10:41:30.831 INFO:teuthology.orchestra.run.smithi107.stdout:(98/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.8 MB/s | 5.1 MB 00:00 2024-05-10T10:41:30.857 INFO:teuthology.orchestra.run.smithi107.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 748 kB/s | 94 kB 00:00 2024-05-10T10:41:30.890 INFO:teuthology.orchestra.run.smithi107.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-05-10T10:41:30.916 INFO:teuthology.orchestra.run.smithi107.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 763 kB/s | 45 kB 00:00 2024-05-10T10:41:31.083 INFO:teuthology.orchestra.run.smithi107.stdout:(102/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-05-10T10:41:31.151 INFO:teuthology.orchestra.run.smithi196.stdout:(4/156): ceph-base-19.0.0-3449.gd39fa088.el9.x8 1.3 MB/s | 5.4 MB 00:04 2024-05-10T10:41:31.183 INFO:teuthology.orchestra.run.smithi107.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 76 kB/s | 22 kB 00:00 2024-05-10T10:41:31.300 INFO:teuthology.orchestra.run.smithi107.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-05-10T10:41:31.825 INFO:teuthology.orchestra.run.smithi107.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 39 kB/s | 19 kB 00:00 2024-05-10T10:41:31.893 INFO:teuthology.orchestra.run.smithi196.stdout:(5/156): ceph-mds-19.0.0-3449.gd39fa088.el9.x86 869 kB/s | 2.4 MB 00:02 2024-05-10T10:41:31.985 INFO:teuthology.orchestra.run.smithi196.stdout:(6/156): ceph-mgr-19.0.0-3449.gd39fa088.el9.x86 1.8 MB/s | 1.5 MB 00:00 2024-05-10T10:41:32.175 INFO:teuthology.orchestra.run.smithi107.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 320 kB/s | 309 kB 00:00 2024-05-10T10:41:32.292 INFO:teuthology.orchestra.run.smithi107.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 223 kB/s | 26 kB 00:00 2024-05-10T10:41:32.317 INFO:teuthology.orchestra.run.smithi107.stdout:(108/156): abseil-cpp-20211102.0-3.el9.x86_64.r 444 kB/s | 548 kB 00:01 2024-05-10T10:41:32.401 INFO:teuthology.orchestra.run.smithi107.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 447 kB/s | 49 kB 00:00 2024-05-10T10:41:32.526 INFO:teuthology.orchestra.run.smithi107.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 323 kB/s | 67 kB 00:00 2024-05-10T10:41:32.622 INFO:teuthology.orchestra.run.smithi184.stdout:(90/156): python3-babel-2.9.1-2.el9.noarch.rpm 991 kB/s | 6.0 MB 00:06 2024-05-10T10:41:32.702 INFO:teuthology.orchestra.run.smithi107.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 503 kB/s | 151 kB 00:00 2024-05-10T10:41:32.739 INFO:teuthology.orchestra.run.smithi184.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 357 kB/s | 42 kB 00:00 2024-05-10T10:41:32.889 INFO:teuthology.orchestra.run.smithi184.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.1 MB/s | 5.1 MB 00:04 2024-05-10T10:41:32.930 INFO:teuthology.orchestra.run.smithi184.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 232 kB/s | 44 kB 00:00 2024-05-10T10:41:33.048 INFO:teuthology.orchestra.run.smithi184.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 304 kB/s | 36 kB 00:00 2024-05-10T10:41:33.157 INFO:teuthology.orchestra.run.smithi184.stdout:(95/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 438 kB/s | 47 kB 00:00 2024-05-10T10:41:33.232 INFO:teuthology.orchestra.run.smithi184.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 644 kB/s | 221 kB 00:00 2024-05-10T10:41:33.332 INFO:teuthology.orchestra.run.smithi184.stdout:(97/156): uuid-1.6.2-55.el9.x86_64.rpm 579 kB/s | 58 kB 00:00 2024-05-10T10:41:33.452 INFO:teuthology.orchestra.run.smithi107.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 731 kB/s | 548 kB 00:00 2024-05-10T10:41:33.549 INFO:teuthology.orchestra.run.smithi184.stdout:(98/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 432 kB/s | 94 kB 00:00 2024-05-10T10:41:33.586 INFO:teuthology.orchestra.run.smithi107.stdout:(113/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 326 kB/s | 43 kB 00:00 2024-05-10T10:41:33.683 INFO:teuthology.orchestra.run.smithi184.stdout:(99/156): socat-1.7.4.1-5.el9.x86_64.rpm 580 kB/s | 305 kB 00:00 2024-05-10T10:41:33.728 INFO:teuthology.orchestra.run.smithi107.stdout:(114/156): python3-cachetools-4.2.4-1.el9.noarc 227 kB/s | 32 kB 00:00 2024-05-10T10:41:33.753 INFO:teuthology.orchestra.run.smithi107.stdout:(115/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 684 kB/s | 839 kB 00:01 2024-05-10T10:41:33.758 INFO:teuthology.orchestra.run.smithi184.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 305 kB/s | 64 kB 00:00 2024-05-10T10:41:33.800 INFO:teuthology.orchestra.run.smithi184.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 383 kB/s | 45 kB 00:00 2024-05-10T10:41:33.878 INFO:teuthology.orchestra.run.smithi107.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 100 kB/s | 15 kB 00:00 2024-05-10T10:41:33.884 INFO:teuthology.orchestra.run.smithi184.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-05-10T10:41:34.062 INFO:teuthology.orchestra.run.smithi107.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 556 kB/s | 172 kB 00:00 2024-05-10T10:41:34.068 INFO:teuthology.orchestra.run.smithi196.stdout:(7/156): ceph-common-19.0.0-3449.gd39fa088.el9. 3.1 MB/s | 21 MB 00:06 2024-05-10T10:41:34.367 INFO:teuthology.orchestra.run.smithi184.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.5 MB/s | 863 kB 00:00 2024-05-10T10:41:34.401 INFO:teuthology.orchestra.run.smithi184.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-05-10T10:41:34.445 INFO:teuthology.orchestra.run.smithi107.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 632 kB/s | 358 kB 00:00 2024-05-10T10:41:34.526 INFO:teuthology.orchestra.run.smithi184.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 156 kB/s | 19 kB 00:00 2024-05-10T10:41:34.563 INFO:teuthology.orchestra.run.smithi107.stdout:(119/156): python3-colorama-0.4.4-12.el9.noarch 302 kB/s | 35 kB 00:00 2024-05-10T10:41:34.588 INFO:teuthology.orchestra.run.smithi107.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 577 kB/s | 303 kB 00:00 2024-05-10T10:41:34.718 INFO:teuthology.orchestra.run.smithi184.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 881 kB/s | 309 kB 00:00 2024-05-10T10:41:34.794 INFO:teuthology.orchestra.run.smithi184.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 345 kB/s | 26 kB 00:00 2024-05-10T10:41:34.861 INFO:teuthology.orchestra.run.smithi184.stdout:(108/156): liboath-2.6.7-2.el9.x86_64.rpm 729 kB/s | 49 kB 00:00 2024-05-10T10:41:34.905 INFO:teuthology.orchestra.run.smithi107.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 602 kB/s | 206 kB 00:00 2024-05-10T10:41:34.936 INFO:teuthology.orchestra.run.smithi184.stdout:(109/156): libunwind-1.6.2-1.el9.x86_64.rpm 898 kB/s | 67 kB 00:00 2024-05-10T10:41:35.011 INFO:teuthology.orchestra.run.smithi184.stdout:(110/156): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-05-10T10:41:35.153 INFO:teuthology.orchestra.run.smithi184.stdout:(111/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-05-10T10:41:35.163 INFO:teuthology.orchestra.run.smithi107.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 559 kB/s | 144 kB 00:00 2024-05-10T10:41:35.237 INFO:teuthology.orchestra.run.smithi184.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-05-10T10:41:35.264 INFO:teuthology.orchestra.run.smithi107.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2024-05-10T10:41:35.312 INFO:teuthology.orchestra.run.smithi184.stdout:(113/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 579 kB/s | 43 kB 00:00 2024-05-10T10:41:35.368 INFO:teuthology.orchestra.run.smithi196.stdout:(8/156): ceph-mon-19.0.0-3449.gd39fa088.el9.x86 1.4 MB/s | 4.7 MB 00:03 2024-05-10T10:41:35.372 INFO:teuthology.orchestra.run.smithi107.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 163 kB/s | 18 kB 00:00 2024-05-10T10:41:35.387 INFO:teuthology.orchestra.run.smithi184.stdout:(114/156): python3-cachetools-4.2.4-1.el9.noarc 429 kB/s | 32 kB 00:00 2024-05-10T10:41:35.435 INFO:teuthology.orchestra.run.smithi196.stdout:(9/156): ceph-selinux-19.0.0-3449.gd39fa088.el9 379 kB/s | 25 kB 00:00 2024-05-10T10:41:35.463 INFO:teuthology.orchestra.run.smithi184.stdout:(115/156): python3-certifi-2021.10.8-2.el9.noar 200 kB/s | 15 kB 00:00 2024-05-10T10:41:35.473 INFO:teuthology.orchestra.run.smithi107.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 231 kB/s | 23 kB 00:00 2024-05-10T10:41:35.538 INFO:teuthology.orchestra.run.smithi184.stdout:(116/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-05-10T10:41:35.565 INFO:teuthology.orchestra.run.smithi107.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 212 kB/s | 19 kB 00:00 2024-05-10T10:41:35.622 INFO:teuthology.orchestra.run.smithi184.stdout:(117/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-05-10T10:41:35.656 INFO:teuthology.orchestra.run.smithi107.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 215 kB/s | 20 kB 00:00 2024-05-10T10:41:35.730 INFO:teuthology.orchestra.run.smithi184.stdout:(118/156): libarrow-9.0.0-11.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-05-10T10:41:35.756 INFO:teuthology.orchestra.run.smithi184.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-05-10T10:41:35.798 INFO:teuthology.orchestra.run.smithi184.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 526 kB/s | 35 kB 00:00 2024-05-10T10:41:35.831 INFO:teuthology.orchestra.run.smithi184.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-05-10T10:41:35.907 INFO:teuthology.orchestra.run.smithi184.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-05-10T10:41:35.973 INFO:teuthology.orchestra.run.smithi184.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2024-05-10T10:41:36.041 INFO:teuthology.orchestra.run.smithi184.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 265 kB/s | 18 kB 00:00 2024-05-10T10:41:36.108 INFO:teuthology.orchestra.run.smithi184.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 347 kB/s | 23 kB 00:00 2024-05-10T10:41:36.158 INFO:teuthology.orchestra.run.smithi184.stdout:(126/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.7 MB/s | 2.0 MB 00:00 2024-05-10T10:41:36.183 INFO:teuthology.orchestra.run.smithi184.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-05-10T10:41:36.225 INFO:teuthology.orchestra.run.smithi184.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 294 kB/s | 20 kB 00:00 2024-05-10T10:41:36.275 INFO:teuthology.orchestra.run.smithi184.stdout:(129/156): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-05-10T10:41:36.300 INFO:teuthology.orchestra.run.smithi184.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 615 kB/s | 46 kB 00:00 2024-05-10T10:41:36.318 INFO:teuthology.orchestra.run.smithi196.stdout:(10/156): ceph-radosgw-19.0.0-3449.gd39fa088.el 4.7 MB/s | 11 MB 00:02 2024-05-10T10:41:36.343 INFO:teuthology.orchestra.run.smithi184.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-05-10T10:41:36.368 INFO:teuthology.orchestra.run.smithi184.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 862 kB/s | 58 kB 00:00 2024-05-10T10:41:36.402 INFO:teuthology.orchestra.run.smithi196.stdout:(11/156): cephfs-mirror-19.0.0-3449.gd39fa088.e 2.6 MB/s | 225 kB 00:00 2024-05-10T10:41:36.418 INFO:teuthology.orchestra.run.smithi184.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-05-10T10:41:36.444 INFO:teuthology.orchestra.run.smithi184.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-05-10T10:41:36.461 INFO:teuthology.orchestra.run.smithi196.stdout:(12/156): cephfs-shell-19.0.0-3449.gd39fa088.el 464 kB/s | 27 kB 00:00 2024-05-10T10:41:36.485 INFO:teuthology.orchestra.run.smithi184.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-05-10T10:41:36.519 INFO:teuthology.orchestra.run.smithi184.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 375 kB/s | 28 kB 00:00 2024-05-10T10:41:36.520 INFO:teuthology.orchestra.run.smithi196.stdout:(13/156): libcephfs-devel-19.0.0-3449.gd39fa088 544 kB/s | 32 kB 00:00 2024-05-10T10:41:36.553 INFO:teuthology.orchestra.run.smithi184.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 458 kB/s | 31 kB 00:00 2024-05-10T10:41:36.586 INFO:teuthology.orchestra.run.smithi184.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 2.8 MB/s | 188 kB 00:00 2024-05-10T10:41:36.620 INFO:teuthology.orchestra.run.smithi184.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 884 kB/s | 59 kB 00:00 2024-05-10T10:41:36.654 INFO:teuthology.orchestra.run.smithi184.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 534 kB/s | 36 kB 00:00 2024-05-10T10:41:36.678 INFO:teuthology.orchestra.run.smithi196.stdout:(14/156): libcephfs2-19.0.0-3449.gd39fa088.el9. 4.6 MB/s | 746 kB 00:00 2024-05-10T10:41:36.696 INFO:teuthology.orchestra.run.smithi184.stdout:(141/156): python3-typing-extensions-4.4.0-2.el 678 kB/s | 51 kB 00:00 2024-05-10T10:41:36.729 INFO:teuthology.orchestra.run.smithi184.stdout:(142/156): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-05-10T10:41:36.746 INFO:teuthology.orchestra.run.smithi196.stdout:(15/156): libcephsqlite-19.0.0-3449.gd39fa088.e 2.4 MB/s | 163 kB 00:00 2024-05-10T10:41:36.763 INFO:teuthology.orchestra.run.smithi184.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-05-10T10:41:36.805 INFO:teuthology.orchestra.run.smithi184.stdout:(144/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-05-10T10:41:36.812 INFO:teuthology.orchestra.run.smithi196.stdout:(16/156): librados-devel-19.0.0-3449.gd39fa088. 1.9 MB/s | 127 kB 00:00 2024-05-10T10:41:36.830 INFO:teuthology.orchestra.run.smithi184.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 298 kB/s | 20 kB 00:00 2024-05-10T10:41:36.880 INFO:teuthology.orchestra.run.smithi184.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-05-10T10:41:36.920 INFO:teuthology.orchestra.run.smithi196.stdout:(17/156): libradosstriper1-19.0.0-3449.gd39fa08 4.5 MB/s | 500 kB 00:00 2024-05-10T10:41:36.956 INFO:teuthology.orchestra.run.smithi107.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 804 kB/s | 1.0 MB 00:01 2024-05-10T10:41:36.982 INFO:teuthology.orchestra.run.smithi184.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-05-10T10:41:37.057 INFO:teuthology.orchestra.run.smithi107.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 464 kB/s | 46 kB 00:00 2024-05-10T10:41:37.199 INFO:teuthology.orchestra.run.smithi107.stdout:(130/156): python3-grpcio-1.46.7-10.el9.x86_64. 799 kB/s | 2.0 MB 00:02 2024-05-10T10:41:37.241 INFO:teuthology.orchestra.run.smithi107.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 429 kB/s | 79 kB 00:00 2024-05-10T10:41:37.391 INFO:teuthology.orchestra.run.smithi107.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 300 kB/s | 58 kB 00:00 2024-05-10T10:41:37.431 INFO:teuthology.orchestra.run.smithi184.stdout:(148/156): librbd1-19.0.0-3449.gd39fa088.el9.x8 7.0 MB/s | 3.1 MB 00:00 2024-05-10T10:41:37.500 INFO:teuthology.orchestra.run.smithi107.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 152 kB/s | 16 kB 00:00 2024-05-10T10:41:37.515 INFO:teuthology.orchestra.run.smithi184.stdout:(149/156): librados2-19.0.0-3449.gd39fa088.el9. 5.4 MB/s | 3.4 MB 00:00 2024-05-10T10:41:37.615 INFO:teuthology.orchestra.run.smithi184.stdout:(150/156): NetworkManager-1.47.5-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-05-10T10:41:37.657 INFO:teuthology.orchestra.run.smithi184.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 1.0 MB/s | 42 kB 00:00 2024-05-10T10:41:37.699 INFO:teuthology.orchestra.run.smithi184.stdout:(152/156): NetworkManager-libnm-1.47.5-1.el9.x8 9.9 MB/s | 1.8 MB 00:00 2024-05-10T10:41:37.724 INFO:teuthology.orchestra.run.smithi184.stdout:(153/156): NetworkManager-tui-1.47.5-1.el9.x86_ 3.6 MB/s | 248 kB 00:00 2024-05-10T10:41:37.735 INFO:teuthology.orchestra.run.smithi107.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 551 kB/s | 272 kB 00:00 2024-05-10T10:41:37.737 INFO:teuthology.orchestra.run.smithi196.stdout:(18/156): librgw2-19.0.0-3449.gd39fa088.el9.x86 6.6 MB/s | 5.4 MB 00:00 2024-05-10T10:41:37.766 INFO:teuthology.orchestra.run.smithi184.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 20 MB/s | 1.3 MB 00:00 2024-05-10T10:41:37.824 INFO:teuthology.orchestra.run.smithi184.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-05-10T10:41:37.837 INFO:teuthology.orchestra.run.smithi196.stdout:(19/156): python3-ceph-argparse-19.0.0-3449.gd3 453 kB/s | 45 kB 00:00 2024-05-10T10:41:37.909 INFO:teuthology.orchestra.run.smithi107.stdout:(135/156): libarrow-9.0.0-11.el9.x86_64.rpm 743 kB/s | 4.4 MB 00:06 2024-05-10T10:41:37.929 INFO:teuthology.orchestra.run.smithi196.stdout:(20/156): python3-ceph-common-19.0.0-3449.gd39f 1.4 MB/s | 135 kB 00:00 2024-05-10T10:41:37.934 INFO:teuthology.orchestra.run.smithi107.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 207 kB/s | 90 kB 00:00 2024-05-10T10:41:37.959 INFO:teuthology.orchestra.run.smithi107.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 126 kB/s | 28 kB 00:00 2024-05-10T10:41:38.009 INFO:teuthology.orchestra.run.smithi107.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2024-05-10T10:41:38.118 INFO:teuthology.orchestra.run.smithi107.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 330 kB/s | 36 kB 00:00 2024-05-10T10:41:38.130 INFO:teuthology.orchestra.run.smithi196.stdout:(21/156): ceph-osd-19.0.0-3449.gd39fa088.el9.x8 2.7 MB/s | 17 MB 00:06 2024-05-10T10:41:38.143 INFO:teuthology.orchestra.run.smithi107.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 322 kB/s | 59 kB 00:00 2024-05-10T10:41:38.155 INFO:teuthology.orchestra.run.smithi196.stdout:(22/156): python3-cephfs-19.0.0-3449.gd39fa088. 717 kB/s | 161 kB 00:00 2024-05-10T10:41:38.218 INFO:teuthology.orchestra.run.smithi107.stdout:(141/156): python3-typing-extensions-4.4.0-2.el 509 kB/s | 51 kB 00:00 2024-05-10T10:41:38.252 INFO:teuthology.orchestra.run.smithi107.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 644 kB/s | 188 kB 00:00 2024-05-10T10:41:38.272 INFO:teuthology.orchestra.run.smithi196.stdout:(23/156): python3-rbd-19.0.0-3449.gd39fa088.el9 2.5 MB/s | 298 kB 00:00 2024-05-10T10:41:38.331 INFO:teuthology.orchestra.run.smithi196.stdout:(24/156): python3-rados-19.0.0-3449.gd39fa088.e 1.6 MB/s | 321 kB 00:00 2024-05-10T10:41:38.373 INFO:teuthology.orchestra.run.smithi196.stdout:(25/156): python3-rgw-19.0.0-3449.gd39fa088.el9 988 kB/s | 99 kB 00:00 2024-05-10T10:41:38.419 INFO:teuthology.orchestra.run.smithi107.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 448 kB/s | 90 kB 00:00 2024-05-10T10:41:38.431 INFO:teuthology.orchestra.run.smithi196.stdout:(26/156): rbd-fuse-19.0.0-3449.gd39fa088.el9.x8 850 kB/s | 85 kB 00:00 2024-05-10T10:41:38.528 INFO:teuthology.orchestra.run.smithi107.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 184 kB/s | 20 kB 00:00 2024-05-10T10:41:38.540 INFO:teuthology.orchestra.run.smithi196.stdout:(27/156): rbd-nbd-19.0.0-3449.gd39fa088.el9.x86 1.5 MB/s | 170 kB 00:00 2024-05-10T10:41:38.553 INFO:teuthology.orchestra.run.smithi107.stdout:(145/156): python3-webob-1.8.7-6.el9.noarch.rpm 561 kB/s | 230 kB 00:00 2024-05-10T10:41:38.615 INFO:teuthology.orchestra.run.smithi196.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3449.g 456 kB/s | 34 kB 00:00 2024-05-10T10:41:38.732 INFO:teuthology.orchestra.run.smithi196.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3449.gd39fa08 1.2 MB/s | 142 kB 00:00 2024-05-10T10:41:38.787 INFO:teuthology.orchestra.run.smithi107.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 741 kB/s | 192 kB 00:00 2024-05-10T10:41:38.920 INFO:teuthology.orchestra.run.smithi107.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 639 kB/s | 427 kB 00:00 2024-05-10T10:41:39.541 INFO:teuthology.orchestra.run.smithi196.stdout:(30/156): rbd-mirror-19.0.0-3449.gd39fa088.el9. 2.6 MB/s | 3.1 MB 00:01 2024-05-10T10:41:39.920 INFO:teuthology.orchestra.run.smithi107.stdout:(148/156): librados2-19.0.0-3449.gd39fa088.el9. 3.0 MB/s | 3.4 MB 00:01 2024-05-10T10:41:40.196 INFO:teuthology.orchestra.run.smithi107.stdout:(149/156): NetworkManager-1.47.5-1.el9.x86_64.r 8.4 MB/s | 2.3 MB 00:00 2024-05-10T10:41:40.263 INFO:teuthology.orchestra.run.smithi107.stdout:(150/156): librbd1-19.0.0-3449.gd39fa088.el9.x8 2.3 MB/s | 3.1 MB 00:01 2024-05-10T10:41:40.421 INFO:teuthology.orchestra.run.smithi107.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 264 kB/s | 42 kB 00:00 2024-05-10T10:41:40.474 INFO:teuthology.orchestra.run.smithi196.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3449.gd39fa 2.0 MB/s | 3.5 MB 00:01 2024-05-10T10:41:40.616 INFO:teuthology.orchestra.run.smithi196.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3449.gd3 1.9 MB/s | 274 kB 00:00 2024-05-10T10:41:40.621 INFO:teuthology.orchestra.run.smithi107.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 1.2 MB/s | 248 kB 00:00 2024-05-10T10:41:40.683 INFO:teuthology.orchestra.run.smithi196.stdout:(33/156): ceph-mgr-rook-19.0.0-3449.gd39fa088.e 740 kB/s | 49 kB 00:00 2024-05-10T10:41:40.758 INFO:teuthology.orchestra.run.smithi196.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3449.gd 220 kB/s | 16 kB 00:00 2024-05-10T10:41:40.900 INFO:teuthology.orchestra.run.smithi196.stdout:(35/156): ceph-volume-19.0.0-3449.gd39fa088.el9 1.9 MB/s | 273 kB 00:00 2024-05-10T10:41:40.905 INFO:teuthology.orchestra.run.smithi107.stdout:(153/156): thrift-0.15.0-2.el9.x86_64.rpm 689 kB/s | 1.6 MB 00:02 2024-05-10T10:41:41.038 INFO:teuthology.orchestra.run.smithi107.stdout:(154/156): NetworkManager-libnm-1.47.5-1.el9.x8 2.2 MB/s | 1.8 MB 00:00 2024-05-10T10:41:41.097 INFO:teuthology.orchestra.run.smithi107.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 2.8 MB/s | 1.3 MB 00:00 2024-05-10T10:41:41.117 INFO:teuthology.orchestra.run.smithi196.stdout:(36/156): cephadm-19.0.0-3449.gd39fa088.el9.noa 3.4 MB/s | 763 kB 00:00 2024-05-10T10:41:41.167 INFO:teuthology.orchestra.run.smithi196.stdout:(37/156): cephfs-top-19.0.0-3449.gd39fa088.el9. 366 kB/s | 18 kB 00:00 2024-05-10T10:41:41.241 INFO:teuthology.orchestra.run.smithi184.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.6 MB/s | 16 MB 00:10 2024-05-10T10:41:41.244 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-05-10T10:41:41.244 INFO:teuthology.orchestra.run.smithi184.stdout:Total 8.3 MB/s | 226 MB 00:27 2024-05-10T10:41:41.309 INFO:teuthology.orchestra.run.smithi196.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 568 kB/s | 80 kB 00:00 2024-05-10T10:41:41.464 INFO:teuthology.orchestra.run.smithi107.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 4.3 MB/s | 2.4 MB 00:00 2024-05-10T10:41:41.471 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-05-10T10:41:41.471 INFO:teuthology.orchestra.run.smithi107.stdout:Total 9.5 MB/s | 226 MB 00:23 2024-05-10T10:41:41.535 INFO:teuthology.orchestra.run.smithi196.stdout:(39/156): libgfortran-11.4.1-3.el9.x86_64.rpm 3.5 MB/s | 803 kB 00:00 2024-05-10T10:41:41.668 INFO:teuthology.orchestra.run.smithi196.stdout:(40/156): ceph-mgr-diskprediction-local-19.0.0- 3.5 MB/s | 7.4 MB 00:02 2024-05-10T10:41:41.694 INFO:teuthology.orchestra.run.smithi196.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-05-10T10:41:41.835 INFO:teuthology.orchestra.run.smithi196.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-05-10T10:41:41.886 INFO:teuthology.orchestra.run.smithi196.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-05-10T10:41:41.944 INFO:teuthology.orchestra.run.smithi196.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-05-10T10:41:41.986 INFO:teuthology.orchestra.run.smithi196.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 4.2 MB/s | 1.2 MB 00:00 2024-05-10T10:41:42.012 INFO:teuthology.orchestra.run.smithi196.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-05-10T10:41:42.070 INFO:teuthology.orchestra.run.smithi196.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-05-10T10:41:42.187 INFO:teuthology.orchestra.run.smithi196.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-05-10T10:41:42.229 INFO:teuthology.orchestra.run.smithi196.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-05-10T10:41:42.263 INFO:teuthology.orchestra.run.smithi196.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-05-10T10:41:42.288 INFO:teuthology.orchestra.run.smithi196.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 368 kB/s | 21 kB 00:00 2024-05-10T10:41:42.314 INFO:teuthology.orchestra.run.smithi196.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-05-10T10:41:42.338 INFO:teuthology.orchestra.run.smithi196.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 650 kB/s | 33 kB 00:00 2024-05-10T10:41:42.381 INFO:teuthology.orchestra.run.smithi196.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-05-10T10:41:42.421 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-05-10T10:41:42.431 INFO:teuthology.orchestra.run.smithi196.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-05-10T10:41:42.456 INFO:teuthology.orchestra.run.smithi196.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-05-10T10:41:42.482 INFO:teuthology.orchestra.run.smithi196.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-05-10T10:41:42.498 INFO:teuthology.orchestra.run.smithi196.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-05-10T10:41:42.541 INFO:teuthology.orchestra.run.smithi196.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-05-10T10:41:42.572 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-05-10T10:41:42.572 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-05-10T10:41:42.582 INFO:teuthology.orchestra.run.smithi196.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 582 kB 00:00 2024-05-10T10:41:42.599 INFO:teuthology.orchestra.run.smithi196.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 437 kB/s | 25 kB 00:00 2024-05-10T10:41:42.616 INFO:teuthology.orchestra.run.smithi196.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-05-10T10:41:42.642 INFO:teuthology.orchestra.run.smithi196.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 292 kB 00:00 2024-05-10T10:41:42.667 INFO:teuthology.orchestra.run.smithi196.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-05-10T10:41:42.691 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-05-10T10:41:42.692 INFO:teuthology.orchestra.run.smithi196.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 704 kB/s | 35 kB 00:00 2024-05-10T10:41:42.776 INFO:teuthology.orchestra.run.smithi196.stdout:(66/156): openblas-openmp-0.3.21-2.el9.x86_64.r 44 MB/s | 4.7 MB 00:00 2024-05-10T10:41:42.843 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-05-10T10:41:42.843 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-05-10T10:41:42.851 INFO:teuthology.orchestra.run.smithi196.stdout:(67/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-05-10T10:41:42.893 INFO:teuthology.orchestra.run.smithi196.stdout:(68/156): postgresql-13.14-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-05-10T10:41:42.927 INFO:teuthology.orchestra.run.smithi196.stdout:(69/156): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 911 kB 00:00 2024-05-10T10:41:42.951 INFO:teuthology.orchestra.run.smithi196.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-05-10T10:41:43.002 INFO:teuthology.orchestra.run.smithi196.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 20 MB/s | 1.0 MB 00:00 2024-05-10T10:41:43.077 INFO:teuthology.orchestra.run.smithi196.stdout:(72/156): postgresql-server-13.14-1.el9.x86_64. 38 MB/s | 5.8 MB 00:00 2024-05-10T10:41:43.103 INFO:teuthology.orchestra.run.smithi196.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 875 kB/s | 87 kB 00:00 2024-05-10T10:41:43.145 INFO:teuthology.orchestra.run.smithi196.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 5.8 MB/s | 244 kB 00:00 2024-05-10T10:41:43.237 INFO:teuthology.orchestra.run.smithi196.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 6.0 MB 00:00 2024-05-10T10:41:43.262 INFO:teuthology.orchestra.run.smithi196.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-05-10T10:41:43.287 INFO:teuthology.orchestra.run.smithi196.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-05-10T10:41:43.304 INFO:teuthology.orchestra.run.smithi196.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 459 kB/s | 19 kB 00:00 2024-05-10T10:41:43.329 INFO:teuthology.orchestra.run.smithi196.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-05-10T10:41:43.346 INFO:teuthology.orchestra.run.smithi196.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 827 kB/s | 35 kB 00:00 2024-05-10T10:41:43.388 INFO:teuthology.orchestra.run.smithi196.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-05-10T10:41:43.464 INFO:teuthology.orchestra.run.smithi196.stdout:(82/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 5.1 MB 00:00 2024-05-10T10:41:43.489 INFO:teuthology.orchestra.run.smithi196.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-05-10T10:41:43.523 INFO:teuthology.orchestra.run.smithi196.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-10T10:41:43.548 INFO:teuthology.orchestra.run.smithi196.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 723 kB/s | 42 kB 00:00 2024-05-10T10:41:43.573 INFO:teuthology.orchestra.run.smithi196.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-05-10T10:41:43.598 INFO:teuthology.orchestra.run.smithi196.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-05-10T10:41:43.624 INFO:teuthology.orchestra.run.smithi196.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-05-10T10:41:43.649 INFO:teuthology.orchestra.run.smithi196.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-05-10T10:41:43.674 INFO:teuthology.orchestra.run.smithi196.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-05-10T10:41:43.716 INFO:teuthology.orchestra.run.smithi196.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-05-10T10:41:43.758 INFO:teuthology.orchestra.run.smithi196.stdout:(92/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-05-10T10:41:43.800 INFO:teuthology.orchestra.run.smithi196.stdout:(93/156): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-05-10T10:41:43.842 INFO:teuthology.orchestra.run.smithi196.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 865 kB/s | 36 kB 00:00 2024-05-10T10:41:44.001 INFO:teuthology.orchestra.run.smithi196.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 46 MB/s | 16 MB 00:00 2024-05-10T10:41:44.026 INFO:teuthology.orchestra.run.smithi196.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 258 kB/s | 47 kB 00:00 2024-05-10T10:41:44.051 INFO:teuthology.orchestra.run.smithi196.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 6.0 MB/s | 305 kB 00:00 2024-05-10T10:41:44.076 INFO:teuthology.orchestra.run.smithi196.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-05-10T10:41:44.102 INFO:teuthology.orchestra.run.smithi196.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-05-10T10:41:44.127 INFO:teuthology.orchestra.run.smithi196.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-05-10T10:41:44.152 INFO:teuthology.orchestra.run.smithi196.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-05-10T10:41:44.236 INFO:teuthology.orchestra.run.smithi196.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-05-10T10:41:44.390 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-05-10T10:41:44.390 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-05-10T10:41:44.436 INFO:teuthology.orchestra.run.smithi196.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.0 MB/s | 863 kB 00:00 2024-05-10T10:41:44.537 INFO:teuthology.orchestra.run.smithi196.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.8 MB/s | 548 kB 00:00 2024-05-10T10:41:44.704 INFO:teuthology.orchestra.run.smithi196.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 117 kB/s | 19 kB 00:00 2024-05-10T10:41:44.787 INFO:teuthology.orchestra.run.smithi196.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 881 kB/s | 309 kB 00:00 2024-05-10T10:41:44.854 INFO:teuthology.orchestra.run.smithi196.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 391 kB/s | 26 kB 00:00 2024-05-10T10:41:44.938 INFO:teuthology.orchestra.run.smithi196.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-05-10T10:41:44.963 INFO:teuthology.orchestra.run.smithi196.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 447 kB/s | 49 kB 00:00 2024-05-10T10:41:44.988 INFO:teuthology.orchestra.run.smithi196.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-05-10T10:41:45.062 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-05-10T10:41:45.063 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-05-10T10:41:45.063 INFO:teuthology.orchestra.run.smithi196.stdout:(111/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-05-10T10:41:45.089 INFO:teuthology.orchestra.run.smithi196.stdout:(112/156): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-05-10T10:41:45.131 INFO:teuthology.orchestra.run.smithi196.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-05-10T10:41:45.165 INFO:teuthology.orchestra.run.smithi196.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 578 kB/s | 43 kB 00:00 2024-05-10T10:41:45.190 INFO:teuthology.orchestra.run.smithi196.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 551 kB/s | 32 kB 00:00 2024-05-10T10:41:45.248 INFO:teuthology.orchestra.run.smithi196.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 180 kB/s | 15 kB 00:00 2024-05-10T10:41:45.274 INFO:teuthology.orchestra.run.smithi196.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-05-10T10:41:45.341 INFO:teuthology.orchestra.run.smithi196.stdout:(118/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-05-10T10:41:45.391 INFO:teuthology.orchestra.run.smithi196.stdout:(119/156): python3-colorama-0.4.4-12.el9.noarch 707 kB/s | 35 kB 00:00 2024-05-10T10:41:45.450 INFO:teuthology.orchestra.run.smithi196.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 1.7 MB/s | 358 kB 00:00 2024-05-10T10:41:45.475 INFO:teuthology.orchestra.run.smithi196.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 2.4 MB/s | 206 kB 00:00 2024-05-10T10:41:45.533 INFO:teuthology.orchestra.run.smithi196.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-05-10T10:41:45.584 INFO:teuthology.orchestra.run.smithi196.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-05-10T10:41:45.642 INFO:teuthology.orchestra.run.smithi196.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 303 kB/s | 18 kB 00:00 2024-05-10T10:41:45.701 INFO:teuthology.orchestra.run.smithi196.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 399 kB/s | 23 kB 00:00 2024-05-10T10:41:45.768 INFO:teuthology.orchestra.run.smithi196.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 291 kB/s | 19 kB 00:00 2024-05-10T10:41:45.827 INFO:teuthology.orchestra.run.smithi196.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 337 kB/s | 20 kB 00:00 2024-05-10T10:41:45.910 INFO:teuthology.orchestra.run.smithi196.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-05-10T10:41:45.969 INFO:teuthology.orchestra.run.smithi196.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 796 kB/s | 46 kB 00:00 2024-05-10T10:41:46.045 INFO:teuthology.orchestra.run.smithi196.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-05-10T10:41:46.094 INFO:teuthology.orchestra.run.smithi196.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-05-10T10:41:46.120 INFO:teuthology.orchestra.run.smithi196.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 774 kB/s | 58 kB 00:00 2024-05-10T10:41:46.178 INFO:teuthology.orchestra.run.smithi196.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 282 kB/s | 16 kB 00:00 2024-05-10T10:41:46.212 INFO:teuthology.orchestra.run.smithi196.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-05-10T10:41:46.237 INFO:teuthology.orchestra.run.smithi196.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-05-10T10:41:46.271 INFO:teuthology.orchestra.run.smithi196.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-05-10T10:41:46.296 INFO:teuthology.orchestra.run.smithi196.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 525 kB/s | 31 kB 00:00 2024-05-10T10:41:46.355 INFO:teuthology.orchestra.run.smithi196.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-05-10T10:41:46.380 INFO:teuthology.orchestra.run.smithi196.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-05-10T10:41:46.414 INFO:teuthology.orchestra.run.smithi196.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 609 kB/s | 36 kB 00:00 2024-05-10T10:41:46.447 INFO:teuthology.orchestra.run.smithi196.stdout:(141/156): python3-typing-extensions-4.4.0-2.el 763 kB/s | 51 kB 00:00 2024-05-10T10:41:46.464 INFO:teuthology.orchestra.run.smithi196.stdout:(142/156): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-05-10T10:41:46.523 INFO:teuthology.orchestra.run.smithi196.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-05-10T10:41:46.548 INFO:teuthology.orchestra.run.smithi196.stdout:(144/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-05-10T10:41:46.649 INFO:teuthology.orchestra.run.smithi196.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 200 kB/s | 20 kB 00:00 2024-05-10T10:41:46.674 INFO:teuthology.orchestra.run.smithi196.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2024-05-10T10:41:46.732 INFO:teuthology.orchestra.run.smithi196.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-05-10T10:41:47.441 INFO:teuthology.orchestra.run.smithi196.stdout:(148/156): librbd1-19.0.0-3449.gd39fa088.el9.x8 4.4 MB/s | 3.1 MB 00:00 2024-05-10T10:41:47.574 INFO:teuthology.orchestra.run.smithi196.stdout:(149/156): librados2-19.0.0-3449.gd39fa088.el9. 3.8 MB/s | 3.4 MB 00:00 2024-05-10T10:41:47.933 INFO:teuthology.orchestra.run.smithi196.stdout:(150/156): NetworkManager-libnm-1.47.5-1.el9.x8 5.1 MB/s | 1.8 MB 00:00 2024-05-10T10:41:47.983 INFO:teuthology.orchestra.run.smithi196.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 840 kB/s | 42 kB 00:00 2024-05-10T10:41:48.400 INFO:teuthology.orchestra.run.smithi196.stdout:(152/156): ceph-test-19.0.0-3449.gd39fa088.el9. 3.8 MB/s | 49 MB 00:12 2024-05-10T10:41:48.426 INFO:teuthology.orchestra.run.smithi196.stdout:(153/156): NetworkManager-tui-1.47.5-1.el9.x86_ 562 kB/s | 248 kB 00:00 2024-05-10T10:41:48.467 INFO:teuthology.orchestra.run.smithi196.stdout:(154/156): NetworkManager-1.47.5-1.el9.x86_64.r 2.3 MB/s | 2.3 MB 00:01 2024-05-10T10:41:48.818 INFO:teuthology.orchestra.run.smithi196.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 3.2 MB/s | 1.3 MB 00:00 2024-05-10T10:41:48.859 INFO:teuthology.orchestra.run.smithi196.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 5.5 MB/s | 2.4 MB 00:00 2024-05-10T10:41:48.864 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-05-10T10:41:48.864 INFO:teuthology.orchestra.run.smithi196.stdout:Total 10 MB/s | 226 MB 00:22 2024-05-10T10:41:50.086 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-05-10T10:41:50.250 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-05-10T10:41:50.251 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-05-10T10:41:50.567 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-05-10T10:41:50.637 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-10T10:41:50.676 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-10T10:41:50.738 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-10T10:41:50.772 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-10T10:41:50.797 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-10T10:41:50.840 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-10T10:41:51.220 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-10T10:41:51.273 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T10:41:51.354 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-05-10T10:41:51.394 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T10:41:51.432 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T10:41:51.435 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-10T10:41:51.482 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-10T10:41:51.524 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T10:41:51.545 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-10T10:41:51.553 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 10/164 2024-05-10T10:41:51.593 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-10T10:41:51.619 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-10T10:41:51.675 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-10T10:41:51.700 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-10T10:41:51.759 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-10T10:41:51.787 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T10:41:51.890 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T10:41:51.913 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 14/164 2024-05-10T10:41:51.975 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 14/164 2024-05-10T10:41:51.997 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-10T10:41:52.006 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-10T10:41:52.019 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-10T10:41:52.062 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-05-10T10:41:52.063 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-05-10T10:41:52.120 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T10:41:52.205 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-10T10:41:52.242 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T10:41:52.279 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T10:41:52.338 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-10T10:41:52.355 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T10:41:52.384 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 10/164 2024-05-10T10:41:52.461 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-10T10:41:52.514 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-10T10:41:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-10T10:41:52.621 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T10:41:52.621 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-10T10:41:52.650 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T10:41:52.690 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T10:41:52.754 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T10:41:52.776 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 14/164 2024-05-10T10:41:52.831 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 14/164 2024-05-10T10:41:52.861 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-10T10:41:52.880 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-10T10:41:52.881 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T10:41:52.996 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-10T10:41:53.054 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-10T10:41:53.089 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-10T10:41:53.121 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-05-10T10:41:53.155 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-05-10T10:41:53.227 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-05-10T10:41:53.233 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-10T10:41:53.263 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-05-10T10:41:53.306 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/164 2024-05-10T10:41:53.339 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/164 2024-05-10T10:41:53.367 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/164 2024-05-10T10:41:53.382 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-10T10:41:53.434 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2024-05-10T10:41:53.443 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-10T10:41:53.489 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/164 2024-05-10T10:41:53.520 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/164 2024-05-10T10:41:53.555 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/164 2024-05-10T10:41:53.581 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T10:41:53.631 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/164 2024-05-10T10:41:53.653 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T10:41:53.666 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-common-2:19.0.0-3449.gd39fa088.el9. 33/164 2024-05-10T10:41:53.709 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el 34/164 2024-05-10T10:41:53.739 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_6 35/164 2024-05-10T10:41:53.807 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/164 2024-05-10T10:41:53.853 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : luarocks-3.9.2-1.el9.noarch 37/164 2024-05-10T10:41:53.861 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T10:41:53.927 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/164 2024-05-10T10:41:53.967 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-10T10:41:54.058 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/164 2024-05-10T10:41:54.061 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-10T10:41:54.103 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-05-10T10:41:54.113 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/164 2024-05-10T10:41:54.143 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-05-10T10:41:54.216 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-05-10T10:41:54.254 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-05-10T10:41:54.310 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/164 2024-05-10T10:41:54.343 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/164 2024-05-10T10:41:54.370 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/164 2024-05-10T10:41:54.439 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2024-05-10T10:41:54.501 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/164 2024-05-10T10:41:54.532 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/164 2024-05-10T10:41:54.575 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/164 2024-05-10T10:41:54.625 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/164 2024-05-10T10:41:54.660 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/164 2024-05-10T10:41:54.694 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-common-2:19.0.0-3449.gd39fa088.el9. 33/164 2024-05-10T10:41:54.700 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/164 2024-05-10T10:41:54.731 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 43/164 2024-05-10T10:41:54.738 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el 34/164 2024-05-10T10:41:54.765 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/164 2024-05-10T10:41:54.766 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_6 35/164 2024-05-10T10:41:54.803 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_6 45/164 2024-05-10T10:41:54.836 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/164 2024-05-10T10:41:54.861 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/164 2024-05-10T10:41:54.882 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : luarocks-3.9.2-1.el9.noarch 37/164 2024-05-10T10:41:54.956 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/164 2024-05-10T10:41:55.018 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/164 2024-05-10T10:41:55.089 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 48/164 2024-05-10T10:41:55.091 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/164 2024-05-10T10:41:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/164 2024-05-10T10:41:55.144 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/164 2024-05-10T10:41:55.216 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-10T10:41:55.249 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-10T10:41:55.292 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-10T10:41:55.332 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-10T10:41:55.368 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-10T10:41:55.411 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-10T10:41:55.453 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-10T10:41:55.586 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-10T10:41:55.634 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-10T10:41:55.664 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-10T10:41:55.674 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/164 2024-05-10T10:41:55.705 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-10T10:41:55.755 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/164 2024-05-10T10:41:55.783 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 43/164 2024-05-10T10:41:55.798 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-10T10:41:55.826 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/164 2024-05-10T10:41:55.856 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-10T10:41:55.864 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_6 45/164 2024-05-10T10:41:55.896 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-10T10:41:55.914 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/164 2024-05-10T10:41:55.921 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-10T10:41:55.946 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-10T10:41:56.020 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-10T10:41:56.066 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/164 2024-05-10T10:41:56.126 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 48/164 2024-05-10T10:41:56.147 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-10T10:41:56.179 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-10T10:41:56.180 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/164 2024-05-10T10:41:56.207 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-10T10:41:56.241 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-10T10:41:56.253 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-10T10:41:56.280 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-10T10:41:56.293 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-10T10:41:56.320 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-10T10:41:56.329 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-10T10:41:56.350 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-10T10:41:56.376 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-10T10:41:56.385 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-10T10:41:56.412 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-10T10:41:56.418 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-10T10:41:56.455 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-10T10:41:56.459 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-10T10:41:56.494 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-10T10:41:56.497 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-10T10:41:56.580 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-10T10:41:56.624 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-10T10:41:56.634 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-10T10:41:56.664 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-10T10:41:56.686 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-10T10:41:56.711 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-10T10:41:56.716 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-10T10:41:56.758 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-10T10:41:56.816 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-10T10:41:56.852 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-10T10:41:56.874 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-10T10:41:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-10T10:41:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-10T10:41:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-10T10:41:56.981 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-10T10:41:57.068 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-10T10:41:57.192 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-10T10:41:57.231 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-10T10:41:57.264 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-10T10:41:57.301 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-10T10:41:57.340 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-10T10:41:57.372 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-10T10:41:57.401 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-10T10:41:57.436 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-10T10:41:57.469 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-10T10:41:57.503 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-10T10:41:57.537 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-10T10:41:57.583 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-10T10:41:57.624 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-10T10:41:57.629 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-10T10:41:57.663 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-10T10:41:57.667 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-10T10:41:57.699 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-10T10:41:57.745 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-10T10:41:57.761 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-10T10:41:57.821 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-10T10:41:57.844 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-10T10:41:57.892 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-10T10:41:57.907 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-10T10:41:57.941 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-10T10:41:58.117 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-10T10:41:58.139 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-10T10:41:58.215 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-10T10:41:58.292 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-05-10T10:41:58.380 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-10T10:41:58.419 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-10T10:41:58.472 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-10T10:41:58.506 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-10T10:41:58.532 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-10T10:41:58.574 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-10T10:41:58.623 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-10T10:41:58.672 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-10T10:41:58.706 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-10T10:41:58.806 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-10T10:41:58.838 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-10T10:41:58.858 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-10T10:41:58.941 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-10T10:41:58.943 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-10T10:41:58.962 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-10T10:41:58.991 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-10T10:41:59.008 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T10:41:59.112 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T10:41:59.142 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T10:41:59.168 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-10T10:41:59.198 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-10T10:41:59.216 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T10:41:59.246 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 10/164 2024-05-10T10:41:59.285 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-10T10:41:59.393 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-10T10:41:59.460 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-10T10:41:59.488 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T10:41:59.590 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T10:41:59.613 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 14/164 2024-05-10T10:41:59.678 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 14/164 2024-05-10T10:41:59.698 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-10T10:41:59.725 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-10T10:41:59.864 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-10T10:41:59.958 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-10T10:41:59.994 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-10T10:42:00.079 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-10T10:42:00.168 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-10T10:42:00.170 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-10T10:42:00.231 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-10T10:42:00.245 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-10T10:42:00.273 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-10T10:42:00.307 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-10T10:42:00.316 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T10:42:00.423 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T10:42:00.619 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-10T10:42:00.626 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-10T10:42:00.661 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 101/164 2024-05-10T10:42:00.744 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 101/164 2024-05-10T10:42:00.746 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-10T10:42:00.774 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 102/164 2024-05-10T10:42:00.810 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-10T10:42:00.839 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-10T10:42:00.879 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-05-10T10:42:00.913 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-05-10T10:42:00.978 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-05-10T10:42:01.012 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-05-10T10:42:01.056 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/164 2024-05-10T10:42:01.088 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/164 2024-05-10T10:42:01.117 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/164 2024-05-10T10:42:01.185 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2024-05-10T10:42:01.246 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/164 2024-05-10T10:42:01.277 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/164 2024-05-10T10:42:01.301 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-10T10:42:01.312 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/164 2024-05-10T10:42:01.331 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 105/164 2024-05-10T10:42:01.334 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-10T10:42:01.388 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/164 2024-05-10T10:42:01.402 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 105/164 2024-05-10T10:42:01.409 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-10T10:42:01.423 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-common-2:19.0.0-3449.gd39fa088.el9. 33/164 2024-05-10T10:42:01.432 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 106/164 2024-05-10T10:42:01.437 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-10T10:42:01.467 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el 34/164 2024-05-10T10:42:01.470 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-10T10:42:01.495 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_6 35/164 2024-05-10T10:42:01.565 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/164 2024-05-10T10:42:01.610 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : luarocks-3.9.2-1.el9.noarch 37/164 2024-05-10T10:42:01.699 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/164 2024-05-10T10:42:01.793 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-10T10:42:01.834 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/164 2024-05-10T10:42:01.841 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 101/164 2024-05-10T10:42:01.887 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/164 2024-05-10T10:42:01.932 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 101/164 2024-05-10T10:42:01.963 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 102/164 2024-05-10T10:42:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-10T10:42:02.406 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/164 2024-05-10T10:42:02.489 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-10T10:42:02.491 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/164 2024-05-10T10:42:02.511 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 105/164 2024-05-10T10:42:02.520 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 43/164 2024-05-10T10:42:02.563 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/164 2024-05-10T10:42:02.583 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 105/164 2024-05-10T10:42:02.601 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_6 45/164 2024-05-10T10:42:02.621 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 106/164 2024-05-10T10:42:02.642 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/164 2024-05-10T10:42:02.790 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 47/164 2024-05-10T10:42:02.837 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 48/164 2024-05-10T10:42:02.892 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 49/164 2024-05-10T10:42:02.964 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-10T10:42:02.996 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-10T10:42:03.032 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-10T10:42:03.079 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-10T10:42:03.115 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-10T10:42:03.158 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-10T10:42:03.200 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-10T10:42:03.334 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-10T10:42:03.380 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-10T10:42:03.410 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-10T10:42:03.452 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-10T10:42:03.546 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-10T10:42:03.577 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-10T10:42:03.617 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-10T10:42:03.642 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-10T10:42:03.661 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T10:42:03.667 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-10T10:42:03.742 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-10T10:42:03.771 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T10:42:03.869 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-10T10:42:03.908 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-10T10:42:03.936 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-10T10:42:03.970 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-10T10:42:04.009 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-10T10:42:04.041 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-10T10:42:04.070 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-10T10:42:04.105 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-10T10:42:04.130 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-10T10:42:04.174 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-10T10:42:04.206 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-10T10:42:04.291 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-10T10:42:04.310 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T10:42:04.336 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-10T10:42:04.357 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 108/164 2024-05-10T10:42:04.367 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-10T10:42:04.414 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-10T10:42:04.456 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 108/164 2024-05-10T10:42:04.456 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-10T10:42:04.456 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-10T10:42:04.456 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-10T10:42:04.484 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 109/164 2024-05-10T10:42:04.511 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-10T10:42:04.569 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-10T10:42:04.960 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T10:42:05.002 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T10:42:05.285 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-10T10:42:05.332 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-10T10:42:05.365 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-10T10:42:05.464 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-10T10:42:05.523 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-10T10:42:05.562 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T10:42:05.597 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 108/164 2024-05-10T10:42:05.635 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-10T10:42:05.667 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-10T10:42:05.679 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 108/164 2024-05-10T10:42:05.679 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-10T10:42:05.679 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-10T10:42:05.679 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:42:05.723 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 109/164 2024-05-10T10:42:05.844 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-10T10:42:05.874 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-10T10:42:05.951 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-10T10:42:06.597 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-10T10:42:06.703 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-10T10:42:07.920 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-10T10:42:08.003 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-10T10:42:08.031 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-10T10:42:08.064 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-10T10:42:08.368 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-10T10:42:08.410 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 101/164 2024-05-10T10:42:08.501 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 101/164 2024-05-10T10:42:08.532 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 102/164 2024-05-10T10:42:08.576 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-10T10:42:09.056 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-10T10:42:09.088 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 105/164 2024-05-10T10:42:09.159 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 105/164 2024-05-10T10:42:09.190 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 106/164 2024-05-10T10:42:11.434 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T10:42:11.478 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T10:42:12.019 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 107/164 2024-05-10T10:42:12.056 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 108/164 2024-05-10T10:42:12.131 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 108/164 2024-05-10T10:42:12.131 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-10T10:42:12.131 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-10T10:42:12.131 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-10T10:42:12.157 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 109/164 2024-05-10T10:42:16.295 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 109/164 2024-05-10T10:42:16.295 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /sys 2024-05-10T10:42:16.295 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /proc 2024-05-10T10:42:16.295 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /mnt 2024-05-10T10:42:16.295 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /var/tmp 2024-05-10T10:42:16.295 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /home 2024-05-10T10:42:16.295 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /root 2024-05-10T10:42:16.295 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /tmp 2024-05-10T10:42:16.296 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-10T10:42:16.474 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 110/164 2024-05-10T10:42:16.490 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 110/164 2024-05-10T10:42:16.490 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:16.490 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-10T10:42:16.490 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-10T10:42:17.085 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 109/164 2024-05-10T10:42:17.085 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /sys 2024-05-10T10:42:17.085 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /proc 2024-05-10T10:42:17.086 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /mnt 2024-05-10T10:42:17.086 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /var/tmp 2024-05-10T10:42:17.086 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /home 2024-05-10T10:42:17.086 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /root 2024-05-10T10:42:17.086 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /tmp 2024-05-10T10:42:17.086 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:42:17.262 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 110/164 2024-05-10T10:42:17.276 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 110/164 2024-05-10T10:42:17.276 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:17.276 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-10T10:42:17.276 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:42:17.969 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 111/164 2024-05-10T10:42:17.994 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 111/164 2024-05-10T10:42:17.995 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:17.995 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-10T10:42:17.995 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-10T10:42:17.995 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-10T10:42:17.995 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-10T10:42:18.220 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 112/164 2024-05-10T10:42:18.242 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 112/164 2024-05-10T10:42:18.243 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:18.243 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-10T10:42:18.243 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-10T10:42:18.243 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-10T10:42:18.243 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-10T10:42:18.679 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 113/164 2024-05-10T10:42:18.701 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 113/164 2024-05-10T10:42:18.702 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:18.702 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-10T10:42:18.702 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-10T10:42:18.702 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-10T10:42:18.702 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-10T10:42:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 111/164 2024-05-10T10:42:18.790 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 111/164 2024-05-10T10:42:18.790 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:18.790 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-10T10:42:18.791 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-10T10:42:18.791 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-10T10:42:18.791 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:42:18.801 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-10T10:42:18.858 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-10T10:42:18.921 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-10T10:42:19.013 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 112/164 2024-05-10T10:42:19.037 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 112/164 2024-05-10T10:42:19.037 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:19.037 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-10T10:42:19.038 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-10T10:42:19.038 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-10T10:42:19.038 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:42:19.106 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-10T10:42:19.154 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-10T10:42:19.232 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-10T10:42:19.320 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-10T10:42:19.459 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-10T10:42:19.472 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 113/164 2024-05-10T10:42:19.496 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 113/164 2024-05-10T10:42:19.496 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:19.496 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-10T10:42:19.496 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-10T10:42:19.496 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-10T10:42:19.496 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:42:19.497 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-10T10:42:19.529 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-10T10:42:19.557 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-10T10:42:19.602 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-10T10:42:19.652 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-10T10:42:19.708 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-10T10:42:19.894 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-10T10:42:19.942 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-10T10:42:19.975 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 125/164 2024-05-10T10:42:20.005 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 125/164 2024-05-10T10:42:20.019 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-10T10:42:20.039 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.e 126/164 2024-05-10T10:42:20.099 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088. 127/164 2024-05-10T10:42:20.107 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-10T10:42:20.128 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 128/164 2024-05-10T10:42:20.247 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-10T10:42:20.300 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-10T10:42:20.332 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-10T10:42:20.359 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-10T10:42:20.822 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 125/164 2024-05-10T10:42:20.849 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 125/164 2024-05-10T10:42:20.882 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.e 126/164 2024-05-10T10:42:20.943 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088. 127/164 2024-05-10T10:42:20.972 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 128/164 2024-05-10T10:42:21.162 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 128/164 2024-05-10T10:42:21.205 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 129/164 2024-05-10T10:42:22.016 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 128/164 2024-05-10T10:42:22.049 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 129/164 2024-05-10T10:42:22.168 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 129/164 2024-05-10T10:42:22.197 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 130/164 2024-05-10T10:42:22.307 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 130/164 2024-05-10T10:42:22.492 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el 131/164 2024-05-10T10:42:22.524 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 132/164 2024-05-10T10:42:22.547 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 132/164 2024-05-10T10:42:22.547 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:22.547 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-10T10:42:22.547 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-10T10:42:22.548 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-10T10:42:22.548 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-10T10:42:22.592 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 133/164 2024-05-10T10:42:22.603 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 133/164 2024-05-10T10:42:22.700 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 134/164 2024-05-10T10:42:22.748 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 135/164 2024-05-10T10:42:23.018 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 129/164 2024-05-10T10:42:23.049 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 130/164 2024-05-10T10:42:23.160 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 130/164 2024-05-10T10:42:23.319 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el 131/164 2024-05-10T10:42:23.360 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 132/164 2024-05-10T10:42:23.384 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 132/164 2024-05-10T10:42:23.384 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:23.384 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-10T10:42:23.384 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-10T10:42:23.384 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-10T10:42:23.384 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:42:23.435 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 133/164 2024-05-10T10:42:23.447 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 133/164 2024-05-10T10:42:23.545 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 134/164 2024-05-10T10:42:23.601 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 135/164 2024-05-10T10:42:23.658 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 109/164 2024-05-10T10:42:23.658 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /sys 2024-05-10T10:42:23.658 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /proc 2024-05-10T10:42:23.658 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /mnt 2024-05-10T10:42:23.658 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /var/tmp 2024-05-10T10:42:23.659 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /home 2024-05-10T10:42:23.659 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /root 2024-05-10T10:42:23.659 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /tmp 2024-05-10T10:42:23.659 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-10T10:42:23.669 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-10T10:42:23.694 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 137/164 2024-05-10T10:42:23.717 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 137/164 2024-05-10T10:42:23.717 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:23.717 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-10T10:42:23.718 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-10T10:42:23.718 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-10T10:42:23.718 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-10T10:42:23.762 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 138/164 2024-05-10T10:42:23.783 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 138/164 2024-05-10T10:42:23.784 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:23.784 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-10T10:42:23.784 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-10T10:42:23.829 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 110/164 2024-05-10T10:42:23.837 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 139/164 2024-05-10T10:42:23.844 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 110/164 2024-05-10T10:42:23.844 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:23.844 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-10T10:42:23.844 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-10T10:42:23.859 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 139/164 2024-05-10T10:42:23.860 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:23.860 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-10T10:42:23.860 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-10T10:42:23.860 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-10T10:42:23.860 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-10T10:42:24.171 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 140/164 2024-05-10T10:42:24.193 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 140/164 2024-05-10T10:42:24.194 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:24.194 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-10T10:42:24.194 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-10T10:42:24.194 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-10T10:42:24.194 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-10T10:42:24.534 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-10T10:42:24.563 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 137/164 2024-05-10T10:42:24.586 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 137/164 2024-05-10T10:42:24.586 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:24.586 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-10T10:42:24.586 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-10T10:42:24.587 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-10T10:42:24.587 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:42:24.630 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 138/164 2024-05-10T10:42:24.653 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 138/164 2024-05-10T10:42:24.653 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:24.653 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-10T10:42:24.653 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:42:24.706 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 139/164 2024-05-10T10:42:24.729 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 139/164 2024-05-10T10:42:24.729 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:24.729 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-10T10:42:24.729 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-10T10:42:24.729 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-10T10:42:24.729 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:42:25.031 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 140/164 2024-05-10T10:42:25.055 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 140/164 2024-05-10T10:42:25.056 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:25.056 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-10T10:42:25.056 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-10T10:42:25.056 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-10T10:42:25.056 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:42:25.324 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 111/164 2024-05-10T10:42:25.350 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 111/164 2024-05-10T10:42:25.350 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:25.350 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-10T10:42:25.350 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-10T10:42:25.350 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-10T10:42:25.350 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-10T10:42:25.583 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 112/164 2024-05-10T10:42:25.605 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 112/164 2024-05-10T10:42:25.606 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:25.606 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-10T10:42:25.606 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-10T10:42:25.606 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-10T10:42:25.606 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-10T10:42:26.042 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 113/164 2024-05-10T10:42:26.065 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 113/164 2024-05-10T10:42:26.065 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:26.065 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-10T10:42:26.065 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-10T10:42:26.065 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-10T10:42:26.065 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-10T10:42:26.163 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-10T10:42:26.211 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-10T10:42:26.267 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-10T10:42:26.450 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-10T10:42:26.494 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-10T10:42:26.569 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-10T10:42:26.665 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-10T10:42:26.797 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-10T10:42:26.843 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-10T10:42:26.875 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-10T10:42:26.902 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-10T10:42:27.346 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 125/164 2024-05-10T10:42:27.376 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 125/164 2024-05-10T10:42:27.408 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.e 126/164 2024-05-10T10:42:27.469 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088. 127/164 2024-05-10T10:42:27.499 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 128/164 2024-05-10T10:42:28.536 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 128/164 2024-05-10T10:42:28.567 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 129/164 2024-05-10T10:42:28.783 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 141/164 2024-05-10T10:42:28.824 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 142/164 2024-05-10T10:42:28.865 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 143/164 2024-05-10T10:42:28.898 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-10T10:42:28.925 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-10T10:42:29.106 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 146/164 2024-05-10T10:42:29.154 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-10T10:42:29.184 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_ 148/164 2024-05-10T10:42:29.214 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-10T10:42:29.260 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-10T10:42:29.537 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 129/164 2024-05-10T10:42:29.559 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 130/164 2024-05-10T10:42:29.670 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 130/164 2024-05-10T10:42:29.701 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 141/164 2024-05-10T10:42:29.742 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 142/164 2024-05-10T10:42:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 143/164 2024-05-10T10:42:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-10T10:42:29.839 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el 131/164 2024-05-10T10:42:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-10T10:42:29.870 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 132/164 2024-05-10T10:42:29.893 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 132/164 2024-05-10T10:42:29.893 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:29.893 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-10T10:42:29.893 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-10T10:42:29.893 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-10T10:42:29.894 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-10T10:42:29.904 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T10:42:29.937 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 133/164 2024-05-10T10:42:29.942 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T10:42:29.948 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 133/164 2024-05-10T10:42:29.961 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T10:42:30.022 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 146/164 2024-05-10T10:42:30.045 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 134/164 2024-05-10T10:42:30.079 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-10T10:42:30.094 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 135/164 2024-05-10T10:42:30.109 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_ 148/164 2024-05-10T10:42:30.139 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-10T10:42:30.177 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-10T10:42:30.790 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 152/164 2024-05-10T10:42:30.809 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T10:42:30.850 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T10:42:30.870 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T10:42:30.880 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-10T10:42:30.921 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-10T10:42:31.002 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-10T10:42:31.014 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-10T10:42:31.033 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-10T10:42:31.048 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 137/164 2024-05-10T10:42:31.059 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-10T10:42:31.060 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-10T10:42:31.070 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 137/164 2024-05-10T10:42:31.070 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:31.070 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-10T10:42:31.070 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-10T10:42:31.071 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-10T10:42:31.071 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-10T10:42:31.115 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 138/164 2024-05-10T10:42:31.127 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-10T10:42:31.137 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 138/164 2024-05-10T10:42:31.138 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:31.138 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-10T10:42:31.138 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-10T10:42:31.152 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-10T10:42:31.152 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-10T10:42:31.191 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 139/164 2024-05-10T10:42:31.213 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 139/164 2024-05-10T10:42:31.214 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:31.214 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-10T10:42:31.214 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-10T10:42:31.214 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-10T10:42:31.214 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-10T10:42:31.245 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-10T10:42:31.270 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-10T10:42:31.275 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T10:42:31.275 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T10:42:31.455 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T10:42:31.456 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-10T10:42:31.525 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 140/164 2024-05-10T10:42:31.539 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-10T10:42:31.548 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 140/164 2024-05-10T10:42:31.548 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-10T10:42:31.548 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-10T10:42:31.548 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-10T10:42:31.548 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-10T10:42:31.548 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-10T10:42:31.603 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T10:42:31.705 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 152/164 2024-05-10T10:42:31.787 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-10T10:42:31.830 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-10T10:42:31.926 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-10T10:42:31.956 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-10T10:42:31.982 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-10T10:42:31.983 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-10T10:42:32.059 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-10T10:42:32.091 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-10T10:42:32.091 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-10T10:42:32.159 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-10T10:42:32.184 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-10T10:42:32.190 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T10:42:32.190 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T10:42:32.369 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T10:42:32.370 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-10T10:42:32.463 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-10T10:42:32.527 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T10:42:36.144 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 141/164 2024-05-10T10:42:36.186 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 142/164 2024-05-10T10:42:36.226 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 143/164 2024-05-10T10:42:36.259 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-10T10:42:36.286 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-10T10:42:36.465 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 146/164 2024-05-10T10:42:36.515 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-10T10:42:36.546 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_ 148/164 2024-05-10T10:42:36.584 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-10T10:42:36.638 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-10T10:42:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T10:42:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 1/164 2024-05-10T10:42:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 2/164 2024-05-10T10:42:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 3/164 2024-05-10T10:42:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 4/164 2024-05-10T10:42:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 5/164 2024-05-10T10:42:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 6/164 2024-05-10T10:42:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 7/164 2024-05-10T10:42:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T10:42:37.032 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T10:42:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 10/164 2024-05-10T10:42:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 11/164 2024-05-10T10:42:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 12/164 2024-05-10T10:42:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T10:42:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 14/164 2024-05-10T10:42:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_ 15/164 2024-05-10T10:42:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 16/164 2024-05-10T10:42:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 17/164 2024-05-10T10:42:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_6 18/164 2024-05-10T10:42:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 19/164 2024-05-10T10:42:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 20/164 2024-05-10T10:42:37.033 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el 21/164 2024-05-10T10:42:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-common-2:19.0.0-3449.gd39fa088.el9. 22/164 2024-05-10T10:42:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_6 23/164 2024-05-10T10:42:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 24/164 2024-05-10T10:42:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 25/164 2024-05-10T10:42:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 26/164 2024-05-10T10:42:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 27/164 2024-05-10T10:42:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 28/164 2024-05-10T10:42:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 29/164 2024-05-10T10:42:37.047 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088. 30/164 2024-05-10T10:42:37.047 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 31/164 2024-05-10T10:42:37.047 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 32/164 2024-05-10T10:42:37.047 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 33/164 2024-05-10T10:42:37.047 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el 34/164 2024-05-10T10:42:37.047 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 35/164 2024-05-10T10:42:37.048 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.e 36/164 2024-05-10T10:42:37.048 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 37/164 2024-05-10T10:42:37.048 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 38/164 2024-05-10T10:42:37.048 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 39/164 2024-05-10T10:42:37.048 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-10T10:42:37.048 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-10T10:42:37.048 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-10T10:42:37.048 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-10T10:42:37.048 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-10T10:42:37.048 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-10T10:42:37.048 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-10T10:42:37.048 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-10T10:42:37.048 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-10T10:42:37.048 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-10T10:42:37.049 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-10T10:42:37.049 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-10T10:42:37.049 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-10T10:42:37.049 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-10T10:42:37.049 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-10T10:42:37.049 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-10T10:42:37.049 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-10T10:42:37.049 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-10T10:42:37.049 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-10T10:42:37.049 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-10T10:42:37.049 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-10T10:42:37.049 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-10T10:42:37.050 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-10T10:42:37.050 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-10T10:42:37.050 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-10T10:42:37.050 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-10T10:42:37.050 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-10T10:42:37.050 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-10T10:42:37.050 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-10T10:42:37.050 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-10T10:42:37.050 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-10T10:42:37.050 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-10T10:42:37.050 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-10T10:42:37.050 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-10T10:42:37.050 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-10T10:42:37.051 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-10T10:42:37.051 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-10T10:42:37.051 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-10T10:42:37.051 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-10T10:42:37.051 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-10T10:42:37.051 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-10T10:42:37.051 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-10T10:42:37.051 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-10T10:42:37.051 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-10T10:42:37.051 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-10T10:42:37.051 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-10T10:42:37.051 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-10T10:42:37.051 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-10T10:42:37.051 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-10T10:42:37.052 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-10T10:42:37.052 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-10T10:42:37.052 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-10T10:42:37.052 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-10T10:42:37.052 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-10T10:42:37.052 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-10T10:42:37.052 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-10T10:42:37.052 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-10T10:42:37.052 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-10T10:42:37.052 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-10T10:42:37.052 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-10T10:42:37.052 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-10T10:42:37.052 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-10T10:42:37.052 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-10T10:42:37.053 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-10T10:42:37.053 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-10T10:42:37.053 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-10T10:42:37.053 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-10T10:42:37.053 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-10T10:42:37.053 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-10T10:42:37.053 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-10T10:42:37.053 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-10T10:42:37.053 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-10T10:42:37.053 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-10T10:42:37.053 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-10T10:42:37.053 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-10T10:42:37.053 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-10T10:42:37.053 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-10T10:42:37.054 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-10T10:42:37.054 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-10T10:42:37.054 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-10T10:42:37.054 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-10T10:42:37.054 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-10T10:42:37.054 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-10T10:42:37.054 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-10T10:42:37.054 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-10T10:42:37.054 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-10T10:42:37.054 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-10T10:42:37.054 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-10T10:42:37.055 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-10T10:42:37.055 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-10T10:42:37.055 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-10T10:42:37.055 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-10T10:42:37.055 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-10T10:42:37.055 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-10T10:42:37.055 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-10T10:42:37.055 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-10T10:42:37.055 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-10T10:42:37.055 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-10T10:42:37.055 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-10T10:42:37.055 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-10T10:42:37.055 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-10T10:42:37.056 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-10T10:42:37.056 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-10T10:42:37.056 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-10T10:42:37.056 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-10T10:42:37.056 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-10T10:42:37.056 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-10T10:42:37.056 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-10T10:42:37.056 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-10T10:42:37.056 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 149/164 2024-05-10T10:42:37.056 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-10T10:42:37.056 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 151/164 2024-05-10T10:42:37.056 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-10T10:42:37.056 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-10T10:42:37.056 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-10T10:42:37.057 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-10T10:42:37.057 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-10T10:42:37.057 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-10T10:42:37.057 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-10T10:42:37.057 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-10T10:42:37.057 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-10T10:42:37.057 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-10T10:42:37.057 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-10T10:42:37.057 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-10T10:42:37.249 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T10:42:37.294 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T10:42:37.314 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-10T10:42:38.042 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T10:42:38.042 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 1/164 2024-05-10T10:42:38.042 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 2/164 2024-05-10T10:42:38.042 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 3/164 2024-05-10T10:42:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 4/164 2024-05-10T10:42:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 5/164 2024-05-10T10:42:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 6/164 2024-05-10T10:42:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 7/164 2024-05-10T10:42:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T10:42:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T10:42:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 10/164 2024-05-10T10:42:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 11/164 2024-05-10T10:42:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 12/164 2024-05-10T10:42:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T10:42:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 14/164 2024-05-10T10:42:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_ 15/164 2024-05-10T10:42:38.043 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 16/164 2024-05-10T10:42:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 17/164 2024-05-10T10:42:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_6 18/164 2024-05-10T10:42:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 19/164 2024-05-10T10:42:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 20/164 2024-05-10T10:42:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el 21/164 2024-05-10T10:42:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-common-2:19.0.0-3449.gd39fa088.el9. 22/164 2024-05-10T10:42:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_6 23/164 2024-05-10T10:42:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 24/164 2024-05-10T10:42:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 25/164 2024-05-10T10:42:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 26/164 2024-05-10T10:42:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 27/164 2024-05-10T10:42:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 28/164 2024-05-10T10:42:38.044 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 29/164 2024-05-10T10:42:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088. 30/164 2024-05-10T10:42:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 31/164 2024-05-10T10:42:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 32/164 2024-05-10T10:42:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 33/164 2024-05-10T10:42:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el 34/164 2024-05-10T10:42:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 35/164 2024-05-10T10:42:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.e 36/164 2024-05-10T10:42:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 37/164 2024-05-10T10:42:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 38/164 2024-05-10T10:42:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 39/164 2024-05-10T10:42:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-10T10:42:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-10T10:42:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-10T10:42:38.045 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-10T10:42:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-10T10:42:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-10T10:42:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-10T10:42:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-10T10:42:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-10T10:42:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-10T10:42:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-10T10:42:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-10T10:42:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-10T10:42:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-10T10:42:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-10T10:42:38.046 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-10T10:42:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-10T10:42:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-10T10:42:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-10T10:42:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-10T10:42:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-10T10:42:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-10T10:42:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-10T10:42:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-10T10:42:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-10T10:42:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-10T10:42:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-10T10:42:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-10T10:42:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-10T10:42:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-10T10:42:38.047 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-10T10:42:38.048 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-10T10:42:38.048 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-10T10:42:38.048 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-10T10:42:38.048 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-10T10:42:38.048 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-10T10:42:38.048 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-10T10:42:38.048 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-10T10:42:38.048 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-10T10:42:38.048 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-10T10:42:38.048 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-10T10:42:38.048 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-10T10:42:38.048 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-10T10:42:38.048 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-10T10:42:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-10T10:42:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-10T10:42:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-10T10:42:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-10T10:42:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-10T10:42:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-10T10:42:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-10T10:42:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-10T10:42:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-10T10:42:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-10T10:42:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-10T10:42:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-10T10:42:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-10T10:42:38.049 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-10T10:42:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-10T10:42:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-10T10:42:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-10T10:42:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-10T10:42:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-10T10:42:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-10T10:42:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-10T10:42:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-10T10:42:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-10T10:42:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-10T10:42:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-10T10:42:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-10T10:42:38.050 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-10T10:42:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-10T10:42:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-10T10:42:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-10T10:42:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-10T10:42:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-10T10:42:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-10T10:42:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-10T10:42:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-10T10:42:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-10T10:42:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-10T10:42:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-10T10:42:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-10T10:42:38.051 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-10T10:42:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-10T10:42:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-10T10:42:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-10T10:42:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-10T10:42:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-10T10:42:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-10T10:42:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-10T10:42:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-10T10:42:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-10T10:42:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-10T10:42:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-10T10:42:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-10T10:42:38.052 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-10T10:42:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-10T10:42:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-10T10:42:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-10T10:42:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-10T10:42:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-10T10:42:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-10T10:42:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-10T10:42:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-10T10:42:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-10T10:42:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-10T10:42:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-10T10:42:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-10T10:42:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 149/164 2024-05-10T10:42:38.053 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-10T10:42:38.054 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 151/164 2024-05-10T10:42:38.054 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-10T10:42:38.054 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-10T10:42:38.054 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-10T10:42:38.054 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-10T10:42:38.054 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-10T10:42:38.054 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-10T10:42:38.054 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-10T10:42:38.054 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-10T10:42:38.054 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-10T10:42:38.054 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-10T10:42:38.054 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-10T10:42:38.054 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-10T10:42:38.134 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 152/164 2024-05-10T10:42:38.215 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-10T10:42:38.256 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-10T10:42:38.337 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-10T10:42:38.376 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-10T10:42:38.403 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-10T10:42:38.403 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-10T10:42:38.470 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-10T10:42:38.503 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-10T10:42:38.503 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-10T10:42:38.571 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-10T10:42:38.596 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-10T10:42:38.601 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T10:42:38.601 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T10:42:38.781 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-10T10:42:38.782 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-10T10:42:38.857 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-10T10:42:38.920 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T10:42:39.846 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T10:42:39.846 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-10T10:42:39.846 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2024-05-10T10:42:39.846 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-10T10:42:39.846 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-10T10:42:39.846 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-10T10:42:39.846 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-10T10:42:39.846 INFO:teuthology.orchestra.run.smithi184.stdout: librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.846 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.846 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-10T10:42:39.847 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-10T10:42:39.847 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-05-10T10:42:39.847 INFO:teuthology.orchestra.run.smithi184.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-10T10:42:39.847 INFO:teuthology.orchestra.run.smithi184.stdout: automake-1.16.2-8.el9.noarch 2024-05-10T10:42:39.847 INFO:teuthology.orchestra.run.smithi184.stdout: bison-3.7.4-5.el9.x86_64 2024-05-10T10:42:39.847 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-10T10:42:39.847 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.847 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.847 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.847 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.847 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:39.847 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.848 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.848 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.848 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:39.848 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:39.848 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:39.848 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:39.848 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:39.848 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.848 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.848 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:39.848 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.848 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.848 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.848 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:39.849 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:39.849 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.849 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.849 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:39.849 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-10T10:42:39.849 INFO:teuthology.orchestra.run.smithi184.stdout: flex-2.6.4-9.el9.x86_64 2024-05-10T10:42:39.849 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-10T10:42:39.849 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-10T10:42:39.849 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-10T10:42:39.849 INFO:teuthology.orchestra.run.smithi184.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-10T10:42:39.849 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-10T10:42:39.849 INFO:teuthology.orchestra.run.smithi184.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-10T10:42:39.849 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-10T10:42:39.850 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-10T10:42:39.850 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-10T10:42:39.850 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.850 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.850 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.850 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-10T10:42:39.850 INFO:teuthology.orchestra.run.smithi184.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-10T10:42:39.850 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-10T10:42:39.850 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-10T10:42:39.850 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-10T10:42:39.850 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.850 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.851 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-10T10:42:39.851 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.851 INFO:teuthology.orchestra.run.smithi184.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-10T10:42:39.851 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-10T10:42:39.851 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-10T10:42:39.851 INFO:teuthology.orchestra.run.smithi184.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-10T10:42:39.851 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-10T10:42:39.851 INFO:teuthology.orchestra.run.smithi184.stdout: lua-5.4.4-4.el9.x86_64 2024-05-10T10:42:39.851 INFO:teuthology.orchestra.run.smithi184.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-10T10:42:39.851 INFO:teuthology.orchestra.run.smithi184.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-10T10:42:39.851 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-10T10:42:39.851 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-10T10:42:39.851 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-10T10:42:39.851 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-10T10:42:39.852 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-13.14-1.el9.x86_64 2024-05-10T10:42:39.852 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-10T10:42:39.852 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-10T10:42:39.852 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-10T10:42:39.852 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-10T10:42:39.852 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-10T10:42:39.852 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-10T10:42:39.852 INFO:teuthology.orchestra.run.smithi184.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-10T10:42:39.852 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-10T10:42:39.852 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-10T10:42:39.852 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-10T10:42:39.852 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.852 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.852 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.853 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-10T10:42:39.853 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-10T10:42:39.853 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-10T10:42:39.853 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-10T10:42:39.853 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-10T10:42:39.853 INFO:teuthology.orchestra.run.smithi184.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-10T10:42:39.853 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-10T10:42:39.853 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-10T10:42:39.853 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-10T10:42:39.853 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-10T10:42:39.853 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-10T10:42:39.853 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-10T10:42:39.853 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-10T10:42:39.854 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-10T10:42:39.854 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-10T10:42:39.854 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-10T10:42:39.854 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-10T10:42:39.854 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-10T10:42:39.854 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-10T10:42:39.854 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-10T10:42:39.854 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-10T10:42:39.854 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-10T10:42:39.854 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-10T10:42:39.854 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-10T10:42:39.854 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-10T10:42:39.854 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-10T10:42:39.855 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-10T10:42:39.855 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-10T10:42:39.855 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-10T10:42:39.855 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-10T10:42:39.855 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply-3.11-14.el9.noarch 2024-05-10T10:42:39.855 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-10T10:42:39.855 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-10T10:42:39.855 INFO:teuthology.orchestra.run.smithi184.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-10T10:42:39.855 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-10T10:42:39.855 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-10T10:42:39.855 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-10T10:42:39.855 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-10T10:42:39.855 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-10T10:42:39.855 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-10T10:42:39.856 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.856 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.856 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-10T10:42:39.856 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-10T10:42:39.856 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-10T10:42:39.856 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.856 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-10T10:42:39.856 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-10T10:42:39.856 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-10T10:42:39.856 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-10T10:42:39.856 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-10T10:42:39.856 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-10T10:42:39.856 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-10T10:42:39.856 INFO:teuthology.orchestra.run.smithi184.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-10T10:42:39.857 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-10T10:42:39.857 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-10T10:42:39.857 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-10T10:42:39.857 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-10T10:42:39.857 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-10T10:42:39.857 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-10T10:42:39.857 INFO:teuthology.orchestra.run.smithi184.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-10T10:42:39.857 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.857 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.857 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:39.857 INFO:teuthology.orchestra.run.smithi184.stdout: re2-1:20211101-3.el9.x86_64 2024-05-10T10:42:39.857 INFO:teuthology.orchestra.run.smithi184.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-10T10:42:39.857 INFO:teuthology.orchestra.run.smithi184.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-10T10:42:39.858 INFO:teuthology.orchestra.run.smithi184.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-10T10:42:39.858 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-10T10:42:39.858 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-10T10:42:39.858 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-10T10:42:39.858 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-10T10:42:39.858 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-05-10T10:42:40.254 DEBUG:teuthology.parallel:result is None 2024-05-10T10:42:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T10:42:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:42:40.605 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2024-05-10T10:42:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-10T10:42:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-10T10:42:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-10T10:42:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-10T10:42:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-10T10:42:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-10T10:42:40.606 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-05-10T10:42:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-10T10:42:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: automake-1.16.2-8.el9.noarch 2024-05-10T10:42:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: bison-3.7.4-5.el9.x86_64 2024-05-10T10:42:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-10T10:42:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-10T10:42:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: flex-2.6.4-9.el9.x86_64 2024-05-10T10:42:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-10T10:42:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-10T10:42:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-10T10:42:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-10T10:42:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-10T10:42:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-10T10:42:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-10T10:42:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-10T10:42:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-10T10:42:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-10T10:42:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-10T10:42:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-10T10:42:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-10T10:42:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-10T10:42:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-10T10:42:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-10T10:42:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-10T10:42:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-10T10:42:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-10T10:42:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-10T10:42:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: lua-5.4.4-4.el9.x86_64 2024-05-10T10:42:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-10T10:42:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-10T10:42:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-10T10:42:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-10T10:42:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-10T10:42:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-10T10:42:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-13.14-1.el9.x86_64 2024-05-10T10:42:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-10T10:42:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-10T10:42:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-10T10:42:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-10T10:42:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-10T10:42:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-10T10:42:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-10T10:42:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-10T10:42:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-10T10:42:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-10T10:42:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-10T10:42:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-10T10:42:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-10T10:42:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-10T10:42:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-10T10:42:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-10T10:42:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-10T10:42:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-10T10:42:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-10T10:42:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-10T10:42:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-10T10:42:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-10T10:42:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-10T10:42:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-10T10:42:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-10T10:42:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-10T10:42:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-10T10:42:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-10T10:42:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-10T10:42:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-10T10:42:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-10T10:42:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-10T10:42:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-10T10:42:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-10T10:42:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-10T10:42:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-10T10:42:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-10T10:42:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-10T10:42:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-10T10:42:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-10T10:42:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply-3.11-14.el9.noarch 2024-05-10T10:42:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-10T10:42:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-10T10:42:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-10T10:42:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-10T10:42:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-10T10:42:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-10T10:42:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-10T10:42:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-10T10:42:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-10T10:42:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-10T10:42:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-10T10:42:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-10T10:42:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-10T10:42:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-10T10:42:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-10T10:42:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-10T10:42:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-10T10:42:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-10T10:42:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-10T10:42:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-10T10:42:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-10T10:42:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-10T10:42:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-10T10:42:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-10T10:42:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-10T10:42:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-10T10:42:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-10T10:42:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: re2-1:20211101-3.el9.x86_64 2024-05-10T10:42:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-10T10:42:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-10T10:42:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-10T10:42:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-10T10:42:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-10T10:42:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-10T10:42:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:42:40.621 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-05-10T10:42:41.062 DEBUG:teuthology.parallel:result is None 2024-05-10T10:42:44.401 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T10:42:44.401 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 1/164 2024-05-10T10:42:44.402 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 2/164 2024-05-10T10:42:44.402 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 3/164 2024-05-10T10:42:44.402 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 4/164 2024-05-10T10:42:44.402 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3449.gd39fa 5/164 2024-05-10T10:42:44.402 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 6/164 2024-05-10T10:42:44.402 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 7/164 2024-05-10T10:42:44.402 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 8/164 2024-05-10T10:42:44.402 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 9/164 2024-05-10T10:42:44.402 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 10/164 2024-05-10T10:42:44.402 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 11/164 2024-05-10T10:42:44.402 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 12/164 2024-05-10T10:42:44.402 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 13/164 2024-05-10T10:42:44.403 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 14/164 2024-05-10T10:42:44.403 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_ 15/164 2024-05-10T10:42:44.403 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 16/164 2024-05-10T10:42:44.403 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 17/164 2024-05-10T10:42:44.403 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_6 18/164 2024-05-10T10:42:44.403 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86 19/164 2024-05-10T10:42:44.403 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 20/164 2024-05-10T10:42:44.403 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el 21/164 2024-05-10T10:42:44.403 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-common-2:19.0.0-3449.gd39fa088.el9. 22/164 2024-05-10T10:42:44.403 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_6 23/164 2024-05-10T10:42:44.403 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 24/164 2024-05-10T10:42:44.403 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 25/164 2024-05-10T10:42:44.403 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 26/164 2024-05-10T10:42:44.403 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 27/164 2024-05-10T10:42:44.404 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 28/164 2024-05-10T10:42:44.404 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 29/164 2024-05-10T10:42:44.404 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088. 30/164 2024-05-10T10:42:44.404 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noa 31/164 2024-05-10T10:42:44.404 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.n 32/164 2024-05-10T10:42:44.404 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39 33/164 2024-05-10T10:42:44.404 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el 34/164 2024-05-10T10:42:44.404 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 35/164 2024-05-10T10:42:44.404 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.e 36/164 2024-05-10T10:42:44.404 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 37/164 2024-05-10T10:42:44.404 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 38/164 2024-05-10T10:42:44.404 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 39/164 2024-05-10T10:42:44.404 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-10T10:42:44.404 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-10T10:42:44.405 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-10T10:42:44.405 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-10T10:42:44.405 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-10T10:42:44.405 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-10T10:42:44.405 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-10T10:42:44.405 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-10T10:42:44.405 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-10T10:42:44.405 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-10T10:42:44.405 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-10T10:42:44.405 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-10T10:42:44.405 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-10T10:42:44.406 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-10T10:42:44.406 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-10T10:42:44.406 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-10T10:42:44.406 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-10T10:42:44.406 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-10T10:42:44.406 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-10T10:42:44.407 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-10T10:42:44.407 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-10T10:42:44.407 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-10T10:42:44.407 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-10T10:42:44.407 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-10T10:42:44.407 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-10T10:42:44.407 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-10T10:42:44.407 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-10T10:42:44.407 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-10T10:42:44.407 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-10T10:42:44.407 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-10T10:42:44.407 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-10T10:42:44.407 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-10T10:42:44.407 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-10T10:42:44.408 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-10T10:42:44.408 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-10T10:42:44.408 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-10T10:42:44.408 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-10T10:42:44.408 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-10T10:42:44.408 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-10T10:42:44.408 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-10T10:42:44.408 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-10T10:42:44.408 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-10T10:42:44.408 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-10T10:42:44.408 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-10T10:42:44.408 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-10T10:42:44.408 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-10T10:42:44.408 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-10T10:42:44.409 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-10T10:42:44.409 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-10T10:42:44.409 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-10T10:42:44.409 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-10T10:42:44.409 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-10T10:42:44.409 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-10T10:42:44.409 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-10T10:42:44.409 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-10T10:42:44.409 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-10T10:42:44.409 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-10T10:42:44.409 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-10T10:42:44.409 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-10T10:42:44.409 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-10T10:42:44.409 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-10T10:42:44.409 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-10T10:42:44.410 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-10T10:42:44.410 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-10T10:42:44.410 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-10T10:42:44.410 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-10T10:42:44.410 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-10T10:42:44.410 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-10T10:42:44.410 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-10T10:42:44.410 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-10T10:42:44.410 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-10T10:42:44.410 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-10T10:42:44.410 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-10T10:42:44.410 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-10T10:42:44.411 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-10T10:42:44.411 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-10T10:42:44.411 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-10T10:42:44.411 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-10T10:42:44.411 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-10T10:42:44.411 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-10T10:42:44.411 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-10T10:42:44.411 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-10T10:42:44.411 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-10T10:42:44.411 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-10T10:42:44.411 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-10T10:42:44.411 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-10T10:42:44.411 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-10T10:42:44.412 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-10T10:42:44.412 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-10T10:42:44.412 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-10T10:42:44.412 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-10T10:42:44.412 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-10T10:42:44.412 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-10T10:42:44.412 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-10T10:42:44.412 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-10T10:42:44.412 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-10T10:42:44.412 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-10T10:42:44.412 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-10T10:42:44.412 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-10T10:42:44.412 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-10T10:42:44.413 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-10T10:42:44.413 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-10T10:42:44.413 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-10T10:42:44.413 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-10T10:42:44.413 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-10T10:42:44.413 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-10T10:42:44.413 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-10T10:42:44.413 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-10T10:42:44.413 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-10T10:42:44.413 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 149/164 2024-05-10T10:42:44.413 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-10T10:42:44.413 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 151/164 2024-05-10T10:42:44.413 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-10T10:42:44.413 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-10T10:42:44.413 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-10T10:42:44.414 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-10T10:42:44.414 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-10T10:42:44.414 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-10T10:42:44.414 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-10T10:42:44.414 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-10T10:42:44.414 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-10T10:42:44.414 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-10T10:42:44.414 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-10T10:42:44.414 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-10T10:42:47.201 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-10T10:42:47.201 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-10T10:42:47.201 INFO:teuthology.orchestra.run.smithi196.stdout:Upgraded: 2024-05-10T10:42:47.201 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-10T10:42:47.201 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-10T10:42:47.201 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-10T10:42:47.201 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-10T10:42:47.202 INFO:teuthology.orchestra.run.smithi196.stdout: librados2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.202 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.202 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-10T10:42:47.202 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-10T10:42:47.202 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-05-10T10:42:47.202 INFO:teuthology.orchestra.run.smithi196.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-10T10:42:47.202 INFO:teuthology.orchestra.run.smithi196.stdout: automake-1.16.2-8.el9.noarch 2024-05-10T10:42:47.202 INFO:teuthology.orchestra.run.smithi196.stdout: bison-3.7.4-5.el9.x86_64 2024-05-10T10:42:47.202 INFO:teuthology.orchestra.run.smithi196.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-10T10:42:47.202 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.202 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.202 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.202 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.203 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:47.203 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.203 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.203 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.203 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:47.203 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:47.203 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:47.203 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:47.203 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:47.203 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.203 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.203 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:47.203 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.203 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.203 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.204 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:47.204 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:47.204 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.204 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-shell-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.204 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-top-2:19.0.0-3449.gd39fa088.el9.noarch 2024-05-10T10:42:47.204 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-10T10:42:47.204 INFO:teuthology.orchestra.run.smithi196.stdout: flex-2.6.4-9.el9.x86_64 2024-05-10T10:42:47.204 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-10T10:42:47.204 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-10T10:42:47.204 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-10T10:42:47.204 INFO:teuthology.orchestra.run.smithi196.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-10T10:42:47.204 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-10T10:42:47.204 INFO:teuthology.orchestra.run.smithi196.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-10T10:42:47.204 INFO:teuthology.orchestra.run.smithi196.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-10T10:42:47.205 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-10T10:42:47.205 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-10T10:42:47.205 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.205 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.205 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.205 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-10T10:42:47.205 INFO:teuthology.orchestra.run.smithi196.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-10T10:42:47.205 INFO:teuthology.orchestra.run.smithi196.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-10T10:42:47.205 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-10T10:42:47.205 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-10T10:42:47.205 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.205 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.205 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-10T10:42:47.205 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.205 INFO:teuthology.orchestra.run.smithi196.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-10T10:42:47.205 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-10T10:42:47.206 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-10T10:42:47.206 INFO:teuthology.orchestra.run.smithi196.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-10T10:42:47.206 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-10T10:42:47.206 INFO:teuthology.orchestra.run.smithi196.stdout: lua-5.4.4-4.el9.x86_64 2024-05-10T10:42:47.206 INFO:teuthology.orchestra.run.smithi196.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-10T10:42:47.206 INFO:teuthology.orchestra.run.smithi196.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-10T10:42:47.206 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-10T10:42:47.206 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-10T10:42:47.206 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-10T10:42:47.206 INFO:teuthology.orchestra.run.smithi196.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-10T10:42:47.206 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-13.14-1.el9.x86_64 2024-05-10T10:42:47.206 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-10T10:42:47.206 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-10T10:42:47.207 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-10T10:42:47.207 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-10T10:42:47.207 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-10T10:42:47.207 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-10T10:42:47.207 INFO:teuthology.orchestra.run.smithi196.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-10T10:42:47.207 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-10T10:42:47.207 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-10T10:42:47.207 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-10T10:42:47.207 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.207 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.207 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.207 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-10T10:42:47.207 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-10T10:42:47.207 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-10T10:42:47.207 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-10T10:42:47.208 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-10T10:42:47.208 INFO:teuthology.orchestra.run.smithi196.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-10T10:42:47.208 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-10T10:42:47.208 INFO:teuthology.orchestra.run.smithi196.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-10T10:42:47.208 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-10T10:42:47.208 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-10T10:42:47.208 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-10T10:42:47.208 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-10T10:42:47.208 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-10T10:42:47.208 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-10T10:42:47.208 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-10T10:42:47.208 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-10T10:42:47.208 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-10T10:42:47.208 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-10T10:42:47.208 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-10T10:42:47.208 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-10T10:42:47.209 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-10T10:42:47.209 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-10T10:42:47.209 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-10T10:42:47.209 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-10T10:42:47.209 INFO:teuthology.orchestra.run.smithi196.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-10T10:42:47.209 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-10T10:42:47.209 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-10T10:42:47.209 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-10T10:42:47.209 INFO:teuthology.orchestra.run.smithi196.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-10T10:42:47.209 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-10T10:42:47.209 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ply-3.11-14.el9.noarch 2024-05-10T10:42:47.209 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-10T10:42:47.209 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-10T10:42:47.209 INFO:teuthology.orchestra.run.smithi196.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-10T10:42:47.209 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-10T10:42:47.210 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-10T10:42:47.210 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-10T10:42:47.210 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-10T10:42:47.210 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-10T10:42:47.210 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-10T10:42:47.210 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.210 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.210 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-10T10:42:47.210 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-10T10:42:47.210 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-10T10:42:47.210 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.210 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-10T10:42:47.210 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-10T10:42:47.210 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-10T10:42:47.211 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-10T10:42:47.211 INFO:teuthology.orchestra.run.smithi196.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-10T10:42:47.211 INFO:teuthology.orchestra.run.smithi196.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-10T10:42:47.211 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-10T10:42:47.211 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-10T10:42:47.211 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-10T10:42:47.211 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-10T10:42:47.211 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-10T10:42:47.211 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-10T10:42:47.211 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-10T10:42:47.211 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-10T10:42:47.211 INFO:teuthology.orchestra.run.smithi196.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-10T10:42:47.211 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.211 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.212 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd-2:19.0.0-3449.gd39fa088.el9.x86_64 2024-05-10T10:42:47.212 INFO:teuthology.orchestra.run.smithi196.stdout: re2-1:20211101-3.el9.x86_64 2024-05-10T10:42:47.212 INFO:teuthology.orchestra.run.smithi196.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-10T10:42:47.212 INFO:teuthology.orchestra.run.smithi196.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-10T10:42:47.212 INFO:teuthology.orchestra.run.smithi196.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-10T10:42:47.212 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-10T10:42:47.212 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-10T10:42:47.212 INFO:teuthology.orchestra.run.smithi196.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-10T10:42:47.213 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-10T10:42:47.213 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-05-10T10:42:47.630 DEBUG:teuthology.parallel:result is None 2024-05-10T10:42:47.631 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T10:42:47.847 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-10T10:42:47.874 INFO:teuthology.orchestra.run.smithi107.stdout:19.0.0-3449.gd39fa088.el9 2024-05-10T10:42:47.874 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3449.gd39fa088.el9 2024-05-10T10:42:47.874 INFO:teuthology.task.install:The correct ceph version 19.0.0-3449.gd39fa088 is installed. 2024-05-10T10:42:47.876 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T10:42:48.089 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-10T10:42:48.115 INFO:teuthology.orchestra.run.smithi184.stdout:19.0.0-3449.gd39fa088.el9 2024-05-10T10:42:48.115 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3449.gd39fa088.el9 2024-05-10T10:42:48.115 INFO:teuthology.task.install:The correct ceph version 19.0.0-3449.gd39fa088 is installed. 2024-05-10T10:42:48.117 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T10:42:48.331 DEBUG:teuthology.orchestra.run.smithi196:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-10T10:42:48.356 INFO:teuthology.orchestra.run.smithi196.stdout:19.0.0-3449.gd39fa088.el9 2024-05-10T10:42:48.357 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3449.gd39fa088.el9 2024-05-10T10:42:48.357 INFO:teuthology.task.install:The correct ceph version 19.0.0-3449.gd39fa088 is installed. 2024-05-10T10:42:48.359 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-10T10:42:48.359 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T10:42:48.359 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T10:42:48.393 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-10T10:42:48.393 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T10:42:48.423 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-10T10:42:48.423 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T10:42:48.453 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-10T10:42:48.453 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T10:42:48.453 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T10:42:48.481 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T10:42:48.548 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-10T10:42:48.548 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T10:42:48.575 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T10:42:48.641 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-10T10:42:48.641 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T10:42:48.669 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T10:42:48.735 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-10T10:42:48.735 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T10:42:48.735 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T10:42:48.763 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T10:42:48.830 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-10T10:42:48.830 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T10:42:48.857 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T10:42:48.924 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-10T10:42:48.924 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T10:42:48.951 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T10:42:49.017 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-10T10:42:49.017 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T10:42:49.017 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T10:42:49.044 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T10:42:49.110 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-10T10:42:49.110 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T10:42:49.138 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T10:42:49.205 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-10T10:42:49.205 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T10:42:49.232 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T10:42:49.299 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-10T10:42:49.407 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-05-10T10:42:49.407 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T10:42:49.408 INFO:tasks.cephadm:Cluster fsid is 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:42:49.408 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-10T10:42:49.408 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.107', 'mon.b': '172.21.15.184', 'mon.c': '172.21.15.196'} 2024-05-10T10:42:49.408 INFO:tasks.cephadm:First mon is mon.a on smithi107 2024-05-10T10:42:49.408 INFO:tasks.cephadm:First mgr is x 2024-05-10T10:42:49.409 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-10T10:42:49.409 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname $(hostname -s) 2024-05-10T10:42:49.439 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname $(hostname -s) 2024-05-10T10:42:49.463 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname $(hostname -s) 2024-05-10T10:42:49.491 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-10T10:42:49.492 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T10:42:49.630 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'd39fa08867836ac070c47cb66c782fa559fd480b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79273/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3449-gd39fa088', 'node_name': '172.21.2.1+braggi01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3449.gd39fa088'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-10 00:52:03.112070', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-63896-from-wip-rishabh-testing-20240501.193033', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-05-10T10:42:49.770 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-63896-from-wip-rishabh-testing-20240501.193033, sha1 d39fa08867836ac070c47cb66c782fa559fd480b from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T10:42:49.771 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/x86_64/flavors/default/cephadm 2024-05-10T10:42:49.772 DEBUG:teuthology.orchestra.run.smithi107:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-10T10:42:51.437 INFO:teuthology.orchestra.run.smithi107.stdout:-rw-r--r--. 1 ubuntu ubuntu 782738 May 10 10:42 /home/ubuntu/cephtest/cephadm 2024-05-10T10:42:51.437 DEBUG:teuthology.orchestra.run.smithi184:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-10T10:42:52.726 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r--. 1 ubuntu ubuntu 782738 May 10 10:42 /home/ubuntu/cephtest/cephadm 2024-05-10T10:42:52.726 DEBUG:teuthology.orchestra.run.smithi196:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-63896-from-wip-rishabh-testing-20240501.193033/d39fa08867836ac070c47cb66c782fa559fd480b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-10T10:42:54.228 INFO:teuthology.orchestra.run.smithi196.stdout:-rw-r--r--. 1 ubuntu ubuntu 782738 May 10 10:42 /home/ubuntu/cephtest/cephadm 2024-05-10T10:42:54.228 DEBUG:teuthology.orchestra.run.smithi107:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-10T10:42:54.249 DEBUG:teuthology.orchestra.run.smithi184:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-10T10:42:54.267 DEBUG:teuthology.orchestra.run.smithi196:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-10T10:42:54.311 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b on all hosts... 2024-05-10T10:42:54.312 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b pull 2024-05-10T10:42:54.315 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b pull 2024-05-10T10:42:54.318 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b pull 2024-05-10T10:42:55.836 INFO:teuthology.orchestra.run.smithi196.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b... 2024-05-10T10:42:55.880 INFO:teuthology.orchestra.run.smithi184.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b... 2024-05-10T10:42:56.002 INFO:teuthology.orchestra.run.smithi107.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b... 2024-05-10T10:43:39.797 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:43:39.797 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_version": "ceph version 19.0.0-3449-gd39fa088 (d39fa08867836ac070c47cb66c782fa559fd480b) squid (dev)", 2024-05-10T10:43:39.798 INFO:teuthology.orchestra.run.smithi107.stdout: "image_id": "ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5", 2024-05-10T10:43:39.798 INFO:teuthology.orchestra.run.smithi107.stdout: "repo_digests": [ 2024-05-10T10:43:39.798 INFO:teuthology.orchestra.run.smithi107.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f" 2024-05-10T10:43:39.798 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-10T10:43:39.798 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:43:50.416 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-05-10T10:43:50.417 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_version": "ceph version 19.0.0-3449-gd39fa088 (d39fa08867836ac070c47cb66c782fa559fd480b) squid (dev)", 2024-05-10T10:43:50.417 INFO:teuthology.orchestra.run.smithi196.stdout: "image_id": "ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5", 2024-05-10T10:43:50.417 INFO:teuthology.orchestra.run.smithi196.stdout: "repo_digests": [ 2024-05-10T10:43:50.417 INFO:teuthology.orchestra.run.smithi196.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f" 2024-05-10T10:43:50.417 INFO:teuthology.orchestra.run.smithi196.stdout: ] 2024-05-10T10:43:50.417 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-05-10T10:43:54.326 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-05-10T10:43:54.326 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 19.0.0-3449-gd39fa088 (d39fa08867836ac070c47cb66c782fa559fd480b) squid (dev)", 2024-05-10T10:43:54.326 INFO:teuthology.orchestra.run.smithi184.stdout: "image_id": "ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5", 2024-05-10T10:43:54.326 INFO:teuthology.orchestra.run.smithi184.stdout: "repo_digests": [ 2024-05-10T10:43:54.326 INFO:teuthology.orchestra.run.smithi184.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f" 2024-05-10T10:43:54.326 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-05-10T10:43:54.326 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-05-10T10:43:54.351 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph 2024-05-10T10:43:54.383 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph 2024-05-10T10:43:54.409 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /etc/ceph 2024-05-10T10:43:54.441 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /etc/ceph 2024-05-10T10:43:54.471 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /etc/ceph 2024-05-10T10:43:54.495 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 777 /etc/ceph 2024-05-10T10:43:54.522 INFO:tasks.cephadm:Writing seed config... 2024-05-10T10:43:54.524 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-05-10T10:43:54.524 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-10T10:43:54.525 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-10T10:43:54.525 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-10T10:43:54.525 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-10T10:43:54.525 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-10T10:43:54.525 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-05-10T10:43:54.525 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-10T10:43:54.526 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-10T10:43:54.526 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-10T10:43:54.526 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-10T10:43:54.526 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-10T10:43:54.526 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-10T10:43:54.526 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-10T10:43:54.526 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-10T10:43:54.526 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-10T10:43:54.526 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-10T10:43:54.526 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-10T10:43:54.526 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-05-10T10:43:54.526 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-05-10T10:43:54.526 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-10T10:43:54.527 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-10T10:43:54.527 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-10T10:43:54.527 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-10T10:43:54.527 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-10T10:43:54.527 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-10T10:43:54.527 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-10T10:43:54.527 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-10T10:43:54.527 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-10T10:43:54.527 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-10T10:43:54.527 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-10T10:43:54.527 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-10T10:43:54.527 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-05-10T10:43:54.527 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-05-10T10:43:54.527 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-05-10T10:43:54.527 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-10T10:43:54.528 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-10T10:43:54.528 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-05-10T10:43:54.528 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-05-10T10:43:54.528 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-10T10:43:54.528 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-10T10:43:54.528 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-05-10T10:43:54.528 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-10T10:43:54.528 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-10T10:43:54.528 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-10T10:43:54.528 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-10T10:43:54.528 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-10T10:43:54.528 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-10T10:43:54.528 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-10T10:43:54.528 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-05-10T10:43:54.529 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T10:43:54.529 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-10T10:43:54.548 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 0ba8a8e4-0eba-11ef-bc98-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-10T10:43:54.548 DEBUG:teuthology.orchestra.run.smithi107:mon.a> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mon.a.service 2024-05-10T10:43:54.591 DEBUG:teuthology.orchestra.run.smithi107:mgr.x> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mgr.x.service 2024-05-10T10:43:54.634 INFO:tasks.cephadm:Bootstrapping... 2024-05-10T10:43:54.634 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b -v bootstrap --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.107 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-10T10:43:54.830 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-05-10T10:43:54.830 INFO:teuthology.orchestra.run.smithi107.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b', '-v', 'bootstrap', '--fsid', '0ba8a8e4-0eba-11ef-bc98-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.107', '--skip-admin-label'] 2024-05-10T10:43:54.830 INFO:teuthology.orchestra.run.smithi107.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-10T10:43:54.831 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying podman|docker is present... 2024-05-10T10:43:54.856 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-10T10:43:54.856 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying lvm2 is present... 2024-05-10T10:43:54.856 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying time synchronization is in place... 2024-05-10T10:43:54.864 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-10T10:43:54.864 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-10T10:43:54.870 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-10T10:43:54.870 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout inactive 2024-05-10T10:43:54.877 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout enabled 2024-05-10T10:43:54.883 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout active 2024-05-10T10:43:54.883 INFO:teuthology.orchestra.run.smithi107.stdout:Unit chronyd.service is enabled and running 2024-05-10T10:43:54.883 INFO:teuthology.orchestra.run.smithi107.stdout:Repeating the final host check... 2024-05-10T10:43:54.907 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-10T10:43:54.907 INFO:teuthology.orchestra.run.smithi107.stdout:podman (/bin/podman) version 4.9.4 is present 2024-05-10T10:43:54.907 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl is present 2024-05-10T10:43:54.907 INFO:teuthology.orchestra.run.smithi107.stdout:lvcreate is present 2024-05-10T10:43:54.914 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-10T10:43:54.914 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-10T10:43:54.920 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-10T10:43:54.920 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout inactive 2024-05-10T10:43:54.927 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout enabled 2024-05-10T10:43:54.933 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout active 2024-05-10T10:43:54.933 INFO:teuthology.orchestra.run.smithi107.stdout:Unit chronyd.service is enabled and running 2024-05-10T10:43:54.933 INFO:teuthology.orchestra.run.smithi107.stdout:Host looks OK 2024-05-10T10:43:54.933 INFO:teuthology.orchestra.run.smithi107.stdout:Cluster fsid: 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:43:54.933 INFO:teuthology.orchestra.run.smithi107.stdout:Acquiring lock 140535727124192 on /run/cephadm/0ba8a8e4-0eba-11ef-bc98-c7b262605968.lock 2024-05-10T10:43:54.933 INFO:teuthology.orchestra.run.smithi107.stdout:Lock 140535727124192 acquired on /run/cephadm/0ba8a8e4-0eba-11ef-bc98-c7b262605968.lock 2024-05-10T10:43:54.934 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying IP 172.21.15.107 port 3300 ... 2024-05-10T10:43:54.934 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying IP 172.21.15.107 port 6789 ... 2024-05-10T10:43:54.934 INFO:teuthology.orchestra.run.smithi107.stdout:Base mon IP(s) is [172.21.15.107:3300, 172.21.15.107:6789], mon addrv is [v2:172.21.15.107:3300,v1:172.21.15.107:6789] 2024-05-10T10:43:54.937 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.107 metric 100 2024-05-10T10:43:54.937 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.107 metric 100 2024-05-10T10:43:54.940 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-10T10:43:54.940 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-05-10T10:43:54.940 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1786sec hoplimit 64 pref medium 2024-05-10T10:43:54.943 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-10T10:43:54.943 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-10T10:43:54.943 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-10T10:43:54.943 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-05-10T10:43:54.943 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link 2024-05-10T10:43:54.943 INFO:teuthology.orchestra.run.smithi107.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-10T10:43:54.944 INFO:teuthology.orchestra.run.smithi107.stdout:Mon IP `172.21.15.107` is in CIDR network `172.21.0.0/20` 2024-05-10T10:43:54.944 INFO:teuthology.orchestra.run.smithi107.stdout:Mon IP `172.21.15.107` is in CIDR network `172.21.0.0/20` 2024-05-10T10:43:54.944 INFO:teuthology.orchestra.run.smithi107.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-10T10:43:54.944 INFO:teuthology.orchestra.run.smithi107.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-10T10:43:54.945 INFO:teuthology.orchestra.run.smithi107.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b... 2024-05-10T10:43:55.421 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stdout ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 2024-05-10T10:43:55.421 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b... 2024-05-10T10:43:55.421 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stderr Getting image source signatures 2024-05-10T10:43:55.421 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stderr Copying blob sha256:5401d9dfdf7b5b1eb30ca8a50398217fe5e68f9c8026e432d9728743b160edef 2024-05-10T10:43:55.422 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stderr Copying blob sha256:bf5b95bd68251da39c6cd2eb96c6ba4138bb37a62bdc39287908b25e92047d7e 2024-05-10T10:43:55.422 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stderr Copying config sha256:ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 2024-05-10T10:43:55.422 INFO:teuthology.orchestra.run.smithi107.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-10T10:43:56.411 INFO:teuthology.orchestra.run.smithi107.stdout:ceph: stdout ceph version 19.0.0-3449-gd39fa088 (d39fa08867836ac070c47cb66c782fa559fd480b) squid (dev) 2024-05-10T10:43:56.412 INFO:teuthology.orchestra.run.smithi107.stdout:Ceph version: ceph version 19.0.0-3449-gd39fa088 (d39fa08867836ac070c47cb66c782fa559fd480b) squid (dev) 2024-05-10T10:43:56.412 INFO:teuthology.orchestra.run.smithi107.stdout:Extracting ceph user uid/gid from container image... 2024-05-10T10:43:57.404 INFO:teuthology.orchestra.run.smithi107.stdout:stat: stdout 167 167 2024-05-10T10:43:57.404 INFO:teuthology.orchestra.run.smithi107.stdout:Creating initial keys... 2024-05-10T10:44:06.844 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph-authtool: stdout AQBw+j1mHcTqExAAjAFo6LdJtIArlQRFPw4tFw== 2024-05-10T10:44:08.851 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph-authtool: stdout AQB4+j1mUENHFBAAekes9ms1frD/2bPHD8zbKQ== 2024-05-10T10:44:09.773 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph-authtool: stdout AQB5+j1mznk9DBAAjyAqxEKAhEUdUzn9KU/XiA== 2024-05-10T10:44:09.774 INFO:teuthology.orchestra.run.smithi107.stdout:Creating initial monmap... 2024-05-10T10:44:10.680 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-10T10:44:10.680 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-05-10T10:44:10.680 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:44:10.681 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-10T10:44:10.681 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool for a [v2:172.21.15.107:3300,v1:172.21.15.107:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-10T10:44:10.681 INFO:teuthology.orchestra.run.smithi107.stdout:setting min_mon_release = quincy 2024-05-10T10:44:10.681 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/monmaptool: set fsid to 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:44:10.681 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-10T10:44:10.681 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:44:10.681 INFO:teuthology.orchestra.run.smithi107.stdout:Creating mon... 2024-05-10T10:44:11.619 INFO:teuthology.orchestra.run.smithi107.stdout:create mon.a on 2024-05-10T10:44:11.819 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-10T10:44:11.951 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-10T10:44:12.144 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968.target → /etc/systemd/system/ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968.target. 2024-05-10T10:44:12.144 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968.target → /etc/systemd/system/ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968.target. 2024-05-10T10:44:12.374 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mon.a 2024-05-10T10:44:12.374 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mon.a.service: Unit ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mon.a.service not loaded. 2024-05-10T10:44:12.592 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968.target.wants/ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mon.a.service → /etc/systemd/system/ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@.service. 2024-05-10T10:44:12.642 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:12 smithi107 systemd[1]: Starting Ceph mon.a for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T10:44:12.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:12 smithi107 podman[29975]: 2024-05-10 10:44:12.827789077 +0000 UTC m=+0.099753879 container create d9ba0f11a58ee3f54132c007e6ace55f5fe7a8f9e9db44347403f59966c42468 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-a, io.buildah.version=1.33.5, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, CEPH_POINT_RELEASE=, ceph=True) 2024-05-10T10:44:12.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:12 smithi107 podman[29975]: 2024-05-10 10:44:12.746118482 +0000 UTC m=+0.018083303 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T10:44:13.126 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-10T10:44:13.126 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout disabled 2024-05-10T10:44:13.133 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-10T10:44:13.133 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout inactive 2024-05-10T10:44:13.133 INFO:teuthology.orchestra.run.smithi107.stdout:firewalld.service is not enabled 2024-05-10T10:44:13.133 INFO:teuthology.orchestra.run.smithi107.stdout:Not possible to enable service . firewalld.service is not available 2024-05-10T10:44:13.134 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for mon to start... 2024-05-10T10:44:13.134 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for mon... 2024-05-10T10:44:13.260 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:13 smithi107 podman[29975]: 2024-05-10 10:44:13.021936036 +0000 UTC m=+0.293900838 container init d9ba0f11a58ee3f54132c007e6ace55f5fe7a8f9e9db44347403f59966c42468 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, maintainer=Guillaume Abrioux ) 2024-05-10T10:44:13.261 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:13 smithi107 podman[29975]: 2024-05-10 10:44:13.024900588 +0000 UTC m=+0.296865393 container start d9ba0f11a58ee3f54132c007e6ace55f5fe7a8f9e9db44347403f59966c42468 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-a, ceph=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-10T10:44:13.261 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:13 smithi107 ceph-mon[29994]: mkfs 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:44:13.261 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:13 smithi107 ceph-mon[29994]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-10T10:44:13.261 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:13 smithi107 bash[29975]: d9ba0f11a58ee3f54132c007e6ace55f5fe7a8f9e9db44347403f59966c42468 2024-05-10T10:44:13.261 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:13 smithi107 systemd[1]: Started Ceph mon.a for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:44:14.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:14 smithi107 ceph-mon[29994]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-10T10:44:14.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:14 smithi107 ceph-mon[29994]: monmap epoch 1 2024-05-10T10:44:14.328 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:14 smithi107 ceph-mon[29994]: fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:44:14.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:14 smithi107 ceph-mon[29994]: last_changed 2024-05-10T10:44:10.080994+0000 2024-05-10T10:44:14.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:14 smithi107 ceph-mon[29994]: created 2024-05-10T10:44:10.080994+0000 2024-05-10T10:44:14.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:14 smithi107 ceph-mon[29994]: min_mon_release 19 (squid) 2024-05-10T10:44:14.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:14 smithi107 ceph-mon[29994]: election_strategy: 1 2024-05-10T10:44:14.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:14 smithi107 ceph-mon[29994]: 0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-05-10T10:44:14.329 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:14 smithi107 ceph-mon[29994]: fsmap 2024-05-10T10:44:14.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:14 smithi107 ceph-mon[29994]: osdmap e1: 0 total, 0 up, 0 in 2024-05-10T10:44:14.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:14 smithi107 ceph-mon[29994]: mgrmap e1: no daemons active 2024-05-10T10:44:14.842 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout cluster: 2024-05-10T10:44:14.842 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout id: 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:44:14.842 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-10T10:44:14.842 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-05-10T10:44:14.842 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout services: 2024-05-10T10:44:14.842 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 1.30537s) 2024-05-10T10:44:14.842 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-10T10:44:14.842 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-10T10:44:14.842 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-05-10T10:44:14.842 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout data: 2024-05-10T10:44:14.842 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-10T10:44:14.842 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-10T10:44:14.843 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-10T10:44:14.843 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout pgs: 2024-05-10T10:44:14.843 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-05-10T10:44:14.843 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.287+0000 7f4fcb17d700 1 Processor -- start 2024-05-10T10:44:14.843 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.287+0000 7f4fcb17d700 1 -- start start 2024-05-10T10:44:14.843 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.287+0000 7f4fcb17d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fc4109c10 0x7f4fc410c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:14.843 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.287+0000 7f4fcb17d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc407ce90 con 0x7f4fc4109c10 2024-05-10T10:44:14.843 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.287+0000 7f4fc8f19700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fc4109c10 0x7f4fc410c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:14.843 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.287+0000 7f4fc8f19700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fc4109c10 0x7f4fc410c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36772/0 (socket says 172.21.15.107:36772) 2024-05-10T10:44:14.843 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.287+0000 7f4fc8f19700 1 -- 172.21.15.107:0/3747899986 learned_addr learned my addr 172.21.15.107:0/3747899986 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:14.843 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.288+0000 7f4fc8f19700 1 -- 172.21.15.107:0/3747899986 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc410c540 con 0x7f4fc4109c10 2024-05-10T10:44:14.843 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.288+0000 7f4fc8f19700 1 --2- 172.21.15.107:0/3747899986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fc4109c10 0x7f4fc410c000 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4fb80098a0 tx=0x7f4fb8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba27671cf92a7185 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:14.843 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.288+0000 7f4fc37fe700 1 -- 172.21.15.107:0/3747899986 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fb8004160 con 0x7f4fc4109c10 2024-05-10T10:44:14.843 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.288+0000 7f4fc37fe700 1 -- 172.21.15.107:0/3747899986 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fb8004300 con 0x7f4fc4109c10 2024-05-10T10:44:14.844 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.288+0000 7f4fc37fe700 1 -- 172.21.15.107:0/3747899986 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fb80036a0 con 0x7f4fc4109c10 2024-05-10T10:44:14.844 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.288+0000 7f4fcb17d700 1 -- 172.21.15.107:0/3747899986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fc4109c10 msgr2=0x7f4fc410c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:14.844 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.288+0000 7f4fcb17d700 1 --2- 172.21.15.107:0/3747899986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fc4109c10 0x7f4fc410c000 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4fb80098a0 tx=0x7f4fb8009bb0 comp rx=0 tx=0).stop 2024-05-10T10:44:14.844 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.289+0000 7f4fcb17d700 1 -- 172.21.15.107:0/3747899986 shutdown_connections 2024-05-10T10:44:14.844 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.289+0000 7f4fcb17d700 1 --2- 172.21.15.107:0/3747899986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fc4109c10 0x7f4fc410c000 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:14.844 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.289+0000 7f4fcb17d700 1 -- 172.21.15.107:0/3747899986 >> 172.21.15.107:0/3747899986 conn(0x7f4fc4103620 msgr2=0x7f4fc4105a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:14.844 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.289+0000 7f4fcb17d700 1 -- 172.21.15.107:0/3747899986 shutdown_connections 2024-05-10T10:44:14.844 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.289+0000 7f4fcb17d700 1 -- 172.21.15.107:0/3747899986 wait complete. 2024-05-10T10:44:14.844 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.289+0000 7f4fcb17d700 1 Processor -- start 2024-05-10T10:44:14.844 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.289+0000 7f4fcb17d700 1 -- start start 2024-05-10T10:44:14.844 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.289+0000 7f4fcb17d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fc4109c10 0x7f4fc419c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:14.844 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.289+0000 7f4fcb17d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc410c9b0 con 0x7f4fc4109c10 2024-05-10T10:44:14.844 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.290+0000 7f4fc8f19700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fc4109c10 0x7f4fc419c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:14.844 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.290+0000 7f4fc8f19700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fc4109c10 0x7f4fc419c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36788/0 (socket says 172.21.15.107:36788) 2024-05-10T10:44:14.845 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.290+0000 7f4fc8f19700 1 -- 172.21.15.107:0/2597326835 learned_addr learned my addr 172.21.15.107:0/2597326835 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:14.845 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.290+0000 7f4fc8f19700 1 -- 172.21.15.107:0/2597326835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc419cd70 con 0x7f4fc4109c10 2024-05-10T10:44:14.845 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.290+0000 7f4fc8f19700 1 --2- 172.21.15.107:0/2597326835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fc4109c10 0x7f4fc419c830 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8000c00 tx=0x7f4fb8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:14.845 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.290+0000 7f4fc1ffb700 1 -- 172.21.15.107:0/2597326835 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fb8003db0 con 0x7f4fc4109c10 2024-05-10T10:44:14.845 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.290+0000 7f4fc1ffb700 1 -- 172.21.15.107:0/2597326835 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fb8011630 con 0x7f4fc4109c10 2024-05-10T10:44:14.845 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.290+0000 7f4fcb17d700 1 -- 172.21.15.107:0/2597326835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc419d000 con 0x7f4fc4109c10 2024-05-10T10:44:14.845 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.290+0000 7f4fc1ffb700 1 -- 172.21.15.107:0/2597326835 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fb8011950 con 0x7f4fc4109c10 2024-05-10T10:44:14.845 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.290+0000 7f4fcb17d700 1 -- 172.21.15.107:0/2597326835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc419fcf0 con 0x7f4fc4109c10 2024-05-10T10:44:14.845 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.290+0000 7f4fc1ffb700 1 -- 172.21.15.107:0/2597326835 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4fb801a460 con 0x7f4fc4109c10 2024-05-10T10:44:14.845 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.291+0000 7f4fc1ffb700 1 -- 172.21.15.107:0/2597326835 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4fb801b780 con 0x7f4fc4109c10 2024-05-10T10:44:14.845 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.291+0000 7f4fcb17d700 1 -- 172.21.15.107:0/2597326835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc4064b00 con 0x7f4fc4109c10 2024-05-10T10:44:14.845 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.294+0000 7f4fc1ffb700 1 -- 172.21.15.107:0/2597326835 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f4fb801ba20 con 0x7f4fc4109c10 2024-05-10T10:44:14.845 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.367+0000 7f4fcb17d700 1 -- 172.21.15.107:0/2597326835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f4fc402e7f0 con 0x7f4fc4109c10 2024-05-10T10:44:14.845 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.368+0000 7f4fc1ffb700 1 -- 172.21.15.107:0/2597326835 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+316 (secure 0 0 0) 0x7f4fb801bc00 con 0x7f4fc4109c10 2024-05-10T10:44:14.845 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.368+0000 7f4fcb17d700 1 -- 172.21.15.107:0/2597326835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fc4109c10 msgr2=0x7f4fc419c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:14.846 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.368+0000 7f4fcb17d700 1 --2- 172.21.15.107:0/2597326835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fc4109c10 0x7f4fc419c830 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8000c00 tx=0x7f4fb8004750 comp rx=0 tx=0).stop 2024-05-10T10:44:14.846 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.369+0000 7f4fcb17d700 1 -- 172.21.15.107:0/2597326835 shutdown_connections 2024-05-10T10:44:14.846 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.369+0000 7f4fcb17d700 1 --2- 172.21.15.107:0/2597326835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fc4109c10 0x7f4fc419c830 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:14.846 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.369+0000 7f4fcb17d700 1 -- 172.21.15.107:0/2597326835 >> 172.21.15.107:0/2597326835 conn(0x7f4fc4103620 msgr2=0x7f4fc4105900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:14.846 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.369+0000 7f4fcb17d700 1 -- 172.21.15.107:0/2597326835 shutdown_connections 2024-05-10T10:44:14.846 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:14.369+0000 7f4fcb17d700 1 -- 172.21.15.107:0/2597326835 wait complete. 2024-05-10T10:44:14.846 INFO:teuthology.orchestra.run.smithi107.stdout:mon is available 2024-05-10T10:44:14.846 INFO:teuthology.orchestra.run.smithi107.stdout:Assimilating anything we can from ceph.conf... 2024-05-10T10:44:15.227 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:15 smithi107 ceph-mon[29994]: from='client.? 172.21.15.107:0/2597326835' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-10T10:44:15.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-05-10T10:44:15.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout [global] 2024-05-10T10:44:15.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout fsid = 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:44:15.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-10T10:44:15.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.107:3300,v1:172.21.15.107:6789] 2024-05-10T10:44:15.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-10T10:44:15.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-10T10:44:15.932 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-10T10:44:15.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-10T10:44:15.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-05-10T10:44:15.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-10T10:44:15.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-10T10:44:15.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-05-10T10:44:15.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout [osd] 2024-05-10T10:44:15.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-05-10T10:44:15.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-10T10:44:15.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-10T10:44:15.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-10T10:44:15.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-10T10:44:15.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-10T10:44:15.933 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.260+0000 7fa933fe9700 1 Processor -- start 2024-05-10T10:44:15.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.260+0000 7fa933fe9700 1 -- start start 2024-05-10T10:44:15.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.260+0000 7fa933fe9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa92c07eda0 0x7fa92c07d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:15.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.260+0000 7fa933fe9700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa92c07d8a0 con 0x7fa92c07eda0 2024-05-10T10:44:15.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.260+0000 7fa931d85700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa92c07eda0 0x7fa92c07d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:15.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.260+0000 7fa931d85700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa92c07eda0 0x7fa92c07d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36804/0 (socket says 172.21.15.107:36804) 2024-05-10T10:44:15.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.260+0000 7fa931d85700 1 -- 172.21.15.107:0/2535629792 learned_addr learned my addr 172.21.15.107:0/2535629792 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:15.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.260+0000 7fa931d85700 1 -- 172.21.15.107:0/2535629792 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa92c07da20 con 0x7fa92c07eda0 2024-05-10T10:44:15.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.261+0000 7fa931d85700 1 --2- 172.21.15.107:0/2535629792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa92c07eda0 0x7fa92c07d360 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa924009e80 tx=0x7fa92400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc77db024fba64bc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:15.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.261+0000 7fa930d83700 1 -- 172.21.15.107:0/2535629792 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa924017070 con 0x7fa92c07eda0 2024-05-10T10:44:15.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.261+0000 7fa930d83700 1 -- 172.21.15.107:0/2535629792 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa924003a20 con 0x7fa92c07eda0 2024-05-10T10:44:15.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.261+0000 7fa930d83700 1 -- 172.21.15.107:0/2535629792 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa924003d20 con 0x7fa92c07eda0 2024-05-10T10:44:15.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.261+0000 7fa933fe9700 1 -- 172.21.15.107:0/2535629792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa92c07eda0 msgr2=0x7fa92c07d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:15.934 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.261+0000 7fa933fe9700 1 --2- 172.21.15.107:0/2535629792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa92c07eda0 0x7fa92c07d360 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa924009e80 tx=0x7fa92400b330 comp rx=0 tx=0).stop 2024-05-10T10:44:15.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.261+0000 7fa933fe9700 1 -- 172.21.15.107:0/2535629792 shutdown_connections 2024-05-10T10:44:15.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.261+0000 7fa933fe9700 1 --2- 172.21.15.107:0/2535629792 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa92c07eda0 0x7fa92c07d360 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:15.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.261+0000 7fa933fe9700 1 -- 172.21.15.107:0/2535629792 >> 172.21.15.107:0/2535629792 conn(0x7fa92c1048b0 msgr2=0x7fa92c106cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:15.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.261+0000 7fa933fe9700 1 -- 172.21.15.107:0/2535629792 shutdown_connections 2024-05-10T10:44:15.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.261+0000 7fa933fe9700 1 -- 172.21.15.107:0/2535629792 wait complete. 2024-05-10T10:44:15.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.262+0000 7fa933fe9700 1 Processor -- start 2024-05-10T10:44:15.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.262+0000 7fa933fe9700 1 -- start start 2024-05-10T10:44:15.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.262+0000 7fa933fe9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa92c07eda0 0x7fa92c19ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:15.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.262+0000 7fa933fe9700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa92c07def0 con 0x7fa92c07eda0 2024-05-10T10:44:15.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.262+0000 7fa931d85700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa92c07eda0 0x7fa92c19ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:15.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.262+0000 7fa931d85700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa92c07eda0 0x7fa92c19ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36820/0 (socket says 172.21.15.107:36820) 2024-05-10T10:44:15.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.262+0000 7fa931d85700 1 -- 172.21.15.107:0/2996667110 learned_addr learned my addr 172.21.15.107:0/2996667110 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:15.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.263+0000 7fa931d85700 1 -- 172.21.15.107:0/2996667110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa92c19ef40 con 0x7fa92c07eda0 2024-05-10T10:44:15.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.263+0000 7fa931d85700 1 --2- 172.21.15.107:0/2996667110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa92c07eda0 0x7fa92c19ea00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fa92c07e430 tx=0x7fa924004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:15.935 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.263+0000 7fa92affd700 1 -- 172.21.15.107:0/2996667110 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa924022020 con 0x7fa92c07eda0 2024-05-10T10:44:15.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.263+0000 7fa92affd700 1 -- 172.21.15.107:0/2996667110 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa924018040 con 0x7fa92c07eda0 2024-05-10T10:44:15.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.263+0000 7fa92affd700 1 -- 172.21.15.107:0/2996667110 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa924017070 con 0x7fa92c07eda0 2024-05-10T10:44:15.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.263+0000 7fa933fe9700 1 -- 172.21.15.107:0/2996667110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa92c19f1d0 con 0x7fa92c07eda0 2024-05-10T10:44:15.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.263+0000 7fa933fe9700 1 -- 172.21.15.107:0/2996667110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa92c1a1ec0 con 0x7fa92c07eda0 2024-05-10T10:44:15.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.263+0000 7fa92affd700 1 -- 172.21.15.107:0/2996667110 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa924025020 con 0x7fa92c07eda0 2024-05-10T10:44:15.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.263+0000 7fa92affd700 1 -- 172.21.15.107:0/2996667110 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa92400f050 con 0x7fa92c07eda0 2024-05-10T10:44:15.936 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.264+0000 7fa933fe9700 1 -- 172.21.15.107:0/2996667110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa92c064b00 con 0x7fa92c07eda0 2024-05-10T10:44:15.937 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.266+0000 7fa92affd700 1 -- 172.21.15.107:0/2996667110 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa92402c030 con 0x7fa92c07eda0 2024-05-10T10:44:15.937 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.332+0000 7fa933fe9700 1 -- 172.21.15.107:0/2996667110 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fa92c02e760 con 0x7fa92c07eda0 2024-05-10T10:44:15.937 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.335+0000 7fa92affd700 1 -- 172.21.15.107:0/2996667110 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+494 (secure 0 0 0) 0x7fa92401e480 con 0x7fa92c07eda0 2024-05-10T10:44:15.937 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.336+0000 7fa92affd700 1 -- 172.21.15.107:0/2996667110 <== mon.0 v2:172.21.15.107:3300/0 8 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fa924003a20 con 0x7fa92c07eda0 2024-05-10T10:44:15.937 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.336+0000 7fa933fe9700 1 -- 172.21.15.107:0/2996667110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa92c07eda0 msgr2=0x7fa92c19ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:15.937 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.336+0000 7fa933fe9700 1 --2- 172.21.15.107:0/2996667110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa92c07eda0 0x7fa92c19ea00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fa92c07e430 tx=0x7fa924004ad0 comp rx=0 tx=0).stop 2024-05-10T10:44:15.937 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.336+0000 7fa933fe9700 1 -- 172.21.15.107:0/2996667110 shutdown_connections 2024-05-10T10:44:15.937 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.336+0000 7fa933fe9700 1 --2- 172.21.15.107:0/2996667110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa92c07eda0 0x7fa92c19ea00 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:15.937 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.336+0000 7fa933fe9700 1 -- 172.21.15.107:0/2996667110 >> 172.21.15.107:0/2996667110 conn(0x7fa92c1048b0 msgr2=0x7fa92c106b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:15.937 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.337+0000 7fa933fe9700 1 -- 172.21.15.107:0/2996667110 shutdown_connections 2024-05-10T10:44:15.937 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:15.337+0000 7fa933fe9700 1 -- 172.21.15.107:0/2996667110 wait complete. 2024-05-10T10:44:15.937 INFO:teuthology.orchestra.run.smithi107.stdout:Generating new minimal ceph.conf... 2024-05-10T10:44:16.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:16 smithi107 ceph-mon[29994]: from='client.? 172.21.15.107:0/2996667110' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-10T10:44:16.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:16 smithi107 ceph-mon[29994]: from='client.? 172.21.15.107:0/2996667110' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-10T10:44:17.013 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.348+0000 7f33c2eec700 1 Processor -- start 2024-05-10T10:44:17.013 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.348+0000 7f33c2eec700 1 -- start start 2024-05-10T10:44:17.013 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.348+0000 7f33c2eec700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33bc109250 0x7f33bc109670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:17.013 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.348+0000 7f33c2eec700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f33bc109bb0 con 0x7f33bc109250 2024-05-10T10:44:17.013 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.348+0000 7f33c0c88700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33bc109250 0x7f33bc109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:17.013 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.348+0000 7f33c0c88700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33bc109250 0x7f33bc109670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36824/0 (socket says 172.21.15.107:36824) 2024-05-10T10:44:17.013 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.348+0000 7f33c0c88700 1 -- 172.21.15.107:0/3225426244 learned_addr learned my addr 172.21.15.107:0/3225426244 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:17.014 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.348+0000 7f33c0c88700 1 -- 172.21.15.107:0/3225426244 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33bc109d30 con 0x7f33bc109250 2024-05-10T10:44:17.014 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.349+0000 7f33c0c88700 1 --2- 172.21.15.107:0/3225426244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33bc109250 0x7f33bc109670 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f33b00098a0 tx=0x7f33b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6c4375d3d13fe4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:17.014 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.349+0000 7f33bb7fe700 1 -- 172.21.15.107:0/3225426244 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33b0004160 con 0x7f33bc109250 2024-05-10T10:44:17.014 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.349+0000 7f33bb7fe700 1 -- 172.21.15.107:0/3225426244 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f33b0004300 con 0x7f33bc109250 2024-05-10T10:44:17.014 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.349+0000 7f33bb7fe700 1 -- 172.21.15.107:0/3225426244 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33b0011b20 con 0x7f33bc109250 2024-05-10T10:44:17.014 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.349+0000 7f33c2eec700 1 -- 172.21.15.107:0/3225426244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33bc109250 msgr2=0x7f33bc109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:17.014 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.349+0000 7f33c2eec700 1 --2- 172.21.15.107:0/3225426244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33bc109250 0x7f33bc109670 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f33b00098a0 tx=0x7f33b0009bb0 comp rx=0 tx=0).stop 2024-05-10T10:44:17.014 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.349+0000 7f33c2eec700 1 -- 172.21.15.107:0/3225426244 shutdown_connections 2024-05-10T10:44:17.014 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.349+0000 7f33c2eec700 1 --2- 172.21.15.107:0/3225426244 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33bc109250 0x7f33bc109670 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:17.014 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.349+0000 7f33c2eec700 1 -- 172.21.15.107:0/3225426244 >> 172.21.15.107:0/3225426244 conn(0x7f33bc1048b0 msgr2=0x7f33bc106cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:17.014 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.349+0000 7f33c2eec700 1 -- 172.21.15.107:0/3225426244 shutdown_connections 2024-05-10T10:44:17.014 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.349+0000 7f33c2eec700 1 -- 172.21.15.107:0/3225426244 wait complete. 2024-05-10T10:44:17.015 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.350+0000 7f33c2eec700 1 Processor -- start 2024-05-10T10:44:17.015 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.350+0000 7f33c2eec700 1 -- start start 2024-05-10T10:44:17.015 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.350+0000 7f33c2eec700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33bc109250 0x7f33bc19cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:17.015 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.350+0000 7f33c2eec700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f33bc10b180 con 0x7f33bc109250 2024-05-10T10:44:17.015 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.350+0000 7f33c0c88700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33bc109250 0x7f33bc19cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:17.015 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.350+0000 7f33c0c88700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33bc109250 0x7f33bc19cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36828/0 (socket says 172.21.15.107:36828) 2024-05-10T10:44:17.015 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.350+0000 7f33c0c88700 1 -- 172.21.15.107:0/4890503 learned_addr learned my addr 172.21.15.107:0/4890503 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:17.015 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.351+0000 7f33c0c88700 1 -- 172.21.15.107:0/4890503 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33bc19d4f0 con 0x7f33bc109250 2024-05-10T10:44:17.015 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.351+0000 7f33c0c88700 1 --2- 172.21.15.107:0/4890503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33bc109250 0x7f33bc19cfb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f33b0006af0 tx=0x7f33b0011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:17.015 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.351+0000 7f33b9ffb700 1 -- 172.21.15.107:0/4890503 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33b00039a0 con 0x7f33bc109250 2024-05-10T10:44:17.015 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.351+0000 7f33b9ffb700 1 -- 172.21.15.107:0/4890503 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f33b0003b40 con 0x7f33bc109250 2024-05-10T10:44:17.016 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.351+0000 7f33c2eec700 1 -- 172.21.15.107:0/4890503 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33bc19d780 con 0x7f33bc109250 2024-05-10T10:44:17.016 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.351+0000 7f33b9ffb700 1 -- 172.21.15.107:0/4890503 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33b0019670 con 0x7f33bc109250 2024-05-10T10:44:17.016 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.351+0000 7f33c2eec700 1 -- 172.21.15.107:0/4890503 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33bc19dbe0 con 0x7f33bc109250 2024-05-10T10:44:17.016 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.351+0000 7f33b9ffb700 1 -- 172.21.15.107:0/4890503 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f33b0019cc0 con 0x7f33bc109250 2024-05-10T10:44:17.016 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.351+0000 7f33b9ffb700 1 -- 172.21.15.107:0/4890503 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f33b0024770 con 0x7f33bc109250 2024-05-10T10:44:17.016 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.352+0000 7f33c2eec700 1 -- 172.21.15.107:0/4890503 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33bc064b00 con 0x7f33bc109250 2024-05-10T10:44:17.016 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.354+0000 7f33b9ffb700 1 -- 172.21.15.107:0/4890503 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f33b0043e50 con 0x7f33bc109250 2024-05-10T10:44:17.016 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.422+0000 7f33c2eec700 1 -- 172.21.15.107:0/4890503 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f33bc1a0650 con 0x7f33bc109250 2024-05-10T10:44:17.016 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.422+0000 7f33b9ffb700 1 -- 172.21.15.107:0/4890503 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7f33b0032020 con 0x7f33bc109250 2024-05-10T10:44:17.016 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.423+0000 7f33c2eec700 1 -- 172.21.15.107:0/4890503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33bc109250 msgr2=0x7f33bc19cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:17.016 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.423+0000 7f33c2eec700 1 --2- 172.21.15.107:0/4890503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33bc109250 0x7f33bc19cfb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f33b0006af0 tx=0x7f33b0011ce0 comp rx=0 tx=0).stop 2024-05-10T10:44:17.016 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.423+0000 7f33c2eec700 1 -- 172.21.15.107:0/4890503 shutdown_connections 2024-05-10T10:44:17.016 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.423+0000 7f33c2eec700 1 --2- 172.21.15.107:0/4890503 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f33bc109250 0x7f33bc19cfb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:17.017 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.423+0000 7f33c2eec700 1 -- 172.21.15.107:0/4890503 >> 172.21.15.107:0/4890503 conn(0x7f33bc1048b0 msgr2=0x7f33bc105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:17.017 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.423+0000 7f33c2eec700 1 -- 172.21.15.107:0/4890503 shutdown_connections 2024-05-10T10:44:17.017 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:16.423+0000 7f33c2eec700 1 -- 172.21.15.107:0/4890503 wait complete. 2024-05-10T10:44:17.017 INFO:teuthology.orchestra.run.smithi107.stdout:Restarting the monitor... 2024-05-10T10:44:17.284 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:17 smithi107 systemd[1]: Stopping Ceph mon.a for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T10:44:17.284 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:17 smithi107 ceph-mon[29994]: from='client.? 172.21.15.107:0/4890503' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:44:17.615 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:17 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-a[29990]: 2024-05-10T10:44:17.281+0000 7ff146861700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T10:44:17.616 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:17 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-a[29990]: 2024-05-10T10:44:17.281+0000 7ff146861700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-10T10:44:17.616 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:17 smithi107 podman[30250]: 2024-05-10 10:44:17.293158282 +0000 UTC m=+0.116487300 container died d9ba0f11a58ee3f54132c007e6ace55f5fe7a8f9e9db44347403f59966c42468 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.license=GPLv2, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-10T10:44:17.616 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:17 smithi107 podman[30250]: 2024-05-10 10:44:17.615414278 +0000 UTC m=+0.438743296 container cleanup d9ba0f11a58ee3f54132c007e6ace55f5fe7a8f9e9db44347403f59966c42468 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_BRANCH=HEAD) 2024-05-10T10:44:17.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:17 smithi107 bash[30250]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-a 2024-05-10T10:44:17.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:17 smithi107 podman[30264]: 2024-05-10 10:44:17.847336506 +0000 UTC m=+0.551143635 container remove d9ba0f11a58ee3f54132c007e6ace55f5fe7a8f9e9db44347403f59966c42468 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, ceph=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-10T10:44:18.301 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 systemd[1]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-10T10:44:18.301 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 systemd[1]: Stopped Ceph mon.a for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:44:18.301 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 systemd[1]: Starting Ceph mon.a for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T10:44:18.557 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 podman[30354]: 2024-05-10 10:44:18.300974897 +0000 UTC m=+0.105854320 container create 69577f9caecb2731fbce95497d20bb4fe187c7a6f89bfc0c47037bcb4a6af545 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, maintainer=Guillaume Abrioux , RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08) 2024-05-10T10:44:18.557 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 podman[30354]: 2024-05-10 10:44:18.212931195 +0000 UTC m=+0.017810587 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T10:44:18.558 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 podman[30354]: 2024-05-10 10:44:18.528802395 +0000 UTC m=+0.333681785 container init 69577f9caecb2731fbce95497d20bb4fe187c7a6f89bfc0c47037bcb4a6af545 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_BRANCH=HEAD, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507) 2024-05-10T10:44:18.558 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 podman[30354]: 2024-05-10 10:44:18.532392178 +0000 UTC m=+0.337271561 container start 69577f9caecb2731fbce95497d20bb4fe187c7a6f89bfc0c47037bcb4a6af545 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507) 2024-05-10T10:44:18.616 INFO:teuthology.orchestra.run.smithi107.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-10T10:44:18.858 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: set uid:gid to 167:167 (ceph:ceph) 2024-05-10T10:44:18.858 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: ceph version 19.0.0-3449-gd39fa088 (d39fa08867836ac070c47cb66c782fa559fd480b) squid (dev), process ceph-mon, pid 2 2024-05-10T10:44:18.858 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: pidfile_write: ignore empty --pid-file 2024-05-10T10:44:18.859 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: load: jerasure load: lrc 2024-05-10T10:44:18.859 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: RocksDB version: 7.9.2 2024-05-10T10:44:18.859 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Git sha 0 2024-05-10T10:44:18.859 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Compile date 2024-05-10 01:38:55 2024-05-10T10:44:18.859 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: DB SUMMARY 2024-05-10T10:44:18.859 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: DB Session ID: MXZOW1H5WD09TTHMKO10 2024-05-10T10:44:18.859 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: CURRENT file: CURRENT 2024-05-10T10:44:18.859 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: IDENTITY file: IDENTITY 2024-05-10T10:44:18.859 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-10T10:44:18.860 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-10T10:44:18.860 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106385 ; 2024-05-10T10:44:18.860 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.error_if_exists: 0 2024-05-10T10:44:18.860 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.create_if_missing: 0 2024-05-10T10:44:18.860 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.paranoid_checks: 1 2024-05-10T10:44:18.860 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-10T10:44:18.860 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-10T10:44:18.860 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-10T10:44:18.860 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.env: 0x5633972e0cc0 2024-05-10T10:44:18.861 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.fs: PosixFileSystem 2024-05-10T10:44:18.861 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.info_log: 0x563398805da0 2024-05-10T10:44:18.861 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_file_opening_threads: 16 2024-05-10T10:44:18.861 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.statistics: (nil) 2024-05-10T10:44:18.861 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.use_fsync: 0 2024-05-10T10:44:18.861 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_log_file_size: 0 2024-05-10T10:44:18.861 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-10T10:44:18.861 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-10T10:44:18.861 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.keep_log_file_num: 1000 2024-05-10T10:44:18.862 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.recycle_log_file_num: 0 2024-05-10T10:44:18.862 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.allow_fallocate: 1 2024-05-10T10:44:18.862 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.allow_mmap_reads: 0 2024-05-10T10:44:18.862 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.allow_mmap_writes: 0 2024-05-10T10:44:18.862 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.use_direct_reads: 0 2024-05-10T10:44:18.862 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-10T10:44:18.862 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.create_missing_column_families: 0 2024-05-10T10:44:18.862 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.db_log_dir: 2024-05-10T10:44:18.863 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.wal_dir: 2024-05-10T10:44:18.863 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-10T10:44:18.863 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-10T10:44:18.863 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-10T10:44:18.863 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-10T10:44:18.863 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-10T10:44:18.863 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-10T10:44:18.863 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.advise_random_on_open: 1 2024-05-10T10:44:18.864 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.db_write_buffer_size: 0 2024-05-10T10:44:18.864 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.write_buffer_manager: 0x5633987d70e0 2024-05-10T10:44:18.864 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-10T10:44:18.864 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-10T10:44:18.864 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-10T10:44:18.864 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.rate_limiter: (nil) 2024-05-10T10:44:18.864 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-10T10:44:18.864 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.wal_recovery_mode: 2 2024-05-10T10:44:18.864 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.enable_thread_tracking: 0 2024-05-10T10:44:18.864 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.enable_pipelined_write: 0 2024-05-10T10:44:18.865 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.unordered_write: 0 2024-05-10T10:44:18.865 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-10T10:44:18.865 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-10T10:44:18.865 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-10T10:44:18.865 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-10T10:44:18.865 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.row_cache: None 2024-05-10T10:44:18.865 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.wal_filter: None 2024-05-10T10:44:18.865 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-10T10:44:18.865 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.allow_ingest_behind: 0 2024-05-10T10:44:18.865 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.two_write_queues: 0 2024-05-10T10:44:18.865 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.manual_wal_flush: 0 2024-05-10T10:44:18.866 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.wal_compression: 0 2024-05-10T10:44:18.866 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.atomic_flush: 0 2024-05-10T10:44:18.866 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-10T10:44:18.866 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-10T10:44:18.866 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-10T10:44:18.866 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.log_readahead_size: 0 2024-05-10T10:44:18.866 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-10T10:44:18.866 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.best_efforts_recovery: 0 2024-05-10T10:44:18.866 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-10T10:44:18.866 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-10T10:44:18.866 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.allow_data_in_errors: 0 2024-05-10T10:44:18.867 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.db_host_id: __hostname__ 2024-05-10T10:44:18.867 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-10T10:44:18.868 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_background_jobs: 2 2024-05-10T10:44:18.868 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_background_compactions: -1 2024-05-10T10:44:18.868 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_subcompactions: 1 2024-05-10T10:44:18.868 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-10T10:44:18.868 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-10T10:44:18.868 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-10T10:44:18.868 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_total_wal_size: 0 2024-05-10T10:44:18.868 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-10T10:44:18.869 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-10T10:44:18.869 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-10T10:44:18.869 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-10T10:44:18.869 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_open_files: -1 2024-05-10T10:44:18.869 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.bytes_per_sync: 0 2024-05-10T10:44:18.869 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-10T10:44:18.869 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-10T10:44:18.869 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compaction_readahead_size: 0 2024-05-10T10:44:18.869 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_background_flushes: -1 2024-05-10T10:44:18.869 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Compression algorithms supported: 2024-05-10T10:44:18.869 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-10T10:44:18.869 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: kZSTD supported: 0 2024-05-10T10:44:18.869 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: kXpressCompression supported: 0 2024-05-10T10:44:18.869 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: kLZ4HCCompression supported: 1 2024-05-10T10:44:18.870 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: kZlibCompression supported: 1 2024-05-10T10:44:18.870 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: kSnappyCompression supported: 1 2024-05-10T10:44:18.870 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: kLZ4Compression supported: 1 2024-05-10T10:44:18.870 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: kBZip2Compression supported: 0 2024-05-10T10:44:18.870 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-10T10:44:18.870 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-10T10:44:18.870 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-10T10:44:18.870 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-10T10:44:18.870 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-10T10:44:18.870 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.merge_operator: 2024-05-10T10:44:18.870 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compaction_filter: None 2024-05-10T10:44:18.870 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compaction_filter_factory: None 2024-05-10T10:44:18.870 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.sst_partitioner_factory: None 2024-05-10T10:44:18.870 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-10T10:44:18.871 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-10T10:44:18.871 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563398805f60) 2024-05-10T10:44:18.871 INFO:journalctl@ceph.mon.a.smithi107.stdout: cache_index_and_filter_blocks: 1 2024-05-10T10:44:18.871 INFO:journalctl@ceph.mon.a.smithi107.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-10T10:44:18.871 INFO:journalctl@ceph.mon.a.smithi107.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-10T10:44:18.871 INFO:journalctl@ceph.mon.a.smithi107.stdout: pin_top_level_index_and_filter: 1 2024-05-10T10:44:18.871 INFO:journalctl@ceph.mon.a.smithi107.stdout: index_type: 0 2024-05-10T10:44:18.871 INFO:journalctl@ceph.mon.a.smithi107.stdout: data_block_index_type: 0 2024-05-10T10:44:18.871 INFO:journalctl@ceph.mon.a.smithi107.stdout: index_shortening: 1 2024-05-10T10:44:18.871 INFO:journalctl@ceph.mon.a.smithi107.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-10T10:44:18.871 INFO:journalctl@ceph.mon.a.smithi107.stdout: checksum: 4 2024-05-10T10:44:18.871 INFO:journalctl@ceph.mon.a.smithi107.stdout: no_block_cache: 0 2024-05-10T10:44:18.871 INFO:journalctl@ceph.mon.a.smithi107.stdout: block_cache: 0x5633988091f0 2024-05-10T10:44:18.871 INFO:journalctl@ceph.mon.a.smithi107.stdout: block_cache_name: BinnedLRUCache 2024-05-10T10:44:18.872 INFO:journalctl@ceph.mon.a.smithi107.stdout: block_cache_options: 2024-05-10T10:44:18.872 INFO:journalctl@ceph.mon.a.smithi107.stdout: capacity : 536870912 2024-05-10T10:44:18.872 INFO:journalctl@ceph.mon.a.smithi107.stdout: num_shard_bits : 4 2024-05-10T10:44:18.872 INFO:journalctl@ceph.mon.a.smithi107.stdout: strict_capacity_limit : 0 2024-05-10T10:44:18.872 INFO:journalctl@ceph.mon.a.smithi107.stdout: high_pri_pool_ratio: 0.000 2024-05-10T10:44:18.872 INFO:journalctl@ceph.mon.a.smithi107.stdout: block_cache_compressed: (nil) 2024-05-10T10:44:18.872 INFO:journalctl@ceph.mon.a.smithi107.stdout: persistent_cache: (nil) 2024-05-10T10:44:18.872 INFO:journalctl@ceph.mon.a.smithi107.stdout: block_size: 4096 2024-05-10T10:44:18.872 INFO:journalctl@ceph.mon.a.smithi107.stdout: block_size_deviation: 10 2024-05-10T10:44:18.872 INFO:journalctl@ceph.mon.a.smithi107.stdout: block_restart_interval: 16 2024-05-10T10:44:18.872 INFO:journalctl@ceph.mon.a.smithi107.stdout: index_block_restart_interval: 1 2024-05-10T10:44:18.872 INFO:journalctl@ceph.mon.a.smithi107.stdout: metadata_block_size: 4096 2024-05-10T10:44:18.872 INFO:journalctl@ceph.mon.a.smithi107.stdout: partition_filters: 0 2024-05-10T10:44:18.872 INFO:journalctl@ceph.mon.a.smithi107.stdout: use_delta_encoding: 1 2024-05-10T10:44:18.872 INFO:journalctl@ceph.mon.a.smithi107.stdout: filter_policy: bloomfilter 2024-05-10T10:44:18.873 INFO:journalctl@ceph.mon.a.smithi107.stdout: whole_key_filtering: 1 2024-05-10T10:44:18.873 INFO:journalctl@ceph.mon.a.smithi107.stdout: verify_compression: 0 2024-05-10T10:44:18.873 INFO:journalctl@ceph.mon.a.smithi107.stdout: read_amp_bytes_per_bit: 0 2024-05-10T10:44:18.873 INFO:journalctl@ceph.mon.a.smithi107.stdout: format_version: 5 2024-05-10T10:44:18.873 INFO:journalctl@ceph.mon.a.smithi107.stdout: enable_index_compression: 1 2024-05-10T10:44:18.873 INFO:journalctl@ceph.mon.a.smithi107.stdout: block_align: 0 2024-05-10T10:44:18.873 INFO:journalctl@ceph.mon.a.smithi107.stdout: max_auto_readahead_size: 262144 2024-05-10T10:44:18.873 INFO:journalctl@ceph.mon.a.smithi107.stdout: prepopulate_block_cache: 0 2024-05-10T10:44:18.873 INFO:journalctl@ceph.mon.a.smithi107.stdout: initial_auto_readahead_size: 8192 2024-05-10T10:44:18.873 INFO:journalctl@ceph.mon.a.smithi107.stdout: num_file_reads_for_auto_readahead: 2 2024-05-10T10:44:18.873 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.write_buffer_size: 33554432 2024-05-10T10:44:18.873 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_write_buffer_number: 2 2024-05-10T10:44:18.873 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compression: NoCompression 2024-05-10T10:44:18.873 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.bottommost_compression: Disabled 2024-05-10T10:44:18.873 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.prefix_extractor: nullptr 2024-05-10T10:44:18.874 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-10T10:44:18.874 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.num_levels: 7 2024-05-10T10:44:18.874 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-10T10:44:18.874 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-10T10:44:18.874 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-10T10:44:18.874 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-10T10:44:18.874 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-10T10:44:18.874 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-10T10:44:18.874 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-10T10:44:18.874 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-10T10:44:18.875 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-10T10:44:18.875 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-10T10:44:18.875 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-10T10:44:18.875 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-10T10:44:18.875 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-10T10:44:18.875 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compression_opts.level: 32767 2024-05-10T10:44:18.875 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compression_opts.strategy: 0 2024-05-10T10:44:18.875 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-10T10:44:18.875 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-10T10:44:18.876 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-10T10:44:18.876 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-10T10:44:18.876 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compression_opts.enabled: false 2024-05-10T10:44:18.876 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-10T10:44:18.876 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-10T10:44:18.876 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-10T10:44:18.876 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-10T10:44:18.876 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.target_file_size_base: 67108864 2024-05-10T10:44:18.876 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-10T10:44:18.876 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-10T10:44:18.877 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-10T10:44:18.877 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-10T10:44:18.877 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-10T10:44:18.877 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-10T10:44:18.877 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-10T10:44:18.877 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-10T10:44:18.877 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-10T10:44:18.877 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-10T10:44:18.877 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-10T10:44:18.877 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-10T10:44:18.877 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-10T10:44:18.878 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-10T10:44:18.878 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.arena_block_size: 1048576 2024-05-10T10:44:18.878 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-10T10:44:18.878 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-10T10:44:18.878 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.disable_auto_compactions: 0 2024-05-10T10:44:18.878 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-10T10:44:18.878 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-10T10:44:18.878 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-10T10:44:18.878 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-10T10:44:18.878 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-10T10:44:18.878 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-10T10:44:18.878 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-10T10:44:18.878 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-10T10:44:18.878 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-10T10:44:18.879 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-10T10:44:18.879 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-10T10:44:18.879 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.inplace_update_support: 0 2024-05-10T10:44:18.879 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-10T10:44:18.879 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-10T10:44:18.879 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-10T10:44:18.879 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-10T10:44:18.879 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.bloom_locality: 0 2024-05-10T10:44:18.879 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.max_successive_merges: 0 2024-05-10T10:44:18.879 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-10T10:44:18.879 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.paranoid_file_checks: 0 2024-05-10T10:44:18.879 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.force_consistency_checks: 1 2024-05-10T10:44:18.879 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.report_bg_io_stats: 0 2024-05-10T10:44:18.879 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.ttl: 2592000 2024-05-10T10:44:18.880 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-10T10:44:18.880 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-10T10:44:18.880 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-10T10:44:18.880 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.enable_blob_files: false 2024-05-10T10:44:18.880 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.min_blob_size: 0 2024-05-10T10:44:18.880 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.blob_file_size: 268435456 2024-05-10T10:44:18.880 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-10T10:44:18.880 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-10T10:44:18.880 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-10T10:44:18.880 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-10T10:44:18.880 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-10T10:44:18.880 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.blob_file_starting_level: 0 2024-05-10T10:44:18.880 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-10T10:44:18.881 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-10T10:44:18.881 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-10T10:44:18.881 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c3d0bbc7-f143-46e4-8062-af3fcf77cb33 2024-05-10T10:44:18.881 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715337858563305, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-10T10:44:18.881 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-10T10:44:18.881 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715337858564320, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101274, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 336, "table_properties": {"data_size": 99163, "index_size": 303, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14451, "raw_average_key_size": 49, "raw_value_size": 91315, "raw_average_value_size": 313, "num_data_blocks": 12, "num_entries": 291, "num_filter_entries": 291, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715337858, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c3d0bbc7-f143-46e4-8062-af3fcf77cb33", "db_session_id": "MXZOW1H5WD09TTHMKO10", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-10T10:44:18.881 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715337858564411, "job": 1, "event": "recovery_finished"} 2024-05-10T10:44:18.882 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-10T10:44:18.882 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-10T10:44:18.882 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563398926000 2024-05-10T10:44:18.882 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: DB pointer 0x563398912000 2024-05-10T10:44:18.882 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-10T10:44:18.882 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-10T10:44:18.882 INFO:journalctl@ceph.mon.a.smithi107.stdout: ** DB Stats ** 2024-05-10T10:44:18.882 INFO:journalctl@ceph.mon.a.smithi107.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-10T10:44:18.883 INFO:journalctl@ceph.mon.a.smithi107.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-10T10:44:18.883 INFO:journalctl@ceph.mon.a.smithi107.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-10T10:44:18.883 INFO:journalctl@ceph.mon.a.smithi107.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-10T10:44:18.883 INFO:journalctl@ceph.mon.a.smithi107.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-10T10:44:18.883 INFO:journalctl@ceph.mon.a.smithi107.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-10T10:44:18.883 INFO:journalctl@ceph.mon.a.smithi107.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-10T10:44:18.883 INFO:journalctl@ceph.mon.a.smithi107.stdout: 2024-05-10T10:44:18.883 INFO:journalctl@ceph.mon.a.smithi107.stdout: ** Compaction Stats [default] ** 2024-05-10T10:44:18.883 INFO:journalctl@ceph.mon.a.smithi107.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-10T10:44:18.884 INFO:journalctl@ceph.mon.a.smithi107.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-10T10:44:18.884 INFO:journalctl@ceph.mon.a.smithi107.stdout: L0 2/0 100.76 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-10T10:44:18.884 INFO:journalctl@ceph.mon.a.smithi107.stdout: Sum 2/0 100.76 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-10T10:44:18.884 INFO:journalctl@ceph.mon.a.smithi107.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-10T10:44:18.884 INFO:journalctl@ceph.mon.a.smithi107.stdout: 2024-05-10T10:44:18.884 INFO:journalctl@ceph.mon.a.smithi107.stdout: ** Compaction Stats [default] ** 2024-05-10T10:44:18.884 INFO:journalctl@ceph.mon.a.smithi107.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-10T10:44:18.884 INFO:journalctl@ceph.mon.a.smithi107.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-10T10:44:18.885 INFO:journalctl@ceph.mon.a.smithi107.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 150.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-10T10:44:18.885 INFO:journalctl@ceph.mon.a.smithi107.stdout: 2024-05-10T10:44:18.885 INFO:journalctl@ceph.mon.a.smithi107.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-10T10:44:18.885 INFO:journalctl@ceph.mon.a.smithi107.stdout: 2024-05-10T10:44:18.885 INFO:journalctl@ceph.mon.a.smithi107.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-10T10:44:18.885 INFO:journalctl@ceph.mon.a.smithi107.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-10T10:44:18.885 INFO:journalctl@ceph.mon.a.smithi107.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-10T10:44:18.885 INFO:journalctl@ceph.mon.a.smithi107.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-10T10:44:18.886 INFO:journalctl@ceph.mon.a.smithi107.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-10T10:44:18.886 INFO:journalctl@ceph.mon.a.smithi107.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-10T10:44:18.886 INFO:journalctl@ceph.mon.a.smithi107.stdout: Cumulative compaction: 0.00 GB write, 32.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-10T10:44:18.886 INFO:journalctl@ceph.mon.a.smithi107.stdout: Interval compaction: 0.00 GB write, 32.10 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-10T10:44:18.886 INFO:journalctl@ceph.mon.a.smithi107.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-10T10:44:18.886 INFO:journalctl@ceph.mon.a.smithi107.stdout: Block cache BinnedLRUCache@0x5633988091f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-05-10T10:44:18.886 INFO:journalctl@ceph.mon.a.smithi107.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-05-10T10:44:18.886 INFO:journalctl@ceph.mon.a.smithi107.stdout: 2024-05-10T10:44:18.886 INFO:journalctl@ceph.mon.a.smithi107.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-10T10:44:18.887 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: starting mon.a rank 0 at public addrs [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] at bind addrs [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:44:18.887 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: mon.a@-1(???) e1 preinit fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:44:18.887 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: mon.a@-1(???).mds e1 new map 2024-05-10T10:44:18.887 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: mon.a@-1(???).mds e1 print_map 2024-05-10T10:44:18.887 INFO:journalctl@ceph.mon.a.smithi107.stdout: e1 2024-05-10T10:44:18.887 INFO:journalctl@ceph.mon.a.smithi107.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-10T10:44:18.887 INFO:journalctl@ceph.mon.a.smithi107.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-10T10:44:18.888 INFO:journalctl@ceph.mon.a.smithi107.stdout: legacy client fscid: -1 2024-05-10T10:44:18.888 INFO:journalctl@ceph.mon.a.smithi107.stdout: 2024-05-10T10:44:18.888 INFO:journalctl@ceph.mon.a.smithi107.stdout: No filesystems configured 2024-05-10T10:44:18.888 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-10T10:44:18.888 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-10T10:44:18.888 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-10T10:44:18.888 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-10T10:44:18.888 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-10T10:44:18.888 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 bash[30354]: 69577f9caecb2731fbce95497d20bb4fe187c7a6f89bfc0c47037bcb4a6af545 2024-05-10T10:44:18.889 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 systemd[1]: Started Ceph mon.a for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:44:18.889 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-10T10:44:18.889 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: monmap epoch 1 2024-05-10T10:44:18.889 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:44:18.889 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: last_changed 2024-05-10T10:44:10.080994+0000 2024-05-10T10:44:18.889 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: created 2024-05-10T10:44:10.080994+0000 2024-05-10T10:44:18.889 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: min_mon_release 19 (squid) 2024-05-10T10:44:18.889 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: election_strategy: 1 2024-05-10T10:44:18.889 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: 0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-05-10T10:44:18.890 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: fsmap 2024-05-10T10:44:18.890 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: osdmap e1: 0 total, 0 up, 0 in 2024-05-10T10:44:18.890 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:18 smithi107 ceph-mon[30373]: mgrmap e1: no daemons active 2024-05-10T10:44:19.868 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.075+0000 7f895fad2700 1 Processor -- start 2024-05-10T10:44:19.868 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.075+0000 7f895fad2700 1 -- start start 2024-05-10T10:44:19.869 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.076+0000 7f895fad2700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8958109650 0x7f8958109a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:19.869 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.076+0000 7f895fad2700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f895810a040 con 0x7f8958109650 2024-05-10T10:44:19.869 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.076+0000 7f895d86e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8958109650 0x7f8958109a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:19.869 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.076+0000 7f895d86e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8958109650 0x7f8958109a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35472/0 (socket says 172.21.15.107:35472) 2024-05-10T10:44:19.869 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.076+0000 7f895d86e700 1 -- 172.21.15.107:0/4259744398 learned_addr learned my addr 172.21.15.107:0/4259744398 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:19.869 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.076+0000 7f895d86e700 1 -- 172.21.15.107:0/4259744398 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8958108260 con 0x7f8958109650 2024-05-10T10:44:19.869 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.077+0000 7f895d86e700 1 --2- 172.21.15.107:0/4259744398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8958109650 0x7f8958109a70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f894c00bb40 tx=0x7f894c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4491ed2a7e8e665 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:19.869 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.077+0000 7f895c86c700 1 -- 172.21.15.107:0/4259744398 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f894c00dbe0 con 0x7f8958109650 2024-05-10T10:44:19.869 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.077+0000 7f895c86c700 1 -- 172.21.15.107:0/4259744398 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f894c0044e0 con 0x7f8958109650 2024-05-10T10:44:19.869 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.077+0000 7f895c86c700 1 -- 172.21.15.107:0/4259744398 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f894c010470 con 0x7f8958109650 2024-05-10T10:44:19.869 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.077+0000 7f895fad2700 1 -- 172.21.15.107:0/4259744398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8958109650 msgr2=0x7f8958109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:19.869 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.077+0000 7f895fad2700 1 --2- 172.21.15.107:0/4259744398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8958109650 0x7f8958109a70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f894c00bb40 tx=0x7f894c00be50 comp rx=0 tx=0).stop 2024-05-10T10:44:19.869 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.077+0000 7f895fad2700 1 -- 172.21.15.107:0/4259744398 shutdown_connections 2024-05-10T10:44:19.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.077+0000 7f895fad2700 1 --2- 172.21.15.107:0/4259744398 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8958109650 0x7f8958109a70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:19.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.077+0000 7f895fad2700 1 -- 172.21.15.107:0/4259744398 >> 172.21.15.107:0/4259744398 conn(0x7f8958102df0 msgr2=0x7f8958105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:19.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.077+0000 7f895fad2700 1 -- 172.21.15.107:0/4259744398 shutdown_connections 2024-05-10T10:44:19.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.078+0000 7f895fad2700 1 -- 172.21.15.107:0/4259744398 wait complete. 2024-05-10T10:44:19.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.078+0000 7f895fad2700 1 Processor -- start 2024-05-10T10:44:19.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.078+0000 7f895fad2700 1 -- start start 2024-05-10T10:44:19.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.078+0000 7f895fad2700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8958109650 0x7f895819ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:19.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.078+0000 7f895fad2700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8958107150 con 0x7f8958109650 2024-05-10T10:44:19.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.078+0000 7f895d86e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8958109650 0x7f895819ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:19.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.078+0000 7f895d86e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8958109650 0x7f895819ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35478/0 (socket says 172.21.15.107:35478) 2024-05-10T10:44:19.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.078+0000 7f895d86e700 1 -- 172.21.15.107:0/541195917 learned_addr learned my addr 172.21.15.107:0/541195917 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:19.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.079+0000 7f895d86e700 1 -- 172.21.15.107:0/541195917 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895819b3d0 con 0x7f8958109650 2024-05-10T10:44:19.870 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.079+0000 7f895d86e700 1 --2- 172.21.15.107:0/541195917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8958109650 0x7f895819ae90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f894c00d650 tx=0x7f894c004080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:19.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.079+0000 7f894affd700 1 -- 172.21.15.107:0/541195917 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f894c027070 con 0x7f8958109650 2024-05-10T10:44:19.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.079+0000 7f894affd700 1 -- 172.21.15.107:0/541195917 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f894c010d50 con 0x7f8958109650 2024-05-10T10:44:19.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.079+0000 7f895fad2700 1 -- 172.21.15.107:0/541195917 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f895819b660 con 0x7f8958109650 2024-05-10T10:44:19.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.079+0000 7f894affd700 1 -- 172.21.15.107:0/541195917 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f894c022cf0 con 0x7f8958109650 2024-05-10T10:44:19.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.079+0000 7f895fad2700 1 -- 172.21.15.107:0/541195917 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f895819e350 con 0x7f8958109650 2024-05-10T10:44:19.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.079+0000 7f894affd700 1 -- 172.21.15.107:0/541195917 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f894c02a070 con 0x7f8958109650 2024-05-10T10:44:19.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.079+0000 7f894affd700 1 -- 172.21.15.107:0/541195917 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f894c01f070 con 0x7f8958109650 2024-05-10T10:44:19.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.080+0000 7f895fad2700 1 -- 172.21.15.107:0/541195917 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8958064b00 con 0x7f8958109650 2024-05-10T10:44:19.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.082+0000 7f894affd700 1 -- 172.21.15.107:0/541195917 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f894c015070 con 0x7f8958109650 2024-05-10T10:44:19.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.148+0000 7f895fad2700 1 -- 172.21.15.107:0/541195917 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f89581943f0 con 0x7f8958109650 2024-05-10T10:44:19.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.150+0000 7f894affd700 1 -- 172.21.15.107:0/541195917 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f894c022410 con 0x7f8958109650 2024-05-10T10:44:19.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.151+0000 7f895fad2700 1 -- 172.21.15.107:0/541195917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8958109650 msgr2=0x7f895819ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:19.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.151+0000 7f895fad2700 1 --2- 172.21.15.107:0/541195917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8958109650 0x7f895819ae90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f894c00d650 tx=0x7f894c004080 comp rx=0 tx=0).stop 2024-05-10T10:44:19.871 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.151+0000 7f895fad2700 1 -- 172.21.15.107:0/541195917 shutdown_connections 2024-05-10T10:44:19.872 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.151+0000 7f895fad2700 1 --2- 172.21.15.107:0/541195917 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8958109650 0x7f895819ae90 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:19.872 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.151+0000 7f895fad2700 1 -- 172.21.15.107:0/541195917 >> 172.21.15.107:0/541195917 conn(0x7f8958102df0 msgr2=0x7f89581914b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:19.872 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.151+0000 7f895fad2700 1 -- 172.21.15.107:0/541195917 shutdown_connections 2024-05-10T10:44:19.872 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:19.151+0000 7f895fad2700 1 -- 172.21.15.107:0/541195917 wait complete. 2024-05-10T10:44:19.872 INFO:teuthology.orchestra.run.smithi107.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-10T10:44:19.894 INFO:teuthology.orchestra.run.smithi107.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-10T10:44:19.894 INFO:teuthology.orchestra.run.smithi107.stdout:Creating mgr... 2024-05-10T10:44:19.894 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-10T10:44:19.895 INFO:teuthology.orchestra.run.smithi107.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-10T10:44:20.140 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mgr.x 2024-05-10T10:44:20.140 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mgr.x.service: Unit ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mgr.x.service not loaded. 2024-05-10T10:44:20.281 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968.target.wants/ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@.service. 2024-05-10T10:44:20.302 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:20 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/541195917' entity='client.admin' 2024-05-10T10:44:20.796 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-10T10:44:20.796 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout disabled 2024-05-10T10:44:20.803 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-10T10:44:20.803 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout inactive 2024-05-10T10:44:20.803 INFO:teuthology.orchestra.run.smithi107.stdout:firewalld.service is not enabled 2024-05-10T10:44:20.803 INFO:teuthology.orchestra.run.smithi107.stdout:Not possible to enable service . firewalld.service is not available 2024-05-10T10:44:20.812 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-10T10:44:20.812 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout disabled 2024-05-10T10:44:20.819 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-10T10:44:20.820 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout inactive 2024-05-10T10:44:20.820 INFO:teuthology.orchestra.run.smithi107.stdout:firewalld.service is not enabled 2024-05-10T10:44:20.820 INFO:teuthology.orchestra.run.smithi107.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-10T10:44:20.820 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for mgr to start... 2024-05-10T10:44:20.820 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for mgr... 2024-05-10T10:44:20.864 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:20 smithi107 systemd[1]: Started Ceph mgr.x for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:44:21.158 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:20 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:20.863+0000 7f2108458200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T10:44:21.158 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:21 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:21.052+0000 7f2108458200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T10:44:21.158 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:21 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:21.156+0000 7f2108458200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T10:44:21.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:21 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1159087519' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-10T10:44:21.675 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:21 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:21.481+0000 7f2108458200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T10:44:21.675 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:21 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:21.568+0000 7f2108458200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T10:44:21.984 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-05-10T10:44:21.985 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2024-05-10T10:44:21.985 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsid": "0ba8a8e4-0eba-11ef-bc98-c7b262605968", 2024-05-10T10:44:21.985 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "health": { 2024-05-10T10:44:21.985 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-10T10:44:21.985 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-10T10:44:21.985 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-10T10:44:21.985 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:21.985 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-10T10:44:21.985 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-10T10:44:21.985 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 0 2024-05-10T10:44:21.985 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-05-10T10:44:21.986 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-10T10:44:21.986 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "a" 2024-05-10T10:44:21.986 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-05-10T10:44:21.986 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-05-10T10:44:21.986 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-10T10:44:21.986 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T10:44:21.986 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-10T10:44:21.986 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-10T10:44:21.986 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:21.986 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-10T10:44:21.986 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T10:44:21.986 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-10T10:44:21.987 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-10T10:44:21.987 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-10T10:44:21.987 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-10T10:44:21.987 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-10T10:44:21.987 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-10T10:44:21.987 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:21.987 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-10T10:44:21.987 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-10T10:44:21.987 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-10T10:44:21.987 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-10T10:44:21.987 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-10T10:44:21.987 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-10T10:44:21.987 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-10T10:44:21.987 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-10T10:44:21.987 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-10T10:44:21.988 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:21.988 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-10T10:44:21.988 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T10:44:21.988 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-10T10:44:21.988 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-10T10:44:21.988 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:21.988 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-10T10:44:21.988 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-10T10:44:21.988 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-10T10:44:21.988 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-10T10:44:21.988 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-10T10:44:21.988 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-10T10:44:21.988 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "restful" 2024-05-10T10:44:21.988 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-05-10T10:44:21.988 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-10T10:44:21.989 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:21.989 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-10T10:44:21.989 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T10:44:21.989 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modified": "2024-05-10T10:44:13.064831+0000", 2024-05-10T10:44:21.989 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-10T10:44:21.989 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:21.989 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-10T10:44:21.989 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2024-05-10T10:44:21.989 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.277+0000 7f11eba99700 1 Processor -- start 2024-05-10T10:44:21.989 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.277+0000 7f11eba99700 1 -- start start 2024-05-10T10:44:21.989 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.278+0000 7f11eba99700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11e41091d0 0x7f11e41095f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:21.989 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.278+0000 7f11eba99700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f11e4109bc0 con 0x7f11e41091d0 2024-05-10T10:44:21.989 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.278+0000 7f11e9835700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11e41091d0 0x7f11e41095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:21.989 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.278+0000 7f11e9835700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11e41091d0 0x7f11e41095f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35498/0 (socket says 172.21.15.107:35498) 2024-05-10T10:44:21.990 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.278+0000 7f11e9835700 1 -- 172.21.15.107:0/440107537 learned_addr learned my addr 172.21.15.107:0/440107537 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:21.990 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.278+0000 7f11e9835700 1 -- 172.21.15.107:0/440107537 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e410a330 con 0x7f11e41091d0 2024-05-10T10:44:21.990 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.278+0000 7f11e9835700 1 --2- 172.21.15.107:0/440107537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11e41091d0 0x7f11e41095f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f11e00098a0 tx=0x7f11e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0485d27dc98d584 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:21.990 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.279+0000 7f11e8833700 1 -- 172.21.15.107:0/440107537 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11e0004160 con 0x7f11e41091d0 2024-05-10T10:44:21.990 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.279+0000 7f11e8833700 1 -- 172.21.15.107:0/440107537 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f11e0004300 con 0x7f11e41091d0 2024-05-10T10:44:21.990 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.279+0000 7f11e8833700 1 -- 172.21.15.107:0/440107537 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11e0011b20 con 0x7f11e41091d0 2024-05-10T10:44:21.990 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.279+0000 7f11eba99700 1 -- 172.21.15.107:0/440107537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11e41091d0 msgr2=0x7f11e41095f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:21.990 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.279+0000 7f11eba99700 1 --2- 172.21.15.107:0/440107537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11e41091d0 0x7f11e41095f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f11e00098a0 tx=0x7f11e0009bb0 comp rx=0 tx=0).stop 2024-05-10T10:44:21.990 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.280+0000 7f11eba99700 1 -- 172.21.15.107:0/440107537 shutdown_connections 2024-05-10T10:44:21.991 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.280+0000 7f11eba99700 1 --2- 172.21.15.107:0/440107537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11e41091d0 0x7f11e41095f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:21.991 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.280+0000 7f11eba99700 1 -- 172.21.15.107:0/440107537 >> 172.21.15.107:0/440107537 conn(0x7f11e4104810 msgr2=0x7f11e4106c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:21.991 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.280+0000 7f11eba99700 1 -- 172.21.15.107:0/440107537 shutdown_connections 2024-05-10T10:44:21.991 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.280+0000 7f11eba99700 1 -- 172.21.15.107:0/440107537 wait complete. 2024-05-10T10:44:21.991 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.280+0000 7f11eba99700 1 Processor -- start 2024-05-10T10:44:21.991 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.280+0000 7f11eba99700 1 -- start start 2024-05-10T10:44:21.991 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.280+0000 7f11eba99700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11e41091d0 0x7f11e419d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:21.991 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.280+0000 7f11eba99700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f11e410d6e0 con 0x7f11e41091d0 2024-05-10T10:44:21.991 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.281+0000 7f11e9835700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11e41091d0 0x7f11e419d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:21.991 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.281+0000 7f11e9835700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11e41091d0 0x7f11e419d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35508/0 (socket says 172.21.15.107:35508) 2024-05-10T10:44:21.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.281+0000 7f11e9835700 1 -- 172.21.15.107:0/1159087519 learned_addr learned my addr 172.21.15.107:0/1159087519 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:21.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.281+0000 7f11e9835700 1 -- 172.21.15.107:0/1159087519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e419d5d0 con 0x7f11e41091d0 2024-05-10T10:44:21.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.281+0000 7f11e9835700 1 --2- 172.21.15.107:0/1159087519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11e41091d0 0x7f11e419d090 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f11e0006af0 tx=0x7f11e0011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:21.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.281+0000 7f11daffd700 1 -- 172.21.15.107:0/1159087519 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11e0003930 con 0x7f11e41091d0 2024-05-10T10:44:21.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.281+0000 7f11daffd700 1 -- 172.21.15.107:0/1159087519 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f11e0003ad0 con 0x7f11e41091d0 2024-05-10T10:44:21.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.281+0000 7f11eba99700 1 -- 172.21.15.107:0/1159087519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11e419d860 con 0x7f11e41091d0 2024-05-10T10:44:21.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.281+0000 7f11daffd700 1 -- 172.21.15.107:0/1159087519 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11e0019610 con 0x7f11e41091d0 2024-05-10T10:44:21.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.281+0000 7f11eba99700 1 -- 172.21.15.107:0/1159087519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11e419dcc0 con 0x7f11e41091d0 2024-05-10T10:44:21.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.281+0000 7f11daffd700 1 -- 172.21.15.107:0/1159087519 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f11e0019c60 con 0x7f11e41091d0 2024-05-10T10:44:21.992 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.282+0000 7f11daffd700 1 -- 172.21.15.107:0/1159087519 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f11e0024730 con 0x7f11e41091d0 2024-05-10T10:44:21.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.282+0000 7f11eba99700 1 -- 172.21.15.107:0/1159087519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11e4064b00 con 0x7f11e41091d0 2024-05-10T10:44:21.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.284+0000 7f11daffd700 1 -- 172.21.15.107:0/1159087519 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f11e0043e50 con 0x7f11e41091d0 2024-05-10T10:44:21.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.358+0000 7f11eba99700 1 -- 172.21.15.107:0/1159087519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f11e41a0610 con 0x7f11e41091d0 2024-05-10T10:44:21.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.358+0000 7f11daffd700 1 -- 172.21.15.107:0/1159087519 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f11e0032020 con 0x7f11e41091d0 2024-05-10T10:44:21.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.360+0000 7f11eba99700 1 -- 172.21.15.107:0/1159087519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11e41091d0 msgr2=0x7f11e419d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:21.993 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.360+0000 7f11eba99700 1 --2- 172.21.15.107:0/1159087519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11e41091d0 0x7f11e419d090 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f11e0006af0 tx=0x7f11e0011c10 comp rx=0 tx=0).stop 2024-05-10T10:44:21.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.360+0000 7f11eba99700 1 -- 172.21.15.107:0/1159087519 shutdown_connections 2024-05-10T10:44:21.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.360+0000 7f11eba99700 1 --2- 172.21.15.107:0/1159087519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11e41091d0 0x7f11e419d090 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:21.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.360+0000 7f11eba99700 1 -- 172.21.15.107:0/1159087519 >> 172.21.15.107:0/1159087519 conn(0x7f11e4104810 msgr2=0x7f11e4105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:21.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.360+0000 7f11eba99700 1 -- 172.21.15.107:0/1159087519 shutdown_connections 2024-05-10T10:44:21.994 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:21.360+0000 7f11eba99700 1 -- 172.21.15.107:0/1159087519 wait complete. 2024-05-10T10:44:21.994 INFO:teuthology.orchestra.run.smithi107.stdout:mgr not available, waiting (1/15)... 2024-05-10T10:44:23.117 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:22 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:22.765+0000 7f2108458200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T10:44:23.117 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:22 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:22.935+0000 7f2108458200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T10:44:23.117 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:23 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:23.115+0000 7f2108458200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T10:44:23.675 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:23 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:23.400+0000 7f2108458200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T10:44:23.675 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:23 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:23.491+0000 7f2108458200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T10:44:24.107 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:23 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:23.691+0000 7f2108458200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T10:44:24.107 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:23 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:23.900+0000 7f2108458200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T10:44:24.675 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:24 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:24.550+0000 7f2108458200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T10:44:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:24 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/4202023165' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-10T10:44:25.026 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-05-10T10:44:25.026 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2024-05-10T10:44:25.026 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsid": "0ba8a8e4-0eba-11ef-bc98-c7b262605968", 2024-05-10T10:44:25.026 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "health": { 2024-05-10T10:44:25.026 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-10T10:44:25.026 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 0 2024-05-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-05-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "a" 2024-05-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-05-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-05-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:25.027 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-10T10:44:25.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T10:44:25.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-10T10:44:25.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-10T10:44:25.028 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-10T10:44:25.036 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-10T10:44:25.036 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-10T10:44:25.036 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-10T10:44:25.036 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:25.036 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-10T10:44:25.036 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-10T10:44:25.036 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-10T10:44:25.036 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-10T10:44:25.036 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-10T10:44:25.036 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-10T10:44:25.037 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-10T10:44:25.037 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-10T10:44:25.037 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-10T10:44:25.037 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:25.037 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-10T10:44:25.037 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T10:44:25.037 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-10T10:44:25.037 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-10T10:44:25.037 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:25.037 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-10T10:44:25.037 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-10T10:44:25.037 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-10T10:44:25.037 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-10T10:44:25.037 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-10T10:44:25.038 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-10T10:44:25.038 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "restful" 2024-05-10T10:44:25.038 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-05-10T10:44:25.038 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-10T10:44:25.038 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:25.038 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-10T10:44:25.038 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T10:44:25.038 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modified": "2024-05-10T10:44:13.064831+0000", 2024-05-10T10:44:25.038 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-10T10:44:25.039 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:25.039 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-10T10:44:25.039 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2024-05-10T10:44:25.039 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.376+0000 7f3910f1d700 1 Processor -- start 2024-05-10T10:44:25.039 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.376+0000 7f3910f1d700 1 -- start start 2024-05-10T10:44:25.039 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.377+0000 7f3910f1d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390c109d30 0x7f390c10c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:25.039 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.377+0000 7f3910f1d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f390c07ce10 con 0x7f390c109d30 2024-05-10T10:44:25.039 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.377+0000 7f390a59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390c109d30 0x7f390c10c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:25.039 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.377+0000 7f390a59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390c109d30 0x7f390c10c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35522/0 (socket says 172.21.15.107:35522) 2024-05-10T10:44:25.039 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.377+0000 7f390a59c700 1 -- 172.21.15.107:0/333876970 learned_addr learned my addr 172.21.15.107:0/333876970 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:25.039 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.377+0000 7f390a59c700 1 -- 172.21.15.107:0/333876970 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390c10c660 con 0x7f390c109d30 2024-05-10T10:44:25.039 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.377+0000 7f390a59c700 1 --2- 172.21.15.107:0/333876970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390c109d30 0x7f390c10c120 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0098a0 tx=0x7f38fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ffdbcde56ff38c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:25.039 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.378+0000 7f390959a700 1 -- 172.21.15.107:0/333876970 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38fc004160 con 0x7f390c109d30 2024-05-10T10:44:25.039 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.378+0000 7f390959a700 1 -- 172.21.15.107:0/333876970 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f38fc004300 con 0x7f390c109d30 2024-05-10T10:44:25.040 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.378+0000 7f390959a700 1 -- 172.21.15.107:0/333876970 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38fc011b20 con 0x7f390c109d30 2024-05-10T10:44:25.040 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.378+0000 7f3910f1d700 1 -- 172.21.15.107:0/333876970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390c109d30 msgr2=0x7f390c10c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:25.040 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.378+0000 7f3910f1d700 1 --2- 172.21.15.107:0/333876970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390c109d30 0x7f390c10c120 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0098a0 tx=0x7f38fc009bb0 comp rx=0 tx=0).stop 2024-05-10T10:44:25.040 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.379+0000 7f3910f1d700 1 -- 172.21.15.107:0/333876970 shutdown_connections 2024-05-10T10:44:25.040 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.379+0000 7f3910f1d700 1 --2- 172.21.15.107:0/333876970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390c109d30 0x7f390c10c120 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:25.040 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.379+0000 7f3910f1d700 1 -- 172.21.15.107:0/333876970 >> 172.21.15.107:0/333876970 conn(0x7f390c1036c0 msgr2=0x7f390c105ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:25.040 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.379+0000 7f3910f1d700 1 -- 172.21.15.107:0/333876970 shutdown_connections 2024-05-10T10:44:25.040 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.379+0000 7f3910f1d700 1 -- 172.21.15.107:0/333876970 wait complete. 2024-05-10T10:44:25.040 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.379+0000 7f3910f1d700 1 Processor -- start 2024-05-10T10:44:25.040 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.380+0000 7f3910f1d700 1 -- start start 2024-05-10T10:44:25.040 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.380+0000 7f3910f1d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390c109d30 0x7f390c19d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:25.040 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.380+0000 7f3910f1d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f390c10d4f0 con 0x7f390c109d30 2024-05-10T10:44:25.040 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.380+0000 7f390a59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390c109d30 0x7f390c19d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:25.040 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.380+0000 7f390a59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390c109d30 0x7f390c19d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:35528/0 (socket says 172.21.15.107:35528) 2024-05-10T10:44:25.040 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.380+0000 7f390a59c700 1 -- 172.21.15.107:0/4202023165 learned_addr learned my addr 172.21.15.107:0/4202023165 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:25.041 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.380+0000 7f390a59c700 1 -- 172.21.15.107:0/4202023165 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390c19d5a0 con 0x7f390c109d30 2024-05-10T10:44:25.041 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.380+0000 7f390a59c700 1 --2- 172.21.15.107:0/4202023165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390c109d30 0x7f390c19d060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f38fc006af0 tx=0x7f38fc011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:25.041 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.380+0000 7f38fb7fe700 1 -- 172.21.15.107:0/4202023165 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38fc003b90 con 0x7f390c109d30 2024-05-10T10:44:25.041 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.381+0000 7f38fb7fe700 1 -- 172.21.15.107:0/4202023165 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f38fc003d30 con 0x7f390c109d30 2024-05-10T10:44:25.041 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.381+0000 7f3910f1d700 1 -- 172.21.15.107:0/4202023165 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f390c19d830 con 0x7f390c109d30 2024-05-10T10:44:25.041 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.381+0000 7f38fb7fe700 1 -- 172.21.15.107:0/4202023165 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38fc0197c0 con 0x7f390c109d30 2024-05-10T10:44:25.041 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.381+0000 7f3910f1d700 1 -- 172.21.15.107:0/4202023165 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f390c19dc90 con 0x7f390c109d30 2024-05-10T10:44:25.041 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.381+0000 7f38fb7fe700 1 -- 172.21.15.107:0/4202023165 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f38fc022020 con 0x7f390c109d30 2024-05-10T10:44:25.041 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.381+0000 7f38fb7fe700 1 -- 172.21.15.107:0/4202023165 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f38fc024df0 con 0x7f390c109d30 2024-05-10T10:44:25.041 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.382+0000 7f3910f1d700 1 -- 172.21.15.107:0/4202023165 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f390c064b00 con 0x7f390c109d30 2024-05-10T10:44:25.041 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.384+0000 7f38fb7fe700 1 -- 172.21.15.107:0/4202023165 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f38fc0042c0 con 0x7f390c109d30 2024-05-10T10:44:25.041 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.459+0000 7f3910f1d700 1 -- 172.21.15.107:0/4202023165 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f390c1a0720 con 0x7f390c109d30 2024-05-10T10:44:25.041 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.460+0000 7f38fb7fe700 1 -- 172.21.15.107:0/4202023165 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f38fc01ac50 con 0x7f390c109d30 2024-05-10T10:44:25.042 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.460+0000 7f3910f1d700 1 -- 172.21.15.107:0/4202023165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390c109d30 msgr2=0x7f390c19d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:25.042 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.460+0000 7f3910f1d700 1 --2- 172.21.15.107:0/4202023165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390c109d30 0x7f390c19d060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f38fc006af0 tx=0x7f38fc011ce0 comp rx=0 tx=0).stop 2024-05-10T10:44:25.042 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.461+0000 7f3910f1d700 1 -- 172.21.15.107:0/4202023165 shutdown_connections 2024-05-10T10:44:25.042 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.461+0000 7f3910f1d700 1 --2- 172.21.15.107:0/4202023165 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f390c109d30 0x7f390c19d060 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:25.042 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.461+0000 7f3910f1d700 1 -- 172.21.15.107:0/4202023165 >> 172.21.15.107:0/4202023165 conn(0x7f390c1036c0 msgr2=0x7f390c104160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:25.042 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.461+0000 7f3910f1d700 1 -- 172.21.15.107:0/4202023165 shutdown_connections 2024-05-10T10:44:25.042 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:24.461+0000 7f3910f1d700 1 -- 172.21.15.107:0/4202023165 wait complete. 2024-05-10T10:44:25.042 INFO:teuthology.orchestra.run.smithi107.stdout:mgr not available, waiting (2/15)... 2024-05-10T10:44:25.110 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:24 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:24.776+0000 7f2108458200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-10T10:44:25.425 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:25 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:25.199+0000 7f2108458200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T10:44:25.425 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:25 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:25.296+0000 7f2108458200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T10:44:25.925 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:25 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:25.666+0000 7f2108458200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T10:44:26.375 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:26 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:26.021+0000 7f2108458200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T10:44:26.375 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:26 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:26.115+0000 7f2108458200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T10:44:26.675 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:26 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:26.374+0000 7f2108458200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T10:44:26.675 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:26 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:26.516+0000 7f2108458200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T10:44:26.675 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:26 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:26.617+0000 7f2108458200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T10:44:27.263 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:26 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:26.955+0000 7f2108458200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T10:44:27.264 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:27 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:27.055+0000 7f2108458200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T10:44:27.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:27 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/4279654085' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-10T10:44:27.925 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:27 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:27.702+0000 7f2108458200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T10:44:28.132 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-05-10T10:44:28.132 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2024-05-10T10:44:28.132 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsid": "0ba8a8e4-0eba-11ef-bc98-c7b262605968", 2024-05-10T10:44:28.132 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "health": { 2024-05-10T10:44:28.132 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-10T10:44:28.132 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-10T10:44:28.132 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-10T10:44:28.132 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:28.132 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-10T10:44:28.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-10T10:44:28.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 0 2024-05-10T10:44:28.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-05-10T10:44:28.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-10T10:44:28.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "a" 2024-05-10T10:44:28.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-05-10T10:44:28.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-05-10T10:44:28.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-10T10:44:28.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T10:44:28.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-10T10:44:28.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-10T10:44:28.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:28.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-10T10:44:28.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T10:44:28.133 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-10T10:44:28.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-10T10:44:28.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-10T10:44:28.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-10T10:44:28.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-10T10:44:28.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-10T10:44:28.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:28.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-10T10:44:28.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-10T10:44:28.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-10T10:44:28.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-10T10:44:28.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-10T10:44:28.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-10T10:44:28.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-10T10:44:28.134 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-10T10:44:28.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-10T10:44:28.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:28.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-10T10:44:28.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T10:44:28.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-10T10:44:28.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-10T10:44:28.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:28.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-10T10:44:28.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-10T10:44:28.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-10T10:44:28.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-10T10:44:28.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-10T10:44:28.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-10T10:44:28.135 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "restful" 2024-05-10T10:44:28.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-05-10T10:44:28.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-10T10:44:28.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:28.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-10T10:44:28.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T10:44:28.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modified": "2024-05-10T10:44:13.064831+0000", 2024-05-10T10:44:28.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-10T10:44:28.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:28.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-10T10:44:28.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2024-05-10T10:44:28.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.458+0000 7f6cbb250700 1 Processor -- start 2024-05-10T10:44:28.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.458+0000 7f6cbb250700 1 -- start start 2024-05-10T10:44:28.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.458+0000 7f6cbb250700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb407ee60 0x7f6cb407d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:28.136 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.458+0000 7f6cbb250700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb407d8a0 con 0x7f6cb407ee60 2024-05-10T10:44:28.137 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.458+0000 7f6cb8fec700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb407ee60 0x7f6cb407d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:28.137 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.458+0000 7f6cb8fec700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb407ee60 0x7f6cb407d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34342/0 (socket says 172.21.15.107:34342) 2024-05-10T10:44:28.137 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.458+0000 7f6cb8fec700 1 -- 172.21.15.107:0/956658630 learned_addr learned my addr 172.21.15.107:0/956658630 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:28.137 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.459+0000 7f6cb8fec700 1 -- 172.21.15.107:0/956658630 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb407da20 con 0x7f6cb407ee60 2024-05-10T10:44:28.137 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.459+0000 7f6cb8fec700 1 --2- 172.21.15.107:0/956658630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb407ee60 0x7f6cb407d360 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80098a0 tx=0x7f6ca8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3318e14080a025e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:28.137 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.459+0000 7f6cb37fe700 1 -- 172.21.15.107:0/956658630 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca8004160 con 0x7f6cb407ee60 2024-05-10T10:44:28.137 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.459+0000 7f6cb37fe700 1 -- 172.21.15.107:0/956658630 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f6ca8004300 con 0x7f6cb407ee60 2024-05-10T10:44:28.137 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.459+0000 7f6cb37fe700 1 -- 172.21.15.107:0/956658630 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca8011b20 con 0x7f6cb407ee60 2024-05-10T10:44:28.137 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.460+0000 7f6cbb250700 1 -- 172.21.15.107:0/956658630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb407ee60 msgr2=0x7f6cb407d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:28.137 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.460+0000 7f6cbb250700 1 --2- 172.21.15.107:0/956658630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb407ee60 0x7f6cb407d360 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80098a0 tx=0x7f6ca8009bb0 comp rx=0 tx=0).stop 2024-05-10T10:44:28.137 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.460+0000 7f6cbb250700 1 -- 172.21.15.107:0/956658630 shutdown_connections 2024-05-10T10:44:28.137 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.460+0000 7f6cbb250700 1 --2- 172.21.15.107:0/956658630 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb407ee60 0x7f6cb407d360 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:28.137 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.460+0000 7f6cbb250700 1 -- 172.21.15.107:0/956658630 >> 172.21.15.107:0/956658630 conn(0x7f6cb4104850 msgr2=0x7f6cb4106c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:28.138 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.460+0000 7f6cbb250700 1 -- 172.21.15.107:0/956658630 shutdown_connections 2024-05-10T10:44:28.138 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.460+0000 7f6cbb250700 1 -- 172.21.15.107:0/956658630 wait complete. 2024-05-10T10:44:28.138 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.460+0000 7f6cbb250700 1 Processor -- start 2024-05-10T10:44:28.138 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.460+0000 7f6cbb250700 1 -- start start 2024-05-10T10:44:28.138 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.461+0000 7f6cbb250700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb407ee60 0x7f6cb419f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:28.138 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.461+0000 7f6cbb250700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb410f6b0 con 0x7f6cb407ee60 2024-05-10T10:44:28.138 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.461+0000 7f6cb8fec700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb407ee60 0x7f6cb419f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:28.138 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.461+0000 7f6cb8fec700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb407ee60 0x7f6cb419f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34358/0 (socket says 172.21.15.107:34358) 2024-05-10T10:44:28.138 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.461+0000 7f6cb8fec700 1 -- 172.21.15.107:0/4279654085 learned_addr learned my addr 172.21.15.107:0/4279654085 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:28.138 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.461+0000 7f6cb8fec700 1 -- 172.21.15.107:0/4279654085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb419f700 con 0x7f6cb407ee60 2024-05-10T10:44:28.138 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.461+0000 7f6cb8fec700 1 --2- 172.21.15.107:0/4279654085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb407ee60 0x7f6cb419f1c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80117e0 tx=0x7f6ca8011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:28.138 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.461+0000 7f6cb1ffb700 1 -- 172.21.15.107:0/4279654085 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca8003b30 con 0x7f6cb407ee60 2024-05-10T10:44:28.138 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.461+0000 7f6cb1ffb700 1 -- 172.21.15.107:0/4279654085 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f6ca8003cd0 con 0x7f6cb407ee60 2024-05-10T10:44:28.138 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.461+0000 7f6cbb250700 1 -- 172.21.15.107:0/4279654085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb419f990 con 0x7f6cb407ee60 2024-05-10T10:44:28.139 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.461+0000 7f6cb1ffb700 1 -- 172.21.15.107:0/4279654085 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ca801a7c0 con 0x7f6cb407ee60 2024-05-10T10:44:28.139 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.462+0000 7f6cbb250700 1 -- 172.21.15.107:0/4279654085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb419fdf0 con 0x7f6cb407ee60 2024-05-10T10:44:28.139 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.462+0000 7f6cb1ffb700 1 -- 172.21.15.107:0/4279654085 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6ca801acf0 con 0x7f6cb407ee60 2024-05-10T10:44:28.139 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.462+0000 7f6cb1ffb700 1 -- 172.21.15.107:0/4279654085 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6ca8019700 con 0x7f6cb407ee60 2024-05-10T10:44:28.139 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.462+0000 7f6cbb250700 1 -- 172.21.15.107:0/4279654085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cb4064b00 con 0x7f6cb407ee60 2024-05-10T10:44:28.139 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.465+0000 7f6cb1ffb700 1 -- 172.21.15.107:0/4279654085 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6ca80042e0 con 0x7f6cb407ee60 2024-05-10T10:44:28.139 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.538+0000 7f6cbb250700 1 -- 172.21.15.107:0/4279654085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6cb41a27c0 con 0x7f6cb407ee60 2024-05-10T10:44:28.139 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.539+0000 7f6cb1ffb700 1 -- 172.21.15.107:0/4279654085 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f6ca8024ba0 con 0x7f6cb407ee60 2024-05-10T10:44:28.139 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.540+0000 7f6cbb250700 1 -- 172.21.15.107:0/4279654085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb407ee60 msgr2=0x7f6cb419f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:28.139 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.540+0000 7f6cbb250700 1 --2- 172.21.15.107:0/4279654085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb407ee60 0x7f6cb419f1c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80117e0 tx=0x7f6ca8011ce0 comp rx=0 tx=0).stop 2024-05-10T10:44:28.139 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.540+0000 7f6cbb250700 1 -- 172.21.15.107:0/4279654085 shutdown_connections 2024-05-10T10:44:28.139 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.540+0000 7f6cbb250700 1 --2- 172.21.15.107:0/4279654085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6cb407ee60 0x7f6cb419f1c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:28.139 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.540+0000 7f6cbb250700 1 -- 172.21.15.107:0/4279654085 >> 172.21.15.107:0/4279654085 conn(0x7f6cb4104850 msgr2=0x7f6cb41052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:28.139 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.540+0000 7f6cbb250700 1 -- 172.21.15.107:0/4279654085 shutdown_connections 2024-05-10T10:44:28.140 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:27.540+0000 7f6cbb250700 1 -- 172.21.15.107:0/4279654085 wait complete. 2024-05-10T10:44:28.140 INFO:teuthology.orchestra.run.smithi107.stdout:mgr not available, waiting (3/15)... 2024-05-10T10:44:28.182 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:27 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:27.924+0000 7f2108458200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T10:44:28.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:28 smithi107 ceph-mon[30373]: Activating manager daemon x 2024-05-10T10:44:28.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:28 smithi107 ceph-mon[30373]: mgrmap e2: x(active, starting, since 0.00334798s) 2024-05-10T10:44:28.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:28 smithi107 ceph-mon[30373]: from='mgr.14100 172.21.15.107:0/288370908' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-10T10:44:28.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:28 smithi107 ceph-mon[30373]: from='mgr.14100 172.21.15.107:0/288370908' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-10T10:44:28.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:28 smithi107 ceph-mon[30373]: from='mgr.14100 172.21.15.107:0/288370908' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-10T10:44:28.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:28 smithi107 ceph-mon[30373]: from='mgr.14100 172.21.15.107:0/288370908' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T10:44:28.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:28 smithi107 ceph-mon[30373]: from='mgr.14100 172.21.15.107:0/288370908' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-10T10:44:28.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:28 smithi107 ceph-mon[30373]: Manager daemon x is now available 2024-05-10T10:44:28.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:28 smithi107 ceph-mon[30373]: from='mgr.14100 172.21.15.107:0/288370908' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-10T10:44:28.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:28 smithi107 ceph-mon[30373]: from='mgr.14100 172.21.15.107:0/288370908' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-10T10:44:28.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:28 smithi107 ceph-mon[30373]: from='mgr.14100 172.21.15.107:0/288370908' entity='mgr.x' 2024-05-10T10:44:28.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:28 smithi107 ceph-mon[30373]: from='mgr.14100 172.21.15.107:0/288370908' entity='mgr.x' 2024-05-10T10:44:28.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:28 smithi107 ceph-mon[30373]: from='mgr.14100 172.21.15.107:0/288370908' entity='mgr.x' 2024-05-10T10:44:30.237 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:29 smithi107 ceph-mon[30373]: mgrmap e3: x(active, since 1.00723s) 2024-05-10T10:44:31.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:30 smithi107 ceph-mon[30373]: mgrmap e4: x(active, since 2s) 2024-05-10T10:44:31.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:30 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1324779239' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-10T10:44:31.364 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-05-10T10:44:31.364 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2024-05-10T10:44:31.364 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsid": "0ba8a8e4-0eba-11ef-bc98-c7b262605968", 2024-05-10T10:44:31.364 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "health": { 2024-05-10T10:44:31.364 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-10T10:44:31.364 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-10T10:44:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-10T10:44:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-10T10:44:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-10T10:44:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 0 2024-05-10T10:44:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-05-10T10:44:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-10T10:44:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "a" 2024-05-10T10:44:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-05-10T10:44:31.365 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-05-10T10:44:31.366 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-10T10:44:31.366 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T10:44:31.366 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-10T10:44:31.366 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-10T10:44:31.366 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:31.366 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-10T10:44:31.366 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T10:44:31.366 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-10T10:44:31.366 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-10T10:44:31.375 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-10T10:44:31.375 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-10T10:44:31.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-10T10:44:31.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-10T10:44:31.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:31.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-10T10:44:31.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-10T10:44:31.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-10T10:44:31.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-10T10:44:31.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-10T10:44:31.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-10T10:44:31.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-10T10:44:31.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-10T10:44:31.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-10T10:44:31.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:31.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-10T10:44:31.376 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T10:44:31.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-10T10:44:31.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-10T10:44:31.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:31.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-10T10:44:31.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-10T10:44:31.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-10T10:44:31.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-10T10:44:31.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-10T10:44:31.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-10T10:44:31.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "restful" 2024-05-10T10:44:31.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ], 2024-05-10T10:44:31.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-10T10:44:31.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:31.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-10T10:44:31.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-10T10:44:31.377 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "modified": "2024-05-10T10:44:13.064831+0000", 2024-05-10T10:44:31.378 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-10T10:44:31.378 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout }, 2024-05-10T10:44:31.378 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-10T10:44:31.378 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2024-05-10T10:44:31.378 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.493+0000 7fa24a3e6700 1 Processor -- start 2024-05-10T10:44:31.378 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.493+0000 7fa24a3e6700 1 -- start start 2024-05-10T10:44:31.378 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.494+0000 7fa24a3e6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa244109230 0x7fa244109650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:31.378 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.494+0000 7fa24a3e6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa244109b90 con 0x7fa244109230 2024-05-10T10:44:31.378 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.494+0000 7fa243fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa244109230 0x7fa244109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:31.378 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.494+0000 7fa243fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa244109230 0x7fa244109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34416/0 (socket says 172.21.15.107:34416) 2024-05-10T10:44:31.378 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.494+0000 7fa243fff700 1 -- 172.21.15.107:0/1031666021 learned_addr learned my addr 172.21.15.107:0/1031666021 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:31.378 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.494+0000 7fa243fff700 1 -- 172.21.15.107:0/1031666021 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa244109d10 con 0x7fa244109230 2024-05-10T10:44:31.378 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.494+0000 7fa243fff700 1 --2- 172.21.15.107:0/1031666021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa244109230 0x7fa244109650 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa2340098a0 tx=0x7fa234009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0afaf6c39905fc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:31.378 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.495+0000 7fa2437fe700 1 -- 172.21.15.107:0/1031666021 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa234004160 con 0x7fa244109230 2024-05-10T10:44:31.379 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.495+0000 7fa2437fe700 1 -- 172.21.15.107:0/1031666021 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fa234004300 con 0x7fa244109230 2024-05-10T10:44:31.379 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.495+0000 7fa2437fe700 1 -- 172.21.15.107:0/1031666021 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa234011b20 con 0x7fa244109230 2024-05-10T10:44:31.379 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.495+0000 7fa24a3e6700 1 -- 172.21.15.107:0/1031666021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa244109230 msgr2=0x7fa244109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:31.379 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.495+0000 7fa24a3e6700 1 --2- 172.21.15.107:0/1031666021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa244109230 0x7fa244109650 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa2340098a0 tx=0x7fa234009bb0 comp rx=0 tx=0).stop 2024-05-10T10:44:31.379 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.495+0000 7fa24a3e6700 1 -- 172.21.15.107:0/1031666021 shutdown_connections 2024-05-10T10:44:31.379 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.495+0000 7fa24a3e6700 1 --2- 172.21.15.107:0/1031666021 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa244109230 0x7fa244109650 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:31.379 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.495+0000 7fa24a3e6700 1 -- 172.21.15.107:0/1031666021 >> 172.21.15.107:0/1031666021 conn(0x7fa2441048b0 msgr2=0x7fa244106cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:31.379 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.496+0000 7fa24a3e6700 1 -- 172.21.15.107:0/1031666021 shutdown_connections 2024-05-10T10:44:31.379 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.496+0000 7fa24a3e6700 1 -- 172.21.15.107:0/1031666021 wait complete. 2024-05-10T10:44:31.379 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.496+0000 7fa24a3e6700 1 Processor -- start 2024-05-10T10:44:31.379 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.496+0000 7fa24a3e6700 1 -- start start 2024-05-10T10:44:31.379 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.496+0000 7fa24a3e6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa244109230 0x7fa24419d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:31.379 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.496+0000 7fa24a3e6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa24410b1d0 con 0x7fa244109230 2024-05-10T10:44:31.379 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.496+0000 7fa243fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa244109230 0x7fa24419d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:31.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.497+0000 7fa243fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa244109230 0x7fa24419d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34426/0 (socket says 172.21.15.107:34426) 2024-05-10T10:44:31.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.497+0000 7fa243fff700 1 -- 172.21.15.107:0/1324779239 learned_addr learned my addr 172.21.15.107:0/1324779239 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:31.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.497+0000 7fa243fff700 1 -- 172.21.15.107:0/1324779239 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa24419d580 con 0x7fa244109230 2024-05-10T10:44:31.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.497+0000 7fa243fff700 1 --2- 172.21.15.107:0/1324779239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa244109230 0x7fa24419d040 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa234006af0 tx=0x7fa234011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:31.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.497+0000 7fa241ffb700 1 -- 172.21.15.107:0/1324779239 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2340039a0 con 0x7fa244109230 2024-05-10T10:44:31.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.497+0000 7fa24a3e6700 1 -- 172.21.15.107:0/1324779239 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa24419d810 con 0x7fa244109230 2024-05-10T10:44:31.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.497+0000 7fa241ffb700 1 -- 172.21.15.107:0/1324779239 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fa234003b40 con 0x7fa244109230 2024-05-10T10:44:31.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.497+0000 7fa241ffb700 1 -- 172.21.15.107:0/1324779239 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa234019670 con 0x7fa244109230 2024-05-10T10:44:31.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.497+0000 7fa24a3e6700 1 -- 172.21.15.107:0/1324779239 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa24419dc70 con 0x7fa244109230 2024-05-10T10:44:31.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.498+0000 7fa241ffb700 1 -- 172.21.15.107:0/1324779239 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7fa234019950 con 0x7fa244109230 2024-05-10T10:44:31.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.498+0000 7fa241ffb700 1 --2- 172.21.15.107:0/1324779239 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7fa23003e3d0 0x7fa230040890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:31.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.498+0000 7fa24a3e6700 1 -- 172.21.15.107:0/1324779239 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa244064b00 con 0x7fa244109230 2024-05-10T10:44:31.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.498+0000 7fa241ffb700 1 -- 172.21.15.107:0/1324779239 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa234053a90 con 0x7fa244109230 2024-05-10T10:44:31.380 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.498+0000 7fa23bfff700 1 --2- 172.21.15.107:0/1324779239 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7fa23003e3d0 0x7fa230040890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:31.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.499+0000 7fa23bfff700 1 --2- 172.21.15.107:0/1324779239 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7fa23003e3d0 0x7fa230040890 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa22c006fd0 tx=0x7fa22c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:31.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.504+0000 7fa241ffb700 1 -- 172.21.15.107:0/1324779239 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa234011e20 con 0x7fa244109230 2024-05-10T10:44:31.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.795+0000 7fa24a3e6700 1 -- 172.21.15.107:0/1324779239 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa2441a06b0 con 0x7fa244109230 2024-05-10T10:44:31.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.796+0000 7fa241ffb700 1 -- 172.21.15.107:0/1324779239 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fa234017e90 con 0x7fa244109230 2024-05-10T10:44:31.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.798+0000 7fa24a3e6700 1 -- 172.21.15.107:0/1324779239 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7fa23003e3d0 msgr2=0x7fa230040890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:31.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.798+0000 7fa24a3e6700 1 --2- 172.21.15.107:0/1324779239 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7fa23003e3d0 0x7fa230040890 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa22c006fd0 tx=0x7fa22c006e40 comp rx=0 tx=0).stop 2024-05-10T10:44:31.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.798+0000 7fa24a3e6700 1 -- 172.21.15.107:0/1324779239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa244109230 msgr2=0x7fa24419d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:31.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.798+0000 7fa24a3e6700 1 --2- 172.21.15.107:0/1324779239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa244109230 0x7fa24419d040 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa234006af0 tx=0x7fa234011ce0 comp rx=0 tx=0).stop 2024-05-10T10:44:31.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.798+0000 7fa24a3e6700 1 -- 172.21.15.107:0/1324779239 shutdown_connections 2024-05-10T10:44:31.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.798+0000 7fa24a3e6700 1 --2- 172.21.15.107:0/1324779239 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7fa23003e3d0 0x7fa230040890 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:31.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.798+0000 7fa24a3e6700 1 --2- 172.21.15.107:0/1324779239 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa244109230 0x7fa24419d040 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:31.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.798+0000 7fa24a3e6700 1 -- 172.21.15.107:0/1324779239 >> 172.21.15.107:0/1324779239 conn(0x7fa2441048b0 msgr2=0x7fa2441052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:31.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.798+0000 7fa24a3e6700 1 -- 172.21.15.107:0/1324779239 shutdown_connections 2024-05-10T10:44:31.381 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:30.798+0000 7fa24a3e6700 1 -- 172.21.15.107:0/1324779239 wait complete. 2024-05-10T10:44:31.382 INFO:teuthology.orchestra.run.smithi107.stdout:mgr is available 2024-05-10T10:44:32.281 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:32 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/4072328392' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-10T10:44:32.541 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-05-10T10:44:32.542 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout [global] 2024-05-10T10:44:32.542 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout fsid = 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:44:32.542 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-10T10:44:32.542 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-10T10:44:32.542 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-10T10:44:32.542 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-10T10:44:32.542 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-10T10:44:32.542 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-05-10T10:44:32.542 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-10T10:44:32.542 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-10T10:44:32.542 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 2024-05-10T10:44:32.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout [osd] 2024-05-10T10:44:32.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-05-10T10:44:32.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-10T10:44:32.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-10T10:44:32.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-10T10:44:32.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-10T10:44:32.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-10T10:44:32.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.778+0000 7f6767042700 1 Processor -- start 2024-05-10T10:44:32.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.778+0000 7f6767042700 1 -- start start 2024-05-10T10:44:32.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.779+0000 7f6767042700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6760108080 0x7f67601084a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:32.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.779+0000 7f6767042700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6760108a70 con 0x7f6760108080 2024-05-10T10:44:32.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.779+0000 7f6764dde700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6760108080 0x7f67601084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:32.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.779+0000 7f6764dde700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6760108080 0x7f67601084a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34428/0 (socket says 172.21.15.107:34428) 2024-05-10T10:44:32.543 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.779+0000 7f6764dde700 1 -- 172.21.15.107:0/3399383579 learned_addr learned my addr 172.21.15.107:0/3399383579 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:32.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.779+0000 7f6764dde700 1 -- 172.21.15.107:0/3399383579 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6760109280 con 0x7f6760108080 2024-05-10T10:44:32.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.779+0000 7f6764dde700 1 --2- 172.21.15.107:0/3399383579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6760108080 0x7f67601084a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f674800bb40 tx=0x7f674800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53136a7df31c9e3c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:32.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.779+0000 7f675f7fe700 1 -- 172.21.15.107:0/3399383579 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f674800dbe0 con 0x7f6760108080 2024-05-10T10:44:32.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.779+0000 7f675f7fe700 1 -- 172.21.15.107:0/3399383579 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f67480044e0 con 0x7f6760108080 2024-05-10T10:44:32.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.779+0000 7f675f7fe700 1 -- 172.21.15.107:0/3399383579 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6748010470 con 0x7f6760108080 2024-05-10T10:44:32.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.780+0000 7f6767042700 1 -- 172.21.15.107:0/3399383579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6760108080 msgr2=0x7f67601084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:32.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.780+0000 7f6767042700 1 --2- 172.21.15.107:0/3399383579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6760108080 0x7f67601084a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f674800bb40 tx=0x7f674800be50 comp rx=0 tx=0).stop 2024-05-10T10:44:32.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.780+0000 7f6767042700 1 -- 172.21.15.107:0/3399383579 shutdown_connections 2024-05-10T10:44:32.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.780+0000 7f6767042700 1 --2- 172.21.15.107:0/3399383579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6760108080 0x7f67601084a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:32.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.780+0000 7f6767042700 1 -- 172.21.15.107:0/3399383579 >> 172.21.15.107:0/3399383579 conn(0x7f6760103660 msgr2=0x7f6760105a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:32.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.780+0000 7f6767042700 1 -- 172.21.15.107:0/3399383579 shutdown_connections 2024-05-10T10:44:32.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.780+0000 7f6767042700 1 -- 172.21.15.107:0/3399383579 wait complete. 2024-05-10T10:44:32.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.781+0000 7f6767042700 1 Processor -- start 2024-05-10T10:44:32.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.781+0000 7f6767042700 1 -- start start 2024-05-10T10:44:32.544 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.781+0000 7f6767042700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6760108080 0x7f676019aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:32.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.781+0000 7f6767042700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6760075f20 con 0x7f6760108080 2024-05-10T10:44:32.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.781+0000 7f6764dde700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6760108080 0x7f676019aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:32.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.781+0000 7f6764dde700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6760108080 0x7f676019aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34430/0 (socket says 172.21.15.107:34430) 2024-05-10T10:44:32.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.781+0000 7f6764dde700 1 -- 172.21.15.107:0/4072328392 learned_addr learned my addr 172.21.15.107:0/4072328392 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:32.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.781+0000 7f6764dde700 1 -- 172.21.15.107:0/4072328392 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676019b400 con 0x7f6760108080 2024-05-10T10:44:32.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.781+0000 7f6764dde700 1 --2- 172.21.15.107:0/4072328392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6760108080 0x7f676019aec0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f674800d650 tx=0x7f6748004080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:32.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.781+0000 7f675dffb700 1 -- 172.21.15.107:0/4072328392 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6748027070 con 0x7f6760108080 2024-05-10T10:44:32.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.781+0000 7f675dffb700 1 -- 172.21.15.107:0/4072328392 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f6748010d50 con 0x7f6760108080 2024-05-10T10:44:32.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.781+0000 7f6767042700 1 -- 172.21.15.107:0/4072328392 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f676019b690 con 0x7f6760108080 2024-05-10T10:44:32.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.781+0000 7f675dffb700 1 -- 172.21.15.107:0/4072328392 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6748022cf0 con 0x7f6760108080 2024-05-10T10:44:32.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.782+0000 7f6767042700 1 -- 172.21.15.107:0/4072328392 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f676019e380 con 0x7f6760108080 2024-05-10T10:44:32.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.783+0000 7f675dffb700 1 -- 172.21.15.107:0/4072328392 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f674802a070 con 0x7f6760108080 2024-05-10T10:44:32.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.783+0000 7f6767042700 1 -- 172.21.15.107:0/4072328392 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6760064b00 con 0x7f6760108080 2024-05-10T10:44:32.545 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.783+0000 7f675dffb700 1 --2- 172.21.15.107:0/4072328392 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f674c03e420 0x7f674c0408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:32.546 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.783+0000 7f675dffb700 1 -- 172.21.15.107:0/4072328392 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f674801f070 con 0x7f6760108080 2024-05-10T10:44:32.546 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.783+0000 7f675ffff700 1 --2- 172.21.15.107:0/4072328392 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f674c03e420 0x7f674c0408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:32.546 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.783+0000 7f675ffff700 1 --2- 172.21.15.107:0/4072328392 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f674c03e420 0x7f674c0408e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f675000ad30 tx=0x7f67500093f0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:32.546 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.788+0000 7f675dffb700 1 -- 172.21.15.107:0/4072328392 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f6748015070 con 0x7f6760108080 2024-05-10T10:44:32.546 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.987+0000 7f6767042700 1 -- 172.21.15.107:0/4072328392 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f676019e550 con 0x7f6760108080 2024-05-10T10:44:32.546 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.987+0000 7f675dffb700 1 -- 172.21.15.107:0/4072328392 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+436 (secure 0 0 0) 0x7f676019e550 con 0x7f6760108080 2024-05-10T10:44:32.546 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.990+0000 7f6767042700 1 -- 172.21.15.107:0/4072328392 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f674c03e420 msgr2=0x7f674c0408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:32.546 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.990+0000 7f6767042700 1 --2- 172.21.15.107:0/4072328392 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f674c03e420 0x7f674c0408e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f675000ad30 tx=0x7f67500093f0 comp rx=0 tx=0).stop 2024-05-10T10:44:32.546 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.990+0000 7f6767042700 1 -- 172.21.15.107:0/4072328392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6760108080 msgr2=0x7f676019aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:32.546 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.990+0000 7f6767042700 1 --2- 172.21.15.107:0/4072328392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6760108080 0x7f676019aec0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f674800d650 tx=0x7f6748004080 comp rx=0 tx=0).stop 2024-05-10T10:44:32.546 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.990+0000 7f6767042700 1 -- 172.21.15.107:0/4072328392 shutdown_connections 2024-05-10T10:44:32.546 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.990+0000 7f6767042700 1 --2- 172.21.15.107:0/4072328392 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f674c03e420 0x7f674c0408e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:32.546 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.990+0000 7f6767042700 1 --2- 172.21.15.107:0/4072328392 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6760108080 0x7f676019aec0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:32.546 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.990+0000 7f6767042700 1 -- 172.21.15.107:0/4072328392 >> 172.21.15.107:0/4072328392 conn(0x7f6760103660 msgr2=0x7f6760191500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:32.547 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.990+0000 7f6767042700 1 -- 172.21.15.107:0/4072328392 shutdown_connections 2024-05-10T10:44:32.547 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:31.990+0000 7f6767042700 1 -- 172.21.15.107:0/4072328392 wait complete. 2024-05-10T10:44:32.547 INFO:teuthology.orchestra.run.smithi107.stdout:Enabling cephadm module... 2024-05-10T10:44:33.637 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:33 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2404831299' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-10T10:44:33.638 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:33 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: ignoring --setuser ceph since I am not root 2024-05-10T10:44:33.638 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:33 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: ignoring --setgroup ceph since I am not root 2024-05-10T10:44:33.638 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:33 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:33.450+0000 7f0b31666200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T10:44:33.638 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:33 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:33.636+0000 7f0b31666200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T10:44:33.925 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:33 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:33.742+0000 7f0b31666200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T10:44:34.047 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.960+0000 7f05ca732700 1 Processor -- start 2024-05-10T10:44:34.047 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.960+0000 7f05ca732700 1 -- start start 2024-05-10T10:44:34.047 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.961+0000 7f05ca732700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c4109c40 0x7f05c410c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:34.047 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.961+0000 7f05ca732700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f05c407ce70 con 0x7f05c4109c40 2024-05-10T10:44:34.047 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.961+0000 7f05c3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c4109c40 0x7f05c410c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:34.048 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.961+0000 7f05c3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c4109c40 0x7f05c410c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34436/0 (socket says 172.21.15.107:34436) 2024-05-10T10:44:34.048 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.961+0000 7f05c3fff700 1 -- 172.21.15.107:0/2322070705 learned_addr learned my addr 172.21.15.107:0/2322070705 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:34.048 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.961+0000 7f05c3fff700 1 -- 172.21.15.107:0/2322070705 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c410c570 con 0x7f05c4109c40 2024-05-10T10:44:34.048 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.961+0000 7f05c3fff700 1 --2- 172.21.15.107:0/2322070705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c4109c40 0x7f05c410c030 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f05b40098a0 tx=0x7f05b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e85d11eacd8dcc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:34.048 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.961+0000 7f05c2ffd700 1 -- 172.21.15.107:0/2322070705 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b4004160 con 0x7f05c4109c40 2024-05-10T10:44:34.048 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.961+0000 7f05c2ffd700 1 -- 172.21.15.107:0/2322070705 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f05b4004300 con 0x7f05c4109c40 2024-05-10T10:44:34.048 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.961+0000 7f05c2ffd700 1 -- 172.21.15.107:0/2322070705 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b4011b20 con 0x7f05c4109c40 2024-05-10T10:44:34.048 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.962+0000 7f05ca732700 1 -- 172.21.15.107:0/2322070705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c4109c40 msgr2=0x7f05c410c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:34.048 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.962+0000 7f05ca732700 1 --2- 172.21.15.107:0/2322070705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c4109c40 0x7f05c410c030 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f05b40098a0 tx=0x7f05b4009bb0 comp rx=0 tx=0).stop 2024-05-10T10:44:34.048 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.962+0000 7f05ca732700 1 -- 172.21.15.107:0/2322070705 shutdown_connections 2024-05-10T10:44:34.048 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.962+0000 7f05ca732700 1 --2- 172.21.15.107:0/2322070705 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c4109c40 0x7f05c410c030 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:34.049 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.962+0000 7f05ca732700 1 -- 172.21.15.107:0/2322070705 >> 172.21.15.107:0/2322070705 conn(0x7f05c4103610 msgr2=0x7f05c4105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:34.049 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.962+0000 7f05ca732700 1 -- 172.21.15.107:0/2322070705 shutdown_connections 2024-05-10T10:44:34.049 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.962+0000 7f05ca732700 1 -- 172.21.15.107:0/2322070705 wait complete. 2024-05-10T10:44:34.049 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.963+0000 7f05ca732700 1 Processor -- start 2024-05-10T10:44:34.049 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.963+0000 7f05ca732700 1 -- start start 2024-05-10T10:44:34.049 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.963+0000 7f05ca732700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c4109c40 0x7f05c419f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:34.049 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.963+0000 7f05ca732700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f05c410d4d0 con 0x7f05c4109c40 2024-05-10T10:44:34.049 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.963+0000 7f05c3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c4109c40 0x7f05c419f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:34.049 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.963+0000 7f05c3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c4109c40 0x7f05c419f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34452/0 (socket says 172.21.15.107:34452) 2024-05-10T10:44:34.049 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.963+0000 7f05c3fff700 1 -- 172.21.15.107:0/2404831299 learned_addr learned my addr 172.21.15.107:0/2404831299 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:34.049 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.963+0000 7f05c3fff700 1 -- 172.21.15.107:0/2404831299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c419f780 con 0x7f05c4109c40 2024-05-10T10:44:34.049 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.963+0000 7f05c3fff700 1 --2- 172.21.15.107:0/2404831299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c4109c40 0x7f05c419f240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f05b4006af0 tx=0x7f05b4011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:34.049 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.964+0000 7f05c17fa700 1 -- 172.21.15.107:0/2404831299 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b40039a0 con 0x7f05c4109c40 2024-05-10T10:44:34.050 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.964+0000 7f05c17fa700 1 -- 172.21.15.107:0/2404831299 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f05b4003b40 con 0x7f05c4109c40 2024-05-10T10:44:34.050 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.964+0000 7f05ca732700 1 -- 172.21.15.107:0/2404831299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c419fa10 con 0x7f05c4109c40 2024-05-10T10:44:34.050 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.964+0000 7f05c17fa700 1 -- 172.21.15.107:0/2404831299 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b4019670 con 0x7f05c4109c40 2024-05-10T10:44:34.050 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.964+0000 7f05ca732700 1 -- 172.21.15.107:0/2404831299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c419fe70 con 0x7f05c4109c40 2024-05-10T10:44:34.050 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.965+0000 7f05c17fa700 1 -- 172.21.15.107:0/2404831299 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f05b40198e0 con 0x7f05c4109c40 2024-05-10T10:44:34.050 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.965+0000 7f05ca732700 1 -- 172.21.15.107:0/2404831299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05c4064b00 con 0x7f05c4109c40 2024-05-10T10:44:34.050 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.965+0000 7f05c17fa700 1 --2- 172.21.15.107:0/2404831299 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f05ac03e420 0x7f05ac0408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:34.050 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.965+0000 7f05c17fa700 1 -- 172.21.15.107:0/2404831299 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f05b4053a40 con 0x7f05c4109c40 2024-05-10T10:44:34.050 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.965+0000 7f05c37fe700 1 --2- 172.21.15.107:0/2404831299 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f05ac03e420 0x7f05ac0408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:34.050 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.965+0000 7f05c37fe700 1 --2- 172.21.15.107:0/2404831299 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f05ac03e420 0x7f05ac0408e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f05b8006fd0 tx=0x7f05b8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:34.050 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:32.970+0000 7f05c17fa700 1 -- 172.21.15.107:0/2404831299 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f05b4011e20 con 0x7f05c4109c40 2024-05-10T10:44:34.050 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:33.229+0000 7f05ca732700 1 -- 172.21.15.107:0/2404831299 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f05c41a2890 con 0x7f05c4109c40 2024-05-10T10:44:34.050 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:33.281+0000 7f05c17fa700 1 -- 172.21.15.107:0/2404831299 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f05c41a2890 con 0x7f05c4109c40 2024-05-10T10:44:34.051 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:33.283+0000 7f05c17fa700 1 -- 172.21.15.107:0/2404831299 <== mon.0 v2:172.21.15.107:3300/0 8 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f05b4019c80 con 0x7f05c4109c40 2024-05-10T10:44:34.051 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:33.284+0000 7f05ca732700 1 -- 172.21.15.107:0/2404831299 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f05ac03e420 msgr2=0x7f05ac0408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:34.051 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:33.284+0000 7f05ca732700 1 --2- 172.21.15.107:0/2404831299 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f05ac03e420 0x7f05ac0408e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f05b8006fd0 tx=0x7f05b8006e40 comp rx=0 tx=0).stop 2024-05-10T10:44:34.051 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:33.284+0000 7f05ca732700 1 -- 172.21.15.107:0/2404831299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c4109c40 msgr2=0x7f05c419f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:34.051 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:33.284+0000 7f05ca732700 1 --2- 172.21.15.107:0/2404831299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c4109c40 0x7f05c419f240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f05b4006af0 tx=0x7f05b4011ce0 comp rx=0 tx=0).stop 2024-05-10T10:44:34.051 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:33.284+0000 7f05ca732700 1 -- 172.21.15.107:0/2404831299 shutdown_connections 2024-05-10T10:44:34.051 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:33.284+0000 7f05ca732700 1 --2- 172.21.15.107:0/2404831299 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f05ac03e420 0x7f05ac0408e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:34.051 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:33.284+0000 7f05ca732700 1 --2- 172.21.15.107:0/2404831299 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05c4109c40 0x7f05c419f240 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:34.051 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:33.284+0000 7f05ca732700 1 -- 172.21.15.107:0/2404831299 >> 172.21.15.107:0/2404831299 conn(0x7f05c4103610 msgr2=0x7f05c4104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:34.051 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:33.284+0000 7f05ca732700 1 -- 172.21.15.107:0/2404831299 shutdown_connections 2024-05-10T10:44:34.051 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:33.284+0000 7f05ca732700 1 -- 172.21.15.107:0/2404831299 wait complete. 2024-05-10T10:44:34.384 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:34 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2404831299' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-10T10:44:34.384 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:34 smithi107 ceph-mon[30373]: mgrmap e5: x(active, since 5s) 2024-05-10T10:44:34.384 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:34 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:34.053+0000 7f0b31666200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T10:44:34.384 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:34 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:34.142+0000 7f0b31666200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T10:44:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:35 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1084911401' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-10T10:44:35.425 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:35 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:35.362+0000 7f0b31666200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T10:44:35.438 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2024-05-10T10:44:35.438 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-10T10:44:35.438 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-10T10:44:35.438 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-10T10:44:35.438 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-10T10:44:35.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2024-05-10T10:44:35.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.483+0000 7f7381d6b700 1 Processor -- start 2024-05-10T10:44:35.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.483+0000 7f7381d6b700 1 -- start start 2024-05-10T10:44:35.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.483+0000 7f7381d6b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c108060 0x7f737c108480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:35.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.483+0000 7f7381d6b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f737c108a50 con 0x7f737c108060 2024-05-10T10:44:35.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.483+0000 7f737b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c108060 0x7f737c108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:35.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.483+0000 7f737b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c108060 0x7f737c108480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34476/0 (socket says 172.21.15.107:34476) 2024-05-10T10:44:35.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.483+0000 7f737b7fe700 1 -- 172.21.15.107:0/2519092128 learned_addr learned my addr 172.21.15.107:0/2519092128 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:35.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.483+0000 7f737b7fe700 1 -- 172.21.15.107:0/2519092128 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737c109260 con 0x7f737c108060 2024-05-10T10:44:35.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.484+0000 7f737b7fe700 1 --2- 172.21.15.107:0/2519092128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c108060 0x7f737c108480 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f73700098a0 tx=0x7f7370009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55cffcb7bc7293cf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:35.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.484+0000 7f737a7fc700 1 -- 172.21.15.107:0/2519092128 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7370004160 con 0x7f737c108060 2024-05-10T10:44:35.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.484+0000 7f737a7fc700 1 -- 172.21.15.107:0/2519092128 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f7370004300 con 0x7f737c108060 2024-05-10T10:44:35.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.484+0000 7f737a7fc700 1 -- 172.21.15.107:0/2519092128 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7370011b20 con 0x7f737c108060 2024-05-10T10:44:35.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.485+0000 7f7381d6b700 1 -- 172.21.15.107:0/2519092128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c108060 msgr2=0x7f737c108480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:35.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.485+0000 7f7381d6b700 1 --2- 172.21.15.107:0/2519092128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c108060 0x7f737c108480 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f73700098a0 tx=0x7f7370009bb0 comp rx=0 tx=0).stop 2024-05-10T10:44:35.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.485+0000 7f7381d6b700 1 -- 172.21.15.107:0/2519092128 shutdown_connections 2024-05-10T10:44:35.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.485+0000 7f7381d6b700 1 --2- 172.21.15.107:0/2519092128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c108060 0x7f737c108480 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:35.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.485+0000 7f7381d6b700 1 -- 172.21.15.107:0/2519092128 >> 172.21.15.107:0/2519092128 conn(0x7f737c103620 msgr2=0x7f737c105a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:35.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.485+0000 7f7381d6b700 1 -- 172.21.15.107:0/2519092128 shutdown_connections 2024-05-10T10:44:35.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.485+0000 7f7381d6b700 1 -- 172.21.15.107:0/2519092128 wait complete. 2024-05-10T10:44:35.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.485+0000 7f7381d6b700 1 Processor -- start 2024-05-10T10:44:35.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.486+0000 7f7381d6b700 1 -- start start 2024-05-10T10:44:35.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.486+0000 7f7381d6b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c108060 0x7f737c19d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:35.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.486+0000 7f7381d6b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f737c10c610 con 0x7f737c108060 2024-05-10T10:44:35.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.486+0000 7f737b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c108060 0x7f737c19d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:35.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.486+0000 7f737b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c108060 0x7f737c19d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34482/0 (socket says 172.21.15.107:34482) 2024-05-10T10:44:35.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.486+0000 7f737b7fe700 1 -- 172.21.15.107:0/1084911401 learned_addr learned my addr 172.21.15.107:0/1084911401 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:35.442 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.486+0000 7f737b7fe700 1 -- 172.21.15.107:0/1084911401 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737c19d5d0 con 0x7f737c108060 2024-05-10T10:44:35.442 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.486+0000 7f737b7fe700 1 --2- 172.21.15.107:0/1084911401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c108060 0x7f737c19d090 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7370006af0 tx=0x7f7370011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:35.442 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.486+0000 7f7378ff9700 1 -- 172.21.15.107:0/1084911401 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7370003930 con 0x7f737c108060 2024-05-10T10:44:35.442 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.486+0000 7f7378ff9700 1 -- 172.21.15.107:0/1084911401 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f7370003ad0 con 0x7f737c108060 2024-05-10T10:44:35.442 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.487+0000 7f7381d6b700 1 -- 172.21.15.107:0/1084911401 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f737c19d860 con 0x7f737c108060 2024-05-10T10:44:35.442 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.487+0000 7f7381d6b700 1 -- 172.21.15.107:0/1084911401 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f737c19dcc0 con 0x7f737c108060 2024-05-10T10:44:35.442 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.487+0000 7f7378ff9700 1 -- 172.21.15.107:0/1084911401 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7370019610 con 0x7f737c108060 2024-05-10T10:44:35.442 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.488+0000 7f7378ff9700 1 -- 172.21.15.107:0/1084911401 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f73700198e0 con 0x7f737c108060 2024-05-10T10:44:35.443 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.488+0000 7f7381d6b700 1 -- 172.21.15.107:0/1084911401 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f737c064b00 con 0x7f737c108060 2024-05-10T10:44:35.443 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.488+0000 7f7378ff9700 1 --2- 172.21.15.107:0/1084911401 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f736403e470 0x7f7364040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:35.443 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.488+0000 7f7378ff9700 1 -- 172.21.15.107:0/1084911401 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7370053a20 con 0x7f737c108060 2024-05-10T10:44:35.443 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.488+0000 7f737affd700 1 -- 172.21.15.107:0/1084911401 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f736403e470 msgr2=0x7f7364040930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/1956906497 2024-05-10T10:44:35.443 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.488+0000 7f737affd700 1 --2- 172.21.15.107:0/1084911401 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f736403e470 0x7f7364040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T10:44:35.443 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.493+0000 7f7378ff9700 1 -- 172.21.15.107:0/1084911401 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f7370011e20 con 0x7f737c108060 2024-05-10T10:44:35.443 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.689+0000 7f737affd700 1 -- 172.21.15.107:0/1084911401 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f736403e470 msgr2=0x7f7364040930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/1956906497 2024-05-10T10:44:35.443 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.689+0000 7f737affd700 1 --2- 172.21.15.107:0/1084911401 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f736403e470 0x7f7364040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-10T10:44:35.444 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.801+0000 7f7381d6b700 1 -- 172.21.15.107:0/1084911401 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f737c0640b0 con 0x7f737c108060 2024-05-10T10:44:35.444 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.802+0000 7f7378ff9700 1 -- 172.21.15.107:0/1084911401 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f7370017e90 con 0x7f737c108060 2024-05-10T10:44:35.444 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.805+0000 7f7381d6b700 1 -- 172.21.15.107:0/1084911401 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f736403e470 msgr2=0x7f7364040930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T10:44:35.444 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.805+0000 7f7381d6b700 1 --2- 172.21.15.107:0/1084911401 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f736403e470 0x7f7364040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:35.444 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.805+0000 7f7381d6b700 1 -- 172.21.15.107:0/1084911401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c108060 msgr2=0x7f737c19d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:35.444 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.805+0000 7f7381d6b700 1 --2- 172.21.15.107:0/1084911401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c108060 0x7f737c19d090 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7370006af0 tx=0x7f7370011c10 comp rx=0 tx=0).stop 2024-05-10T10:44:35.444 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.805+0000 7f7381d6b700 1 -- 172.21.15.107:0/1084911401 shutdown_connections 2024-05-10T10:44:35.444 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.805+0000 7f7381d6b700 1 --2- 172.21.15.107:0/1084911401 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f736403e470 0x7f7364040930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:35.444 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.805+0000 7f7381d6b700 1 --2- 172.21.15.107:0/1084911401 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f737c108060 0x7f737c19d090 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:35.444 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.805+0000 7f7381d6b700 1 -- 172.21.15.107:0/1084911401 >> 172.21.15.107:0/1084911401 conn(0x7f737c103620 msgr2=0x7f737c1044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:35.445 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.805+0000 7f7381d6b700 1 -- 172.21.15.107:0/1084911401 shutdown_connections 2024-05-10T10:44:35.445 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:34.805+0000 7f7381d6b700 1 -- 172.21.15.107:0/1084911401 wait complete. 2024-05-10T10:44:35.445 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for the mgr to restart... 2024-05-10T10:44:35.445 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for mgr epoch 5... 2024-05-10T10:44:35.719 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:35 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:35.540+0000 7f0b31666200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T10:44:35.720 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:35 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:35.718+0000 7f0b31666200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T10:44:36.304 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:36 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:36.012+0000 7f0b31666200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T10:44:36.304 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:36 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:36.104+0000 7f0b31666200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T10:44:36.304 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:36 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:36.302+0000 7f0b31666200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T10:44:36.675 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:36 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:36.494+0000 7f0b31666200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T10:44:37.422 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:37 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:37.099+0000 7f0b31666200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T10:44:37.422 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:37 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:37.318+0000 7f0b31666200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-10T10:44:38.175 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:37 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:37.745+0000 7f0b31666200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T10:44:38.175 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:37 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:37.841+0000 7f0b31666200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T10:44:38.558 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:38.206+0000 7f0b31666200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T10:44:38.842 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:38.556+0000 7f0b31666200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T10:44:38.842 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:38.648+0000 7f0b31666200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T10:44:39.118 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:38.889+0000 7f0b31666200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T10:44:39.118 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:39 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:39.021+0000 7f0b31666200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T10:44:39.425 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:39 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:39.116+0000 7f0b31666200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T10:44:39.925 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:39 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:39.437+0000 7f0b31666200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T10:44:39.925 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:39 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:39.530+0000 7f0b31666200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T10:44:40.391 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:40 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:40.123+0000 7f0b31666200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T10:44:40.391 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:40 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:44:40.337+0000 7f0b31666200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T10:44:40.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:40 smithi107 ceph-mon[30373]: Active manager daemon x restarted 2024-05-10T10:44:40.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:40 smithi107 ceph-mon[30373]: Activating manager daemon x 2024-05-10T10:44:40.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:40 smithi107 ceph-mon[30373]: osdmap e2: 0 total, 0 up, 0 in 2024-05-10T10:44:40.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:40 smithi107 ceph-mon[30373]: mgrmap e6: x(active, starting, since 0.00351171s) 2024-05-10T10:44:40.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:40 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T10:44:40.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:40 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-10T10:44:40.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:40 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-10T10:44:40.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:40 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-10T10:44:40.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:40 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-10T10:44:40.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:40 smithi107 ceph-mon[30373]: Manager daemon x is now available 2024-05-10T10:44:40.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:40 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' 2024-05-10T10:44:40.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:40 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' 2024-05-10T10:44:40.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:40 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:44:40.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:40 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:44:40.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:40 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-10T10:44:41.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:41 smithi107 ceph-mon[30373]: Found migration_current of "None". Setting to last migration. 2024-05-10T10:44:41.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:41 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-10T10:44:41.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:41 smithi107 ceph-mon[30373]: mgrmap e7: x(active, since 1.00584s) 2024-05-10T10:44:42.020 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2024-05-10T10:44:42.020 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-10T10:44:42.020 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-10T10:44:42.020 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2024-05-10T10:44:42.021 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.831+0000 7f6c3c87b700 1 Processor -- start 2024-05-10T10:44:42.021 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.831+0000 7f6c3c87b700 1 -- start start 2024-05-10T10:44:42.021 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.831+0000 7f6c3c87b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c38108070 0x7f6c38108490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:42.021 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.831+0000 7f6c3c87b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38108a60 con 0x7f6c38108070 2024-05-10T10:44:42.021 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.832+0000 7f6c3659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c38108070 0x7f6c38108490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:42.021 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.832+0000 7f6c3659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c38108070 0x7f6c38108490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34496/0 (socket says 172.21.15.107:34496) 2024-05-10T10:44:42.021 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.832+0000 7f6c3659c700 1 -- 172.21.15.107:0/2222219078 learned_addr learned my addr 172.21.15.107:0/2222219078 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:42.021 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.832+0000 7f6c3659c700 1 -- 172.21.15.107:0/2222219078 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c38109270 con 0x7f6c38108070 2024-05-10T10:44:42.021 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.832+0000 7f6c3659c700 1 --2- 172.21.15.107:0/2222219078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c38108070 0x7f6c38108490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6c280098a0 tx=0x7f6c28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873ba8cd1ea20884 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:42.021 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.832+0000 7f6c3559a700 1 -- 172.21.15.107:0/2222219078 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c28004160 con 0x7f6c38108070 2024-05-10T10:44:42.021 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.832+0000 7f6c3559a700 1 -- 172.21.15.107:0/2222219078 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f6c28004300 con 0x7f6c38108070 2024-05-10T10:44:42.021 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.832+0000 7f6c3559a700 1 -- 172.21.15.107:0/2222219078 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c28011b20 con 0x7f6c38108070 2024-05-10T10:44:42.021 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.833+0000 7f6c3c87b700 1 -- 172.21.15.107:0/2222219078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c38108070 msgr2=0x7f6c38108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:42.021 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.833+0000 7f6c3c87b700 1 --2- 172.21.15.107:0/2222219078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c38108070 0x7f6c38108490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6c280098a0 tx=0x7f6c28009bb0 comp rx=0 tx=0).stop 2024-05-10T10:44:42.022 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.833+0000 7f6c3c87b700 1 -- 172.21.15.107:0/2222219078 shutdown_connections 2024-05-10T10:44:42.022 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.833+0000 7f6c3c87b700 1 --2- 172.21.15.107:0/2222219078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c38108070 0x7f6c38108490 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:42.022 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.833+0000 7f6c3c87b700 1 -- 172.21.15.107:0/2222219078 >> 172.21.15.107:0/2222219078 conn(0x7f6c38103610 msgr2=0x7f6c38105a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:42.022 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.833+0000 7f6c3c87b700 1 -- 172.21.15.107:0/2222219078 shutdown_connections 2024-05-10T10:44:42.022 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.833+0000 7f6c3c87b700 1 -- 172.21.15.107:0/2222219078 wait complete. 2024-05-10T10:44:42.022 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.834+0000 7f6c3c87b700 1 Processor -- start 2024-05-10T10:44:42.022 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.834+0000 7f6c3c87b700 1 -- start start 2024-05-10T10:44:42.022 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.834+0000 7f6c3c87b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c38108070 0x7f6c3819d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:42.022 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.834+0000 7f6c3c87b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3810c620 con 0x7f6c38108070 2024-05-10T10:44:42.022 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.834+0000 7f6c3659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c38108070 0x7f6c3819d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:42.022 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.834+0000 7f6c3659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c38108070 0x7f6c3819d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34502/0 (socket says 172.21.15.107:34502) 2024-05-10T10:44:42.022 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.834+0000 7f6c3659c700 1 -- 172.21.15.107:0/2332295756 learned_addr learned my addr 172.21.15.107:0/2332295756 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:42.022 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.834+0000 7f6c3659c700 1 -- 172.21.15.107:0/2332295756 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3819d610 con 0x7f6c38108070 2024-05-10T10:44:42.022 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.834+0000 7f6c3659c700 1 --2- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c38108070 0x7f6c3819d0d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6c28006af0 tx=0x7f6c28011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:42.023 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.835+0000 7f6c277fe700 1 -- 172.21.15.107:0/2332295756 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c28003930 con 0x7f6c38108070 2024-05-10T10:44:42.023 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.835+0000 7f6c277fe700 1 -- 172.21.15.107:0/2332295756 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f6c28003ad0 con 0x7f6c38108070 2024-05-10T10:44:42.023 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.835+0000 7f6c3c87b700 1 -- 172.21.15.107:0/2332295756 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c3819d8a0 con 0x7f6c38108070 2024-05-10T10:44:42.023 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.835+0000 7f6c277fe700 1 -- 172.21.15.107:0/2332295756 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c28019610 con 0x7f6c38108070 2024-05-10T10:44:42.023 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.835+0000 7f6c3c87b700 1 -- 172.21.15.107:0/2332295756 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c3819dd00 con 0x7f6c38108070 2024-05-10T10:44:42.023 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.836+0000 7f6c277fe700 1 -- 172.21.15.107:0/2332295756 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f6c28019880 con 0x7f6c38108070 2024-05-10T10:44:42.023 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.836+0000 7f6c277fe700 1 --2- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f6c2003e470 0x7f6c20040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:42.023 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.836+0000 7f6c277fe700 1 -- 172.21.15.107:0/2332295756 --> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6c20041040 con 0x7f6c2003e470 2024-05-10T10:44:42.023 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.836+0000 7f6c35d9b700 1 -- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f6c2003e470 msgr2=0x7f6c20040930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/1956906497 2024-05-10T10:44:42.023 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.836+0000 7f6c277fe700 1 -- 172.21.15.107:0/2332295756 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6c28053a10 con 0x7f6c38108070 2024-05-10T10:44:42.023 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:35.836+0000 7f6c35d9b700 1 --2- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f6c2003e470 0x7f6c20040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T10:44:42.023 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:36.037+0000 7f6c35d9b700 1 -- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f6c2003e470 msgr2=0x7f6c20040930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/1956906497 2024-05-10T10:44:42.023 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:36.037+0000 7f6c35d9b700 1 --2- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f6c2003e470 0x7f6c20040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-10T10:44:42.023 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:36.438+0000 7f6c35d9b700 1 -- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f6c2003e470 msgr2=0x7f6c20040930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/1956906497 2024-05-10T10:44:42.024 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:36.438+0000 7f6c35d9b700 1 --2- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f6c2003e470 0x7f6c20040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-10T10:44:42.024 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:37.239+0000 7f6c35d9b700 1 -- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f6c2003e470 msgr2=0x7f6c20040930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/1956906497 2024-05-10T10:44:42.024 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:37.239+0000 7f6c35d9b700 1 --2- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f6c2003e470 0x7f6c20040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-10T10:44:42.024 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:38.840+0000 7f6c35d9b700 1 -- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f6c2003e470 msgr2=0x7f6c20040930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/1956906497 2024-05-10T10:44:42.024 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:38.840+0000 7f6c35d9b700 1 --2- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f6c2003e470 0x7f6c20040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-10T10:44:42.024 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:40.340+0000 7f6c277fe700 1 -- 172.21.15.107:0/2332295756 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mgrmap(e 6) ==== 49989+0+0 (secure 0 0 0) 0x7f6c2800fd80 con 0x7f6c38108070 2024-05-10T10:44:42.024 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:40.341+0000 7f6c277fe700 1 -- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f6c2003e470 msgr2=0x7f6c20040930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T10:44:42.024 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:40.341+0000 7f6c277fe700 1 --2- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f6c2003e470 0x7f6c20040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:42.024 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:41.342+0000 7f6c277fe700 1 -- 172.21.15.107:0/2332295756 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 7) ==== 50116+0+0 (secure 0 0 0) 0x7f6c28055b30 con 0x7f6c38108070 2024-05-10T10:44:42.024 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:41.342+0000 7f6c277fe700 1 --2- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f6c20041d60 0x7f6c20044150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:42.024 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:41.342+0000 7f6c277fe700 1 -- 172.21.15.107:0/2332295756 --> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6c28022e70 con 0x7f6c20041d60 2024-05-10T10:44:42.024 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:41.343+0000 7f6c35d9b700 1 --2- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f6c20041d60 0x7f6c20044150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:42.024 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:41.343+0000 7f6c35d9b700 1 --2- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f6c20041d60 0x7f6c20044150 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c003a10 tx=0x7f6c2c0092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:42.024 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:41.344+0000 7f6c277fe700 1 -- 172.21.15.107:0/2332295756 <== mgr.14120 v2:172.21.15.107:6800/892499090 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f6c28022e70 con 0x7f6c20041d60 2024-05-10T10:44:42.024 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:41.358+0000 7f6c3c87b700 1 -- 172.21.15.107:0/2332295756 --> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f6c38064b00 con 0x7f6c20041d60 2024-05-10T10:44:42.025 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:41.358+0000 7f6c277fe700 1 -- 172.21.15.107:0/2332295756 <== mgr.14120 v2:172.21.15.107:6800/892499090 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f6c38064b00 con 0x7f6c20041d60 2024-05-10T10:44:42.025 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:41.358+0000 7f6c3c87b700 1 -- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f6c20041d60 msgr2=0x7f6c20044150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:42.025 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:41.358+0000 7f6c3c87b700 1 --2- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f6c20041d60 0x7f6c20044150 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c003a10 tx=0x7f6c2c0092b0 comp rx=0 tx=0).stop 2024-05-10T10:44:42.025 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:41.358+0000 7f6c3c87b700 1 -- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c38108070 msgr2=0x7f6c3819d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:42.025 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:41.358+0000 7f6c3c87b700 1 --2- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c38108070 0x7f6c3819d0d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6c28006af0 tx=0x7f6c28011c10 comp rx=0 tx=0).stop 2024-05-10T10:44:42.025 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:41.358+0000 7f6c3c87b700 1 -- 172.21.15.107:0/2332295756 shutdown_connections 2024-05-10T10:44:42.025 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:41.358+0000 7f6c3c87b700 1 --2- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f6c20041d60 0x7f6c20044150 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:42.025 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:41.358+0000 7f6c3c87b700 1 --2- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6c38108070 0x7f6c3819d0d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:42.025 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:41.358+0000 7f6c3c87b700 1 --2- 172.21.15.107:0/2332295756 >> [v2:172.21.15.107:6800/1956906497,v1:172.21.15.107:6801/1956906497] conn(0x7f6c2003e470 0x7f6c20040930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:42.025 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:41.358+0000 7f6c3c87b700 1 -- 172.21.15.107:0/2332295756 >> 172.21.15.107:0/2332295756 conn(0x7f6c38103610 msgr2=0x7f6c381044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:42.025 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:41.359+0000 7f6c3c87b700 1 -- 172.21.15.107:0/2332295756 shutdown_connections 2024-05-10T10:44:42.025 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:41.359+0000 7f6c3c87b700 1 -- 172.21.15.107:0/2332295756 wait complete. 2024-05-10T10:44:42.025 INFO:teuthology.orchestra.run.smithi107.stdout:mgr epoch 5 is available 2024-05-10T10:44:42.025 INFO:teuthology.orchestra.run.smithi107.stdout:Setting orchestrator backend to cephadm... 2024-05-10T10:44:42.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:42 smithi107 ceph-mon[30373]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-10T10:44:42.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:42 smithi107 ceph-mon[30373]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-10T10:44:42.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:42 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' 2024-05-10T10:44:42.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:42 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' 2024-05-10T10:44:42.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:42 smithi107 ceph-mon[30373]: [10/May/2024:10:44:41] ENGINE Bus STARTING 2024-05-10T10:44:42.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:42 smithi107 ceph-mon[30373]: [10/May/2024:10:44:41] ENGINE Serving on http://172.21.15.107:8765 2024-05-10T10:44:42.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:42 smithi107 ceph-mon[30373]: [10/May/2024:10:44:42] ENGINE Serving on https://172.21.15.107:7150 2024-05-10T10:44:42.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:42 smithi107 ceph-mon[30373]: [10/May/2024:10:44:42] ENGINE Bus STARTED 2024-05-10T10:44:42.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:42 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:44:43.259 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.439+0000 7f2059272700 1 Processor -- start 2024-05-10T10:44:43.259 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.439+0000 7f2059272700 1 -- start start 2024-05-10T10:44:43.259 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.439+0000 7f2059272700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20541074f0 0x7f2054107910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:43.259 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.439+0000 7f2059272700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2054107ee0 con 0x7f20541074f0 2024-05-10T10:44:43.259 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.439+0000 7f2052ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20541074f0 0x7f2054107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:43.259 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.439+0000 7f2052ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20541074f0 0x7f2054107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59342/0 (socket says 172.21.15.107:59342) 2024-05-10T10:44:43.259 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.439+0000 7f2052ffd700 1 -- 172.21.15.107:0/4218279353 learned_addr learned my addr 172.21.15.107:0/4218279353 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:43.259 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.440+0000 7f2052ffd700 1 -- 172.21.15.107:0/4218279353 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205410a490 con 0x7f20541074f0 2024-05-10T10:44:43.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.440+0000 7f2052ffd700 1 --2- 172.21.15.107:0/4218279353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20541074f0 0x7f2054107910 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f20440098a0 tx=0x7f2044009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a990976601ad3e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:43.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.440+0000 7f2051ffb700 1 -- 172.21.15.107:0/4218279353 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2044004160 con 0x7f20541074f0 2024-05-10T10:44:43.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.440+0000 7f2051ffb700 1 -- 172.21.15.107:0/4218279353 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f2044004300 con 0x7f20541074f0 2024-05-10T10:44:43.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.440+0000 7f2051ffb700 1 -- 172.21.15.107:0/4218279353 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2044011b20 con 0x7f20541074f0 2024-05-10T10:44:43.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.440+0000 7f2059272700 1 -- 172.21.15.107:0/4218279353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20541074f0 msgr2=0x7f2054107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:43.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.440+0000 7f2059272700 1 --2- 172.21.15.107:0/4218279353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20541074f0 0x7f2054107910 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f20440098a0 tx=0x7f2044009bb0 comp rx=0 tx=0).stop 2024-05-10T10:44:43.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.441+0000 7f2059272700 1 -- 172.21.15.107:0/4218279353 shutdown_connections 2024-05-10T10:44:43.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.441+0000 7f2059272700 1 --2- 172.21.15.107:0/4218279353 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20541074f0 0x7f2054107910 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:43.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.441+0000 7f2059272700 1 -- 172.21.15.107:0/4218279353 >> 172.21.15.107:0/4218279353 conn(0x7f2054102e90 msgr2=0x7f20541052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:43.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.441+0000 7f2059272700 1 -- 172.21.15.107:0/4218279353 shutdown_connections 2024-05-10T10:44:43.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.441+0000 7f2059272700 1 -- 172.21.15.107:0/4218279353 wait complete. 2024-05-10T10:44:43.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.441+0000 7f2059272700 1 Processor -- start 2024-05-10T10:44:43.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.441+0000 7f2059272700 1 -- start start 2024-05-10T10:44:43.260 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.442+0000 7f2059272700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20541074f0 0x7f205419d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:43.261 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.442+0000 7f2059272700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f205410d6c0 con 0x7f20541074f0 2024-05-10T10:44:43.261 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.442+0000 7f2052ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20541074f0 0x7f205419d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:43.261 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.442+0000 7f2052ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20541074f0 0x7f205419d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59344/0 (socket says 172.21.15.107:59344) 2024-05-10T10:44:43.261 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.442+0000 7f2052ffd700 1 -- 172.21.15.107:0/3312571163 learned_addr learned my addr 172.21.15.107:0/3312571163 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:43.261 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.442+0000 7f2052ffd700 1 -- 172.21.15.107:0/3312571163 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205419d5b0 con 0x7f20541074f0 2024-05-10T10:44:43.261 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.442+0000 7f2052ffd700 1 --2- 172.21.15.107:0/3312571163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20541074f0 0x7f205419d070 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f20440116a0 tx=0x7f2044011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:43.261 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.442+0000 7f203bfff700 1 -- 172.21.15.107:0/3312571163 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2044003ab0 con 0x7f20541074f0 2024-05-10T10:44:43.261 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.442+0000 7f203bfff700 1 -- 172.21.15.107:0/3312571163 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f2044003c50 con 0x7f20541074f0 2024-05-10T10:44:43.261 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.442+0000 7f2059272700 1 -- 172.21.15.107:0/3312571163 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205419d840 con 0x7f20541074f0 2024-05-10T10:44:43.261 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.442+0000 7f203bfff700 1 -- 172.21.15.107:0/3312571163 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2044019870 con 0x7f20541074f0 2024-05-10T10:44:43.261 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.442+0000 7f2059272700 1 -- 172.21.15.107:0/3312571163 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f205419dca0 con 0x7f20541074f0 2024-05-10T10:44:43.261 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.443+0000 7f203bfff700 1 -- 172.21.15.107:0/3312571163 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 7) ==== 50116+0+0 (secure 0 0 0) 0x7f2044019b30 con 0x7f20541074f0 2024-05-10T10:44:43.261 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.443+0000 7f2059272700 1 -- 172.21.15.107:0/3312571163 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2054064b00 con 0x7f20541074f0 2024-05-10T10:44:43.261 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.443+0000 7f203bfff700 1 --2- 172.21.15.107:0/3312571163 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f203c03e310 0x7f203c0407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.443+0000 7f203bfff700 1 -- 172.21.15.107:0/3312571163 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2044053680 con 0x7f20541074f0 2024-05-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.444+0000 7f20527fc700 1 --2- 172.21.15.107:0/3312571163 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f203c03e310 0x7f203c0407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.444+0000 7f20527fc700 1 --2- 172.21.15.107:0/3312571163 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f203c03e310 0x7f203c0407d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2048006fd0 tx=0x7f2048006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.448+0000 7f203bfff700 1 -- 172.21.15.107:0/3312571163 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f2044011e20 con 0x7f20541074f0 2024-05-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.593+0000 7f203bfff700 1 -- 172.21.15.107:0/3312571163 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f204402dcd0 con 0x7f20541074f0 2024-05-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.669+0000 7f2059272700 1 -- 172.21.15.107:0/3312571163 --> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f2054104020 con 0x7f203c03e310 2024-05-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.674+0000 7f203bfff700 1 -- 172.21.15.107:0/3312571163 <== mgr.14120 v2:172.21.15.107:6800/892499090 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2054104020 con 0x7f203c03e310 2024-05-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.676+0000 7f2059272700 1 -- 172.21.15.107:0/3312571163 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f203c03e310 msgr2=0x7f203c0407d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.676+0000 7f2059272700 1 --2- 172.21.15.107:0/3312571163 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f203c03e310 0x7f203c0407d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2048006fd0 tx=0x7f2048006e40 comp rx=0 tx=0).stop 2024-05-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.676+0000 7f2059272700 1 -- 172.21.15.107:0/3312571163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20541074f0 msgr2=0x7f205419d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.676+0000 7f2059272700 1 --2- 172.21.15.107:0/3312571163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20541074f0 0x7f205419d070 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f20440116a0 tx=0x7f2044011ce0 comp rx=0 tx=0).stop 2024-05-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.676+0000 7f2059272700 1 -- 172.21.15.107:0/3312571163 shutdown_connections 2024-05-10T10:44:43.262 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.676+0000 7f2059272700 1 --2- 172.21.15.107:0/3312571163 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f203c03e310 0x7f203c0407d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:43.263 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.676+0000 7f2059272700 1 --2- 172.21.15.107:0/3312571163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f20541074f0 0x7f205419d070 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:43.263 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.676+0000 7f2059272700 1 -- 172.21.15.107:0/3312571163 >> 172.21.15.107:0/3312571163 conn(0x7f2054102e90 msgr2=0x7f2054103910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:43.263 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.677+0000 7f2059272700 1 -- 172.21.15.107:0/3312571163 shutdown_connections 2024-05-10T10:44:43.263 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:42.677+0000 7f2059272700 1 -- 172.21.15.107:0/3312571163 wait complete. 2024-05-10T10:44:43.876 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:43 smithi107 ceph-mon[30373]: mgrmap e8: x(active, since 2s) 2024-05-10T10:44:43.876 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:43 smithi107 ceph-mon[30373]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:44:43.876 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:43 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' 2024-05-10T10:44:43.877 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:43 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:44:44.483 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-10T10:44:44.483 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.658+0000 7f459b3a4700 1 Processor -- start 2024-05-10T10:44:44.483 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.658+0000 7f459b3a4700 1 -- start start 2024-05-10T10:44:44.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.658+0000 7f459b3a4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4594109240 0x7f4594109660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:44.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.658+0000 7f459b3a4700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4594109c30 con 0x7f4594109240 2024-05-10T10:44:44.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.658+0000 7f4599140700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4594109240 0x7f4594109660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:44.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.658+0000 7f4599140700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4594109240 0x7f4594109660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59352/0 (socket says 172.21.15.107:59352) 2024-05-10T10:44:44.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.658+0000 7f4599140700 1 -- 172.21.15.107:0/1333651093 learned_addr learned my addr 172.21.15.107:0/1333651093 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:44.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.658+0000 7f4599140700 1 -- 172.21.15.107:0/1333651093 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459410a3a0 con 0x7f4594109240 2024-05-10T10:44:44.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.659+0000 7f4599140700 1 --2- 172.21.15.107:0/1333651093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4594109240 0x7f4594109660 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f45840098a0 tx=0x7f4584009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83c20db66348bb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:44.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.659+0000 7f458bfff700 1 -- 172.21.15.107:0/1333651093 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4584004160 con 0x7f4594109240 2024-05-10T10:44:44.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.659+0000 7f458bfff700 1 -- 172.21.15.107:0/1333651093 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f4584004300 con 0x7f4594109240 2024-05-10T10:44:44.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.659+0000 7f458bfff700 1 -- 172.21.15.107:0/1333651093 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4584011b20 con 0x7f4594109240 2024-05-10T10:44:44.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.659+0000 7f459b3a4700 1 -- 172.21.15.107:0/1333651093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4594109240 msgr2=0x7f4594109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:44.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.659+0000 7f459b3a4700 1 --2- 172.21.15.107:0/1333651093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4594109240 0x7f4594109660 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f45840098a0 tx=0x7f4584009bb0 comp rx=0 tx=0).stop 2024-05-10T10:44:44.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.659+0000 7f459b3a4700 1 -- 172.21.15.107:0/1333651093 shutdown_connections 2024-05-10T10:44:44.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.659+0000 7f459b3a4700 1 --2- 172.21.15.107:0/1333651093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4594109240 0x7f4594109660 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:44.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.659+0000 7f459b3a4700 1 -- 172.21.15.107:0/1333651093 >> 172.21.15.107:0/1333651093 conn(0x7f4594104840 msgr2=0x7f4594106c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:44.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.659+0000 7f459b3a4700 1 -- 172.21.15.107:0/1333651093 shutdown_connections 2024-05-10T10:44:44.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.659+0000 7f459b3a4700 1 -- 172.21.15.107:0/1333651093 wait complete. 2024-05-10T10:44:44.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.660+0000 7f459b3a4700 1 Processor -- start 2024-05-10T10:44:44.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.660+0000 7f459b3a4700 1 -- start start 2024-05-10T10:44:44.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.660+0000 7f459b3a4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4594109240 0x7f459407eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:44.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.660+0000 7f459b3a4700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f459410d5d0 con 0x7f4594109240 2024-05-10T10:44:44.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.660+0000 7f4599140700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4594109240 0x7f459407eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:44.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.660+0000 7f4599140700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4594109240 0x7f459407eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59356/0 (socket says 172.21.15.107:59356) 2024-05-10T10:44:44.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.660+0000 7f4599140700 1 -- 172.21.15.107:0/2193816306 learned_addr learned my addr 172.21.15.107:0/2193816306 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:44.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.661+0000 7f4599140700 1 -- 172.21.15.107:0/2193816306 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459407f0d0 con 0x7f4594109240 2024-05-10T10:44:44.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.661+0000 7f4599140700 1 --2- 172.21.15.107:0/2193816306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4594109240 0x7f459407eb90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f45840117e0 tx=0x7f4584011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:44.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.661+0000 7f458a7fc700 1 -- 172.21.15.107:0/2193816306 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45840039f0 con 0x7f4594109240 2024-05-10T10:44:44.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.661+0000 7f458a7fc700 1 -- 172.21.15.107:0/2193816306 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f4584003b90 con 0x7f4594109240 2024-05-10T10:44:44.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.661+0000 7f459b3a4700 1 -- 172.21.15.107:0/2193816306 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f459407d2c0 con 0x7f4594109240 2024-05-10T10:44:44.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.661+0000 7f458a7fc700 1 -- 172.21.15.107:0/2193816306 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f458401a690 con 0x7f4594109240 2024-05-10T10:44:44.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.661+0000 7f459b3a4700 1 -- 172.21.15.107:0/2193816306 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f459407d780 con 0x7f4594109240 2024-05-10T10:44:44.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.662+0000 7f458a7fc700 1 -- 172.21.15.107:0/2193816306 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f458401a940 con 0x7f4594109240 2024-05-10T10:44:44.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.662+0000 7f459b3a4700 1 -- 172.21.15.107:0/2193816306 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4594064b00 con 0x7f4594109240 2024-05-10T10:44:44.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.662+0000 7f458a7fc700 1 --2- 172.21.15.107:0/2193816306 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f458003e420 0x7f45800408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:44.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.662+0000 7f458a7fc700 1 -- 172.21.15.107:0/2193816306 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4584053ae0 con 0x7f4594109240 2024-05-10T10:44:44.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.662+0000 7f459893f700 1 --2- 172.21.15.107:0/2193816306 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f458003e420 0x7f45800408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:44.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.663+0000 7f459893f700 1 --2- 172.21.15.107:0/2193816306 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f458003e420 0x7f45800408e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4590006fd0 tx=0x7f4590006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:44.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.667+0000 7f458a7fc700 1 -- 172.21.15.107:0/2193816306 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4584011e20 con 0x7f4594109240 2024-05-10T10:44:44.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.875+0000 7f459b3a4700 1 -- 172.21.15.107:0/2193816306 --> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f45941059f0 con 0x7f458003e420 2024-05-10T10:44:44.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.876+0000 7f458a7fc700 1 -- 172.21.15.107:0/2193816306 <== mgr.14120 v2:172.21.15.107:6800/892499090 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f45941059f0 con 0x7f458003e420 2024-05-10T10:44:44.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.878+0000 7f459b3a4700 1 -- 172.21.15.107:0/2193816306 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f458003e420 msgr2=0x7f45800408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:44.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.878+0000 7f459b3a4700 1 --2- 172.21.15.107:0/2193816306 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f458003e420 0x7f45800408e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4590006fd0 tx=0x7f4590006e40 comp rx=0 tx=0).stop 2024-05-10T10:44:44.487 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.878+0000 7f459b3a4700 1 -- 172.21.15.107:0/2193816306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4594109240 msgr2=0x7f459407eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:44.487 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.878+0000 7f459b3a4700 1 --2- 172.21.15.107:0/2193816306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4594109240 0x7f459407eb90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f45840117e0 tx=0x7f4584011ba0 comp rx=0 tx=0).stop 2024-05-10T10:44:44.487 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.878+0000 7f459b3a4700 1 -- 172.21.15.107:0/2193816306 shutdown_connections 2024-05-10T10:44:44.487 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.878+0000 7f459b3a4700 1 --2- 172.21.15.107:0/2193816306 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f458003e420 0x7f45800408e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:44.487 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.878+0000 7f459b3a4700 1 --2- 172.21.15.107:0/2193816306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4594109240 0x7f459407eb90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:44.487 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.878+0000 7f459b3a4700 1 -- 172.21.15.107:0/2193816306 >> 172.21.15.107:0/2193816306 conn(0x7f4594104840 msgr2=0x7f45941052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:44.487 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.878+0000 7f459b3a4700 1 -- 172.21.15.107:0/2193816306 shutdown_connections 2024-05-10T10:44:44.487 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:43.878+0000 7f459b3a4700 1 -- 172.21.15.107:0/2193816306 wait complete. 2024-05-10T10:44:44.487 INFO:teuthology.orchestra.run.smithi107.stdout:Generating ssh key... 2024-05-10T10:44:44.725 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:44 smithi107 ceph-mon[30373]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:44:45.379 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: Generating public/private rsa key pair. 2024-05-10T10:44:45.380 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: Your identification has been saved in /tmp/tmp2425h8fy/key. 2024-05-10T10:44:45.380 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: Your public key has been saved in /tmp/tmp2425h8fy/key.pub. 2024-05-10T10:44:45.380 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: The key fingerprint is: 2024-05-10T10:44:45.380 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: SHA256:1vmnXiJdhAgSqY/npiDlYe85Fa0OaZgNR/vm2il5bb8 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:44:45.380 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: The key's randomart image is: 2024-05-10T10:44:45.380 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: +---[RSA 3072]----+ 2024-05-10T10:44:45.380 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: | oo. | 2024-05-10T10:44:45.380 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: | . .. . . . | 2024-05-10T10:44:45.380 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: | . o . . . . | 2024-05-10T10:44:45.381 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: | . + . .. . . | 2024-05-10T10:44:45.381 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: | +* = oS o . | 2024-05-10T10:44:45.381 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: | +oo* B. o . | 2024-05-10T10:44:45.381 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: |. o..X . . + o | 2024-05-10T10:44:45.381 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: | . o+o*.o . = | 2024-05-10T10:44:45.381 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: | =Bo. .Eoo | 2024-05-10T10:44:45.381 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:44:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: +----[SHA256]-----+ 2024-05-10T10:44:45.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:45 smithi107 ceph-mon[30373]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:44:45.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:45 smithi107 ceph-mon[30373]: Generating ssh key... 2024-05-10T10:44:45.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:45 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' 2024-05-10T10:44:45.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:45 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' 2024-05-10T10:44:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.914+0000 7f125764b700 1 Processor -- start 2024-05-10T10:44:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.914+0000 7f125764b700 1 -- start start 2024-05-10T10:44:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.914+0000 7f125764b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f125010a770 0x7f125010ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.914+0000 7f125764b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f125010b160 con 0x7f125010a770 2024-05-10T10:44:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.915+0000 7f12553e7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f125010a770 0x7f125010ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.915+0000 7f12553e7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f125010a770 0x7f125010ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59362/0 (socket says 172.21.15.107:59362) 2024-05-10T10:44:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.915+0000 7f12553e7700 1 -- 172.21.15.107:0/3371792894 learned_addr learned my addr 172.21.15.107:0/3371792894 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:45.957 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.915+0000 7f12553e7700 1 -- 172.21.15.107:0/3371792894 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f125010b2e0 con 0x7f125010a770 2024-05-10T10:44:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.915+0000 7f12553e7700 1 --2- 172.21.15.107:0/3371792894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f125010a770 0x7f125010ab90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f124c0098a0 tx=0x7f124c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4a2e1d210adf30 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.915+0000 7f1247fff700 1 -- 172.21.15.107:0/3371792894 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f124c004160 con 0x7f125010a770 2024-05-10T10:44:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.915+0000 7f1247fff700 1 -- 172.21.15.107:0/3371792894 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f124c004300 con 0x7f125010a770 2024-05-10T10:44:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.915+0000 7f1247fff700 1 -- 172.21.15.107:0/3371792894 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f124c011b20 con 0x7f125010a770 2024-05-10T10:44:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.916+0000 7f125764b700 1 -- 172.21.15.107:0/3371792894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f125010a770 msgr2=0x7f125010ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.916+0000 7f125764b700 1 --2- 172.21.15.107:0/3371792894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f125010a770 0x7f125010ab90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f124c0098a0 tx=0x7f124c009bb0 comp rx=0 tx=0).stop 2024-05-10T10:44:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.916+0000 7f125764b700 1 -- 172.21.15.107:0/3371792894 shutdown_connections 2024-05-10T10:44:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.916+0000 7f125764b700 1 --2- 172.21.15.107:0/3371792894 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f125010a770 0x7f125010ab90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.916+0000 7f125764b700 1 -- 172.21.15.107:0/3371792894 >> 172.21.15.107:0/3371792894 conn(0x7f1250102df0 msgr2=0x7f1250105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.916+0000 7f125764b700 1 -- 172.21.15.107:0/3371792894 shutdown_connections 2024-05-10T10:44:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.916+0000 7f125764b700 1 -- 172.21.15.107:0/3371792894 wait complete. 2024-05-10T10:44:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.916+0000 7f125764b700 1 Processor -- start 2024-05-10T10:44:45.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.916+0000 7f125764b700 1 -- start start 2024-05-10T10:44:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.917+0000 7f125764b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f125010a770 0x7f1250109d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.917+0000 7f125764b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1250107f60 con 0x7f125010a770 2024-05-10T10:44:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.917+0000 7f12553e7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f125010a770 0x7f1250109d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.917+0000 7f12553e7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f125010a770 0x7f1250109d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59372/0 (socket says 172.21.15.107:59372) 2024-05-10T10:44:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.917+0000 7f12553e7700 1 -- 172.21.15.107:0/281952109 learned_addr learned my addr 172.21.15.107:0/281952109 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.917+0000 7f12553e7700 1 -- 172.21.15.107:0/281952109 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f125010a2d0 con 0x7f125010a770 2024-05-10T10:44:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.917+0000 7f12553e7700 1 --2- 172.21.15.107:0/281952109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f125010a770 0x7f1250109d90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f124c006af0 tx=0x7f124c011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.917+0000 7f12467fc700 1 -- 172.21.15.107:0/281952109 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f124c003930 con 0x7f125010a770 2024-05-10T10:44:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.917+0000 7f12467fc700 1 -- 172.21.15.107:0/281952109 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f124c003ad0 con 0x7f125010a770 2024-05-10T10:44:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.917+0000 7f125764b700 1 -- 172.21.15.107:0/281952109 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12501084c0 con 0x7f125010a770 2024-05-10T10:44:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.917+0000 7f12467fc700 1 -- 172.21.15.107:0/281952109 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f124c019610 con 0x7f125010a770 2024-05-10T10:44:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.917+0000 7f125764b700 1 -- 172.21.15.107:0/281952109 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1250108980 con 0x7f125010a770 2024-05-10T10:44:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.918+0000 7f12467fc700 1 -- 172.21.15.107:0/281952109 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f124c01a430 con 0x7f125010a770 2024-05-10T10:44:45.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.918+0000 7f125764b700 1 -- 172.21.15.107:0/281952109 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f125010d740 con 0x7f125010a770 2024-05-10T10:44:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.918+0000 7f12467fc700 1 --2- 172.21.15.107:0/281952109 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f123c03e470 0x7f123c040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.919+0000 7f12467fc700 1 -- 172.21.15.107:0/281952109 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f124c053a00 con 0x7f125010a770 2024-05-10T10:44:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.919+0000 7f1254be6700 1 --2- 172.21.15.107:0/281952109 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f123c03e470 0x7f123c040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.919+0000 7f1254be6700 1 --2- 172.21.15.107:0/281952109 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f123c03e470 0x7f123c040930 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1240006fd0 tx=0x7f1240006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:44.923+0000 7f12467fc700 1 -- 172.21.15.107:0/281952109 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f124c011e20 con 0x7f125010a770 2024-05-10T10:44:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:45.125+0000 7f125764b700 1 -- 172.21.15.107:0/281952109 --> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f1250109290 con 0x7f123c03e470 2024-05-10T10:44:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:45.365+0000 7f12467fc700 1 -- 172.21.15.107:0/281952109 <== mgr.14120 v2:172.21.15.107:6800/892499090 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1250109290 con 0x7f123c03e470 2024-05-10T10:44:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:45.367+0000 7f125764b700 1 -- 172.21.15.107:0/281952109 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f123c03e470 msgr2=0x7f123c040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:45.367+0000 7f125764b700 1 --2- 172.21.15.107:0/281952109 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f123c03e470 0x7f123c040930 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1240006fd0 tx=0x7f1240006e40 comp rx=0 tx=0).stop 2024-05-10T10:44:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:45.367+0000 7f125764b700 1 -- 172.21.15.107:0/281952109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f125010a770 msgr2=0x7f1250109d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:45.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:45.367+0000 7f125764b700 1 --2- 172.21.15.107:0/281952109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f125010a770 0x7f1250109d90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f124c006af0 tx=0x7f124c011c10 comp rx=0 tx=0).stop 2024-05-10T10:44:45.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:45.367+0000 7f125764b700 1 -- 172.21.15.107:0/281952109 shutdown_connections 2024-05-10T10:44:45.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:45.367+0000 7f125764b700 1 --2- 172.21.15.107:0/281952109 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f123c03e470 0x7f123c040930 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:45.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:45.367+0000 7f125764b700 1 --2- 172.21.15.107:0/281952109 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f125010a770 0x7f1250109d90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:45.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:45.367+0000 7f125764b700 1 -- 172.21.15.107:0/281952109 >> 172.21.15.107:0/281952109 conn(0x7f1250102df0 msgr2=0x7f1250103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:45.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:45.367+0000 7f125764b700 1 -- 172.21.15.107:0/281952109 shutdown_connections 2024-05-10T10:44:45.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:45.367+0000 7f125764b700 1 -- 172.21.15.107:0/281952109 wait complete. 2024-05-10T10:44:47.163 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZ2jTjakOAcd0dEY2ebwicktqPpIyZd5J5sAmljeNwXxd+BOEVLk8ObiPRjrpWzL9DzPbLPM9yfDQJLWlDXzmHggoqlxHVsnfr55OIXBg+XI3u1PPolN2yy1EfZey1SKGXxSlD/O0e0FiJFuvwo0BnncCI0FLYxj1yQ6Ova14aTMpQWhTuOf65HJK6pDtIxiDYtcBhWDSsPjcuxGSGSHFPXg33FzDSfndcBRC2T1wQ2QVYYF1W/lRhOZwhqfvAnJNus4WVnrT7k1GGQajWulEHddcs2xfiMKCXGO+hTWyLJmuh+/tkW20COdOaA5O9LcCDCqO9vJgtN7ZwpVulpflUQ5QSGWbqksgxHFI5GSdB49xIyEmVKfHBL8pS6zYUFwkL3NL+QvOjxvFOVSQVdI412nKXXMipQLvxrHNQEvBJxqiW0yTxH9OOCE/vx+QzC8FrOgG73AkhFKIdsxq1v5DHN8YBHvUMxxw73oRKMwqJSK2Qwy9Y8dPAFXu8dIbN9Mc= ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:44:47.164 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.395+0000 7f4bacdf6700 1 Processor -- start 2024-05-10T10:44:47.164 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.395+0000 7f4bacdf6700 1 -- start start 2024-05-10T10:44:47.164 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.396+0000 7f4bacdf6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ba81080c0 0x7f4ba81084e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:47.164 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.396+0000 7f4bacdf6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba8108ab0 con 0x7f4ba81080c0 2024-05-10T10:44:47.164 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.396+0000 7f4ba659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ba81080c0 0x7f4ba81084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:47.164 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.396+0000 7f4ba659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ba81080c0 0x7f4ba81084e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59384/0 (socket says 172.21.15.107:59384) 2024-05-10T10:44:47.164 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.396+0000 7f4ba659c700 1 -- 172.21.15.107:0/4137192523 learned_addr learned my addr 172.21.15.107:0/4137192523 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:47.164 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.396+0000 7f4ba659c700 1 -- 172.21.15.107:0/4137192523 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba81092c0 con 0x7f4ba81080c0 2024-05-10T10:44:47.164 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.396+0000 7f4ba659c700 1 --2- 172.21.15.107:0/4137192523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ba81080c0 0x7f4ba81084e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4b980098a0 tx=0x7f4b98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9b72991c94be5a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:47.164 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.396+0000 7f4ba559a700 1 -- 172.21.15.107:0/4137192523 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b98004160 con 0x7f4ba81080c0 2024-05-10T10:44:47.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.396+0000 7f4ba559a700 1 -- 172.21.15.107:0/4137192523 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f4b98004300 con 0x7f4ba81080c0 2024-05-10T10:44:47.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.396+0000 7f4ba559a700 1 -- 172.21.15.107:0/4137192523 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b98011b20 con 0x7f4ba81080c0 2024-05-10T10:44:47.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.397+0000 7f4bacdf6700 1 -- 172.21.15.107:0/4137192523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ba81080c0 msgr2=0x7f4ba81084e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:47.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.397+0000 7f4bacdf6700 1 --2- 172.21.15.107:0/4137192523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ba81080c0 0x7f4ba81084e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4b980098a0 tx=0x7f4b98009bb0 comp rx=0 tx=0).stop 2024-05-10T10:44:47.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.397+0000 7f4bacdf6700 1 -- 172.21.15.107:0/4137192523 shutdown_connections 2024-05-10T10:44:47.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.397+0000 7f4bacdf6700 1 --2- 172.21.15.107:0/4137192523 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ba81080c0 0x7f4ba81084e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:47.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.397+0000 7f4bacdf6700 1 -- 172.21.15.107:0/4137192523 >> 172.21.15.107:0/4137192523 conn(0x7f4ba8103680 msgr2=0x7f4ba8105aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:47.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.397+0000 7f4bacdf6700 1 -- 172.21.15.107:0/4137192523 shutdown_connections 2024-05-10T10:44:47.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.397+0000 7f4bacdf6700 1 -- 172.21.15.107:0/4137192523 wait complete. 2024-05-10T10:44:47.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.398+0000 7f4bacdf6700 1 Processor -- start 2024-05-10T10:44:47.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.398+0000 7f4bacdf6700 1 -- start start 2024-05-10T10:44:47.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.398+0000 7f4bacdf6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ba81080c0 0x7f4ba807ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:47.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.398+0000 7f4bacdf6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba810c670 con 0x7f4ba81080c0 2024-05-10T10:44:47.165 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.398+0000 7f4ba659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ba81080c0 0x7f4ba807ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:47.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.398+0000 7f4ba659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ba81080c0 0x7f4ba807ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59396/0 (socket says 172.21.15.107:59396) 2024-05-10T10:44:47.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.398+0000 7f4ba659c700 1 -- 172.21.15.107:0/27141778 learned_addr learned my addr 172.21.15.107:0/27141778 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:47.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.398+0000 7f4ba659c700 1 -- 172.21.15.107:0/27141778 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba819fd90 con 0x7f4ba81080c0 2024-05-10T10:44:47.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.399+0000 7f4ba659c700 1 --2- 172.21.15.107:0/27141778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ba81080c0 0x7f4ba807ca90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b98006af0 tx=0x7f4b98011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:47.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.399+0000 7f4b977fe700 1 -- 172.21.15.107:0/27141778 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b98003b90 con 0x7f4ba81080c0 2024-05-10T10:44:47.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.399+0000 7f4b977fe700 1 -- 172.21.15.107:0/27141778 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f4b98003d30 con 0x7f4ba81080c0 2024-05-10T10:44:47.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.399+0000 7f4b977fe700 1 -- 172.21.15.107:0/27141778 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b980197c0 con 0x7f4ba81080c0 2024-05-10T10:44:47.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.399+0000 7f4bacdf6700 1 -- 172.21.15.107:0/27141778 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba819ff60 con 0x7f4ba81080c0 2024-05-10T10:44:47.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.399+0000 7f4bacdf6700 1 -- 172.21.15.107:0/27141778 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba81a0300 con 0x7f4ba81080c0 2024-05-10T10:44:47.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.400+0000 7f4bacdf6700 1 -- 172.21.15.107:0/27141778 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba8064b00 con 0x7f4ba81080c0 2024-05-10T10:44:47.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.400+0000 7f4b977fe700 1 -- 172.21.15.107:0/27141778 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f4b98022020 con 0x7f4ba81080c0 2024-05-10T10:44:47.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.400+0000 7f4b977fe700 1 --2- 172.21.15.107:0/27141778 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f4b9003e4c0 0x7f4b90040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:47.166 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.400+0000 7f4b977fe700 1 -- 172.21.15.107:0/27141778 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4b98053880 con 0x7f4ba81080c0 2024-05-10T10:44:47.167 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.400+0000 7f4ba5d9b700 1 --2- 172.21.15.107:0/27141778 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f4b9003e4c0 0x7f4b90040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:47.167 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.400+0000 7f4ba5d9b700 1 --2- 172.21.15.107:0/27141778 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f4b9003e4c0 0x7f4b90040980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c006fd0 tx=0x7f4b9c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:47.167 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.405+0000 7f4b977fe700 1 -- 172.21.15.107:0/27141778 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4b9802b350 con 0x7f4ba81080c0 2024-05-10T10:44:47.167 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.612+0000 7f4bacdf6700 1 -- 172.21.15.107:0/27141778 --> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f4ba8104880 con 0x7f4b9003e4c0 2024-05-10T10:44:47.167 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.612+0000 7f4b977fe700 1 -- 172.21.15.107:0/27141778 <== mgr.14120 v2:172.21.15.107:6800/892499090 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f4ba8104880 con 0x7f4b9003e4c0 2024-05-10T10:44:47.167 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.615+0000 7f4bacdf6700 1 -- 172.21.15.107:0/27141778 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f4b9003e4c0 msgr2=0x7f4b90040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:47.167 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.615+0000 7f4bacdf6700 1 --2- 172.21.15.107:0/27141778 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f4b9003e4c0 0x7f4b90040980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c006fd0 tx=0x7f4b9c006e40 comp rx=0 tx=0).stop 2024-05-10T10:44:47.167 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.615+0000 7f4bacdf6700 1 -- 172.21.15.107:0/27141778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ba81080c0 msgr2=0x7f4ba807ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:47.167 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.615+0000 7f4bacdf6700 1 --2- 172.21.15.107:0/27141778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ba81080c0 0x7f4ba807ca90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b98006af0 tx=0x7f4b98011ce0 comp rx=0 tx=0).stop 2024-05-10T10:44:47.167 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.615+0000 7f4bacdf6700 1 -- 172.21.15.107:0/27141778 shutdown_connections 2024-05-10T10:44:47.167 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.615+0000 7f4bacdf6700 1 --2- 172.21.15.107:0/27141778 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f4b9003e4c0 0x7f4b90040980 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:47.167 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.615+0000 7f4bacdf6700 1 --2- 172.21.15.107:0/27141778 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ba81080c0 0x7f4ba807ca90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:47.167 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.615+0000 7f4bacdf6700 1 -- 172.21.15.107:0/27141778 >> 172.21.15.107:0/27141778 conn(0x7f4ba8103680 msgr2=0x7f4ba8104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:47.168 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.615+0000 7f4bacdf6700 1 -- 172.21.15.107:0/27141778 shutdown_connections 2024-05-10T10:44:47.168 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:46.615+0000 7f4bacdf6700 1 -- 172.21.15.107:0/27141778 wait complete. 2024-05-10T10:44:47.168 INFO:teuthology.orchestra.run.smithi107.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-10T10:44:47.168 INFO:teuthology.orchestra.run.smithi107.stdout:Adding key to root@localhost authorized_keys... 2024-05-10T10:44:47.168 INFO:teuthology.orchestra.run.smithi107.stdout:Adding host smithi107... 2024-05-10T10:44:47.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:47 smithi107 ceph-mon[30373]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:44:48.656 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:48 smithi107 ceph-mon[30373]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi107", "addr": "172.21.15.107", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:44:49.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:49 smithi107 ceph-mon[30373]: Deploying cephadm binary to smithi107 2024-05-10T10:44:52.437 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout Added host 'smithi107' with addr '172.21.15.107' 2024-05-10T10:44:52.438 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.581+0000 7f8eab528700 1 Processor -- start 2024-05-10T10:44:52.438 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.581+0000 7f8eab528700 1 -- start start 2024-05-10T10:44:52.438 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.581+0000 7f8eab528700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ea41091d0 0x7f8ea41095f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:52.438 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.581+0000 7f8eab528700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea4109bc0 con 0x7f8ea41091d0 2024-05-10T10:44:52.438 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.582+0000 7f8ea92c4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ea41091d0 0x7f8ea41095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:52.438 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.582+0000 7f8ea92c4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ea41091d0 0x7f8ea41095f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44542/0 (socket says 172.21.15.107:44542) 2024-05-10T10:44:52.438 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.582+0000 7f8ea92c4700 1 -- 172.21.15.107:0/1435402620 learned_addr learned my addr 172.21.15.107:0/1435402620 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:52.438 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.582+0000 7f8ea92c4700 1 -- 172.21.15.107:0/1435402620 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea410a330 con 0x7f8ea41091d0 2024-05-10T10:44:52.438 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.582+0000 7f8ea92c4700 1 --2- 172.21.15.107:0/1435402620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ea41091d0 0x7f8ea41095f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00098a0 tx=0x7f8ea0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb4ea2a7e22419e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:52.438 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.582+0000 7f8e9bfff700 1 -- 172.21.15.107:0/1435402620 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea0004160 con 0x7f8ea41091d0 2024-05-10T10:44:52.438 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.582+0000 7f8e9bfff700 1 -- 172.21.15.107:0/1435402620 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f8ea0004300 con 0x7f8ea41091d0 2024-05-10T10:44:52.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.582+0000 7f8e9bfff700 1 -- 172.21.15.107:0/1435402620 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea0011b20 con 0x7f8ea41091d0 2024-05-10T10:44:52.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.583+0000 7f8eab528700 1 -- 172.21.15.107:0/1435402620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ea41091d0 msgr2=0x7f8ea41095f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:52.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.583+0000 7f8eab528700 1 --2- 172.21.15.107:0/1435402620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ea41091d0 0x7f8ea41095f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00098a0 tx=0x7f8ea0009bb0 comp rx=0 tx=0).stop 2024-05-10T10:44:52.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.583+0000 7f8eab528700 1 -- 172.21.15.107:0/1435402620 shutdown_connections 2024-05-10T10:44:52.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.583+0000 7f8eab528700 1 --2- 172.21.15.107:0/1435402620 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ea41091d0 0x7f8ea41095f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:52.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.583+0000 7f8eab528700 1 -- 172.21.15.107:0/1435402620 >> 172.21.15.107:0/1435402620 conn(0x7f8ea4104810 msgr2=0x7f8ea4106c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:52.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.583+0000 7f8eab528700 1 -- 172.21.15.107:0/1435402620 shutdown_connections 2024-05-10T10:44:52.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.583+0000 7f8eab528700 1 -- 172.21.15.107:0/1435402620 wait complete. 2024-05-10T10:44:52.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.583+0000 7f8eab528700 1 Processor -- start 2024-05-10T10:44:52.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.584+0000 7f8eab528700 1 -- start start 2024-05-10T10:44:52.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.584+0000 7f8eab528700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ea41091d0 0x7f8ea419d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:52.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.584+0000 7f8eab528700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea410d6e0 con 0x7f8ea41091d0 2024-05-10T10:44:52.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.584+0000 7f8ea92c4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ea41091d0 0x7f8ea419d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:52.439 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.584+0000 7f8ea92c4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ea41091d0 0x7f8ea419d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44558/0 (socket says 172.21.15.107:44558) 2024-05-10T10:44:52.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.584+0000 7f8ea92c4700 1 -- 172.21.15.107:0/3550830288 learned_addr learned my addr 172.21.15.107:0/3550830288 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:52.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.584+0000 7f8ea92c4700 1 -- 172.21.15.107:0/3550830288 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea419d5d0 con 0x7f8ea41091d0 2024-05-10T10:44:52.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.584+0000 7f8ea92c4700 1 --2- 172.21.15.107:0/3550830288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ea41091d0 0x7f8ea419d090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0006af0 tx=0x7f8ea0011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:52.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.584+0000 7f8e9a7fc700 1 -- 172.21.15.107:0/3550830288 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea0003b90 con 0x7f8ea41091d0 2024-05-10T10:44:52.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.584+0000 7f8eab528700 1 -- 172.21.15.107:0/3550830288 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea419d860 con 0x7f8ea41091d0 2024-05-10T10:44:52.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.584+0000 7f8e9a7fc700 1 -- 172.21.15.107:0/3550830288 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f8ea0003d30 con 0x7f8ea41091d0 2024-05-10T10:44:52.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.584+0000 7f8e9a7fc700 1 -- 172.21.15.107:0/3550830288 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea00197c0 con 0x7f8ea41091d0 2024-05-10T10:44:52.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.584+0000 7f8eab528700 1 -- 172.21.15.107:0/3550830288 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea419dcc0 con 0x7f8ea41091d0 2024-05-10T10:44:52.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.585+0000 7f8e9a7fc700 1 -- 172.21.15.107:0/3550830288 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f8ea0022020 con 0x7f8ea41091d0 2024-05-10T10:44:52.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.585+0000 7f8eab528700 1 -- 172.21.15.107:0/3550830288 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea4064b00 con 0x7f8ea41091d0 2024-05-10T10:44:52.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.586+0000 7f8e9a7fc700 1 --2- 172.21.15.107:0/3550830288 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f8e9003e470 0x7f8e90040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:52.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.586+0000 7f8e9a7fc700 1 -- 172.21.15.107:0/3550830288 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8ea00538a0 con 0x7f8ea41091d0 2024-05-10T10:44:52.440 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.586+0000 7f8ea8ac3700 1 --2- 172.21.15.107:0/3550830288 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f8e9003e470 0x7f8e90040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:52.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.586+0000 7f8ea8ac3700 1 --2- 172.21.15.107:0/3550830288 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f8e9003e470 0x7f8e90040930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8e94006fd0 tx=0x7f8e94006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:52.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.591+0000 7f8e9a7fc700 1 -- 172.21.15.107:0/3550830288 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8ea002b350 con 0x7f8ea41091d0 2024-05-10T10:44:52.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:47.801+0000 7f8eab528700 1 -- 172.21.15.107:0/3550830288 --> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi107", "addr": "172.21.15.107", "target": ["mon-mgr", ""]}) -- 0x7f8ea4105a80 con 0x7f8e9003e470 2024-05-10T10:44:52.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:51.889+0000 7f8e9a7fc700 1 -- 172.21.15.107:0/3550830288 <== mgr.14120 v2:172.21.15.107:6800/892499090 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f8ea4105a80 con 0x7f8e9003e470 2024-05-10T10:44:52.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:51.892+0000 7f8eab528700 1 -- 172.21.15.107:0/3550830288 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f8e9003e470 msgr2=0x7f8e90040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:52.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:51.892+0000 7f8eab528700 1 --2- 172.21.15.107:0/3550830288 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f8e9003e470 0x7f8e90040930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8e94006fd0 tx=0x7f8e94006e40 comp rx=0 tx=0).stop 2024-05-10T10:44:52.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:51.892+0000 7f8eab528700 1 -- 172.21.15.107:0/3550830288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ea41091d0 msgr2=0x7f8ea419d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:52.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:51.892+0000 7f8eab528700 1 --2- 172.21.15.107:0/3550830288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ea41091d0 0x7f8ea419d090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0006af0 tx=0x7f8ea0011ce0 comp rx=0 tx=0).stop 2024-05-10T10:44:52.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:51.892+0000 7f8eab528700 1 -- 172.21.15.107:0/3550830288 shutdown_connections 2024-05-10T10:44:52.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:51.892+0000 7f8eab528700 1 --2- 172.21.15.107:0/3550830288 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f8e9003e470 0x7f8e90040930 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:52.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:51.892+0000 7f8eab528700 1 --2- 172.21.15.107:0/3550830288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8ea41091d0 0x7f8ea419d090 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:52.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:51.892+0000 7f8eab528700 1 -- 172.21.15.107:0/3550830288 >> 172.21.15.107:0/3550830288 conn(0x7f8ea4104810 msgr2=0x7f8ea4105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:52.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:51.892+0000 7f8eab528700 1 -- 172.21.15.107:0/3550830288 shutdown_connections 2024-05-10T10:44:52.441 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:51.892+0000 7f8eab528700 1 -- 172.21.15.107:0/3550830288 wait complete. 2024-05-10T10:44:52.441 INFO:teuthology.orchestra.run.smithi107.stdout:Deploying unmanaged mon service... 2024-05-10T10:44:53.061 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:52 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' 2024-05-10T10:44:53.061 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:52 smithi107 ceph-mon[30373]: Added host smithi107 2024-05-10T10:44:53.061 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:52 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:44:53.958 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-10T10:44:53.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.893+0000 7f1d1957c700 1 Processor -- start 2024-05-10T10:44:53.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.893+0000 7f1d1957c700 1 -- start start 2024-05-10T10:44:53.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.893+0000 7f1d1957c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d14108080 0x7f1d141084a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:53.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.893+0000 7f1d1957c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1d14108a70 con 0x7f1d14108080 2024-05-10T10:44:53.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.893+0000 7f1d12ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d14108080 0x7f1d141084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:53.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.893+0000 7f1d12ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d14108080 0x7f1d141084a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44572/0 (socket says 172.21.15.107:44572) 2024-05-10T10:44:53.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.893+0000 7f1d12ffd700 1 -- 172.21.15.107:0/1162379274 learned_addr learned my addr 172.21.15.107:0/1162379274 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:53.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.893+0000 7f1d12ffd700 1 -- 172.21.15.107:0/1162379274 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d14109280 con 0x7f1d14108080 2024-05-10T10:44:53.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.894+0000 7f1d12ffd700 1 --2- 172.21.15.107:0/1162379274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d14108080 0x7f1d141084a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1d040098a0 tx=0x7f1d04009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee52257ced0af6f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:53.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.894+0000 7f1d11ffb700 1 -- 172.21.15.107:0/1162379274 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d04004160 con 0x7f1d14108080 2024-05-10T10:44:53.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.894+0000 7f1d11ffb700 1 -- 172.21.15.107:0/1162379274 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f1d04004300 con 0x7f1d14108080 2024-05-10T10:44:53.959 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.894+0000 7f1d11ffb700 1 -- 172.21.15.107:0/1162379274 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d04011b20 con 0x7f1d14108080 2024-05-10T10:44:53.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.894+0000 7f1d1957c700 1 -- 172.21.15.107:0/1162379274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d14108080 msgr2=0x7f1d141084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:53.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.894+0000 7f1d1957c700 1 --2- 172.21.15.107:0/1162379274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d14108080 0x7f1d141084a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1d040098a0 tx=0x7f1d04009bb0 comp rx=0 tx=0).stop 2024-05-10T10:44:53.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.894+0000 7f1d1957c700 1 -- 172.21.15.107:0/1162379274 shutdown_connections 2024-05-10T10:44:53.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.894+0000 7f1d1957c700 1 --2- 172.21.15.107:0/1162379274 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d14108080 0x7f1d141084a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:53.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.894+0000 7f1d1957c700 1 -- 172.21.15.107:0/1162379274 >> 172.21.15.107:0/1162379274 conn(0x7f1d14103660 msgr2=0x7f1d14105a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:53.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.894+0000 7f1d1957c700 1 -- 172.21.15.107:0/1162379274 shutdown_connections 2024-05-10T10:44:53.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.894+0000 7f1d1957c700 1 -- 172.21.15.107:0/1162379274 wait complete. 2024-05-10T10:44:53.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.895+0000 7f1d1957c700 1 Processor -- start 2024-05-10T10:44:53.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.895+0000 7f1d1957c700 1 -- start start 2024-05-10T10:44:53.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.895+0000 7f1d1957c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d14108080 0x7f1d1419bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:53.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.895+0000 7f1d1957c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1410c630 con 0x7f1d14108080 2024-05-10T10:44:53.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.895+0000 7f1d12ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d14108080 0x7f1d1419bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:53.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.895+0000 7f1d12ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d14108080 0x7f1d1419bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44582/0 (socket says 172.21.15.107:44582) 2024-05-10T10:44:53.960 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.895+0000 7f1d12ffd700 1 -- 172.21.15.107:0/188964587 learned_addr learned my addr 172.21.15.107:0/188964587 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:53.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.896+0000 7f1d12ffd700 1 -- 172.21.15.107:0/188964587 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1419c4e0 con 0x7f1d14108080 2024-05-10T10:44:53.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.896+0000 7f1d12ffd700 1 --2- 172.21.15.107:0/188964587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d14108080 0x7f1d1419bfa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1d04006af0 tx=0x7f1d04011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:53.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.896+0000 7f1cfbfff700 1 -- 172.21.15.107:0/188964587 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d04003930 con 0x7f1d14108080 2024-05-10T10:44:53.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.896+0000 7f1cfbfff700 1 -- 172.21.15.107:0/188964587 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f1d04003ad0 con 0x7f1d14108080 2024-05-10T10:44:53.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.896+0000 7f1d1957c700 1 -- 172.21.15.107:0/188964587 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1419c770 con 0x7f1d14108080 2024-05-10T10:44:53.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.896+0000 7f1cfbfff700 1 -- 172.21.15.107:0/188964587 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d04019610 con 0x7f1d14108080 2024-05-10T10:44:53.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.896+0000 7f1d1957c700 1 -- 172.21.15.107:0/188964587 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d1419cbd0 con 0x7f1d14108080 2024-05-10T10:44:53.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.897+0000 7f1cfbfff700 1 -- 172.21.15.107:0/188964587 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f1d040198d0 con 0x7f1d14108080 2024-05-10T10:44:53.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.897+0000 7f1cfbfff700 1 --2- 172.21.15.107:0/188964587 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f1cfc03e420 0x7f1cfc0408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:53.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.897+0000 7f1cfbfff700 1 -- 172.21.15.107:0/188964587 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1d04053aa0 con 0x7f1d14108080 2024-05-10T10:44:53.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.897+0000 7f1d1957c700 1 -- 172.21.15.107:0/188964587 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d14064b00 con 0x7f1d14108080 2024-05-10T10:44:53.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.897+0000 7f1d127fc700 1 --2- 172.21.15.107:0/188964587 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f1cfc03e420 0x7f1cfc0408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:53.961 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.897+0000 7f1d127fc700 1 --2- 172.21.15.107:0/188964587 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f1cfc03e420 0x7f1cfc0408e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1d08006fd0 tx=0x7f1d08006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:53.962 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:52.902+0000 7f1cfbfff700 1 -- 172.21.15.107:0/188964587 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f1d04011e20 con 0x7f1d14108080 2024-05-10T10:44:53.962 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:53.132+0000 7f1d1957c700 1 -- 172.21.15.107:0/188964587 --> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f1d14104860 con 0x7f1cfc03e420 2024-05-10T10:44:53.962 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:53.139+0000 7f1cfbfff700 1 -- 172.21.15.107:0/188964587 <== mgr.14120 v2:172.21.15.107:6800/892499090 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1d14104860 con 0x7f1cfc03e420 2024-05-10T10:44:53.962 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:53.141+0000 7f1d1957c700 1 -- 172.21.15.107:0/188964587 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f1cfc03e420 msgr2=0x7f1cfc0408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:53.962 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:53.141+0000 7f1d1957c700 1 --2- 172.21.15.107:0/188964587 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f1cfc03e420 0x7f1cfc0408e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1d08006fd0 tx=0x7f1d08006e40 comp rx=0 tx=0).stop 2024-05-10T10:44:53.962 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:53.141+0000 7f1d1957c700 1 -- 172.21.15.107:0/188964587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d14108080 msgr2=0x7f1d1419bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:53.962 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:53.141+0000 7f1d1957c700 1 --2- 172.21.15.107:0/188964587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d14108080 0x7f1d1419bfa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1d04006af0 tx=0x7f1d04011c10 comp rx=0 tx=0).stop 2024-05-10T10:44:53.962 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:53.142+0000 7f1d1957c700 1 -- 172.21.15.107:0/188964587 shutdown_connections 2024-05-10T10:44:53.962 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:53.142+0000 7f1d1957c700 1 --2- 172.21.15.107:0/188964587 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f1cfc03e420 0x7f1cfc0408e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:53.962 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:53.142+0000 7f1d1957c700 1 --2- 172.21.15.107:0/188964587 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d14108080 0x7f1d1419bfa0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:53.962 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:53.142+0000 7f1d1957c700 1 -- 172.21.15.107:0/188964587 >> 172.21.15.107:0/188964587 conn(0x7f1d14103660 msgr2=0x7f1d14104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:53.963 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:53.142+0000 7f1d1957c700 1 -- 172.21.15.107:0/188964587 shutdown_connections 2024-05-10T10:44:53.963 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:53.142+0000 7f1d1957c700 1 -- 172.21.15.107:0/188964587 wait complete. 2024-05-10T10:44:53.963 INFO:teuthology.orchestra.run.smithi107.stdout:Deploying unmanaged mgr service... 2024-05-10T10:44:54.244 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:54 smithi107 ceph-mon[30373]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:44:54.244 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:54 smithi107 ceph-mon[30373]: Saving service mon spec with placement count:5 2024-05-10T10:44:54.244 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:54 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' 2024-05-10T10:44:55.695 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:55 smithi107 ceph-mon[30373]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:44:55.695 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:55 smithi107 ceph-mon[30373]: Saving service mgr spec with placement count:2 2024-05-10T10:44:55.695 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:55 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' 2024-05-10T10:44:55.695 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:55 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' 2024-05-10T10:44:55.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-10T10:44:55.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.345+0000 7fa8fe582700 1 Processor -- start 2024-05-10T10:44:55.703 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.345+0000 7fa8fe582700 1 -- start start 2024-05-10T10:44:55.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.345+0000 7fa8fe582700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f8107ae0 0x7fa8f8107f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:55.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.345+0000 7fa8fe582700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f807ce50 con 0x7fa8f8107ae0 2024-05-10T10:44:55.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.345+0000 7fa8f7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f8107ae0 0x7fa8f8107f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:55.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.345+0000 7fa8f7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f8107ae0 0x7fa8f8107f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44598/0 (socket says 172.21.15.107:44598) 2024-05-10T10:44:55.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.345+0000 7fa8f7fff700 1 -- 172.21.15.107:0/4063395925 learned_addr learned my addr 172.21.15.107:0/4063395925 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:55.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.345+0000 7fa8f7fff700 1 -- 172.21.15.107:0/4063395925 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f8108440 con 0x7fa8f8107ae0 2024-05-10T10:44:55.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.345+0000 7fa8f7fff700 1 --2- 172.21.15.107:0/4063395925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f8107ae0 0x7fa8f8107f00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80098a0 tx=0x7fa8e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3e20535e82d188 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:55.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.346+0000 7fa8f6ffd700 1 -- 172.21.15.107:0/4063395925 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8e8004160 con 0x7fa8f8107ae0 2024-05-10T10:44:55.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.346+0000 7fa8f6ffd700 1 -- 172.21.15.107:0/4063395925 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fa8e8004300 con 0x7fa8f8107ae0 2024-05-10T10:44:55.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.346+0000 7fa8f6ffd700 1 -- 172.21.15.107:0/4063395925 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8e8011b20 con 0x7fa8f8107ae0 2024-05-10T10:44:55.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.346+0000 7fa8fe582700 1 -- 172.21.15.107:0/4063395925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f8107ae0 msgr2=0x7fa8f8107f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:55.704 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.346+0000 7fa8fe582700 1 --2- 172.21.15.107:0/4063395925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f8107ae0 0x7fa8f8107f00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80098a0 tx=0x7fa8e8009bb0 comp rx=0 tx=0).stop 2024-05-10T10:44:55.705 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.346+0000 7fa8fe582700 1 -- 172.21.15.107:0/4063395925 shutdown_connections 2024-05-10T10:44:55.705 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.346+0000 7fa8fe582700 1 --2- 172.21.15.107:0/4063395925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f8107ae0 0x7fa8f8107f00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:55.705 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.346+0000 7fa8fe582700 1 -- 172.21.15.107:0/4063395925 >> 172.21.15.107:0/4063395925 conn(0x7fa8f81036a0 msgr2=0x7fa8f8105ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:55.705 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.346+0000 7fa8fe582700 1 -- 172.21.15.107:0/4063395925 shutdown_connections 2024-05-10T10:44:55.705 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.346+0000 7fa8fe582700 1 -- 172.21.15.107:0/4063395925 wait complete. 2024-05-10T10:44:55.705 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.347+0000 7fa8fe582700 1 Processor -- start 2024-05-10T10:44:55.705 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.347+0000 7fa8fe582700 1 -- start start 2024-05-10T10:44:55.705 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.347+0000 7fa8fe582700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f8107ae0 0x7fa8f819f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:55.705 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.347+0000 7fa8fe582700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f81093f0 con 0x7fa8f8107ae0 2024-05-10T10:44:55.705 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.347+0000 7fa8f7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f8107ae0 0x7fa8f819f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:55.705 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.347+0000 7fa8f7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f8107ae0 0x7fa8f819f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44600/0 (socket says 172.21.15.107:44600) 2024-05-10T10:44:55.705 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.347+0000 7fa8f7fff700 1 -- 172.21.15.107:0/2347605046 learned_addr learned my addr 172.21.15.107:0/2347605046 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:55.705 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.348+0000 7fa8f7fff700 1 -- 172.21.15.107:0/2347605046 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f819f770 con 0x7fa8f8107ae0 2024-05-10T10:44:55.705 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.348+0000 7fa8f7fff700 1 --2- 172.21.15.107:0/2347605046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f8107ae0 0x7fa8f819f230 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80116a0 tx=0x7fa8e8011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:55.705 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.348+0000 7fa8f57fa700 1 -- 172.21.15.107:0/2347605046 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8e8003ab0 con 0x7fa8f8107ae0 2024-05-10T10:44:55.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.348+0000 7fa8f57fa700 1 -- 172.21.15.107:0/2347605046 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fa8e8003c50 con 0x7fa8f8107ae0 2024-05-10T10:44:55.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.348+0000 7fa8fe582700 1 -- 172.21.15.107:0/2347605046 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f819fa00 con 0x7fa8f8107ae0 2024-05-10T10:44:55.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.348+0000 7fa8f57fa700 1 -- 172.21.15.107:0/2347605046 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8e8019870 con 0x7fa8f8107ae0 2024-05-10T10:44:55.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.348+0000 7fa8fe582700 1 -- 172.21.15.107:0/2347605046 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f819fe60 con 0x7fa8f8107ae0 2024-05-10T10:44:55.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.349+0000 7fa8f57fa700 1 -- 172.21.15.107:0/2347605046 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fa8e8019ae0 con 0x7fa8f8107ae0 2024-05-10T10:44:55.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.349+0000 7fa8fe582700 1 -- 172.21.15.107:0/2347605046 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f8064b00 con 0x7fa8f8107ae0 2024-05-10T10:44:55.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.349+0000 7fa8f57fa700 1 --2- 172.21.15.107:0/2347605046 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fa8e003e470 0x7fa8e0040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:55.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.349+0000 7fa8f57fa700 1 -- 172.21.15.107:0/2347605046 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa8e8053950 con 0x7fa8f8107ae0 2024-05-10T10:44:55.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.349+0000 7fa8f77fe700 1 --2- 172.21.15.107:0/2347605046 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fa8e003e470 0x7fa8e0040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:55.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.350+0000 7fa8f77fe700 1 --2- 172.21.15.107:0/2347605046 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fa8e003e470 0x7fa8e0040930 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec006fd0 tx=0x7fa8ec006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:55.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.354+0000 7fa8f57fa700 1 -- 172.21.15.107:0/2347605046 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa8e8011e20 con 0x7fa8f8107ae0 2024-05-10T10:44:55.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.575+0000 7fa8fe582700 1 -- 172.21.15.107:0/2347605046 --> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fa8f80638e0 con 0x7fa8e003e470 2024-05-10T10:44:55.706 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.582+0000 7fa8f57fa700 1 -- 172.21.15.107:0/2347605046 <== mgr.14120 v2:172.21.15.107:6800/892499090 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa8f80638e0 con 0x7fa8e003e470 2024-05-10T10:44:55.707 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.584+0000 7fa8fe582700 1 -- 172.21.15.107:0/2347605046 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fa8e003e470 msgr2=0x7fa8e0040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:55.707 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.584+0000 7fa8fe582700 1 --2- 172.21.15.107:0/2347605046 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fa8e003e470 0x7fa8e0040930 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec006fd0 tx=0x7fa8ec006e40 comp rx=0 tx=0).stop 2024-05-10T10:44:55.707 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.584+0000 7fa8fe582700 1 -- 172.21.15.107:0/2347605046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f8107ae0 msgr2=0x7fa8f819f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:55.707 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.584+0000 7fa8fe582700 1 --2- 172.21.15.107:0/2347605046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f8107ae0 0x7fa8f819f230 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80116a0 tx=0x7fa8e8011ce0 comp rx=0 tx=0).stop 2024-05-10T10:44:55.707 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.584+0000 7fa8fe582700 1 -- 172.21.15.107:0/2347605046 shutdown_connections 2024-05-10T10:44:55.707 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.584+0000 7fa8fe582700 1 --2- 172.21.15.107:0/2347605046 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fa8e003e470 0x7fa8e0040930 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:55.707 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.584+0000 7fa8fe582700 1 --2- 172.21.15.107:0/2347605046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f8107ae0 0x7fa8f819f230 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:55.707 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.584+0000 7fa8fe582700 1 -- 172.21.15.107:0/2347605046 >> 172.21.15.107:0/2347605046 conn(0x7fa8f81036a0 msgr2=0x7fa8f8195ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:55.707 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.584+0000 7fa8fe582700 1 -- 172.21.15.107:0/2347605046 shutdown_connections 2024-05-10T10:44:55.707 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:54.584+0000 7fa8fe582700 1 -- 172.21.15.107:0/2347605046 wait complete. 2024-05-10T10:44:56.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.115+0000 7fe77c290700 1 Processor -- start 2024-05-10T10:44:56.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.115+0000 7fe77c290700 1 -- start start 2024-05-10T10:44:56.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.116+0000 7fe77c290700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe774107a60 0x7fe774107e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:56.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.116+0000 7fe77c290700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe774076d80 con 0x7fe774107a60 2024-05-10T10:44:56.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.116+0000 7fe77a02c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe774107a60 0x7fe774107e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:56.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.116+0000 7fe77a02c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe774107a60 0x7fe774107e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44616/0 (socket says 172.21.15.107:44616) 2024-05-10T10:44:56.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.116+0000 7fe77a02c700 1 -- 172.21.15.107:0/1496505925 learned_addr learned my addr 172.21.15.107:0/1496505925 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:56.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.116+0000 7fe77a02c700 1 -- 172.21.15.107:0/1496505925 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7741083c0 con 0x7fe774107a60 2024-05-10T10:44:56.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.116+0000 7fe77a02c700 1 --2- 172.21.15.107:0/1496505925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe774107a60 0x7fe774107e80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe7700098a0 tx=0x7fe770009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3984773e695031dd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:56.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.116+0000 7fe77902a700 1 -- 172.21.15.107:0/1496505925 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe770004160 con 0x7fe774107a60 2024-05-10T10:44:56.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.116+0000 7fe77902a700 1 -- 172.21.15.107:0/1496505925 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe770004300 con 0x7fe774107a60 2024-05-10T10:44:56.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.116+0000 7fe77902a700 1 -- 172.21.15.107:0/1496505925 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe770011af0 con 0x7fe774107a60 2024-05-10T10:44:56.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.117+0000 7fe77c290700 1 -- 172.21.15.107:0/1496505925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe774107a60 msgr2=0x7fe774107e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:56.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.117+0000 7fe77c290700 1 --2- 172.21.15.107:0/1496505925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe774107a60 0x7fe774107e80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe7700098a0 tx=0x7fe770009bb0 comp rx=0 tx=0).stop 2024-05-10T10:44:56.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.117+0000 7fe77c290700 1 -- 172.21.15.107:0/1496505925 shutdown_connections 2024-05-10T10:44:56.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.117+0000 7fe77c290700 1 --2- 172.21.15.107:0/1496505925 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe774107a60 0x7fe774107e80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:56.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.117+0000 7fe77c290700 1 -- 172.21.15.107:0/1496505925 >> 172.21.15.107:0/1496505925 conn(0x7fe774103660 msgr2=0x7fe774105a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:56.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.117+0000 7fe77c290700 1 -- 172.21.15.107:0/1496505925 shutdown_connections 2024-05-10T10:44:56.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.117+0000 7fe77c290700 1 -- 172.21.15.107:0/1496505925 wait complete. 2024-05-10T10:44:56.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.118+0000 7fe77c290700 1 Processor -- start 2024-05-10T10:44:56.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.118+0000 7fe77c290700 1 -- start start 2024-05-10T10:44:56.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.118+0000 7fe77c290700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe774107a60 0x7fe77419f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:56.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.118+0000 7fe77c290700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe774109490 con 0x7fe774107a60 2024-05-10T10:44:56.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.118+0000 7fe77a02c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe774107a60 0x7fe77419f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:56.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.118+0000 7fe77a02c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe774107a60 0x7fe77419f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44630/0 (socket says 172.21.15.107:44630) 2024-05-10T10:44:56.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.118+0000 7fe77a02c700 1 -- 172.21.15.107:0/3969354272 learned_addr learned my addr 172.21.15.107:0/3969354272 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:56.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.119+0000 7fe77a02c700 1 -- 172.21.15.107:0/3969354272 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77419f820 con 0x7fe774107a60 2024-05-10T10:44:56.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.119+0000 7fe77a02c700 1 --2- 172.21.15.107:0/3969354272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe774107a60 0x7fe77419f2e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe7700117b0 tx=0x7fe770011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:56.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.119+0000 7fe76b7fe700 1 -- 172.21.15.107:0/3969354272 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7700039e0 con 0x7fe774107a60 2024-05-10T10:44:56.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.119+0000 7fe76b7fe700 1 -- 172.21.15.107:0/3969354272 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe770003b80 con 0x7fe774107a60 2024-05-10T10:44:56.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.119+0000 7fe77c290700 1 -- 172.21.15.107:0/3969354272 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe77419fab0 con 0x7fe774107a60 2024-05-10T10:44:56.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.119+0000 7fe76b7fe700 1 -- 172.21.15.107:0/3969354272 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe770024780 con 0x7fe774107a60 2024-05-10T10:44:56.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.119+0000 7fe77c290700 1 -- 172.21.15.107:0/3969354272 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7741a27a0 con 0x7fe774107a60 2024-05-10T10:44:56.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.120+0000 7fe76b7fe700 1 -- 172.21.15.107:0/3969354272 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fe770022020 con 0x7fe774107a60 2024-05-10T10:44:56.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.120+0000 7fe76b7fe700 1 --2- 172.21.15.107:0/3969354272 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fe76003e4c0 0x7fe760040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:56.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.120+0000 7fe76b7fe700 1 -- 172.21.15.107:0/3969354272 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe7700546e0 con 0x7fe774107a60 2024-05-10T10:44:56.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.120+0000 7fe77982b700 1 --2- 172.21.15.107:0/3969354272 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fe76003e4c0 0x7fe760040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:56.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.120+0000 7fe77c290700 1 -- 172.21.15.107:0/3969354272 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe774064b00 con 0x7fe774107a60 2024-05-10T10:44:56.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.121+0000 7fe77982b700 1 --2- 172.21.15.107:0/3969354272 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fe76003e4c0 0x7fe760040980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe764006fd0 tx=0x7fe764006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:56.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.126+0000 7fe76b7fe700 1 -- 172.21.15.107:0/3969354272 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe77000e260 con 0x7fe774107a60 2024-05-10T10:44:56.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.356+0000 7fe77c290700 1 -- 172.21.15.107:0/3969354272 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fe77402e750 con 0x7fe774107a60 2024-05-10T10:44:56.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.359+0000 7fe76b7fe700 1 -- 172.21.15.107:0/3969354272 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fe770018350 con 0x7fe774107a60 2024-05-10T10:44:56.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.362+0000 7fe77c290700 1 -- 172.21.15.107:0/3969354272 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fe76003e4c0 msgr2=0x7fe760040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:56.929 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.362+0000 7fe77c290700 1 --2- 172.21.15.107:0/3969354272 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fe76003e4c0 0x7fe760040980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe764006fd0 tx=0x7fe764006e40 comp rx=0 tx=0).stop 2024-05-10T10:44:56.930 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.362+0000 7fe77c290700 1 -- 172.21.15.107:0/3969354272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe774107a60 msgr2=0x7fe77419f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:56.930 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.362+0000 7fe77c290700 1 --2- 172.21.15.107:0/3969354272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe774107a60 0x7fe77419f2e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe7700117b0 tx=0x7fe770011b70 comp rx=0 tx=0).stop 2024-05-10T10:44:56.930 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.362+0000 7fe77c290700 1 -- 172.21.15.107:0/3969354272 shutdown_connections 2024-05-10T10:44:56.930 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.362+0000 7fe77c290700 1 --2- 172.21.15.107:0/3969354272 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fe76003e4c0 0x7fe760040980 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:56.930 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.362+0000 7fe77c290700 1 --2- 172.21.15.107:0/3969354272 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe774107a60 0x7fe77419f2e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:56.930 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.362+0000 7fe77c290700 1 -- 172.21.15.107:0/3969354272 >> 172.21.15.107:0/3969354272 conn(0x7fe774103660 msgr2=0x7fe774195ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:56.930 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.362+0000 7fe77c290700 1 -- 172.21.15.107:0/3969354272 shutdown_connections 2024-05-10T10:44:56.930 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:56.362+0000 7fe77c290700 1 -- 172.21.15.107:0/3969354272 wait complete. 2024-05-10T10:44:57.294 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:57 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' 2024-05-10T10:44:57.294 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:57 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3969354272' entity='client.admin' 2024-05-10T10:44:58.636 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.336+0000 7fa3d367f700 1 Processor -- start 2024-05-10T10:44:58.636 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.336+0000 7fa3d367f700 1 -- start start 2024-05-10T10:44:58.636 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.337+0000 7fa3d367f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3cc107a60 0x7fa3cc107e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:58.636 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.337+0000 7fa3d367f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa3cc076d80 con 0x7fa3cc107a60 2024-05-10T10:44:58.636 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.337+0000 7fa3d141b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3cc107a60 0x7fa3cc107e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:58.636 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.337+0000 7fa3d141b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3cc107a60 0x7fa3cc107e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37160/0 (socket says 172.21.15.107:37160) 2024-05-10T10:44:58.636 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.337+0000 7fa3d141b700 1 -- 172.21.15.107:0/2789067301 learned_addr learned my addr 172.21.15.107:0/2789067301 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:58.636 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.337+0000 7fa3d141b700 1 -- 172.21.15.107:0/2789067301 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3cc1083c0 con 0x7fa3cc107a60 2024-05-10T10:44:58.637 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.337+0000 7fa3d141b700 1 --2- 172.21.15.107:0/2789067301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3cc107a60 0x7fa3cc107e80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80098a0 tx=0x7fa3c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581083a068228ed3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:58.637 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.337+0000 7fa3c3fff700 1 -- 172.21.15.107:0/2789067301 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3c8004160 con 0x7fa3cc107a60 2024-05-10T10:44:58.637 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.337+0000 7fa3c3fff700 1 -- 172.21.15.107:0/2789067301 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa3c8004300 con 0x7fa3cc107a60 2024-05-10T10:44:58.637 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.337+0000 7fa3c3fff700 1 -- 172.21.15.107:0/2789067301 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3c8011af0 con 0x7fa3cc107a60 2024-05-10T10:44:58.637 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.338+0000 7fa3d367f700 1 -- 172.21.15.107:0/2789067301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3cc107a60 msgr2=0x7fa3cc107e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:58.637 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.338+0000 7fa3d367f700 1 --2- 172.21.15.107:0/2789067301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3cc107a60 0x7fa3cc107e80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80098a0 tx=0x7fa3c8009bb0 comp rx=0 tx=0).stop 2024-05-10T10:44:58.637 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.338+0000 7fa3d367f700 1 -- 172.21.15.107:0/2789067301 shutdown_connections 2024-05-10T10:44:58.637 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.338+0000 7fa3d367f700 1 --2- 172.21.15.107:0/2789067301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3cc107a60 0x7fa3cc107e80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:58.637 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.338+0000 7fa3d367f700 1 -- 172.21.15.107:0/2789067301 >> 172.21.15.107:0/2789067301 conn(0x7fa3cc103660 msgr2=0x7fa3cc105a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:58.637 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.338+0000 7fa3d367f700 1 -- 172.21.15.107:0/2789067301 shutdown_connections 2024-05-10T10:44:58.637 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.338+0000 7fa3d367f700 1 -- 172.21.15.107:0/2789067301 wait complete. 2024-05-10T10:44:58.637 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.339+0000 7fa3d367f700 1 Processor -- start 2024-05-10T10:44:58.637 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.339+0000 7fa3d367f700 1 -- start start 2024-05-10T10:44:58.638 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.339+0000 7fa3d367f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3cc107a60 0x7fa3cc19f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:58.638 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.339+0000 7fa3d367f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa3cc109490 con 0x7fa3cc107a60 2024-05-10T10:44:58.638 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.339+0000 7fa3d141b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3cc107a60 0x7fa3cc19f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:58.638 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.339+0000 7fa3d141b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3cc107a60 0x7fa3cc19f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37164/0 (socket says 172.21.15.107:37164) 2024-05-10T10:44:58.638 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.339+0000 7fa3d141b700 1 -- 172.21.15.107:0/561903896 learned_addr learned my addr 172.21.15.107:0/561903896 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:44:58.638 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.339+0000 7fa3d141b700 1 -- 172.21.15.107:0/561903896 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3cc19f830 con 0x7fa3cc107a60 2024-05-10T10:44:58.638 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.339+0000 7fa3d141b700 1 --2- 172.21.15.107:0/561903896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3cc107a60 0x7fa3cc19f2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80117b0 tx=0x7fa3c80045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:58.638 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.339+0000 7fa3c27fc700 1 -- 172.21.15.107:0/561903896 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3c80036a0 con 0x7fa3cc107a60 2024-05-10T10:44:58.638 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.340+0000 7fa3c27fc700 1 -- 172.21.15.107:0/561903896 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa3c801a430 con 0x7fa3cc107a60 2024-05-10T10:44:58.638 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.340+0000 7fa3d367f700 1 -- 172.21.15.107:0/561903896 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3cc19fac0 con 0x7fa3cc107a60 2024-05-10T10:44:58.638 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.340+0000 7fa3c27fc700 1 -- 172.21.15.107:0/561903896 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3c8019530 con 0x7fa3cc107a60 2024-05-10T10:44:58.638 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.340+0000 7fa3d367f700 1 -- 172.21.15.107:0/561903896 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3cc1a27b0 con 0x7fa3cc107a60 2024-05-10T10:44:58.638 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.341+0000 7fa3c27fc700 1 -- 172.21.15.107:0/561903896 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fa3c80197e0 con 0x7fa3cc107a60 2024-05-10T10:44:58.639 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.341+0000 7fa3d367f700 1 -- 172.21.15.107:0/561903896 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3cc064b00 con 0x7fa3cc107a60 2024-05-10T10:44:58.639 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.341+0000 7fa3c27fc700 1 --2- 172.21.15.107:0/561903896 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fa3b803e470 0x7fa3b8040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:44:58.639 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.341+0000 7fa3c27fc700 1 -- 172.21.15.107:0/561903896 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa3c8053910 con 0x7fa3cc107a60 2024-05-10T10:44:58.639 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.341+0000 7fa3d0c1a700 1 --2- 172.21.15.107:0/561903896 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fa3b803e470 0x7fa3b8040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:44:58.639 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.341+0000 7fa3d0c1a700 1 --2- 172.21.15.107:0/561903896 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fa3b803e470 0x7fa3b8040930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc006fd0 tx=0x7fa3bc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:44:58.639 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.346+0000 7fa3c27fc700 1 -- 172.21.15.107:0/561903896 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa3c800fd80 con 0x7fa3cc107a60 2024-05-10T10:44:58.639 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.552+0000 7fa3d367f700 1 -- 172.21.15.107:0/561903896 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fa3cc02e7d0 con 0x7fa3cc107a60 2024-05-10T10:44:58.639 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.555+0000 7fa3c27fc700 1 -- 172.21.15.107:0/561903896 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fa3c801a5e0 con 0x7fa3cc107a60 2024-05-10T10:44:58.639 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.557+0000 7fa3d367f700 1 -- 172.21.15.107:0/561903896 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fa3b803e470 msgr2=0x7fa3b8040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:58.639 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.557+0000 7fa3d367f700 1 --2- 172.21.15.107:0/561903896 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fa3b803e470 0x7fa3b8040930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc006fd0 tx=0x7fa3bc006e40 comp rx=0 tx=0).stop 2024-05-10T10:44:58.639 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.557+0000 7fa3d367f700 1 -- 172.21.15.107:0/561903896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3cc107a60 msgr2=0x7fa3cc19f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:44:58.639 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.557+0000 7fa3d367f700 1 --2- 172.21.15.107:0/561903896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3cc107a60 0x7fa3cc19f2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80117b0 tx=0x7fa3c80045f0 comp rx=0 tx=0).stop 2024-05-10T10:44:58.639 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.557+0000 7fa3d367f700 1 -- 172.21.15.107:0/561903896 shutdown_connections 2024-05-10T10:44:58.639 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.557+0000 7fa3d367f700 1 --2- 172.21.15.107:0/561903896 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fa3b803e470 0x7fa3b8040930 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:58.640 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.557+0000 7fa3d367f700 1 --2- 172.21.15.107:0/561903896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3cc107a60 0x7fa3cc19f2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:44:58.640 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.557+0000 7fa3d367f700 1 -- 172.21.15.107:0/561903896 >> 172.21.15.107:0/561903896 conn(0x7fa3cc103660 msgr2=0x7fa3cc195ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:44:58.640 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.558+0000 7fa3d367f700 1 -- 172.21.15.107:0/561903896 shutdown_connections 2024-05-10T10:44:58.640 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:57.558+0000 7fa3d367f700 1 -- 172.21.15.107:0/561903896 wait complete. 2024-05-10T10:44:58.640 INFO:teuthology.orchestra.run.smithi107.stdout:Enabling the dashboard module... 2024-05-10T10:44:58.862 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:58 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/561903896' entity='client.admin' 2024-05-10T10:44:58.862 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:44:58 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' 2024-05-10T10:45:00.538 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:00 smithi107 ceph-mon[30373]: from='mgr.14120 172.21.15.107:0/3421914114' entity='mgr.x' 2024-05-10T10:45:00.538 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:00 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2293987790' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-10T10:45:00.539 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:00 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: ignoring --setuser ceph since I am not root 2024-05-10T10:45:00.539 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:00 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: ignoring --setgroup ceph since I am not root 2024-05-10T10:45:00.539 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:00 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:00.537+0000 7f64324ee200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T10:45:00.826 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:00 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:00.720+0000 7f64324ee200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T10:45:00.826 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:00 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:00.824+0000 7f64324ee200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T10:45:01.145 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.092+0000 7f3a21b46700 1 Processor -- start 2024-05-10T10:45:01.145 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.092+0000 7f3a21b46700 1 -- start start 2024-05-10T10:45:01.145 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.093+0000 7f3a21b46700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a1c109c30 0x7f3a1c10c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:01.145 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.093+0000 7f3a21b46700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c076dc0 con 0x7f3a1c109c30 2024-05-10T10:45:01.145 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.093+0000 7f3a1b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a1c109c30 0x7f3a1c10c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:01.145 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.093+0000 7f3a1b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a1c109c30 0x7f3a1c10c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37174/0 (socket says 172.21.15.107:37174) 2024-05-10T10:45:01.145 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.093+0000 7f3a1b7fe700 1 -- 172.21.15.107:0/1507568171 learned_addr learned my addr 172.21.15.107:0/1507568171 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:01.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.093+0000 7f3a1b7fe700 1 -- 172.21.15.107:0/1507568171 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1c10c560 con 0x7f3a1c109c30 2024-05-10T10:45:01.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.093+0000 7f3a1b7fe700 1 --2- 172.21.15.107:0/1507568171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a1c109c30 0x7f3a1c10c020 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0098a0 tx=0x7f3a0c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0e784dafc4d21 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:01.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.094+0000 7f3a1a7fc700 1 -- 172.21.15.107:0/1507568171 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a0c004160 con 0x7f3a1c109c30 2024-05-10T10:45:01.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.094+0000 7f3a1a7fc700 1 -- 172.21.15.107:0/1507568171 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3a0c004300 con 0x7f3a1c109c30 2024-05-10T10:45:01.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.094+0000 7f3a1a7fc700 1 -- 172.21.15.107:0/1507568171 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a0c011af0 con 0x7f3a1c109c30 2024-05-10T10:45:01.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.094+0000 7f3a21b46700 1 -- 172.21.15.107:0/1507568171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a1c109c30 msgr2=0x7f3a1c10c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:01.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.094+0000 7f3a21b46700 1 --2- 172.21.15.107:0/1507568171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a1c109c30 0x7f3a1c10c020 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0098a0 tx=0x7f3a0c009bb0 comp rx=0 tx=0).stop 2024-05-10T10:45:01.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.094+0000 7f3a21b46700 1 -- 172.21.15.107:0/1507568171 shutdown_connections 2024-05-10T10:45:01.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.094+0000 7f3a21b46700 1 --2- 172.21.15.107:0/1507568171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a1c109c30 0x7f3a1c10c020 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:01.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.094+0000 7f3a21b46700 1 -- 172.21.15.107:0/1507568171 >> 172.21.15.107:0/1507568171 conn(0x7f3a1c103660 msgr2=0x7f3a1c105a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:01.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.094+0000 7f3a21b46700 1 -- 172.21.15.107:0/1507568171 shutdown_connections 2024-05-10T10:45:01.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.094+0000 7f3a21b46700 1 -- 172.21.15.107:0/1507568171 wait complete. 2024-05-10T10:45:01.146 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.095+0000 7f3a21b46700 1 Processor -- start 2024-05-10T10:45:01.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.095+0000 7f3a21b46700 1 -- start start 2024-05-10T10:45:01.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.095+0000 7f3a21b46700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a1c109c30 0x7f3a1c19d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:01.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.095+0000 7f3a21b46700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c10d5c0 con 0x7f3a1c109c30 2024-05-10T10:45:01.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.095+0000 7f3a1b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a1c109c30 0x7f3a1c19d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:01.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.096+0000 7f3a1b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a1c109c30 0x7f3a1c19d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37182/0 (socket says 172.21.15.107:37182) 2024-05-10T10:45:01.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.096+0000 7f3a1b7fe700 1 -- 172.21.15.107:0/2293987790 learned_addr learned my addr 172.21.15.107:0/2293987790 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:01.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.096+0000 7f3a1b7fe700 1 -- 172.21.15.107:0/2293987790 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1c19d600 con 0x7f3a1c109c30 2024-05-10T10:45:01.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.096+0000 7f3a1b7fe700 1 --2- 172.21.15.107:0/2293987790 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a1c109c30 0x7f3a1c19d0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0117b0 tx=0x7f3a0c0045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:01.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.096+0000 7f3a18ff9700 1 -- 172.21.15.107:0/2293987790 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a0c0036a0 con 0x7f3a1c109c30 2024-05-10T10:45:01.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.096+0000 7f3a18ff9700 1 -- 172.21.15.107:0/2293987790 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3a0c01a430 con 0x7f3a1c109c30 2024-05-10T10:45:01.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.096+0000 7f3a21b46700 1 -- 172.21.15.107:0/2293987790 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a1c19d890 con 0x7f3a1c109c30 2024-05-10T10:45:01.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.096+0000 7f3a18ff9700 1 -- 172.21.15.107:0/2293987790 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a0c019530 con 0x7f3a1c109c30 2024-05-10T10:45:01.147 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.096+0000 7f3a21b46700 1 -- 172.21.15.107:0/2293987790 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a1c1a0580 con 0x7f3a1c109c30 2024-05-10T10:45:01.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.097+0000 7f3a18ff9700 1 -- 172.21.15.107:0/2293987790 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f3a0c0197e0 con 0x7f3a1c109c30 2024-05-10T10:45:01.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.097+0000 7f3a21b46700 1 -- 172.21.15.107:0/2293987790 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a1c064b00 con 0x7f3a1c109c30 2024-05-10T10:45:01.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.097+0000 7f3a18ff9700 1 --2- 172.21.15.107:0/2293987790 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f3a0403e470 0x7f3a04040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:01.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.097+0000 7f3a1affd700 1 --2- 172.21.15.107:0/2293987790 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f3a0403e470 0x7f3a04040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:01.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.097+0000 7f3a18ff9700 1 -- 172.21.15.107:0/2293987790 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3a0c0538c0 con 0x7f3a1c109c30 2024-05-10T10:45:01.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.098+0000 7f3a1affd700 1 --2- 172.21.15.107:0/2293987790 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f3a0403e470 0x7f3a04040930 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3a10006fd0 tx=0x7f3a10006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:01.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.107+0000 7f3a18ff9700 1 -- 172.21.15.107:0/2293987790 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f3a0c017e90 con 0x7f3a1c109c30 2024-05-10T10:45:01.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:44:59.389+0000 7f3a21b46700 1 -- 172.21.15.107:0/2293987790 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f3a1c1a0b30 con 0x7f3a1c109c30 2024-05-10T10:45:01.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:00.357+0000 7f3a18ff9700 1 -- 172.21.15.107:0/2293987790 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f3a0c02d500 con 0x7f3a1c109c30 2024-05-10T10:45:01.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:00.360+0000 7f3a18ff9700 1 -- 172.21.15.107:0/2293987790 <== mon.0 v2:172.21.15.107:3300/0 8 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f3a0c00fd80 con 0x7f3a1c109c30 2024-05-10T10:45:01.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:00.361+0000 7f3a21b46700 1 -- 172.21.15.107:0/2293987790 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f3a0403e470 msgr2=0x7f3a04040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:01.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:00.361+0000 7f3a21b46700 1 --2- 172.21.15.107:0/2293987790 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f3a0403e470 0x7f3a04040930 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3a10006fd0 tx=0x7f3a10006e40 comp rx=0 tx=0).stop 2024-05-10T10:45:01.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:00.361+0000 7f3a21b46700 1 -- 172.21.15.107:0/2293987790 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a1c109c30 msgr2=0x7f3a1c19d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:01.148 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:00.361+0000 7f3a21b46700 1 --2- 172.21.15.107:0/2293987790 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a1c109c30 0x7f3a1c19d0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0117b0 tx=0x7f3a0c0045f0 comp rx=0 tx=0).stop 2024-05-10T10:45:01.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:00.361+0000 7f3a21b46700 1 -- 172.21.15.107:0/2293987790 shutdown_connections 2024-05-10T10:45:01.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:00.361+0000 7f3a21b46700 1 --2- 172.21.15.107:0/2293987790 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7f3a0403e470 0x7f3a04040930 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:01.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:00.361+0000 7f3a21b46700 1 --2- 172.21.15.107:0/2293987790 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3a1c109c30 0x7f3a1c19d0c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:01.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:00.361+0000 7f3a21b46700 1 -- 172.21.15.107:0/2293987790 >> 172.21.15.107:0/2293987790 conn(0x7f3a1c103660 msgr2=0x7f3a1c104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:01.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:00.361+0000 7f3a21b46700 1 -- 172.21.15.107:0/2293987790 shutdown_connections 2024-05-10T10:45:01.149 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:00.361+0000 7f3a21b46700 1 -- 172.21.15.107:0/2293987790 wait complete. 2024-05-10T10:45:01.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:01 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2293987790' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-10T10:45:01.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:01 smithi107 ceph-mon[30373]: mgrmap e9: x(active, since 20s) 2024-05-10T10:45:01.425 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:01 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:01.132+0000 7f64324ee200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T10:45:01.425 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:01 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:01.228+0000 7f64324ee200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T10:45:02.615 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:02 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2498460010' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-10T10:45:02.615 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:02 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:02.439+0000 7f64324ee200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T10:45:02.615 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:02 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:02.613+0000 7f64324ee200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T10:45:02.912 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:02 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:02.785+0000 7f64324ee200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T10:45:02.920 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2024-05-10T10:45:02.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-10T10:45:02.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-10T10:45:02.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-10T10:45:02.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-10T10:45:02.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2024-05-10T10:45:02.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.000+0000 7fbda3cfc700 1 Processor -- start 2024-05-10T10:45:02.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.001+0000 7fbda3cfc700 1 -- start start 2024-05-10T10:45:02.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.001+0000 7fbda3cfc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd9c109bd0 0x7fbd9c10bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:02.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.001+0000 7fbda3cfc700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9c07ced0 con 0x7fbd9c109bd0 2024-05-10T10:45:02.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.001+0000 7fbda1a98700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd9c109bd0 0x7fbd9c10bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:02.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.001+0000 7fbda1a98700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd9c109bd0 0x7fbd9c10bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37208/0 (socket says 172.21.15.107:37208) 2024-05-10T10:45:02.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.001+0000 7fbda1a98700 1 -- 172.21.15.107:0/1028557554 learned_addr learned my addr 172.21.15.107:0/1028557554 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:02.921 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.002+0000 7fbda1a98700 1 -- 172.21.15.107:0/1028557554 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9c10c500 con 0x7fbd9c109bd0 2024-05-10T10:45:02.922 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.002+0000 7fbda1a98700 1 --2- 172.21.15.107:0/1028557554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd9c109bd0 0x7fbd9c10bfc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbd980098a0 tx=0x7fbd98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee8e1155a82e853 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:02.922 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.002+0000 7fbda0a96700 1 -- 172.21.15.107:0/1028557554 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd98004160 con 0x7fbd9c109bd0 2024-05-10T10:45:02.922 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.002+0000 7fbda0a96700 1 -- 172.21.15.107:0/1028557554 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbd98004300 con 0x7fbd9c109bd0 2024-05-10T10:45:02.922 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.002+0000 7fbda0a96700 1 -- 172.21.15.107:0/1028557554 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd98011af0 con 0x7fbd9c109bd0 2024-05-10T10:45:02.922 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.002+0000 7fbda3cfc700 1 -- 172.21.15.107:0/1028557554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd9c109bd0 msgr2=0x7fbd9c10bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:02.922 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.002+0000 7fbda3cfc700 1 --2- 172.21.15.107:0/1028557554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd9c109bd0 0x7fbd9c10bfc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbd980098a0 tx=0x7fbd98009bb0 comp rx=0 tx=0).stop 2024-05-10T10:45:02.922 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.003+0000 7fbda3cfc700 1 -- 172.21.15.107:0/1028557554 shutdown_connections 2024-05-10T10:45:02.923 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.003+0000 7fbda3cfc700 1 --2- 172.21.15.107:0/1028557554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd9c109bd0 0x7fbd9c10bfc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:02.923 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.003+0000 7fbda3cfc700 1 -- 172.21.15.107:0/1028557554 >> 172.21.15.107:0/1028557554 conn(0x7fbd9c103620 msgr2=0x7fbd9c105a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:02.923 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.003+0000 7fbda3cfc700 1 -- 172.21.15.107:0/1028557554 shutdown_connections 2024-05-10T10:45:02.923 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.003+0000 7fbda3cfc700 1 -- 172.21.15.107:0/1028557554 wait complete. 2024-05-10T10:45:02.923 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.003+0000 7fbda3cfc700 1 Processor -- start 2024-05-10T10:45:02.923 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.003+0000 7fbda3cfc700 1 -- start start 2024-05-10T10:45:02.923 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.003+0000 7fbda3cfc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd9c109bd0 0x7fbd9c19d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:02.923 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.003+0000 7fbda3cfc700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9c10d570 con 0x7fbd9c109bd0 2024-05-10T10:45:02.923 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.004+0000 7fbda1a98700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd9c109bd0 0x7fbd9c19d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:02.923 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.004+0000 7fbda1a98700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd9c109bd0 0x7fbd9c19d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37216/0 (socket says 172.21.15.107:37216) 2024-05-10T10:45:02.923 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.004+0000 7fbda1a98700 1 -- 172.21.15.107:0/2498460010 learned_addr learned my addr 172.21.15.107:0/2498460010 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:02.923 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.004+0000 7fbda1a98700 1 -- 172.21.15.107:0/2498460010 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9c19d590 con 0x7fbd9c109bd0 2024-05-10T10:45:02.924 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.004+0000 7fbda1a98700 1 --2- 172.21.15.107:0/2498460010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd9c109bd0 0x7fbd9c19d050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd980117b0 tx=0x7fbd980045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:02.924 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.004+0000 7fbd92ffd700 1 -- 172.21.15.107:0/2498460010 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd980036a0 con 0x7fbd9c109bd0 2024-05-10T10:45:02.924 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.004+0000 7fbd92ffd700 1 -- 172.21.15.107:0/2498460010 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbd9801a430 con 0x7fbd9c109bd0 2024-05-10T10:45:02.924 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.004+0000 7fbda3cfc700 1 -- 172.21.15.107:0/2498460010 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9c19d820 con 0x7fbd9c109bd0 2024-05-10T10:45:02.924 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.004+0000 7fbd92ffd700 1 -- 172.21.15.107:0/2498460010 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd98019530 con 0x7fbd9c109bd0 2024-05-10T10:45:02.924 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.004+0000 7fbda3cfc700 1 -- 172.21.15.107:0/2498460010 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd9c1a0510 con 0x7fbd9c109bd0 2024-05-10T10:45:02.924 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.005+0000 7fbda3cfc700 1 -- 172.21.15.107:0/2498460010 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd9c064b00 con 0x7fbd9c109bd0 2024-05-10T10:45:02.924 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.005+0000 7fbd92ffd700 1 -- 172.21.15.107:0/2498460010 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7fbd98019830 con 0x7fbd9c109bd0 2024-05-10T10:45:02.924 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.006+0000 7fbd92ffd700 1 --2- 172.21.15.107:0/2498460010 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fbd8803e470 0x7fbd88040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:02.924 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.006+0000 7fbda1297700 1 -- 172.21.15.107:0/2498460010 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fbd8803e470 msgr2=0x7fbd88040930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/892499090 2024-05-10T10:45:02.924 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.006+0000 7fbd92ffd700 1 -- 172.21.15.107:0/2498460010 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbd980539c0 con 0x7fbd9c109bd0 2024-05-10T10:45:02.924 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.006+0000 7fbda1297700 1 --2- 172.21.15.107:0/2498460010 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fbd8803e470 0x7fbd88040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T10:45:02.924 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.010+0000 7fbd92ffd700 1 -- 172.21.15.107:0/2498460010 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fbd98053310 con 0x7fbd9c109bd0 2024-05-10T10:45:02.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.207+0000 7fbda1297700 1 -- 172.21.15.107:0/2498460010 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fbd8803e470 msgr2=0x7fbd88040930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/892499090 2024-05-10T10:45:02.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.207+0000 7fbda1297700 1 --2- 172.21.15.107:0/2498460010 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fbd8803e470 0x7fbd88040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-10T10:45:02.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.278+0000 7fbda3cfc700 1 -- 172.21.15.107:0/2498460010 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fbd9c1a0ac0 con 0x7fbd9c109bd0 2024-05-10T10:45:02.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.278+0000 7fbd92ffd700 1 -- 172.21.15.107:0/2498460010 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fbd98003840 con 0x7fbd9c109bd0 2024-05-10T10:45:02.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.281+0000 7fbda3cfc700 1 -- 172.21.15.107:0/2498460010 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fbd8803e470 msgr2=0x7fbd88040930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T10:45:02.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.281+0000 7fbda3cfc700 1 --2- 172.21.15.107:0/2498460010 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fbd8803e470 0x7fbd88040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:02.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.281+0000 7fbda3cfc700 1 -- 172.21.15.107:0/2498460010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd9c109bd0 msgr2=0x7fbd9c19d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:02.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.281+0000 7fbda3cfc700 1 --2- 172.21.15.107:0/2498460010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd9c109bd0 0x7fbd9c19d050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd980117b0 tx=0x7fbd980045f0 comp rx=0 tx=0).stop 2024-05-10T10:45:02.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.281+0000 7fbda3cfc700 1 -- 172.21.15.107:0/2498460010 shutdown_connections 2024-05-10T10:45:02.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.281+0000 7fbda3cfc700 1 --2- 172.21.15.107:0/2498460010 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fbd8803e470 0x7fbd88040930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:02.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.281+0000 7fbda3cfc700 1 --2- 172.21.15.107:0/2498460010 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd9c109bd0 0x7fbd9c19d050 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:02.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.281+0000 7fbda3cfc700 1 -- 172.21.15.107:0/2498460010 >> 172.21.15.107:0/2498460010 conn(0x7fbd9c103620 msgr2=0x7fbd9c1040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:02.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.281+0000 7fbda3cfc700 1 -- 172.21.15.107:0/2498460010 shutdown_connections 2024-05-10T10:45:02.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:02.281+0000 7fbda3cfc700 1 -- 172.21.15.107:0/2498460010 wait complete. 2024-05-10T10:45:02.926 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for the mgr to restart... 2024-05-10T10:45:02.926 INFO:teuthology.orchestra.run.smithi107.stdout:Waiting for mgr epoch 9... 2024-05-10T10:45:03.175 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:03 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:03.083+0000 7f64324ee200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T10:45:03.552 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:03 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:03.180+0000 7f64324ee200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T10:45:03.552 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:03 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:03.390+0000 7f64324ee200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T10:45:03.925 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:03 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:03.586+0000 7f64324ee200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T10:45:04.415 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:04 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:04.191+0000 7f64324ee200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T10:45:04.415 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:04 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:04.414+0000 7f64324ee200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-10T10:45:05.175 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:04 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:04.841+0000 7f64324ee200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T10:45:05.175 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:04 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:04.939+0000 7f64324ee200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T10:45:05.671 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:05 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:05.311+0000 7f64324ee200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T10:45:05.671 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:05 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:05.669+0000 7f64324ee200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T10:45:05.925 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:05 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:05.763+0000 7f64324ee200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T10:45:06.356 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:06 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:06.011+0000 7f64324ee200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T10:45:06.356 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:06 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:06.146+0000 7f64324ee200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T10:45:06.356 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:06 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:06.244+0000 7f64324ee200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T10:45:06.666 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:06 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:06.570+0000 7f64324ee200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T10:45:06.667 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:06 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:06.665+0000 7f64324ee200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T10:45:07.571 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:07 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:07.279+0000 7f64324ee200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T10:45:07.571 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:07 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:07.516+0000 7f64324ee200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T10:45:07.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:07 smithi107 ceph-mon[30373]: Active manager daemon x restarted 2024-05-10T10:45:07.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:07 smithi107 ceph-mon[30373]: Activating manager daemon x 2024-05-10T10:45:07.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:07 smithi107 ceph-mon[30373]: osdmap e3: 0 total, 0 up, 0 in 2024-05-10T10:45:07.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:07 smithi107 ceph-mon[30373]: mgrmap e10: x(active, starting, since 0.00439924s) 2024-05-10T10:45:07.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T10:45:07.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-10T10:45:07.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-10T10:45:07.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-10T10:45:07.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-10T10:45:07.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:07 smithi107 ceph-mon[30373]: Manager daemon x is now available 2024-05-10T10:45:07.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:45:07.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-10T10:45:08.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-10T10:45:08.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:08 smithi107 ceph-mon[30373]: mgrmap e11: x(active, since 1.00624s) 2024-05-10T10:45:09.349 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout { 2024-05-10T10:45:09.349 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-10T10:45:09.349 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-10T10:45:09.349 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout } 2024-05-10T10:45:09.349 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.345+0000 7fba3ef43700 1 Processor -- start 2024-05-10T10:45:09.349 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.345+0000 7fba3ef43700 1 -- start start 2024-05-10T10:45:09.349 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.345+0000 7fba3ef43700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba38109c00 0x7fba3810bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:09.349 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.345+0000 7fba3ef43700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fba38076de0 con 0x7fba38109c00 2024-05-10T10:45:09.349 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.345+0000 7fba3ccdf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba38109c00 0x7fba3810bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:09.349 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.345+0000 7fba3ccdf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba38109c00 0x7fba3810bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37232/0 (socket says 172.21.15.107:37232) 2024-05-10T10:45:09.349 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.345+0000 7fba3ccdf700 1 -- 172.21.15.107:0/746444172 learned_addr learned my addr 172.21.15.107:0/746444172 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:09.350 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.345+0000 7fba3ccdf700 1 -- 172.21.15.107:0/746444172 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3810c530 con 0x7fba38109c00 2024-05-10T10:45:09.350 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.345+0000 7fba3ccdf700 1 --2- 172.21.15.107:0/746444172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba38109c00 0x7fba3810bff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fba2c0098a0 tx=0x7fba2c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1ee51ac62c7f48 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:09.350 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.346+0000 7fba377fe700 1 -- 172.21.15.107:0/746444172 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba2c004160 con 0x7fba38109c00 2024-05-10T10:45:09.350 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.346+0000 7fba377fe700 1 -- 172.21.15.107:0/746444172 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba2c004300 con 0x7fba38109c00 2024-05-10T10:45:09.350 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.346+0000 7fba377fe700 1 -- 172.21.15.107:0/746444172 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba2c011af0 con 0x7fba38109c00 2024-05-10T10:45:09.350 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.346+0000 7fba3ef43700 1 -- 172.21.15.107:0/746444172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba38109c00 msgr2=0x7fba3810bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:09.350 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.346+0000 7fba3ef43700 1 --2- 172.21.15.107:0/746444172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba38109c00 0x7fba3810bff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fba2c0098a0 tx=0x7fba2c009bb0 comp rx=0 tx=0).stop 2024-05-10T10:45:09.350 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.346+0000 7fba3ef43700 1 -- 172.21.15.107:0/746444172 shutdown_connections 2024-05-10T10:45:09.350 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.346+0000 7fba3ef43700 1 --2- 172.21.15.107:0/746444172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba38109c00 0x7fba3810bff0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:09.350 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.346+0000 7fba3ef43700 1 -- 172.21.15.107:0/746444172 >> 172.21.15.107:0/746444172 conn(0x7fba38103670 msgr2=0x7fba38105a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:09.350 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.346+0000 7fba3ef43700 1 -- 172.21.15.107:0/746444172 shutdown_connections 2024-05-10T10:45:09.350 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.346+0000 7fba3ef43700 1 -- 172.21.15.107:0/746444172 wait complete. 2024-05-10T10:45:09.351 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.347+0000 7fba3ef43700 1 Processor -- start 2024-05-10T10:45:09.351 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.347+0000 7fba3ef43700 1 -- start start 2024-05-10T10:45:09.351 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.347+0000 7fba3ef43700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba38109c00 0x7fba3819d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:09.351 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.347+0000 7fba3ef43700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fba3810d530 con 0x7fba38109c00 2024-05-10T10:45:09.351 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.347+0000 7fba3ccdf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba38109c00 0x7fba3819d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:09.351 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.347+0000 7fba3ccdf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba38109c00 0x7fba3819d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37246/0 (socket says 172.21.15.107:37246) 2024-05-10T10:45:09.351 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.347+0000 7fba3ccdf700 1 -- 172.21.15.107:0/1859907327 learned_addr learned my addr 172.21.15.107:0/1859907327 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:09.351 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.348+0000 7fba3ccdf700 1 -- 172.21.15.107:0/1859907327 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3819d5a0 con 0x7fba38109c00 2024-05-10T10:45:09.351 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.348+0000 7fba3ccdf700 1 --2- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba38109c00 0x7fba3819d060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fba2c0117b0 tx=0x7fba2c011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:09.351 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.348+0000 7fba35ffb700 1 -- 172.21.15.107:0/1859907327 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba2c0039e0 con 0x7fba38109c00 2024-05-10T10:45:09.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.348+0000 7fba35ffb700 1 -- 172.21.15.107:0/1859907327 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba2c003b80 con 0x7fba38109c00 2024-05-10T10:45:09.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.348+0000 7fba3ef43700 1 -- 172.21.15.107:0/1859907327 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba3819d890 con 0x7fba38109c00 2024-05-10T10:45:09.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.348+0000 7fba35ffb700 1 -- 172.21.15.107:0/1859907327 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba2c024780 con 0x7fba38109c00 2024-05-10T10:45:09.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.348+0000 7fba3ef43700 1 -- 172.21.15.107:0/1859907327 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba381a0520 con 0x7fba38109c00 2024-05-10T10:45:09.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.349+0000 7fba35ffb700 1 -- 172.21.15.107:0/1859907327 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7fba2c022020 con 0x7fba38109c00 2024-05-10T10:45:09.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.349+0000 7fba35ffb700 1 --2- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fba2803e520 0x7fba280409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:09.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.349+0000 7fba35ffb700 1 -- 172.21.15.107:0/1859907327 --> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fba280410f0 con 0x7fba2803e520 2024-05-10T10:45:09.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.349+0000 7fba35ffb700 1 -- 172.21.15.107:0/1859907327 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fba2c0537a0 con 0x7fba38109c00 2024-05-10T10:45:09.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.349+0000 7fba37fff700 1 -- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fba2803e520 msgr2=0x7fba280409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/892499090 2024-05-10T10:45:09.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.349+0000 7fba37fff700 1 --2- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fba2803e520 0x7fba280409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T10:45:09.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.551+0000 7fba37fff700 1 -- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fba2803e520 msgr2=0x7fba280409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/892499090 2024-05-10T10:45:09.352 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.551+0000 7fba37fff700 1 --2- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fba2803e520 0x7fba280409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-10T10:45:09.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.952+0000 7fba37fff700 1 -- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fba2803e520 msgr2=0x7fba280409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/892499090 2024-05-10T10:45:09.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:03.952+0000 7fba37fff700 1 --2- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fba2803e520 0x7fba280409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-10T10:45:09.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:04.753+0000 7fba37fff700 1 -- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fba2803e520 msgr2=0x7fba280409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/892499090 2024-05-10T10:45:09.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:04.753+0000 7fba37fff700 1 --2- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fba2803e520 0x7fba280409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-10T10:45:09.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:06.354+0000 7fba37fff700 1 -- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fba2803e520 msgr2=0x7fba280409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.107:6800/892499090 2024-05-10T10:45:09.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:06.354+0000 7fba37fff700 1 --2- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fba2803e520 0x7fba280409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-10T10:45:09.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:07.520+0000 7fba35ffb700 1 -- 172.21.15.107:0/1859907327 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mgrmap(e 10) ==== 50002+0+0 (secure 0 0 0) 0x7fba2c019ca0 con 0x7fba38109c00 2024-05-10T10:45:09.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:07.520+0000 7fba35ffb700 1 -- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fba2803e520 msgr2=0x7fba280409e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T10:45:09.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:07.520+0000 7fba35ffb700 1 --2- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fba2803e520 0x7fba280409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:09.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:08.521+0000 7fba35ffb700 1 -- 172.21.15.107:0/1859907327 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 11) ==== 50129+0+0 (secure 0 0 0) 0x7fba2c0551e0 con 0x7fba38109c00 2024-05-10T10:45:09.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:08.522+0000 7fba35ffb700 1 --2- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fba28041fa0 0x7fba28044390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:09.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:08.522+0000 7fba35ffb700 1 -- 172.21.15.107:0/1859907327 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fba280410f0 con 0x7fba28041fa0 2024-05-10T10:45:09.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:08.523+0000 7fba37fff700 1 --2- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fba28041fa0 0x7fba28044390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:09.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:08.523+0000 7fba37fff700 1 --2- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fba28041fa0 0x7fba28044390 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fba24003a10 tx=0x7fba24009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:09.353 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:08.524+0000 7fba35ffb700 1 -- 172.21.15.107:0/1859907327 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fba280410f0 con 0x7fba28041fa0 2024-05-10T10:45:09.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:08.532+0000 7fba3ef43700 1 -- 172.21.15.107:0/1859907327 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fba38064b00 con 0x7fba28041fa0 2024-05-10T10:45:09.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:08.533+0000 7fba35ffb700 1 -- 172.21.15.107:0/1859907327 <== mgr.14152 v2:172.21.15.107:6800/2062256859 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fba38064b00 con 0x7fba28041fa0 2024-05-10T10:45:09.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:08.533+0000 7fba3ef43700 1 -- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fba28041fa0 msgr2=0x7fba28044390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:09.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:08.533+0000 7fba3ef43700 1 --2- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fba28041fa0 0x7fba28044390 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fba24003a10 tx=0x7fba24009270 comp rx=0 tx=0).stop 2024-05-10T10:45:09.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:08.533+0000 7fba3ef43700 1 -- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba38109c00 msgr2=0x7fba3819d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:09.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:08.533+0000 7fba3ef43700 1 --2- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba38109c00 0x7fba3819d060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fba2c0117b0 tx=0x7fba2c011b70 comp rx=0 tx=0).stop 2024-05-10T10:45:09.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:08.533+0000 7fba3ef43700 1 -- 172.21.15.107:0/1859907327 shutdown_connections 2024-05-10T10:45:09.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:08.533+0000 7fba3ef43700 1 --2- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fba28041fa0 0x7fba28044390 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:09.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:08.533+0000 7fba3ef43700 1 --2- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fba38109c00 0x7fba3819d060 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:09.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:08.533+0000 7fba3ef43700 1 --2- 172.21.15.107:0/1859907327 >> [v2:172.21.15.107:6800/892499090,v1:172.21.15.107:6801/892499090] conn(0x7fba2803e520 0x7fba280409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:09.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:08.533+0000 7fba3ef43700 1 -- 172.21.15.107:0/1859907327 >> 172.21.15.107:0/1859907327 conn(0x7fba38103670 msgr2=0x7fba38104160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:09.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:08.533+0000 7fba3ef43700 1 -- 172.21.15.107:0/1859907327 shutdown_connections 2024-05-10T10:45:09.354 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:08.533+0000 7fba3ef43700 1 -- 172.21.15.107:0/1859907327 wait complete. 2024-05-10T10:45:09.354 INFO:teuthology.orchestra.run.smithi107.stdout:mgr epoch 9 is available 2024-05-10T10:45:09.355 INFO:teuthology.orchestra.run.smithi107.stdout:Generating a dashboard self-signed certificate... 2024-05-10T10:45:10.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:10 smithi107 ceph-mon[30373]: [10/May/2024:10:45:08] ENGINE Bus STARTING 2024-05-10T10:45:10.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:10 smithi107 ceph-mon[30373]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-10T10:45:10.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:10 smithi107 ceph-mon[30373]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-10T10:45:10.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:10 smithi107 ceph-mon[30373]: [10/May/2024:10:45:08] ENGINE Serving on http://172.21.15.107:8765 2024-05-10T10:45:10.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:10 smithi107 ceph-mon[30373]: [10/May/2024:10:45:08] ENGINE Serving on https://172.21.15.107:7150 2024-05-10T10:45:10.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:10 smithi107 ceph-mon[30373]: [10/May/2024:10:45:08] ENGINE Bus STARTED 2024-05-10T10:45:10.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:10 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:10.801 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-10T10:45:10.801 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.844+0000 7f7518e86700 1 Processor -- start 2024-05-10T10:45:10.801 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.844+0000 7f7518e86700 1 -- start start 2024-05-10T10:45:10.801 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.845+0000 7f7518e86700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f751407dd70 0x7f751407c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:10.801 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.845+0000 7f7518e86700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f751407c7a0 con 0x7f751407dd70 2024-05-10T10:45:10.801 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.845+0000 7f751259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f751407dd70 0x7f751407c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:10.801 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.845+0000 7f751259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f751407dd70 0x7f751407c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37994/0 (socket says 172.21.15.107:37994) 2024-05-10T10:45:10.801 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.845+0000 7f751259c700 1 -- 172.21.15.107:0/2336929319 learned_addr learned my addr 172.21.15.107:0/2336929319 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:10.801 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.845+0000 7f751259c700 1 -- 172.21.15.107:0/2336929319 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751407c920 con 0x7f751407dd70 2024-05-10T10:45:10.801 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.846+0000 7f751259c700 1 --2- 172.21.15.107:0/2336929319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f751407dd70 0x7f751407c1d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f75040098a0 tx=0x7f7504009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8da75dd59798765 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:10.801 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.846+0000 7f751159a700 1 -- 172.21.15.107:0/2336929319 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7504004160 con 0x7f751407dd70 2024-05-10T10:45:10.802 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.846+0000 7f751159a700 1 -- 172.21.15.107:0/2336929319 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7504004300 con 0x7f751407dd70 2024-05-10T10:45:10.802 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.846+0000 7f751159a700 1 -- 172.21.15.107:0/2336929319 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7504011af0 con 0x7f751407dd70 2024-05-10T10:45:10.802 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.846+0000 7f7518e86700 1 -- 172.21.15.107:0/2336929319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f751407dd70 msgr2=0x7f751407c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:10.802 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.846+0000 7f7518e86700 1 --2- 172.21.15.107:0/2336929319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f751407dd70 0x7f751407c1d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f75040098a0 tx=0x7f7504009bb0 comp rx=0 tx=0).stop 2024-05-10T10:45:10.802 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.847+0000 7f7518e86700 1 -- 172.21.15.107:0/2336929319 shutdown_connections 2024-05-10T10:45:10.802 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.847+0000 7f7518e86700 1 --2- 172.21.15.107:0/2336929319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f751407dd70 0x7f751407c1d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:10.802 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.847+0000 7f7518e86700 1 -- 172.21.15.107:0/2336929319 >> 172.21.15.107:0/2336929319 conn(0x7f7514104780 msgr2=0x7f7514106ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:10.802 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.847+0000 7f7518e86700 1 -- 172.21.15.107:0/2336929319 shutdown_connections 2024-05-10T10:45:10.802 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.847+0000 7f7518e86700 1 -- 172.21.15.107:0/2336929319 wait complete. 2024-05-10T10:45:10.802 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.847+0000 7f7518e86700 1 Processor -- start 2024-05-10T10:45:10.802 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.847+0000 7f7518e86700 1 -- start start 2024-05-10T10:45:10.802 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.848+0000 7f7518e86700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f751407dd70 0x7f751419f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:10.802 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.848+0000 7f7518e86700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f751410f800 con 0x7f751407dd70 2024-05-10T10:45:10.803 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.848+0000 7f751259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f751407dd70 0x7f751419f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:10.803 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.848+0000 7f751259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f751407dd70 0x7f751419f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37996/0 (socket says 172.21.15.107:37996) 2024-05-10T10:45:10.803 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.848+0000 7f751259c700 1 -- 172.21.15.107:0/1017824283 learned_addr learned my addr 172.21.15.107:0/1017824283 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:10.803 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.848+0000 7f751259c700 1 -- 172.21.15.107:0/1017824283 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751419f820 con 0x7f751407dd70 2024-05-10T10:45:10.803 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.848+0000 7f751259c700 1 --2- 172.21.15.107:0/1017824283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f751407dd70 0x7f751419f2e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f75040117b0 tx=0x7f75040045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:10.803 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.848+0000 7f75037fe700 1 -- 172.21.15.107:0/1017824283 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75040036a0 con 0x7f751407dd70 2024-05-10T10:45:10.803 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.848+0000 7f75037fe700 1 -- 172.21.15.107:0/1017824283 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f750401a430 con 0x7f751407dd70 2024-05-10T10:45:10.803 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.848+0000 7f7518e86700 1 -- 172.21.15.107:0/1017824283 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751419fab0 con 0x7f751407dd70 2024-05-10T10:45:10.803 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.848+0000 7f75037fe700 1 -- 172.21.15.107:0/1017824283 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7504019530 con 0x7f751407dd70 2024-05-10T10:45:10.803 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.849+0000 7f7518e86700 1 -- 172.21.15.107:0/1017824283 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75141a27a0 con 0x7f751407dd70 2024-05-10T10:45:10.803 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.849+0000 7f75037fe700 1 -- 172.21.15.107:0/1017824283 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 11) ==== 50129+0+0 (secure 0 0 0) 0x7f75040197e0 con 0x7f751407dd70 2024-05-10T10:45:10.803 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.849+0000 7f7518e86700 1 -- 172.21.15.107:0/1017824283 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7514064b00 con 0x7f751407dd70 2024-05-10T10:45:10.803 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.850+0000 7f75037fe700 1 --2- 172.21.15.107:0/1017824283 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f74fc03e3b0 0x7f74fc040870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:10.803 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.850+0000 7f75037fe700 1 -- 172.21.15.107:0/1017824283 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7504053690 con 0x7f751407dd70 2024-05-10T10:45:10.803 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.850+0000 7f7511d9b700 1 --2- 172.21.15.107:0/1017824283 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f74fc03e3b0 0x7f74fc040870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:10.803 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.850+0000 7f7511d9b700 1 --2- 172.21.15.107:0/1017824283 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f74fc03e3b0 0x7f74fc040870 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7508006fd0 tx=0x7f7508006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:10.804 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:09.855+0000 7f75037fe700 1 -- 172.21.15.107:0/1017824283 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f7504017e90 con 0x7f751407dd70 2024-05-10T10:45:10.804 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:10.069+0000 7f7518e86700 1 -- 172.21.15.107:0/1017824283 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f7514105950 con 0x7f74fc03e3b0 2024-05-10T10:45:10.804 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:10.077+0000 7f75037fe700 1 -- 172.21.15.107:0/1017824283 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f750400fd80 con 0x7f751407dd70 2024-05-10T10:45:10.804 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:10.189+0000 7f75037fe700 1 -- 172.21.15.107:0/1017824283 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f7514105950 con 0x7f74fc03e3b0 2024-05-10T10:45:10.804 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:10.191+0000 7f7518e86700 1 -- 172.21.15.107:0/1017824283 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f74fc03e3b0 msgr2=0x7f74fc040870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:10.804 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:10.191+0000 7f7518e86700 1 --2- 172.21.15.107:0/1017824283 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f74fc03e3b0 0x7f74fc040870 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7508006fd0 tx=0x7f7508006e40 comp rx=0 tx=0).stop 2024-05-10T10:45:10.804 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:10.191+0000 7f7518e86700 1 -- 172.21.15.107:0/1017824283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f751407dd70 msgr2=0x7f751419f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:10.804 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:10.191+0000 7f7518e86700 1 --2- 172.21.15.107:0/1017824283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f751407dd70 0x7f751419f2e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f75040117b0 tx=0x7f75040045f0 comp rx=0 tx=0).stop 2024-05-10T10:45:10.804 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:10.191+0000 7f7518e86700 1 -- 172.21.15.107:0/1017824283 shutdown_connections 2024-05-10T10:45:10.804 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:10.191+0000 7f7518e86700 1 --2- 172.21.15.107:0/1017824283 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f74fc03e3b0 0x7f74fc040870 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:10.804 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:10.191+0000 7f7518e86700 1 --2- 172.21.15.107:0/1017824283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f751407dd70 0x7f751419f2e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:10.804 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:10.191+0000 7f7518e86700 1 -- 172.21.15.107:0/1017824283 >> 172.21.15.107:0/1017824283 conn(0x7f7514104780 msgr2=0x7f7514105240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:10.804 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:10.191+0000 7f7518e86700 1 -- 172.21.15.107:0/1017824283 shutdown_connections 2024-05-10T10:45:10.804 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:10.191+0000 7f7518e86700 1 -- 172.21.15.107:0/1017824283 wait complete. 2024-05-10T10:45:10.804 INFO:teuthology.orchestra.run.smithi107.stdout:Creating initial admin user... 2024-05-10T10:45:11.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:11 smithi107 ceph-mon[30373]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:45:11.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:11 smithi107 ceph-mon[30373]: mgrmap e12: x(active, since 2s) 2024-05-10T10:45:11.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:11 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:11.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:11 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:12.282 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Huu0rJ5g/MD3eHpOZqQfS.h.VaPAgDxsG8OEDwjXXje34T9u95tma", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715337911, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-10T10:45:12.282 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.220+0000 7f647c523700 1 Processor -- start 2024-05-10T10:45:12.282 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.220+0000 7f647c523700 1 -- start start 2024-05-10T10:45:12.282 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.221+0000 7f647c523700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474108090 0x7f64741084b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:12.282 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.221+0000 7f647c523700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6474108a80 con 0x7f6474108090 2024-05-10T10:45:12.282 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.221+0000 7f647a2bf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474108090 0x7f64741084b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:12.282 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.221+0000 7f647a2bf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474108090 0x7f64741084b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38012/0 (socket says 172.21.15.107:38012) 2024-05-10T10:45:12.282 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.221+0000 7f647a2bf700 1 -- 172.21.15.107:0/1577508303 learned_addr learned my addr 172.21.15.107:0/1577508303 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:12.283 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.221+0000 7f647a2bf700 1 -- 172.21.15.107:0/1577508303 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6474109290 con 0x7f6474108090 2024-05-10T10:45:12.283 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.221+0000 7f647a2bf700 1 --2- 172.21.15.107:0/1577508303 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474108090 0x7f64741084b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f64700098a0 tx=0x7f6470009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb9584125c07a55 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:12.283 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.221+0000 7f64792bd700 1 -- 172.21.15.107:0/1577508303 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6470004160 con 0x7f6474108090 2024-05-10T10:45:12.283 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.221+0000 7f64792bd700 1 -- 172.21.15.107:0/1577508303 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6470004300 con 0x7f6474108090 2024-05-10T10:45:12.283 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.221+0000 7f64792bd700 1 -- 172.21.15.107:0/1577508303 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6470011af0 con 0x7f6474108090 2024-05-10T10:45:12.283 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.222+0000 7f647c523700 1 -- 172.21.15.107:0/1577508303 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474108090 msgr2=0x7f64741084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:12.283 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.222+0000 7f647c523700 1 --2- 172.21.15.107:0/1577508303 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474108090 0x7f64741084b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f64700098a0 tx=0x7f6470009bb0 comp rx=0 tx=0).stop 2024-05-10T10:45:12.283 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.222+0000 7f647c523700 1 -- 172.21.15.107:0/1577508303 shutdown_connections 2024-05-10T10:45:12.283 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.222+0000 7f647c523700 1 --2- 172.21.15.107:0/1577508303 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474108090 0x7f64741084b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:12.283 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.222+0000 7f647c523700 1 -- 172.21.15.107:0/1577508303 >> 172.21.15.107:0/1577508303 conn(0x7f6474103670 msgr2=0x7f6474105a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:12.283 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.222+0000 7f647c523700 1 -- 172.21.15.107:0/1577508303 shutdown_connections 2024-05-10T10:45:12.283 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.222+0000 7f647c523700 1 -- 172.21.15.107:0/1577508303 wait complete. 2024-05-10T10:45:12.283 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.223+0000 7f647c523700 1 Processor -- start 2024-05-10T10:45:12.283 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.223+0000 7f647c523700 1 -- start start 2024-05-10T10:45:12.284 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.223+0000 7f647c523700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474108090 0x7f647407ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:12.284 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.223+0000 7f647c523700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f647410c640 con 0x7f6474108090 2024-05-10T10:45:12.284 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.223+0000 7f647a2bf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474108090 0x7f647407ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:12.284 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.223+0000 7f647a2bf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474108090 0x7f647407ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38024/0 (socket says 172.21.15.107:38024) 2024-05-10T10:45:12.284 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.223+0000 7f647a2bf700 1 -- 172.21.15.107:0/2715316649 learned_addr learned my addr 172.21.15.107:0/2715316649 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:12.284 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.223+0000 7f647a2bf700 1 -- 172.21.15.107:0/2715316649 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647419fe00 con 0x7f6474108090 2024-05-10T10:45:12.284 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.223+0000 7f647a2bf700 1 --2- 172.21.15.107:0/2715316649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474108090 0x7f647407ca70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6470009520 tx=0x7f64700045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:12.284 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.224+0000 7f646b7fe700 1 -- 172.21.15.107:0/2715316649 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64700036a0 con 0x7f6474108090 2024-05-10T10:45:12.284 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.224+0000 7f646b7fe700 1 -- 172.21.15.107:0/2715316649 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f647001a430 con 0x7f6474108090 2024-05-10T10:45:12.284 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.224+0000 7f647c523700 1 -- 172.21.15.107:0/2715316649 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647419ffd0 con 0x7f6474108090 2024-05-10T10:45:12.284 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.224+0000 7f646b7fe700 1 -- 172.21.15.107:0/2715316649 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6470019550 con 0x7f6474108090 2024-05-10T10:45:12.284 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.224+0000 7f647c523700 1 -- 172.21.15.107:0/2715316649 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64741a0370 con 0x7f6474108090 2024-05-10T10:45:12.284 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.225+0000 7f646b7fe700 1 -- 172.21.15.107:0/2715316649 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f647001a5e0 con 0x7f6474108090 2024-05-10T10:45:12.284 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.225+0000 7f647c523700 1 -- 172.21.15.107:0/2715316649 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6474064b00 con 0x7f6474108090 2024-05-10T10:45:12.285 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.225+0000 7f646b7fe700 1 --2- 172.21.15.107:0/2715316649 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f646003e470 0x7f6460040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:12.285 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.225+0000 7f646b7fe700 1 -- 172.21.15.107:0/2715316649 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6470053860 con 0x7f6474108090 2024-05-10T10:45:12.285 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.225+0000 7f6479abe700 1 --2- 172.21.15.107:0/2715316649 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f646003e470 0x7f6460040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:12.285 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.225+0000 7f6479abe700 1 --2- 172.21.15.107:0/2715316649 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f646003e470 0x7f6460040930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6464006fd0 tx=0x7f6464006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:12.285 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.230+0000 7f646b7fe700 1 -- 172.21.15.107:0/2715316649 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f6470017e90 con 0x7f6474108090 2024-05-10T10:45:12.285 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.458+0000 7f647c523700 1 -- 172.21.15.107:0/2715316649 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f64741a0790 con 0x7f646003e470 2024-05-10T10:45:12.285 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.680+0000 7f646b7fe700 1 -- 172.21.15.107:0/2715316649 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f64741a0790 con 0x7f646003e470 2024-05-10T10:45:12.285 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.684+0000 7f647c523700 1 -- 172.21.15.107:0/2715316649 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f646003e470 msgr2=0x7f6460040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:12.285 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.684+0000 7f647c523700 1 --2- 172.21.15.107:0/2715316649 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f646003e470 0x7f6460040930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6464006fd0 tx=0x7f6464006e40 comp rx=0 tx=0).stop 2024-05-10T10:45:12.285 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.684+0000 7f647c523700 1 -- 172.21.15.107:0/2715316649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474108090 msgr2=0x7f647407ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:12.285 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.684+0000 7f647c523700 1 --2- 172.21.15.107:0/2715316649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474108090 0x7f647407ca70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6470009520 tx=0x7f64700045f0 comp rx=0 tx=0).stop 2024-05-10T10:45:12.285 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.684+0000 7f647c523700 1 -- 172.21.15.107:0/2715316649 shutdown_connections 2024-05-10T10:45:12.285 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.684+0000 7f647c523700 1 --2- 172.21.15.107:0/2715316649 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f646003e470 0x7f6460040930 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:12.285 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.684+0000 7f647c523700 1 --2- 172.21.15.107:0/2715316649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6474108090 0x7f647407ca70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:12.286 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.684+0000 7f647c523700 1 -- 172.21.15.107:0/2715316649 >> 172.21.15.107:0/2715316649 conn(0x7f6474103670 msgr2=0x7f6474104110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:12.286 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.684+0000 7f647c523700 1 -- 172.21.15.107:0/2715316649 shutdown_connections 2024-05-10T10:45:12.286 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:11.684+0000 7f647c523700 1 -- 172.21.15.107:0/2715316649 wait complete. 2024-05-10T10:45:12.286 INFO:teuthology.orchestra.run.smithi107.stdout:Fetching dashboard port number... 2024-05-10T10:45:12.602 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:12 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:12.602 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:12 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:13.616 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:13 smithi107 ceph-mon[30373]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:45:13.617 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:13 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1545233741' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-10T10:45:13.924 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stdout 8443 2024-05-10T10:45:13.924 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.808+0000 7f3842c76700 1 Processor -- start 2024-05-10T10:45:13.924 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.808+0000 7f3842c76700 1 -- start start 2024-05-10T10:45:13.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.808+0000 7f3842c76700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f383c107a20 0x7f383c107e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:13.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.808+0000 7f3842c76700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f383c076dc0 con 0x7f383c107a20 2024-05-10T10:45:13.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.809+0000 7f3840a12700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f383c107a20 0x7f383c107e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:13.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.809+0000 7f3840a12700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f383c107a20 0x7f383c107e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38040/0 (socket says 172.21.15.107:38040) 2024-05-10T10:45:13.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.809+0000 7f3840a12700 1 -- 172.21.15.107:0/10154680 learned_addr learned my addr 172.21.15.107:0/10154680 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:13.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.809+0000 7f3840a12700 1 -- 172.21.15.107:0/10154680 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383c108380 con 0x7f383c107a20 2024-05-10T10:45:13.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.809+0000 7f3840a12700 1 --2- 172.21.15.107:0/10154680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f383c107a20 0x7f383c107e40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f38300098a0 tx=0x7f3830009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d546c2fedef29c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:13.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.809+0000 7f383b7fe700 1 -- 172.21.15.107:0/10154680 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3830004160 con 0x7f383c107a20 2024-05-10T10:45:13.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.809+0000 7f383b7fe700 1 -- 172.21.15.107:0/10154680 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3830004300 con 0x7f383c107a20 2024-05-10T10:45:13.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.809+0000 7f383b7fe700 1 -- 172.21.15.107:0/10154680 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3830011af0 con 0x7f383c107a20 2024-05-10T10:45:13.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.810+0000 7f3842c76700 1 -- 172.21.15.107:0/10154680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f383c107a20 msgr2=0x7f383c107e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:13.925 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.810+0000 7f3842c76700 1 --2- 172.21.15.107:0/10154680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f383c107a20 0x7f383c107e40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f38300098a0 tx=0x7f3830009bb0 comp rx=0 tx=0).stop 2024-05-10T10:45:13.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.810+0000 7f3842c76700 1 -- 172.21.15.107:0/10154680 shutdown_connections 2024-05-10T10:45:13.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.810+0000 7f3842c76700 1 --2- 172.21.15.107:0/10154680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f383c107a20 0x7f383c107e40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:13.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.810+0000 7f3842c76700 1 -- 172.21.15.107:0/10154680 >> 172.21.15.107:0/10154680 conn(0x7f383c103660 msgr2=0x7f383c105a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:13.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.810+0000 7f3842c76700 1 -- 172.21.15.107:0/10154680 shutdown_connections 2024-05-10T10:45:13.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.810+0000 7f3842c76700 1 -- 172.21.15.107:0/10154680 wait complete. 2024-05-10T10:45:13.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.810+0000 7f3842c76700 1 Processor -- start 2024-05-10T10:45:13.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.810+0000 7f3842c76700 1 -- start start 2024-05-10T10:45:13.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.811+0000 7f3842c76700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f383c107a20 0x7f383c19f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:13.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.811+0000 7f3842c76700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f383c109450 con 0x7f383c107a20 2024-05-10T10:45:13.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.811+0000 7f3840a12700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f383c107a20 0x7f383c19f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:13.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.811+0000 7f3840a12700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f383c107a20 0x7f383c19f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38050/0 (socket says 172.21.15.107:38050) 2024-05-10T10:45:13.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.811+0000 7f3840a12700 1 -- 172.21.15.107:0/1545233741 learned_addr learned my addr 172.21.15.107:0/1545233741 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:13.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.811+0000 7f3840a12700 1 -- 172.21.15.107:0/1545233741 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383c19f800 con 0x7f383c107a20 2024-05-10T10:45:13.926 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.811+0000 7f3840a12700 1 --2- 172.21.15.107:0/1545233741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f383c107a20 0x7f383c19f2c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f38300117b0 tx=0x7f38300045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:13.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.811+0000 7f3839ffb700 1 -- 172.21.15.107:0/1545233741 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38300036a0 con 0x7f383c107a20 2024-05-10T10:45:13.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.811+0000 7f3839ffb700 1 -- 172.21.15.107:0/1545233741 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f383001a430 con 0x7f383c107a20 2024-05-10T10:45:13.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.811+0000 7f3842c76700 1 -- 172.21.15.107:0/1545233741 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f383c19fa90 con 0x7f383c107a20 2024-05-10T10:45:13.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.811+0000 7f3839ffb700 1 -- 172.21.15.107:0/1545233741 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3830019530 con 0x7f383c107a20 2024-05-10T10:45:13.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.812+0000 7f3842c76700 1 -- 172.21.15.107:0/1545233741 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f383c1a2780 con 0x7f383c107a20 2024-05-10T10:45:13.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.812+0000 7f3839ffb700 1 -- 172.21.15.107:0/1545233741 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f383001a5e0 con 0x7f383c107a20 2024-05-10T10:45:13.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.812+0000 7f3842c76700 1 -- 172.21.15.107:0/1545233741 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f383c064b00 con 0x7f383c107a20 2024-05-10T10:45:13.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.813+0000 7f3839ffb700 1 --2- 172.21.15.107:0/1545233741 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f382c03e470 0x7f382c040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:13.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.813+0000 7f3839ffb700 1 -- 172.21.15.107:0/1545233741 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3830053860 con 0x7f383c107a20 2024-05-10T10:45:13.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.813+0000 7f383bfff700 1 --2- 172.21.15.107:0/1545233741 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f382c03e470 0x7f382c040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:13.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.813+0000 7f383bfff700 1 --2- 172.21.15.107:0/1545233741 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f382c03e470 0x7f382c040930 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3828006fd0 tx=0x7f3828006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:13.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:12.818+0000 7f3839ffb700 1 -- 172.21.15.107:0/1545233741 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f383000b3e0 con 0x7f383c107a20 2024-05-10T10:45:13.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:13.025+0000 7f3842c76700 1 -- 172.21.15.107:0/1545233741 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f383c02e7a0 con 0x7f383c107a20 2024-05-10T10:45:13.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:13.025+0000 7f3839ffb700 1 -- 172.21.15.107:0/1545233741 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f383000e260 con 0x7f383c107a20 2024-05-10T10:45:13.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:13.027+0000 7f3842c76700 1 -- 172.21.15.107:0/1545233741 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f382c03e470 msgr2=0x7f382c040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:13.927 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:13.028+0000 7f3842c76700 1 --2- 172.21.15.107:0/1545233741 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f382c03e470 0x7f382c040930 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3828006fd0 tx=0x7f3828006e40 comp rx=0 tx=0).stop 2024-05-10T10:45:13.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:13.028+0000 7f3842c76700 1 -- 172.21.15.107:0/1545233741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f383c107a20 msgr2=0x7f383c19f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:13.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:13.028+0000 7f3842c76700 1 --2- 172.21.15.107:0/1545233741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f383c107a20 0x7f383c19f2c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f38300117b0 tx=0x7f38300045f0 comp rx=0 tx=0).stop 2024-05-10T10:45:13.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:13.028+0000 7f3842c76700 1 -- 172.21.15.107:0/1545233741 shutdown_connections 2024-05-10T10:45:13.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:13.028+0000 7f3842c76700 1 --2- 172.21.15.107:0/1545233741 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f382c03e470 0x7f382c040930 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:13.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:13.028+0000 7f3842c76700 1 --2- 172.21.15.107:0/1545233741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f383c107a20 0x7f383c19f2c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:13.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:13.028+0000 7f3842c76700 1 -- 172.21.15.107:0/1545233741 >> 172.21.15.107:0/1545233741 conn(0x7f383c103660 msgr2=0x7f383c195f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:13.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:13.028+0000 7f3842c76700 1 -- 172.21.15.107:0/1545233741 shutdown_connections 2024-05-10T10:45:13.928 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:13.028+0000 7f3842c76700 1 -- 172.21.15.107:0/1545233741 wait complete. 2024-05-10T10:45:13.934 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-10T10:45:13.935 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout disabled 2024-05-10T10:45:13.942 INFO:teuthology.orchestra.run.smithi107.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-10T10:45:13.942 INFO:teuthology.orchestra.run.smithi107.stdout:systemctl: stdout inactive 2024-05-10T10:45:13.942 INFO:teuthology.orchestra.run.smithi107.stdout:firewalld.service is not enabled 2024-05-10T10:45:13.942 INFO:teuthology.orchestra.run.smithi107.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-10T10:45:13.944 INFO:teuthology.orchestra.run.smithi107.stdout:Ceph Dashboard is now available at: 2024-05-10T10:45:13.944 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:45:13.944 INFO:teuthology.orchestra.run.smithi107.stdout: URL: https://smithi107.front.sepia.ceph.com:8443/ 2024-05-10T10:45:13.944 INFO:teuthology.orchestra.run.smithi107.stdout: User: admin 2024-05-10T10:45:13.944 INFO:teuthology.orchestra.run.smithi107.stdout: Password: av304yreq5 2024-05-10T10:45:13.944 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:45:13.944 INFO:teuthology.orchestra.run.smithi107.stdout:Saving cluster configuration to /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config directory 2024-05-10T10:45:13.945 INFO:teuthology.orchestra.run.smithi107.stdout:Enabling autotune for osd_memory_target 2024-05-10T10:45:15.475 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:15 smithi107 ceph-mon[30373]: mgrmap e13: x(active, since 6s) 2024-05-10T10:45:15.483 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.698+0000 7f1f730a1700 1 Processor -- start 2024-05-10T10:45:15.483 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.698+0000 7f1f730a1700 1 -- start start 2024-05-10T10:45:15.483 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.698+0000 7f1f730a1700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6c109d10 0x7f1f6c10c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:15.483 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.698+0000 7f1f730a1700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6c07cdf0 con 0x7f1f6c109d10 2024-05-10T10:45:15.483 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.698+0000 7f1f70e3d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6c109d10 0x7f1f6c10c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:15.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.699+0000 7f1f70e3d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6c109d10 0x7f1f6c10c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38058/0 (socket says 172.21.15.107:38058) 2024-05-10T10:45:15.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.699+0000 7f1f70e3d700 1 -- 172.21.15.107:0/2450784191 learned_addr learned my addr 172.21.15.107:0/2450784191 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:15.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.699+0000 7f1f70e3d700 1 -- 172.21.15.107:0/2450784191 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f6c10c640 con 0x7f1f6c109d10 2024-05-10T10:45:15.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.699+0000 7f1f70e3d700 1 --2- 172.21.15.107:0/2450784191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6c109d10 0x7f1f6c10c100 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1f600098a0 tx=0x7f1f60009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca3705ba9be5018 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:15.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.699+0000 7f1f6b7fe700 1 -- 172.21.15.107:0/2450784191 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f60004160 con 0x7f1f6c109d10 2024-05-10T10:45:15.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.699+0000 7f1f6b7fe700 1 -- 172.21.15.107:0/2450784191 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1f60004300 con 0x7f1f6c109d10 2024-05-10T10:45:15.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.699+0000 7f1f6b7fe700 1 -- 172.21.15.107:0/2450784191 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f60011af0 con 0x7f1f6c109d10 2024-05-10T10:45:15.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.700+0000 7f1f730a1700 1 -- 172.21.15.107:0/2450784191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6c109d10 msgr2=0x7f1f6c10c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:15.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.700+0000 7f1f730a1700 1 --2- 172.21.15.107:0/2450784191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6c109d10 0x7f1f6c10c100 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1f600098a0 tx=0x7f1f60009bb0 comp rx=0 tx=0).stop 2024-05-10T10:45:15.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.700+0000 7f1f730a1700 1 -- 172.21.15.107:0/2450784191 shutdown_connections 2024-05-10T10:45:15.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.700+0000 7f1f730a1700 1 --2- 172.21.15.107:0/2450784191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6c109d10 0x7f1f6c10c100 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:15.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.700+0000 7f1f730a1700 1 -- 172.21.15.107:0/2450784191 >> 172.21.15.107:0/2450784191 conn(0x7f1f6c103680 msgr2=0x7f1f6c105aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:15.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.700+0000 7f1f730a1700 1 -- 172.21.15.107:0/2450784191 shutdown_connections 2024-05-10T10:45:15.484 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.700+0000 7f1f730a1700 1 -- 172.21.15.107:0/2450784191 wait complete. 2024-05-10T10:45:15.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.700+0000 7f1f730a1700 1 Processor -- start 2024-05-10T10:45:15.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.700+0000 7f1f730a1700 1 -- start start 2024-05-10T10:45:15.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.701+0000 7f1f730a1700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6c109d10 0x7f1f6c109590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:15.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.701+0000 7f1f730a1700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6c10d5e0 con 0x7f1f6c109d10 2024-05-10T10:45:15.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.701+0000 7f1f70e3d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6c109d10 0x7f1f6c109590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:15.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.701+0000 7f1f70e3d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6c109d10 0x7f1f6c109590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38066/0 (socket says 172.21.15.107:38066) 2024-05-10T10:45:15.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.701+0000 7f1f70e3d700 1 -- 172.21.15.107:0/2012125652 learned_addr learned my addr 172.21.15.107:0/2012125652 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:15.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.701+0000 7f1f70e3d700 1 -- 172.21.15.107:0/2012125652 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f6c109ad0 con 0x7f1f6c109d10 2024-05-10T10:45:15.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.701+0000 7f1f70e3d700 1 --2- 172.21.15.107:0/2012125652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6c109d10 0x7f1f6c109590 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1f600117b0 tx=0x7f1f600045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:15.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.701+0000 7f1f69ffb700 1 -- 172.21.15.107:0/2012125652 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f600036a0 con 0x7f1f6c109d10 2024-05-10T10:45:15.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.701+0000 7f1f69ffb700 1 -- 172.21.15.107:0/2012125652 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1f6001a430 con 0x7f1f6c109d10 2024-05-10T10:45:15.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.701+0000 7f1f69ffb700 1 -- 172.21.15.107:0/2012125652 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f60019530 con 0x7f1f6c109d10 2024-05-10T10:45:15.485 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.701+0000 7f1f730a1700 1 -- 172.21.15.107:0/2012125652 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f6c107cc0 con 0x7f1f6c109d10 2024-05-10T10:45:15.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.702+0000 7f1f730a1700 1 -- 172.21.15.107:0/2012125652 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f6c108200 con 0x7f1f6c109d10 2024-05-10T10:45:15.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.702+0000 7f1f69ffb700 1 -- 172.21.15.107:0/2012125652 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f1f6001a5e0 con 0x7f1f6c109d10 2024-05-10T10:45:15.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.702+0000 7f1f730a1700 1 -- 172.21.15.107:0/2012125652 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f6c064b00 con 0x7f1f6c109d10 2024-05-10T10:45:15.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.703+0000 7f1f69ffb700 1 --2- 172.21.15.107:0/2012125652 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1f5c03e570 0x7f1f5c040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:15.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.703+0000 7f1f69ffb700 1 -- 172.21.15.107:0/2012125652 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1f600538f0 con 0x7f1f6c109d10 2024-05-10T10:45:15.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.703+0000 7f1f6bfff700 1 --2- 172.21.15.107:0/2012125652 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1f5c03e570 0x7f1f5c040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:15.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.703+0000 7f1f6bfff700 1 --2- 172.21.15.107:0/2012125652 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1f5c03e570 0x7f1f5c040a30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1f58006fd0 tx=0x7f1f58006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:15.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.708+0000 7f1f69ffb700 1 -- 172.21.15.107:0/2012125652 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f1f60018e20 con 0x7f1f6c109d10 2024-05-10T10:45:15.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.909+0000 7f1f730a1700 1 -- 172.21.15.107:0/2012125652 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f1f6c108540 con 0x7f1f6c109d10 2024-05-10T10:45:15.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.910+0000 7f1f69ffb700 1 -- 172.21.15.107:0/2012125652 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f1f6c108540 con 0x7f1f6c109d10 2024-05-10T10:45:15.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.912+0000 7f1f730a1700 1 -- 172.21.15.107:0/2012125652 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1f5c03e570 msgr2=0x7f1f5c040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:15.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.912+0000 7f1f730a1700 1 --2- 172.21.15.107:0/2012125652 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1f5c03e570 0x7f1f5c040a30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1f58006fd0 tx=0x7f1f58006e40 comp rx=0 tx=0).stop 2024-05-10T10:45:15.486 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.912+0000 7f1f730a1700 1 -- 172.21.15.107:0/2012125652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6c109d10 msgr2=0x7f1f6c109590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:15.487 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.912+0000 7f1f730a1700 1 --2- 172.21.15.107:0/2012125652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6c109d10 0x7f1f6c109590 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1f600117b0 tx=0x7f1f600045f0 comp rx=0 tx=0).stop 2024-05-10T10:45:15.487 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.912+0000 7f1f730a1700 1 -- 172.21.15.107:0/2012125652 shutdown_connections 2024-05-10T10:45:15.487 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.912+0000 7f1f730a1700 1 --2- 172.21.15.107:0/2012125652 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1f5c03e570 0x7f1f5c040a30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:15.487 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.912+0000 7f1f730a1700 1 --2- 172.21.15.107:0/2012125652 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1f6c109d10 0x7f1f6c109590 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:15.487 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.912+0000 7f1f730a1700 1 -- 172.21.15.107:0/2012125652 >> 172.21.15.107:0/2012125652 conn(0x7f1f6c103680 msgr2=0x7f1f6c104140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:15.487 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.912+0000 7f1f730a1700 1 -- 172.21.15.107:0/2012125652 shutdown_connections 2024-05-10T10:45:15.487 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:14.912+0000 7f1f730a1700 1 -- 172.21.15.107:0/2012125652 wait complete. 2024-05-10T10:45:16.773 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.920+0000 7f6e39428700 1 Processor -- start 2024-05-10T10:45:16.773 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.920+0000 7f6e39428700 1 -- start start 2024-05-10T10:45:16.773 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.921+0000 7f6e39428700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e34108080 0x7f6e341084a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:16.773 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.921+0000 7f6e39428700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6e34108a70 con 0x7f6e34108080 2024-05-10T10:45:16.773 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.921+0000 7f6e32ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e34108080 0x7f6e341084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:16.773 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.921+0000 7f6e32ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e34108080 0x7f6e341084a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38070/0 (socket says 172.21.15.107:38070) 2024-05-10T10:45:16.774 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.921+0000 7f6e32ffd700 1 -- 172.21.15.107:0/2961337207 learned_addr learned my addr 172.21.15.107:0/2961337207 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:16.774 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.921+0000 7f6e32ffd700 1 -- 172.21.15.107:0/2961337207 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e34109280 con 0x7f6e34108080 2024-05-10T10:45:16.774 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.921+0000 7f6e32ffd700 1 --2- 172.21.15.107:0/2961337207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e34108080 0x7f6e341084a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6e24009e80 tx=0x7f6e2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b354d65442afa1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:16.774 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.921+0000 7f6e327fc700 1 -- 172.21.15.107:0/2961337207 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e24017070 con 0x7f6e34108080 2024-05-10T10:45:16.774 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.921+0000 7f6e327fc700 1 -- 172.21.15.107:0/2961337207 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6e2400b8c0 con 0x7f6e34108080 2024-05-10T10:45:16.774 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.921+0000 7f6e327fc700 1 -- 172.21.15.107:0/2961337207 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e24004500 con 0x7f6e34108080 2024-05-10T10:45:16.774 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.922+0000 7f6e39428700 1 -- 172.21.15.107:0/2961337207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e34108080 msgr2=0x7f6e341084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:16.774 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.922+0000 7f6e39428700 1 --2- 172.21.15.107:0/2961337207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e34108080 0x7f6e341084a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6e24009e80 tx=0x7f6e2400b330 comp rx=0 tx=0).stop 2024-05-10T10:45:16.774 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.922+0000 7f6e39428700 1 -- 172.21.15.107:0/2961337207 shutdown_connections 2024-05-10T10:45:16.774 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.922+0000 7f6e39428700 1 --2- 172.21.15.107:0/2961337207 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e34108080 0x7f6e341084a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:16.774 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.922+0000 7f6e39428700 1 -- 172.21.15.107:0/2961337207 >> 172.21.15.107:0/2961337207 conn(0x7f6e34103600 msgr2=0x7f6e34105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:16.774 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.922+0000 7f6e39428700 1 -- 172.21.15.107:0/2961337207 shutdown_connections 2024-05-10T10:45:16.774 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.922+0000 7f6e39428700 1 -- 172.21.15.107:0/2961337207 wait complete. 2024-05-10T10:45:16.775 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.923+0000 7f6e39428700 1 Processor -- start 2024-05-10T10:45:16.775 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.923+0000 7f6e39428700 1 -- start start 2024-05-10T10:45:16.775 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.923+0000 7f6e39428700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e34108080 0x7f6e3419d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:16.775 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.923+0000 7f6e39428700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3410c630 con 0x7f6e34108080 2024-05-10T10:45:16.775 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.923+0000 7f6e32ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e34108080 0x7f6e3419d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:16.775 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.923+0000 7f6e32ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e34108080 0x7f6e3419d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38084/0 (socket says 172.21.15.107:38084) 2024-05-10T10:45:16.775 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.923+0000 7f6e32ffd700 1 -- 172.21.15.107:0/1910708285 learned_addr learned my addr 172.21.15.107:0/1910708285 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:16.775 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.923+0000 7f6e32ffd700 1 -- 172.21.15.107:0/1910708285 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3419d680 con 0x7f6e34108080 2024-05-10T10:45:16.775 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.923+0000 7f6e32ffd700 1 --2- 172.21.15.107:0/1910708285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e34108080 0x7f6e3419d140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6e240072a0 tx=0x7f6e2400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:16.775 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.923+0000 7f6e30ff9700 1 -- 172.21.15.107:0/1910708285 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e24021020 con 0x7f6e34108080 2024-05-10T10:45:16.775 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.924+0000 7f6e39428700 1 -- 172.21.15.107:0/1910708285 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3419d910 con 0x7f6e34108080 2024-05-10T10:45:16.775 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.924+0000 7f6e30ff9700 1 -- 172.21.15.107:0/1910708285 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6e2401d470 con 0x7f6e34108080 2024-05-10T10:45:16.775 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.924+0000 7f6e30ff9700 1 -- 172.21.15.107:0/1910708285 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e24017040 con 0x7f6e34108080 2024-05-10T10:45:16.775 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.924+0000 7f6e39428700 1 -- 172.21.15.107:0/1910708285 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e341a0600 con 0x7f6e34108080 2024-05-10T10:45:16.776 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.924+0000 7f6e30ff9700 1 -- 172.21.15.107:0/1910708285 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f6e24024020 con 0x7f6e34108080 2024-05-10T10:45:16.776 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.924+0000 7f6e39428700 1 -- 172.21.15.107:0/1910708285 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e34064b00 con 0x7f6e34108080 2024-05-10T10:45:16.776 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.925+0000 7f6e30ff9700 1 --2- 172.21.15.107:0/1910708285 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f6e1c03e510 0x7f6e1c0409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:16.776 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.925+0000 7f6e30ff9700 1 -- 172.21.15.107:0/1910708285 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6e2400f050 con 0x7f6e34108080 2024-05-10T10:45:16.776 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.925+0000 7f6e23fff700 1 --2- 172.21.15.107:0/1910708285 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f6e1c03e510 0x7f6e1c0409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:16.776 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.925+0000 7f6e23fff700 1 --2- 172.21.15.107:0/1910708285 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f6e1c03e510 0x7f6e1c0409d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6e28006fd0 tx=0x7f6e28006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:16.776 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:15.930+0000 7f6e30ff9700 1 -- 172.21.15.107:0/1910708285 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f6e2402b020 con 0x7f6e34108080 2024-05-10T10:45:16.776 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:16.246+0000 7f6e39428700 1 -- 172.21.15.107:0/1910708285 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f6e341a0bd0 con 0x7f6e34108080 2024-05-10T10:45:16.776 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:16.248+0000 7f6e30ff9700 1 -- 172.21.15.107:0/1910708285 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f6e2400a040 con 0x7f6e34108080 2024-05-10T10:45:16.776 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:16.250+0000 7f6e39428700 1 -- 172.21.15.107:0/1910708285 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f6e1c03e510 msgr2=0x7f6e1c0409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:16.776 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:16.250+0000 7f6e39428700 1 --2- 172.21.15.107:0/1910708285 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f6e1c03e510 0x7f6e1c0409d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6e28006fd0 tx=0x7f6e28006e40 comp rx=0 tx=0).stop 2024-05-10T10:45:16.776 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:16.250+0000 7f6e39428700 1 -- 172.21.15.107:0/1910708285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e34108080 msgr2=0x7f6e3419d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:16.776 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:16.250+0000 7f6e39428700 1 --2- 172.21.15.107:0/1910708285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e34108080 0x7f6e3419d140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6e240072a0 tx=0x7f6e2400bd50 comp rx=0 tx=0).stop 2024-05-10T10:45:16.776 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:16.250+0000 7f6e39428700 1 -- 172.21.15.107:0/1910708285 shutdown_connections 2024-05-10T10:45:16.777 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:16.250+0000 7f6e39428700 1 --2- 172.21.15.107:0/1910708285 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f6e1c03e510 0x7f6e1c0409d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:16.777 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:16.250+0000 7f6e39428700 1 --2- 172.21.15.107:0/1910708285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6e34108080 0x7f6e3419d140 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:16.777 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:16.250+0000 7f6e39428700 1 -- 172.21.15.107:0/1910708285 >> 172.21.15.107:0/1910708285 conn(0x7f6e34103600 msgr2=0x7f6e34104160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:16.777 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:16.250+0000 7f6e39428700 1 -- 172.21.15.107:0/1910708285 shutdown_connections 2024-05-10T10:45:16.777 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr 2024-05-10T10:45:16.251+0000 7f6e39428700 1 -- 172.21.15.107:0/1910708285 wait complete. 2024-05-10T10:45:16.777 INFO:teuthology.orchestra.run.smithi107.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-10T10:45:16.777 INFO:teuthology.orchestra.run.smithi107.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-10T10:45:16.777 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:45:16.777 INFO:teuthology.orchestra.run.smithi107.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-10T10:45:16.777 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:45:16.777 INFO:teuthology.orchestra.run.smithi107.stdout:Or, if you are only running a single cluster on this host: 2024-05-10T10:45:16.777 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:45:16.777 INFO:teuthology.orchestra.run.smithi107.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-10T10:45:16.777 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:45:16.778 INFO:teuthology.orchestra.run.smithi107.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-10T10:45:16.778 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:45:16.778 INFO:teuthology.orchestra.run.smithi107.stdout: ceph telemetry on 2024-05-10T10:45:16.778 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:45:16.778 INFO:teuthology.orchestra.run.smithi107.stdout:For more information see: 2024-05-10T10:45:16.778 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:45:16.778 INFO:teuthology.orchestra.run.smithi107.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-10T10:45:16.778 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:45:16.778 INFO:teuthology.orchestra.run.smithi107.stdout:Bootstrap complete. 2024-05-10T10:45:16.808 INFO:tasks.cephadm:Fetching config... 2024-05-10T10:45:16.809 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T10:45:16.809 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-10T10:45:16.825 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-10T10:45:16.825 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T10:45:16.825 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-10T10:45:16.882 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-10T10:45:16.882 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T10:45:16.882 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-10T10:45:16.946 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-10T10:45:16.946 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T10:45:16.946 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-10T10:45:17.002 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-10T10:45:17.003 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZ2jTjakOAcd0dEY2ebwicktqPpIyZd5J5sAmljeNwXxd+BOEVLk8ObiPRjrpWzL9DzPbLPM9yfDQJLWlDXzmHggoqlxHVsnfr55OIXBg+XI3u1PPolN2yy1EfZey1SKGXxSlD/O0e0FiJFuvwo0BnncCI0FLYxj1yQ6Ova14aTMpQWhTuOf65HJK6pDtIxiDYtcBhWDSsPjcuxGSGSHFPXg33FzDSfndcBRC2T1wQ2QVYYF1W/lRhOZwhqfvAnJNus4WVnrT7k1GGQajWulEHddcs2xfiMKCXGO+hTWyLJmuh+/tkW20COdOaA5O9LcCDCqO9vJgtN7ZwpVulpflUQ5QSGWbqksgxHFI5GSdB49xIyEmVKfHBL8pS6zYUFwkL3NL+QvOjxvFOVSQVdI412nKXXMipQLvxrHNQEvBJxqiW0yTxH9OOCE/vx+QzC8FrOgG73AkhFKIdsxq1v5DHN8YBHvUMxxw73oRKMwqJSK2Qwy9Y8dPAFXu8dIbN9Mc= ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-10T10:45:17.081 INFO:teuthology.orchestra.run.smithi107.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZ2jTjakOAcd0dEY2ebwicktqPpIyZd5J5sAmljeNwXxd+BOEVLk8ObiPRjrpWzL9DzPbLPM9yfDQJLWlDXzmHggoqlxHVsnfr55OIXBg+XI3u1PPolN2yy1EfZey1SKGXxSlD/O0e0FiJFuvwo0BnncCI0FLYxj1yQ6Ova14aTMpQWhTuOf65HJK6pDtIxiDYtcBhWDSsPjcuxGSGSHFPXg33FzDSfndcBRC2T1wQ2QVYYF1W/lRhOZwhqfvAnJNus4WVnrT7k1GGQajWulEHddcs2xfiMKCXGO+hTWyLJmuh+/tkW20COdOaA5O9LcCDCqO9vJgtN7ZwpVulpflUQ5QSGWbqksgxHFI5GSdB49xIyEmVKfHBL8pS6zYUFwkL3NL+QvOjxvFOVSQVdI412nKXXMipQLvxrHNQEvBJxqiW0yTxH9OOCE/vx+QzC8FrOgG73AkhFKIdsxq1v5DHN8YBHvUMxxw73oRKMwqJSK2Qwy9Y8dPAFXu8dIbN9Mc= ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:45:17.094 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZ2jTjakOAcd0dEY2ebwicktqPpIyZd5J5sAmljeNwXxd+BOEVLk8ObiPRjrpWzL9DzPbLPM9yfDQJLWlDXzmHggoqlxHVsnfr55OIXBg+XI3u1PPolN2yy1EfZey1SKGXxSlD/O0e0FiJFuvwo0BnncCI0FLYxj1yQ6Ova14aTMpQWhTuOf65HJK6pDtIxiDYtcBhWDSsPjcuxGSGSHFPXg33FzDSfndcBRC2T1wQ2QVYYF1W/lRhOZwhqfvAnJNus4WVnrT7k1GGQajWulEHddcs2xfiMKCXGO+hTWyLJmuh+/tkW20COdOaA5O9LcCDCqO9vJgtN7ZwpVulpflUQ5QSGWbqksgxHFI5GSdB49xIyEmVKfHBL8pS6zYUFwkL3NL+QvOjxvFOVSQVdI412nKXXMipQLvxrHNQEvBJxqiW0yTxH9OOCE/vx+QzC8FrOgG73AkhFKIdsxq1v5DHN8YBHvUMxxw73oRKMwqJSK2Qwy9Y8dPAFXu8dIbN9Mc= ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-10T10:45:17.133 INFO:teuthology.orchestra.run.smithi184.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZ2jTjakOAcd0dEY2ebwicktqPpIyZd5J5sAmljeNwXxd+BOEVLk8ObiPRjrpWzL9DzPbLPM9yfDQJLWlDXzmHggoqlxHVsnfr55OIXBg+XI3u1PPolN2yy1EfZey1SKGXxSlD/O0e0FiJFuvwo0BnncCI0FLYxj1yQ6Ova14aTMpQWhTuOf65HJK6pDtIxiDYtcBhWDSsPjcuxGSGSHFPXg33FzDSfndcBRC2T1wQ2QVYYF1W/lRhOZwhqfvAnJNus4WVnrT7k1GGQajWulEHddcs2xfiMKCXGO+hTWyLJmuh+/tkW20COdOaA5O9LcCDCqO9vJgtN7ZwpVulpflUQ5QSGWbqksgxHFI5GSdB49xIyEmVKfHBL8pS6zYUFwkL3NL+QvOjxvFOVSQVdI412nKXXMipQLvxrHNQEvBJxqiW0yTxH9OOCE/vx+QzC8FrOgG73AkhFKIdsxq1v5DHN8YBHvUMxxw73oRKMwqJSK2Qwy9Y8dPAFXu8dIbN9Mc= ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:45:17.146 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZ2jTjakOAcd0dEY2ebwicktqPpIyZd5J5sAmljeNwXxd+BOEVLk8ObiPRjrpWzL9DzPbLPM9yfDQJLWlDXzmHggoqlxHVsnfr55OIXBg+XI3u1PPolN2yy1EfZey1SKGXxSlD/O0e0FiJFuvwo0BnncCI0FLYxj1yQ6Ova14aTMpQWhTuOf65HJK6pDtIxiDYtcBhWDSsPjcuxGSGSHFPXg33FzDSfndcBRC2T1wQ2QVYYF1W/lRhOZwhqfvAnJNus4WVnrT7k1GGQajWulEHddcs2xfiMKCXGO+hTWyLJmuh+/tkW20COdOaA5O9LcCDCqO9vJgtN7ZwpVulpflUQ5QSGWbqksgxHFI5GSdB49xIyEmVKfHBL8pS6zYUFwkL3NL+QvOjxvFOVSQVdI412nKXXMipQLvxrHNQEvBJxqiW0yTxH9OOCE/vx+QzC8FrOgG73AkhFKIdsxq1v5DHN8YBHvUMxxw73oRKMwqJSK2Qwy9Y8dPAFXu8dIbN9Mc= ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-10T10:45:17.184 INFO:teuthology.orchestra.run.smithi196.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZ2jTjakOAcd0dEY2ebwicktqPpIyZd5J5sAmljeNwXxd+BOEVLk8ObiPRjrpWzL9DzPbLPM9yfDQJLWlDXzmHggoqlxHVsnfr55OIXBg+XI3u1PPolN2yy1EfZey1SKGXxSlD/O0e0FiJFuvwo0BnncCI0FLYxj1yQ6Ova14aTMpQWhTuOf65HJK6pDtIxiDYtcBhWDSsPjcuxGSGSHFPXg33FzDSfndcBRC2T1wQ2QVYYF1W/lRhOZwhqfvAnJNus4WVnrT7k1GGQajWulEHddcs2xfiMKCXGO+hTWyLJmuh+/tkW20COdOaA5O9LcCDCqO9vJgtN7ZwpVulpflUQ5QSGWbqksgxHFI5GSdB49xIyEmVKfHBL8pS6zYUFwkL3NL+QvOjxvFOVSQVdI412nKXXMipQLvxrHNQEvBJxqiW0yTxH9OOCE/vx+QzC8FrOgG73AkhFKIdsxq1v5DHN8YBHvUMxxw73oRKMwqJSK2Qwy9Y8dPAFXu8dIbN9Mc= ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:45:17.196 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-10T10:45:17.435 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:45:17.557 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:17 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1910708285' entity='client.admin' 2024-05-10T10:45:19.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.517+0000 7fe3fd220700 1 -- 172.21.15.107:0/955372675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3f8101e40 msgr2=0x7fe3f8102260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:19.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.517+0000 7fe3fd220700 1 --2- 172.21.15.107:0/955372675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3f8101e40 0x7fe3f8102260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009910 tx=0x7fe3e8009c20 comp rx=0 tx=0).stop 2024-05-10T10:45:19.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.517+0000 7fe3fd220700 1 -- 172.21.15.107:0/955372675 shutdown_connections 2024-05-10T10:45:19.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.517+0000 7fe3fd220700 1 --2- 172.21.15.107:0/955372675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3f8101e40 0x7fe3f8102260 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:19.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.517+0000 7fe3fd220700 1 -- 172.21.15.107:0/955372675 >> 172.21.15.107:0/955372675 conn(0x7fe3f80fd400 msgr2=0x7fe3f80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:19.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.517+0000 7fe3fd220700 1 -- 172.21.15.107:0/955372675 shutdown_connections 2024-05-10T10:45:19.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.517+0000 7fe3fd220700 1 -- 172.21.15.107:0/955372675 wait complete. 2024-05-10T10:45:19.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.517+0000 7fe3fd220700 1 Processor -- start 2024-05-10T10:45:19.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.518+0000 7fe3fd220700 1 -- start start 2024-05-10T10:45:19.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.518+0000 7fe3fd220700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3f8101e40 0x7fe3f8198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:19.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.518+0000 7fe3fd220700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f8107e30 con 0x7fe3f8101e40 2024-05-10T10:45:19.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.518+0000 7fe3f6d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3f8101e40 0x7fe3f8198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:19.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.518+0000 7fe3f6d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3f8101e40 0x7fe3f8198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45216/0 (socket says 172.21.15.107:45216) 2024-05-10T10:45:19.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.518+0000 7fe3f6d9d700 1 -- 172.21.15.107:0/2382113135 learned_addr learned my addr 172.21.15.107:0/2382113135 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:19.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.518+0000 7fe3f6d9d700 1 -- 172.21.15.107:0/2382113135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f8198a90 con 0x7fe3f8101e40 2024-05-10T10:45:19.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.518+0000 7fe3f6d9d700 1 --2- 172.21.15.107:0/2382113135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3f8101e40 0x7fe3f8198550 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009ef0 tx=0x7fe3e8004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:19.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.519+0000 7fe3dffff700 1 -- 172.21.15.107:0/2382113135 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e8027070 con 0x7fe3f8101e40 2024-05-10T10:45:19.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.519+0000 7fe3fd220700 1 -- 172.21.15.107:0/2382113135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f8198d20 con 0x7fe3f8101e40 2024-05-10T10:45:19.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.519+0000 7fe3dffff700 1 -- 172.21.15.107:0/2382113135 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe3e8022470 con 0x7fe3f8101e40 2024-05-10T10:45:19.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.519+0000 7fe3dffff700 1 -- 172.21.15.107:0/2382113135 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e800f5f0 con 0x7fe3f8101e40 2024-05-10T10:45:19.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.519+0000 7fe3fd220700 1 -- 172.21.15.107:0/2382113135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f819ba10 con 0x7fe3f8101e40 2024-05-10T10:45:19.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.520+0000 7fe3dffff700 1 -- 172.21.15.107:0/2382113135 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7fe3e802a070 con 0x7fe3f8101e40 2024-05-10T10:45:19.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.520+0000 7fe3fd220700 1 -- 172.21.15.107:0/2382113135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3f81085b0 con 0x7fe3f8101e40 2024-05-10T10:45:19.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.520+0000 7fe3dffff700 1 --2- 172.21.15.107:0/2382113135 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe3e003e510 0x7fe3e00409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:19.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.520+0000 7fe3dffff700 1 -- 172.21.15.107:0/2382113135 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe3e801e030 con 0x7fe3f8101e40 2024-05-10T10:45:19.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.520+0000 7fe3f659c700 1 --2- 172.21.15.107:0/2382113135 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe3e003e510 0x7fe3e00409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:19.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.520+0000 7fe3f659c700 1 --2- 172.21.15.107:0/2382113135 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe3e003e510 0x7fe3e00409d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec006fd0 tx=0x7fe3ec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:19.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.530+0000 7fe3dffff700 1 -- 172.21.15.107:0/2382113135 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe3e8013070 con 0x7fe3f8101e40 2024-05-10T10:45:19.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.803+0000 7fe3fd220700 1 -- 172.21.15.107:0/2382113135 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fe3f802e620 con 0x7fe3f8101e40 2024-05-10T10:45:19.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.807+0000 7fe3dffff700 1 -- 172.21.15.107:0/2382113135 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fe3e8020e00 con 0x7fe3f8101e40 2024-05-10T10:45:19.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.809+0000 7fe3fd220700 1 -- 172.21.15.107:0/2382113135 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe3e003e510 msgr2=0x7fe3e00409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:19.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.809+0000 7fe3fd220700 1 --2- 172.21.15.107:0/2382113135 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe3e003e510 0x7fe3e00409d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec006fd0 tx=0x7fe3ec006e40 comp rx=0 tx=0).stop 2024-05-10T10:45:19.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.809+0000 7fe3fd220700 1 -- 172.21.15.107:0/2382113135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3f8101e40 msgr2=0x7fe3f8198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:19.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.809+0000 7fe3fd220700 1 --2- 172.21.15.107:0/2382113135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3f8101e40 0x7fe3f8198550 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009ef0 tx=0x7fe3e8004690 comp rx=0 tx=0).stop 2024-05-10T10:45:19.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.810+0000 7fe3fd220700 1 -- 172.21.15.107:0/2382113135 shutdown_connections 2024-05-10T10:45:19.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.810+0000 7fe3fd220700 1 --2- 172.21.15.107:0/2382113135 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe3e003e510 0x7fe3e00409d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:19.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.810+0000 7fe3fd220700 1 --2- 172.21.15.107:0/2382113135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe3f8101e40 0x7fe3f8198550 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:19.811 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.810+0000 7fe3fd220700 1 -- 172.21.15.107:0/2382113135 >> 172.21.15.107:0/2382113135 conn(0x7fe3f80fd400 msgr2=0x7fe3f806b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:19.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.810+0000 7fe3fd220700 1 -- 172.21.15.107:0/2382113135 shutdown_connections 2024-05-10T10:45:19.812 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:19.810+0000 7fe3fd220700 1 -- 172.21.15.107:0/2382113135 wait complete. 2024-05-10T10:45:20.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:20.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:20.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi107", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:45:20.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:20.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:45:20.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:20.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:20 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2382113135' entity='client.admin' 2024-05-10T10:45:20.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:45:20.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:20.591 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-10T10:45:20.591 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-10T10:45:21.299 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:45:22.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.664+0000 7f97c78f8700 1 -- 172.21.15.107:0/714903422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97c0101e20 msgr2=0x7f97c0102240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:22.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.664+0000 7f97c78f8700 1 --2- 172.21.15.107:0/714903422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97c0101e20 0x7f97c0102240 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009910 tx=0x7f97b4009c20 comp rx=0 tx=0).stop 2024-05-10T10:45:22.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.664+0000 7f97c78f8700 1 -- 172.21.15.107:0/714903422 shutdown_connections 2024-05-10T10:45:22.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.664+0000 7f97c78f8700 1 --2- 172.21.15.107:0/714903422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97c0101e20 0x7f97c0102240 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:22.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.664+0000 7f97c78f8700 1 -- 172.21.15.107:0/714903422 >> 172.21.15.107:0/714903422 conn(0x7f97c00fd3a0 msgr2=0x7f97c00ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:22.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.665+0000 7f97c78f8700 1 -- 172.21.15.107:0/714903422 shutdown_connections 2024-05-10T10:45:22.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.665+0000 7f97c78f8700 1 -- 172.21.15.107:0/714903422 wait complete. 2024-05-10T10:45:22.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.665+0000 7f97c78f8700 1 Processor -- start 2024-05-10T10:45:22.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.665+0000 7f97c78f8700 1 -- start start 2024-05-10T10:45:22.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.665+0000 7f97c78f8700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97c0101e20 0x7f97c01985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:22.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.665+0000 7f97c78f8700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f97c0107e10 con 0x7f97c0101e20 2024-05-10T10:45:22.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.665+0000 7f97c5694700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97c0101e20 0x7f97c01985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:22.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.665+0000 7f97c5694700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97c0101e20 0x7f97c01985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45242/0 (socket says 172.21.15.107:45242) 2024-05-10T10:45:22.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.665+0000 7f97c5694700 1 -- 172.21.15.107:0/396343827 learned_addr learned my addr 172.21.15.107:0/396343827 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:22.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.666+0000 7f97c5694700 1 -- 172.21.15.107:0/396343827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c0198b20 con 0x7f97c0101e20 2024-05-10T10:45:22.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.666+0000 7f97c5694700 1 --2- 172.21.15.107:0/396343827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97c0101e20 0x7f97c01985e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f97b4005b40 tx=0x7f97b4004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:22.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.666+0000 7f97b27fc700 1 -- 172.21.15.107:0/396343827 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b4027070 con 0x7f97c0101e20 2024-05-10T10:45:22.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.666+0000 7f97c78f8700 1 -- 172.21.15.107:0/396343827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c0198db0 con 0x7f97c0101e20 2024-05-10T10:45:22.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.666+0000 7f97b27fc700 1 -- 172.21.15.107:0/396343827 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f97b400be30 con 0x7f97c0101e20 2024-05-10T10:45:22.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.666+0000 7f97b27fc700 1 -- 172.21.15.107:0/396343827 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97b400f460 con 0x7f97c0101e20 2024-05-10T10:45:22.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.666+0000 7f97c78f8700 1 -- 172.21.15.107:0/396343827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c019baa0 con 0x7f97c0101e20 2024-05-10T10:45:22.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.667+0000 7f97b27fc700 1 -- 172.21.15.107:0/396343827 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f97b402a070 con 0x7f97c0101e20 2024-05-10T10:45:22.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.667+0000 7f97c78f8700 1 -- 172.21.15.107:0/396343827 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c0108590 con 0x7f97c0101e20 2024-05-10T10:45:22.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.667+0000 7f97b27fc700 1 --2- 172.21.15.107:0/396343827 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f97ac03e510 0x7f97ac0409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:22.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.667+0000 7f97b27fc700 1 -- 172.21.15.107:0/396343827 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f97b401e030 con 0x7f97c0101e20 2024-05-10T10:45:22.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.667+0000 7f97c4e93700 1 --2- 172.21.15.107:0/396343827 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f97ac03e510 0x7f97ac0409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:22.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.668+0000 7f97c4e93700 1 --2- 172.21.15.107:0/396343827 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f97ac03e510 0x7f97ac0409d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f97bc006fd0 tx=0x7f97bc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:22.674 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.672+0000 7f97b27fc700 1 -- 172.21.15.107:0/396343827 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f97b4013070 con 0x7f97c0101e20 2024-05-10T10:45:22.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.879+0000 7f97c78f8700 1 -- 172.21.15.107:0/396343827 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f97c002e620 con 0x7f97ac03e510 2024-05-10T10:45:22.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.882+0000 7f97b27fc700 1 -- 172.21.15.107:0/396343827 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f97c002e620 con 0x7f97ac03e510 2024-05-10T10:45:22.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.884+0000 7f97c78f8700 1 -- 172.21.15.107:0/396343827 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f97ac03e510 msgr2=0x7f97ac0409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:22.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.884+0000 7f97c78f8700 1 --2- 172.21.15.107:0/396343827 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f97ac03e510 0x7f97ac0409d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f97bc006fd0 tx=0x7f97bc006e40 comp rx=0 tx=0).stop 2024-05-10T10:45:22.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.884+0000 7f97c78f8700 1 -- 172.21.15.107:0/396343827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97c0101e20 msgr2=0x7f97c01985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:22.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.884+0000 7f97c78f8700 1 --2- 172.21.15.107:0/396343827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97c0101e20 0x7f97c01985e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f97b4005b40 tx=0x7f97b4004690 comp rx=0 tx=0).stop 2024-05-10T10:45:22.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.884+0000 7f97c78f8700 1 -- 172.21.15.107:0/396343827 shutdown_connections 2024-05-10T10:45:22.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.884+0000 7f97c78f8700 1 --2- 172.21.15.107:0/396343827 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f97ac03e510 0x7f97ac0409d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:22.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.884+0000 7f97c78f8700 1 --2- 172.21.15.107:0/396343827 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97c0101e20 0x7f97c01985e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:22.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.884+0000 7f97c78f8700 1 -- 172.21.15.107:0/396343827 >> 172.21.15.107:0/396343827 conn(0x7f97c00fd3a0 msgr2=0x7f97c006b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:22.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.885+0000 7f97c78f8700 1 -- 172.21.15.107:0/396343827 shutdown_connections 2024-05-10T10:45:22.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:22.885+0000 7f97c78f8700 1 -- 172.21.15.107:0/396343827 wait complete. 2024-05-10T10:45:23.585 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi184 2024-05-10T10:45:23.585 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-10T10:45:23.585 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/etc/ceph/ceph.conf 2024-05-10T10:45:23.603 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-10T10:45:23.603 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-10T10:45:23.660 INFO:tasks.cephadm:Adding host smithi184 to orchestrator... 2024-05-10T10:45:23.660 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch host add smithi184 2024-05-10T10:45:23.904 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:45:24.148 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:23 smithi107 ceph-mon[30373]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:45:24.148 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:23 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:24.149 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:23 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:45:24.149 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:23 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:45:24.149 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:23 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:45:24.149 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:23 smithi107 ceph-mon[30373]: Updating smithi107:/etc/ceph/ceph.conf 2024-05-10T10:45:24.149 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:23 smithi107 ceph-mon[30373]: Updating smithi107:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T10:45:24.149 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:23 smithi107 ceph-mon[30373]: Updating smithi107:/etc/ceph/ceph.client.admin.keyring 2024-05-10T10:45:24.149 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:23 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:24.149 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:23 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:24.149 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:23 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:25.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:24 smithi107 ceph-mon[30373]: Updating smithi107:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-10T10:45:25.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.451+0000 7f486e36b700 1 -- 172.21.15.107:0/4069864142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4868101fe0 msgr2=0x7f48681023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:25.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.451+0000 7f486e36b700 1 --2- 172.21.15.107:0/4069864142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4868101fe0 0x7f48681023c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4858009910 tx=0x7f4858009c20 comp rx=0 tx=0).stop 2024-05-10T10:45:25.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.451+0000 7f486e36b700 1 -- 172.21.15.107:0/4069864142 shutdown_connections 2024-05-10T10:45:25.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.451+0000 7f486e36b700 1 --2- 172.21.15.107:0/4069864142 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4868101fe0 0x7f48681023c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:25.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.451+0000 7f486e36b700 1 -- 172.21.15.107:0/4069864142 >> 172.21.15.107:0/4069864142 conn(0x7f48680fd870 msgr2=0x7f48680ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:25.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.451+0000 7f486e36b700 1 -- 172.21.15.107:0/4069864142 shutdown_connections 2024-05-10T10:45:25.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.451+0000 7f486e36b700 1 -- 172.21.15.107:0/4069864142 wait complete. 2024-05-10T10:45:25.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.451+0000 7f486e36b700 1 Processor -- start 2024-05-10T10:45:25.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.451+0000 7f486e36b700 1 -- start start 2024-05-10T10:45:25.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.452+0000 7f486e36b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4868101fe0 0x7f4868199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.452+0000 7f486e36b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f486810c3a0 con 0x7f4868101fe0 2024-05-10T10:45:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.452+0000 7f4867fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4868101fe0 0x7f4868199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.452+0000 7f4867fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4868101fe0 0x7f4868199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45248/0 (socket says 172.21.15.107:45248) 2024-05-10T10:45:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.452+0000 7f4867fff700 1 -- 172.21.15.107:0/111481440 learned_addr learned my addr 172.21.15.107:0/111481440 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.452+0000 7f4867fff700 1 -- 172.21.15.107:0/111481440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4868199d40 con 0x7f4868101fe0 2024-05-10T10:45:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.452+0000 7f4867fff700 1 --2- 172.21.15.107:0/111481440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4868101fe0 0x7f4868199800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4858005780 tx=0x7f48580057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.452+0000 7f4865ffb700 1 -- 172.21.15.107:0/111481440 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4858026070 con 0x7f4868101fe0 2024-05-10T10:45:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.452+0000 7f486e36b700 1 -- 172.21.15.107:0/111481440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f486819a030 con 0x7f4868101fe0 2024-05-10T10:45:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.452+0000 7f4865ffb700 1 -- 172.21.15.107:0/111481440 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4858004370 con 0x7f4868101fe0 2024-05-10T10:45:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.452+0000 7f4865ffb700 1 -- 172.21.15.107:0/111481440 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4858003a30 con 0x7f4868101fe0 2024-05-10T10:45:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.452+0000 7f486e36b700 1 -- 172.21.15.107:0/111481440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f486819a4f0 con 0x7f4868101fe0 2024-05-10T10:45:25.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.453+0000 7f4865ffb700 1 -- 172.21.15.107:0/111481440 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f4858029070 con 0x7f4868101fe0 2024-05-10T10:45:25.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.453+0000 7f486e36b700 1 -- 172.21.15.107:0/111481440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48681034c0 con 0x7f4868101fe0 2024-05-10T10:45:25.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.454+0000 7f4865ffb700 1 --2- 172.21.15.107:0/111481440 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f485403e510 0x7f48540409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:25.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.454+0000 7f4865ffb700 1 -- 172.21.15.107:0/111481440 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f485801e070 con 0x7f4868101fe0 2024-05-10T10:45:25.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.454+0000 7f485ffff700 1 --2- 172.21.15.107:0/111481440 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f485403e510 0x7f48540409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:25.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.454+0000 7f485ffff700 1 --2- 172.21.15.107:0/111481440 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f485403e510 0x7f48540409d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4850006fd0 tx=0x7f4850006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:25.460 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.459+0000 7f4865ffb700 1 -- 172.21.15.107:0/111481440 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4858013070 con 0x7f4868101fe0 2024-05-10T10:45:25.669 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:25.667+0000 7f486e36b700 1 -- 172.21.15.107:0/111481440 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi184", "target": ["mon-mgr", ""]}) -- 0x7f486806b8e0 con 0x7f485403e510 2024-05-10T10:45:26.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:26 smithi107 ceph-mon[30373]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi184", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:45:26.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:26 smithi107 ceph-mon[30373]: Deploying cephadm binary to smithi184 2024-05-10T10:45:28.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:28 smithi107 ceph-mon[30373]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:29.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:29.787+0000 7f4865ffb700 1 -- 172.21.15.107:0/111481440 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f486806b8e0 con 0x7f485403e510 2024-05-10T10:45:29.788 INFO:teuthology.orchestra.run.smithi107.stdout:Added host 'smithi184' with addr '172.21.15.184' 2024-05-10T10:45:29.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:29.789+0000 7f486e36b700 1 -- 172.21.15.107:0/111481440 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f485403e510 msgr2=0x7f48540409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:29.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:29.789+0000 7f486e36b700 1 --2- 172.21.15.107:0/111481440 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f485403e510 0x7f48540409d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4850006fd0 tx=0x7f4850006e40 comp rx=0 tx=0).stop 2024-05-10T10:45:29.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:29.789+0000 7f486e36b700 1 -- 172.21.15.107:0/111481440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4868101fe0 msgr2=0x7f4868199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:29.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:29.789+0000 7f486e36b700 1 --2- 172.21.15.107:0/111481440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4868101fe0 0x7f4868199800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4858005780 tx=0x7f48580057b0 comp rx=0 tx=0).stop 2024-05-10T10:45:29.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:29.790+0000 7f486e36b700 1 -- 172.21.15.107:0/111481440 shutdown_connections 2024-05-10T10:45:29.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:29.790+0000 7f486e36b700 1 --2- 172.21.15.107:0/111481440 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f485403e510 0x7f48540409d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:29.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:29.790+0000 7f486e36b700 1 --2- 172.21.15.107:0/111481440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4868101fe0 0x7f4868199800 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:29.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:29.790+0000 7f486e36b700 1 -- 172.21.15.107:0/111481440 >> 172.21.15.107:0/111481440 conn(0x7f48680fd870 msgr2=0x7f48681039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:29.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:29.790+0000 7f486e36b700 1 -- 172.21.15.107:0/111481440 shutdown_connections 2024-05-10T10:45:29.792 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:29.790+0000 7f486e36b700 1 -- 172.21.15.107:0/111481440 wait complete. 2024-05-10T10:45:30.377 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch host ls --format=json 2024-05-10T10:45:30.615 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:45:31.028 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:30 smithi107 ceph-mon[30373]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:31.028 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:30 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:31.028 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:30 smithi107 ceph-mon[30373]: Added host smithi184 2024-05-10T10:45:31.028 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:30 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:45:31.028 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:30 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:31.919 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:32.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.135+0000 7f9c3e965700 1 -- 172.21.15.107:0/1631642098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c381030e0 msgr2=0x7f9c381034c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:32.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.135+0000 7f9c3e965700 1 --2- 172.21.15.107:0/1631642098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c381030e0 0x7f9c381034c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9c28009910 tx=0x7f9c28009c20 comp rx=0 tx=0).stop 2024-05-10T10:45:32.136 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.135+0000 7f9c3e965700 1 -- 172.21.15.107:0/1631642098 shutdown_connections 2024-05-10T10:45:32.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.135+0000 7f9c3e965700 1 --2- 172.21.15.107:0/1631642098 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c381030e0 0x7f9c381034c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:32.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.135+0000 7f9c3e965700 1 -- 172.21.15.107:0/1631642098 >> 172.21.15.107:0/1631642098 conn(0x7f9c380fe990 msgr2=0x7f9c38100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:32.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.135+0000 7f9c3e965700 1 -- 172.21.15.107:0/1631642098 shutdown_connections 2024-05-10T10:45:32.137 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.135+0000 7f9c3e965700 1 -- 172.21.15.107:0/1631642098 wait complete. 2024-05-10T10:45:32.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.136+0000 7f9c3e965700 1 Processor -- start 2024-05-10T10:45:32.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.136+0000 7f9c3e965700 1 -- start start 2024-05-10T10:45:32.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.136+0000 7f9c3e965700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c381030e0 0x7f9c380757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:32.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.136+0000 7f9c3e965700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3810d4a0 con 0x7f9c381030e0 2024-05-10T10:45:32.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.136+0000 7f9c37fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c381030e0 0x7f9c380757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:32.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.136+0000 7f9c37fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c381030e0 0x7f9c380757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46914/0 (socket says 172.21.15.107:46914) 2024-05-10T10:45:32.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.136+0000 7f9c37fff700 1 -- 172.21.15.107:0/2862637997 learned_addr learned my addr 172.21.15.107:0/2862637997 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:32.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.136+0000 7f9c37fff700 1 -- 172.21.15.107:0/2862637997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c38077690 con 0x7f9c381030e0 2024-05-10T10:45:32.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.136+0000 7f9c37fff700 1 --2- 172.21.15.107:0/2862637997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c381030e0 0x7f9c380757a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9c28006010 tx=0x7f9c28009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:32.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.137+0000 7f9c357fa700 1 -- 172.21.15.107:0/2862637997 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c28027070 con 0x7f9c381030e0 2024-05-10T10:45:32.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.137+0000 7f9c357fa700 1 -- 172.21.15.107:0/2862637997 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9c2800be30 con 0x7f9c381030e0 2024-05-10T10:45:32.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.137+0000 7f9c357fa700 1 -- 172.21.15.107:0/2862637997 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c2800f460 con 0x7f9c381030e0 2024-05-10T10:45:32.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.137+0000 7f9c3e965700 1 -- 172.21.15.107:0/2862637997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c38075d40 con 0x7f9c381030e0 2024-05-10T10:45:32.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.137+0000 7f9c3e965700 1 -- 172.21.15.107:0/2862637997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c38076200 con 0x7f9c381030e0 2024-05-10T10:45:32.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.138+0000 7f9c357fa700 1 -- 172.21.15.107:0/2862637997 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f9c2802a070 con 0x7f9c381030e0 2024-05-10T10:45:32.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.138+0000 7f9c3e965700 1 -- 172.21.15.107:0/2862637997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c381045c0 con 0x7f9c381030e0 2024-05-10T10:45:32.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.138+0000 7f9c357fa700 1 --2- 172.21.15.107:0/2862637997 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f9c2003e570 0x7f9c20040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:32.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.138+0000 7f9c357fa700 1 -- 172.21.15.107:0/2862637997 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9c2801e030 con 0x7f9c381030e0 2024-05-10T10:45:32.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.138+0000 7f9c377fe700 1 --2- 172.21.15.107:0/2862637997 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f9c2003e570 0x7f9c20040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:32.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.138+0000 7f9c377fe700 1 --2- 172.21.15.107:0/2862637997 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f9c2003e570 0x7f9c20040a30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c006fd0 tx=0x7f9c2c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:32.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.143+0000 7f9c357fa700 1 -- 172.21.15.107:0/2862637997 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f9c28013070 con 0x7f9c381030e0 2024-05-10T10:45:32.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.352+0000 7f9c3e965700 1 -- 172.21.15.107:0/2862637997 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9c38076490 con 0x7f9c2003e570 2024-05-10T10:45:32.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.354+0000 7f9c357fa700 1 -- 172.21.15.107:0/2862637997 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7f9c38076490 con 0x7f9c2003e570 2024-05-10T10:45:32.355 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:45:32.355 INFO:teuthology.orchestra.run.smithi107.stdout:[{"addr": "172.21.15.107", "hostname": "smithi107", "labels": [], "status": ""}, {"addr": "172.21.15.184", "hostname": "smithi184", "labels": [], "status": ""}] 2024-05-10T10:45:32.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.356+0000 7f9c3e965700 1 -- 172.21.15.107:0/2862637997 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f9c2003e570 msgr2=0x7f9c20040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:32.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.356+0000 7f9c3e965700 1 --2- 172.21.15.107:0/2862637997 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f9c2003e570 0x7f9c20040a30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c006fd0 tx=0x7f9c2c006e40 comp rx=0 tx=0).stop 2024-05-10T10:45:32.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.356+0000 7f9c3e965700 1 -- 172.21.15.107:0/2862637997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c381030e0 msgr2=0x7f9c380757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:32.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.356+0000 7f9c3e965700 1 --2- 172.21.15.107:0/2862637997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c381030e0 0x7f9c380757a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9c28006010 tx=0x7f9c28009ec0 comp rx=0 tx=0).stop 2024-05-10T10:45:32.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.356+0000 7f9c3e965700 1 -- 172.21.15.107:0/2862637997 shutdown_connections 2024-05-10T10:45:32.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.356+0000 7f9c3e965700 1 --2- 172.21.15.107:0/2862637997 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f9c2003e570 0x7f9c20040a30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:32.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.356+0000 7f9c3e965700 1 --2- 172.21.15.107:0/2862637997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c381030e0 0x7f9c380757a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:32.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.356+0000 7f9c3e965700 1 -- 172.21.15.107:0/2862637997 >> 172.21.15.107:0/2862637997 conn(0x7f9c380fe990 msgr2=0x7f9c38104ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:32.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.356+0000 7f9c3e965700 1 -- 172.21.15.107:0/2862637997 shutdown_connections 2024-05-10T10:45:32.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:32.356+0000 7f9c3e965700 1 -- 172.21.15.107:0/2862637997 wait complete. 2024-05-10T10:45:32.948 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi196 2024-05-10T10:45:32.948 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-10T10:45:32.948 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/etc/ceph/ceph.conf 2024-05-10T10:45:32.967 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-10T10:45:32.967 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-10T10:45:33.024 INFO:tasks.cephadm:Adding host smithi196 to orchestrator... 2024-05-10T10:45:33.024 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch host add smithi196 2024-05-10T10:45:33.259 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:45:33.673 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:33 smithi107 ceph-mon[30373]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:33.673 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:33 smithi107 ceph-mon[30373]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:45:33.673 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:34.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.617+0000 7f79fc519700 1 -- 172.21.15.107:0/2200249788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79f4103100 msgr2=0x7f79f41034e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:34.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.617+0000 7f79fc519700 1 --2- 172.21.15.107:0/2200249788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79f4103100 0x7f79f41034e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f79f000b0a0 tx=0x7f79f000b3b0 comp rx=0 tx=0).stop 2024-05-10T10:45:34.619 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.617+0000 7f79fc519700 1 -- 172.21.15.107:0/2200249788 shutdown_connections 2024-05-10T10:45:34.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.617+0000 7f79fc519700 1 --2- 172.21.15.107:0/2200249788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79f4103100 0x7f79f41034e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:34.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.617+0000 7f79fc519700 1 -- 172.21.15.107:0/2200249788 >> 172.21.15.107:0/2200249788 conn(0x7f79f40fe9b0 msgr2=0x7f79f4100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:34.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.617+0000 7f79fc519700 1 -- 172.21.15.107:0/2200249788 shutdown_connections 2024-05-10T10:45:34.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.617+0000 7f79fc519700 1 -- 172.21.15.107:0/2200249788 wait complete. 2024-05-10T10:45:34.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.618+0000 7f79fc519700 1 Processor -- start 2024-05-10T10:45:34.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.618+0000 7f79fc519700 1 -- start start 2024-05-10T10:45:34.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.618+0000 7f79fc519700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79f4103100 0x7f79f419e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:34.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.618+0000 7f79fc519700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f79f410d4c0 con 0x7f79f4103100 2024-05-10T10:45:34.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.618+0000 7f79fa2b5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79f4103100 0x7f79f419e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:34.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.618+0000 7f79fa2b5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79f4103100 0x7f79f419e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46922/0 (socket says 172.21.15.107:46922) 2024-05-10T10:45:34.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.618+0000 7f79fa2b5700 1 -- 172.21.15.107:0/3612188396 learned_addr learned my addr 172.21.15.107:0/3612188396 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:34.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.618+0000 7f79fa2b5700 1 -- 172.21.15.107:0/3612188396 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f419ebc0 con 0x7f79f4103100 2024-05-10T10:45:34.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.618+0000 7f79fa2b5700 1 --2- 172.21.15.107:0/3612188396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79f4103100 0x7f79f419e680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f79f0015040 tx=0x7f79f000bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:34.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.618+0000 7f79eb7fe700 1 -- 172.21.15.107:0/3612188396 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79f0017040 con 0x7f79f4103100 2024-05-10T10:45:34.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.618+0000 7f79fc519700 1 -- 172.21.15.107:0/3612188396 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79f419ee50 con 0x7f79f4103100 2024-05-10T10:45:34.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.618+0000 7f79eb7fe700 1 -- 172.21.15.107:0/3612188396 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f79f0022070 con 0x7f79f4103100 2024-05-10T10:45:34.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.619+0000 7f79eb7fe700 1 -- 172.21.15.107:0/3612188396 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79f00049b0 con 0x7f79f4103100 2024-05-10T10:45:34.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.619+0000 7f79fc519700 1 -- 172.21.15.107:0/3612188396 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f4198800 con 0x7f79f4103100 2024-05-10T10:45:34.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.619+0000 7f79fc519700 1 -- 172.21.15.107:0/3612188396 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79f41045e0 con 0x7f79f4103100 2024-05-10T10:45:34.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.619+0000 7f79eb7fe700 1 -- 172.21.15.107:0/3612188396 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f79f0004160 con 0x7f79f4103100 2024-05-10T10:45:34.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.620+0000 7f79eb7fe700 1 --2- 172.21.15.107:0/3612188396 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f79e003e510 0x7f79e00409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:34.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.620+0000 7f79eb7fe700 1 -- 172.21.15.107:0/3612188396 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f79f000f050 con 0x7f79f4103100 2024-05-10T10:45:34.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.620+0000 7f79f9ab4700 1 --2- 172.21.15.107:0/3612188396 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f79e003e510 0x7f79e00409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:34.622 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.620+0000 7f79f9ab4700 1 --2- 172.21.15.107:0/3612188396 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f79e003e510 0x7f79e00409d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f79e4006fd0 tx=0x7f79e4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:34.626 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.625+0000 7f79eb7fe700 1 -- 172.21.15.107:0/3612188396 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f79f0055cb0 con 0x7f79f4103100 2024-05-10T10:45:34.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:34.832+0000 7f79fc519700 1 -- 172.21.15.107:0/3612188396 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi196", "target": ["mon-mgr", ""]}) -- 0x7f79f4199d30 con 0x7f79e003e510 2024-05-10T10:45:35.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:35 smithi107 ceph-mon[30373]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:36.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:36 smithi107 ceph-mon[30373]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi196", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:45:36.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:36 smithi107 ceph-mon[30373]: Deploying cephadm binary to smithi196 2024-05-10T10:45:36.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:36.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:36.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:36.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:36.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi184", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:45:36.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:45:36.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:45:37.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:37 smithi107 ceph-mon[30373]: Updating smithi184:/etc/ceph/ceph.conf 2024-05-10T10:45:37.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:37 smithi107 ceph-mon[30373]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:37.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:37 smithi107 ceph-mon[30373]: Updating smithi184:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T10:45:37.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:37 smithi107 ceph-mon[30373]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-05-10T10:45:39.015 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:39.013+0000 7f79eb7fe700 1 -- 172.21.15.107:0/3612188396 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f79f4199d30 con 0x7f79e003e510 2024-05-10T10:45:39.015 INFO:teuthology.orchestra.run.smithi107.stdout:Added host 'smithi196' with addr '172.21.15.196' 2024-05-10T10:45:39.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:39.015+0000 7f79fc519700 1 -- 172.21.15.107:0/3612188396 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f79e003e510 msgr2=0x7f79e00409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:39.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:39.015+0000 7f79fc519700 1 --2- 172.21.15.107:0/3612188396 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f79e003e510 0x7f79e00409d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f79e4006fd0 tx=0x7f79e4006e40 comp rx=0 tx=0).stop 2024-05-10T10:45:39.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:39.015+0000 7f79fc519700 1 -- 172.21.15.107:0/3612188396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79f4103100 msgr2=0x7f79f419e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:39.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:39.015+0000 7f79fc519700 1 --2- 172.21.15.107:0/3612188396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79f4103100 0x7f79f419e680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f79f0015040 tx=0x7f79f000bd40 comp rx=0 tx=0).stop 2024-05-10T10:45:39.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:39.016+0000 7f79fc519700 1 -- 172.21.15.107:0/3612188396 shutdown_connections 2024-05-10T10:45:39.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:39.016+0000 7f79fc519700 1 --2- 172.21.15.107:0/3612188396 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f79e003e510 0x7f79e00409d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:39.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:39.016+0000 7f79fc519700 1 --2- 172.21.15.107:0/3612188396 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79f4103100 0x7f79f419e680 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:39.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:39.016+0000 7f79fc519700 1 -- 172.21.15.107:0/3612188396 >> 172.21.15.107:0/3612188396 conn(0x7f79f40fe9b0 msgr2=0x7f79f4104ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:39.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:39.016+0000 7f79fc519700 1 -- 172.21.15.107:0/3612188396 shutdown_connections 2024-05-10T10:45:39.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:39.016+0000 7f79fc519700 1 -- 172.21.15.107:0/3612188396 wait complete. 2024-05-10T10:45:39.632 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:39 smithi107 ceph-mon[30373]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:39.632 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:39 smithi107 ceph-mon[30373]: Updating smithi184:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-10T10:45:39.632 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:39 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:39.632 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:39 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:39.632 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:39 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:39.632 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:39 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:39.633 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:39 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:45:39.659 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch host ls --format=json 2024-05-10T10:45:39.896 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:45:40.612 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:40 smithi107 ceph-mon[30373]: Added host smithi196 2024-05-10T10:45:40.613 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:40.613 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:41.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.383+0000 7f36d33e1700 1 -- 172.21.15.107:0/3436922974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36cc1030e0 msgr2=0x7f36cc1034c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:41.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.383+0000 7f36d33e1700 1 --2- 172.21.15.107:0/3436922974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36cc1030e0 0x7f36cc1034c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009910 tx=0x7f36c8009c20 comp rx=0 tx=0).stop 2024-05-10T10:45:41.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.383+0000 7f36d33e1700 1 -- 172.21.15.107:0/3436922974 shutdown_connections 2024-05-10T10:45:41.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.383+0000 7f36d33e1700 1 --2- 172.21.15.107:0/3436922974 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36cc1030e0 0x7f36cc1034c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:41.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.383+0000 7f36d33e1700 1 -- 172.21.15.107:0/3436922974 >> 172.21.15.107:0/3436922974 conn(0x7f36cc0fe990 msgr2=0x7f36cc100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:41.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.384+0000 7f36d33e1700 1 -- 172.21.15.107:0/3436922974 shutdown_connections 2024-05-10T10:45:41.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.384+0000 7f36d33e1700 1 -- 172.21.15.107:0/3436922974 wait complete. 2024-05-10T10:45:41.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.384+0000 7f36d33e1700 1 Processor -- start 2024-05-10T10:45:41.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.384+0000 7f36d33e1700 1 -- start start 2024-05-10T10:45:41.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.384+0000 7f36d33e1700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36cc1030e0 0x7f36cc19e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:41.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.384+0000 7f36d33e1700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f36cc10d4a0 con 0x7f36cc1030e0 2024-05-10T10:45:41.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.384+0000 7f36d117d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36cc1030e0 0x7f36cc19e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:41.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.384+0000 7f36d117d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36cc1030e0 0x7f36cc19e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36502/0 (socket says 172.21.15.107:36502) 2024-05-10T10:45:41.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.384+0000 7f36d117d700 1 -- 172.21.15.107:0/228407481 learned_addr learned my addr 172.21.15.107:0/228407481 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:41.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.385+0000 7f36d117d700 1 -- 172.21.15.107:0/228407481 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36cc19ebd0 con 0x7f36cc1030e0 2024-05-10T10:45:41.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.385+0000 7f36d117d700 1 --2- 172.21.15.107:0/228407481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36cc1030e0 0x7f36cc19e690 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f36c8005780 tx=0x7f36c80057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:41.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.385+0000 7f36c27fc700 1 -- 172.21.15.107:0/228407481 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36c8026070 con 0x7f36cc1030e0 2024-05-10T10:45:41.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.385+0000 7f36d33e1700 1 -- 172.21.15.107:0/228407481 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36cc19eec0 con 0x7f36cc1030e0 2024-05-10T10:45:41.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.385+0000 7f36c27fc700 1 -- 172.21.15.107:0/228407481 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f36c8004370 con 0x7f36cc1030e0 2024-05-10T10:45:41.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.385+0000 7f36c27fc700 1 -- 172.21.15.107:0/228407481 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36c8003a30 con 0x7f36cc1030e0 2024-05-10T10:45:41.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.385+0000 7f36d33e1700 1 -- 172.21.15.107:0/228407481 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36cc198930 con 0x7f36cc1030e0 2024-05-10T10:45:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.386+0000 7f36c27fc700 1 -- 172.21.15.107:0/228407481 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f36c8029070 con 0x7f36cc1030e0 2024-05-10T10:45:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.386+0000 7f36d33e1700 1 -- 172.21.15.107:0/228407481 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36cc1045c0 con 0x7f36cc1030e0 2024-05-10T10:45:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.386+0000 7f36c27fc700 1 --2- 172.21.15.107:0/228407481 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f36b803e510 0x7f36b80409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.386+0000 7f36c27fc700 1 -- 172.21.15.107:0/228407481 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f36c801e070 con 0x7f36cc1030e0 2024-05-10T10:45:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.386+0000 7f36d097c700 1 --2- 172.21.15.107:0/228407481 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f36b803e510 0x7f36b80409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.387+0000 7f36d097c700 1 --2- 172.21.15.107:0/228407481 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f36b803e510 0x7f36b80409d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f36bc006fd0 tx=0x7f36bc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:41.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.391+0000 7f36c27fc700 1 -- 172.21.15.107:0/228407481 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f36c8013070 con 0x7f36cc1030e0 2024-05-10T10:45:41.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.604+0000 7f36d33e1700 1 -- 172.21.15.107:0/228407481 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f36cc199c90 con 0x7f36b803e510 2024-05-10T10:45:41.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.605+0000 7f36c27fc700 1 -- 172.21.15.107:0/228407481 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7f36cc199c90 con 0x7f36b803e510 2024-05-10T10:45:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:45:41.606 INFO:teuthology.orchestra.run.smithi107.stdout:[{"addr": "172.21.15.107", "hostname": "smithi107", "labels": [], "status": ""}, {"addr": "172.21.15.184", "hostname": "smithi184", "labels": [], "status": ""}, {"addr": "172.21.15.196", "hostname": "smithi196", "labels": [], "status": ""}] 2024-05-10T10:45:41.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.607+0000 7f36d33e1700 1 -- 172.21.15.107:0/228407481 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f36b803e510 msgr2=0x7f36b80409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:41.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.607+0000 7f36d33e1700 1 --2- 172.21.15.107:0/228407481 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f36b803e510 0x7f36b80409d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f36bc006fd0 tx=0x7f36bc006e40 comp rx=0 tx=0).stop 2024-05-10T10:45:41.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.607+0000 7f36d33e1700 1 -- 172.21.15.107:0/228407481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36cc1030e0 msgr2=0x7f36cc19e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:41.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.607+0000 7f36d33e1700 1 --2- 172.21.15.107:0/228407481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36cc1030e0 0x7f36cc19e690 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f36c8005780 tx=0x7f36c80057b0 comp rx=0 tx=0).stop 2024-05-10T10:45:41.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.607+0000 7f36d33e1700 1 -- 172.21.15.107:0/228407481 shutdown_connections 2024-05-10T10:45:41.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.607+0000 7f36d33e1700 1 --2- 172.21.15.107:0/228407481 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f36b803e510 0x7f36b80409d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:41.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.607+0000 7f36d33e1700 1 --2- 172.21.15.107:0/228407481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f36cc1030e0 0x7f36cc19e690 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:41.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.607+0000 7f36d33e1700 1 -- 172.21.15.107:0/228407481 >> 172.21.15.107:0/228407481 conn(0x7f36cc0fe990 msgr2=0x7f36cc104ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:41.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.607+0000 7f36d33e1700 1 -- 172.21.15.107:0/228407481 shutdown_connections 2024-05-10T10:45:41.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:41.607+0000 7f36d33e1700 1 -- 172.21.15.107:0/228407481 wait complete. 2024-05-10T10:45:41.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:41 smithi107 ceph-mon[30373]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:41.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:41 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:42.181 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-10T10:45:42.181 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd crush tunables default 2024-05-10T10:45:42.416 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:45:43.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:43 smithi107 ceph-mon[30373]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:43.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:43 smithi107 ceph-mon[30373]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:45:43.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.955+0000 7f31a0279700 1 -- 172.21.15.107:0/4032114460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3198104070 msgr2=0x7f3198104450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:43.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.955+0000 7f31a0279700 1 --2- 172.21.15.107:0/4032114460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3198104070 0x7f3198104450 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f319400b0a0 tx=0x7f319400b3b0 comp rx=0 tx=0).stop 2024-05-10T10:45:43.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.955+0000 7f31a0279700 1 -- 172.21.15.107:0/4032114460 shutdown_connections 2024-05-10T10:45:43.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.955+0000 7f31a0279700 1 --2- 172.21.15.107:0/4032114460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3198104070 0x7f3198104450 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:43.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.955+0000 7f31a0279700 1 -- 172.21.15.107:0/4032114460 >> 172.21.15.107:0/4032114460 conn(0x7f31980fd8e0 msgr2=0x7f31980ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:43.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.955+0000 7f31a0279700 1 -- 172.21.15.107:0/4032114460 shutdown_connections 2024-05-10T10:45:43.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.955+0000 7f31a0279700 1 -- 172.21.15.107:0/4032114460 wait complete. 2024-05-10T10:45:43.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.956+0000 7f31a0279700 1 Processor -- start 2024-05-10T10:45:43.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.956+0000 7f31a0279700 1 -- start start 2024-05-10T10:45:43.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.956+0000 7f31a0279700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3198104070 0x7f3198101cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:43.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.956+0000 7f31a0279700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f319810d550 con 0x7f3198104070 2024-05-10T10:45:43.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.956+0000 7f319e015700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3198104070 0x7f3198101cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:43.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.956+0000 7f319e015700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3198104070 0x7f3198101cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36520/0 (socket says 172.21.15.107:36520) 2024-05-10T10:45:43.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.956+0000 7f319e015700 1 -- 172.21.15.107:0/3550072064 learned_addr learned my addr 172.21.15.107:0/3550072064 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:45:43.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.956+0000 7f319e015700 1 -- 172.21.15.107:0/3550072064 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3198103bc0 con 0x7f3198104070 2024-05-10T10:45:43.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.956+0000 7f319e015700 1 --2- 172.21.15.107:0/3550072064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3198104070 0x7f3198101cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f31940062a0 tx=0x7f3194003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:43.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.956+0000 7f318f7fe700 1 -- 172.21.15.107:0/3550072064 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3194017040 con 0x7f3198104070 2024-05-10T10:45:43.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.956+0000 7f318f7fe700 1 -- 172.21.15.107:0/3550072064 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3194022070 con 0x7f3198104070 2024-05-10T10:45:43.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.957+0000 7f31a0279700 1 -- 172.21.15.107:0/3550072064 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3198102210 con 0x7f3198104070 2024-05-10T10:45:43.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.957+0000 7f318f7fe700 1 -- 172.21.15.107:0/3550072064 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f319401d450 con 0x7f3198104070 2024-05-10T10:45:43.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.957+0000 7f31a0279700 1 -- 172.21.15.107:0/3550072064 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31981026d0 con 0x7f3198104070 2024-05-10T10:45:43.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.957+0000 7f318f7fe700 1 -- 172.21.15.107:0/3550072064 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f31940041f0 con 0x7f3198104070 2024-05-10T10:45:43.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.958+0000 7f31a0279700 1 -- 172.21.15.107:0/3550072064 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f319806ba40 con 0x7f3198104070 2024-05-10T10:45:43.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.958+0000 7f318f7fe700 1 --2- 172.21.15.107:0/3550072064 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f318403e510 0x7f31840409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:43.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.958+0000 7f318f7fe700 1 -- 172.21.15.107:0/3550072064 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f319400f050 con 0x7f3198104070 2024-05-10T10:45:43.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.958+0000 7f319d814700 1 --2- 172.21.15.107:0/3550072064 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f318403e510 0x7f31840409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:43.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.958+0000 7f319d814700 1 --2- 172.21.15.107:0/3550072064 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f318403e510 0x7f31840409d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3188006fd0 tx=0x7f3188006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:43.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:43.963+0000 7f318f7fe700 1 -- 172.21.15.107:0/3550072064 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f31940192e0 con 0x7f3198104070 2024-05-10T10:45:44.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:44.172+0000 7f31a0279700 1 -- 172.21.15.107:0/3550072064 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f31981032a0 con 0x7f3198104070 2024-05-10T10:45:45.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:45.124+0000 7f318f7fe700 1 -- 172.21.15.107:0/3550072064 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f31940093e0 con 0x7f3198104070 2024-05-10T10:45:45.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:45.126+0000 7f31a0279700 1 -- 172.21.15.107:0/3550072064 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f318403e510 msgr2=0x7f31840409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:45.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:45.126+0000 7f31a0279700 1 --2- 172.21.15.107:0/3550072064 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f318403e510 0x7f31840409d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3188006fd0 tx=0x7f3188006e40 comp rx=0 tx=0).stop 2024-05-10T10:45:45.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:45.126+0000 7f31a0279700 1 -- 172.21.15.107:0/3550072064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3198104070 msgr2=0x7f3198101cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:45.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:45.126+0000 7f31a0279700 1 --2- 172.21.15.107:0/3550072064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3198104070 0x7f3198101cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f31940062a0 tx=0x7f3194003ce0 comp rx=0 tx=0).stop 2024-05-10T10:45:45.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:45.126+0000 7f31a0279700 1 -- 172.21.15.107:0/3550072064 shutdown_connections 2024-05-10T10:45:45.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:45.126+0000 7f31a0279700 1 --2- 172.21.15.107:0/3550072064 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f318403e510 0x7f31840409d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:45.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:45.126+0000 7f31a0279700 1 --2- 172.21.15.107:0/3550072064 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3198104070 0x7f3198101cd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:45.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:45.126+0000 7f31a0279700 1 -- 172.21.15.107:0/3550072064 >> 172.21.15.107:0/3550072064 conn(0x7f31980fd8e0 msgr2=0x7f3198104e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:45.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:45.126+0000 7f31a0279700 1 -- 172.21.15.107:0/3550072064 shutdown_connections 2024-05-10T10:45:45.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:45:45.126+0000 7f31a0279700 1 -- 172.21.15.107:0/3550072064 wait complete. 2024-05-10T10:45:45.129 INFO:teuthology.orchestra.run.smithi107.stderr:adjusted tunables profile to default 2024-05-10T10:45:45.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:45 smithi107 ceph-mon[30373]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:45.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:45.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:45.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:45.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:45.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi196", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:45:45.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:45:45.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:45:45.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:45 smithi107 ceph-mon[30373]: Updating smithi196:/etc/ceph/ceph.conf 2024-05-10T10:45:45.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:45 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3550072064' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-10T10:45:45.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:45 smithi107 ceph-mon[30373]: Updating smithi196:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T10:45:45.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:45.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:45.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:45.749 INFO:tasks.cephadm:Adding mon.a on smithi107 2024-05-10T10:45:45.749 INFO:tasks.cephadm:Adding mon.b on smithi184 2024-05-10T10:45:45.749 INFO:tasks.cephadm:Adding mon.c on smithi196 2024-05-10T10:45:45.749 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch apply mon '3;smithi107:172.21.15.107=a;smithi184:172.21.15.184=b;smithi196:172.21.15.196=c' 2024-05-10T10:45:45.975 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T10:45:46.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:46 smithi107 ceph-mon[30373]: Updating smithi196:/etc/ceph/ceph.client.admin.keyring 2024-05-10T10:45:46.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:46 smithi107 ceph-mon[30373]: Updating smithi196:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-10T10:45:46.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:46 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3550072064' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-10T10:45:46.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:46 smithi107 ceph-mon[30373]: osdmap e4: 0 total, 0 up, 0 in 2024-05-10T10:45:47.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.362+0000 7f2cb233d700 1 -- 172.21.15.196:0/1004648824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2cac1075c0 msgr2=0x7f2cac1079a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:47.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.362+0000 7f2cb233d700 1 --2- 172.21.15.196:0/1004648824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2cac1075c0 0x7f2cac1079a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009910 tx=0x7f2c9c009c20 comp rx=0 tx=0).stop 2024-05-10T10:45:47.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.362+0000 7f2cb233d700 1 -- 172.21.15.196:0/1004648824 shutdown_connections 2024-05-10T10:45:47.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.362+0000 7f2cb233d700 1 --2- 172.21.15.196:0/1004648824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2cac1075c0 0x7f2cac1079a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:47.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.362+0000 7f2cb233d700 1 -- 172.21.15.196:0/1004648824 >> 172.21.15.196:0/1004648824 conn(0x7f2cac078490 msgr2=0x7f2cac0788a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:47.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.362+0000 7f2cb233d700 1 -- 172.21.15.196:0/1004648824 shutdown_connections 2024-05-10T10:45:47.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.362+0000 7f2cb233d700 1 -- 172.21.15.196:0/1004648824 wait complete. 2024-05-10T10:45:47.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.363+0000 7f2cb233d700 1 Processor -- start 2024-05-10T10:45:47.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.363+0000 7f2cb233d700 1 -- start start 2024-05-10T10:45:47.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.363+0000 7f2cb233d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2cac1075c0 0x7f2cac19e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:47.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.363+0000 7f2cb233d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2cac10b310 con 0x7f2cac1075c0 2024-05-10T10:45:47.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.364+0000 7f2cabfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2cac1075c0 0x7f2cac19e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:47.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.364+0000 7f2cabfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2cac1075c0 0x7f2cac19e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.196:60436/0 (socket says 172.21.15.196:60436) 2024-05-10T10:45:47.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.364+0000 7f2cabfff700 1 -- 172.21.15.196:0/1804252597 learned_addr learned my addr 172.21.15.196:0/1804252597 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-10T10:45:47.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.364+0000 7f2cabfff700 1 -- 172.21.15.196:0/1804252597 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cac19eb40 con 0x7f2cac1075c0 2024-05-10T10:45:47.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.364+0000 7f2cabfff700 1 --2- 172.21.15.196:0/1804252597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2cac1075c0 0x7f2cac19e600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c005780 tx=0x7f2c9c0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:47.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.364+0000 7f2ca97fa700 1 -- 172.21.15.196:0/1804252597 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c9c026070 con 0x7f2cac1075c0 2024-05-10T10:45:47.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.364+0000 7f2ca97fa700 1 -- 172.21.15.196:0/1804252597 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2c9c004370 con 0x7f2cac1075c0 2024-05-10T10:45:47.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.364+0000 7f2ca97fa700 1 -- 172.21.15.196:0/1804252597 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c9c003af0 con 0x7f2cac1075c0 2024-05-10T10:45:47.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.364+0000 7f2cb233d700 1 -- 172.21.15.196:0/1804252597 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cac19edd0 con 0x7f2cac1075c0 2024-05-10T10:45:47.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.364+0000 7f2cb233d700 1 -- 172.21.15.196:0/1804252597 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cac1987d0 con 0x7f2cac1075c0 2024-05-10T10:45:47.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.365+0000 7f2cb233d700 1 -- 172.21.15.196:0/1804252597 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cac102c30 con 0x7f2cac1075c0 2024-05-10T10:45:47.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.365+0000 7f2ca97fa700 1 -- 172.21.15.196:0/1804252597 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f2c9c029070 con 0x7f2cac1075c0 2024-05-10T10:45:47.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.366+0000 7f2ca97fa700 1 --2- 172.21.15.196:0/1804252597 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f2c9403e510 0x7f2c940409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:47.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.366+0000 7f2ca97fa700 1 -- 172.21.15.196:0/1804252597 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2c9c01e070 con 0x7f2cac1075c0 2024-05-10T10:45:47.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.366+0000 7f2cab7fe700 1 --2- 172.21.15.196:0/1804252597 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f2c9403e510 0x7f2c940409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:47.368 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.366+0000 7f2cab7fe700 1 --2- 172.21.15.196:0/1804252597 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f2c9403e510 0x7f2c940409d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0006fd0 tx=0x7f2ca0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:47.372 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.371+0000 7f2ca97fa700 1 -- 172.21.15.196:0/1804252597 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f2c9c013070 con 0x7f2cac1075c0 2024-05-10T10:45:47.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:47 smithi107 ceph-mon[30373]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:47.587 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.586+0000 7f2cb233d700 1 -- 172.21.15.196:0/1804252597 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi107:172.21.15.107=a;smithi184:172.21.15.184=b;smithi196:172.21.15.196=c", "target": ["mon-mgr", ""]}) -- 0x7f2cac199cb0 con 0x7f2c9403e510 2024-05-10T10:45:47.594 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.593+0000 7f2ca97fa700 1 -- 172.21.15.196:0/1804252597 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2cac199cb0 con 0x7f2c9403e510 2024-05-10T10:45:47.594 INFO:teuthology.orchestra.run.smithi196.stdout:Scheduled mon update... 2024-05-10T10:45:47.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.595+0000 7f2cb233d700 1 -- 172.21.15.196:0/1804252597 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f2c9403e510 msgr2=0x7f2c940409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:47.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.595+0000 7f2cb233d700 1 --2- 172.21.15.196:0/1804252597 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f2c9403e510 0x7f2c940409d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0006fd0 tx=0x7f2ca0006e40 comp rx=0 tx=0).stop 2024-05-10T10:45:47.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.595+0000 7f2cb233d700 1 -- 172.21.15.196:0/1804252597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2cac1075c0 msgr2=0x7f2cac19e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:47.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.595+0000 7f2cb233d700 1 --2- 172.21.15.196:0/1804252597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2cac1075c0 0x7f2cac19e600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c005780 tx=0x7f2c9c0057b0 comp rx=0 tx=0).stop 2024-05-10T10:45:47.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.596+0000 7f2cb233d700 1 -- 172.21.15.196:0/1804252597 shutdown_connections 2024-05-10T10:45:47.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.596+0000 7f2cb233d700 1 --2- 172.21.15.196:0/1804252597 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f2c9403e510 0x7f2c940409d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:47.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.596+0000 7f2cb233d700 1 --2- 172.21.15.196:0/1804252597 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2cac1075c0 0x7f2cac19e600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:47.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.596+0000 7f2cb233d700 1 -- 172.21.15.196:0/1804252597 >> 172.21.15.196:0/1804252597 conn(0x7f2cac078490 msgr2=0x7f2cac100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:47.597 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.596+0000 7f2cb233d700 1 -- 172.21.15.196:0/1804252597 shutdown_connections 2024-05-10T10:45:47.598 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:47.596+0000 7f2cb233d700 1 -- 172.21.15.196:0/1804252597 wait complete. 2024-05-10T10:45:48.234 DEBUG:teuthology.orchestra.run.smithi184:mon.b> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mon.b.service 2024-05-10T10:45:48.237 DEBUG:teuthology.orchestra.run.smithi196:mon.c> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mon.c.service 2024-05-10T10:45:48.239 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-10T10:45:48.239 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-10T10:45:48.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:48 smithi107 ceph-mon[30373]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:48.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:48 smithi107 ceph-mon[30373]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi107:172.21.15.107=a;smithi184:172.21.15.184=b;smithi196:172.21.15.196=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:45:48.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:48 smithi107 ceph-mon[30373]: Saving service mon spec with placement smithi107:172.21.15.107=a;smithi184:172.21.15.184=b;smithi196:172.21.15.196=c;count:3 2024-05-10T10:45:48.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:48.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:45:48.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:45:48.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:45:48.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:48.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T10:45:48.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:45:48.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:48 smithi107 ceph-mon[30373]: Deploying daemon mon.c on smithi196 2024-05-10T10:45:49.483 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T10:45:50.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:50 smithi107 ceph-mon[30373]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:51.645 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:51 smithi196 systemd[1]: Starting Ceph mon.c for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T10:45:52.176 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:51 smithi196 podman[34843]: 2024-05-10 10:45:51.891081612 +0000 UTC m=+0.146935794 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T10:45:52.176 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:51 smithi196 podman[34843]: 2024-05-10 10:45:51.997893375 +0000 UTC m=+0.253747545 container create f3ec729d9d06f14cf8d4076b94b1372d04b95871cde667c540dbff1cfe4a58bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-10T10:45:52.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.275+0000 7f687caa2700 1 -- 172.21.15.196:0/2791559054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6878103100 msgr2=0x7f68781034e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:52.510 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.275+0000 7f687caa2700 1 --2- 172.21.15.196:0/2791559054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6878103100 0x7f68781034e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6868009910 tx=0x7f6868009c20 comp rx=0 tx=0).stop 2024-05-10T10:45:52.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.275+0000 7f687caa2700 1 -- 172.21.15.196:0/2791559054 shutdown_connections 2024-05-10T10:45:52.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.275+0000 7f687caa2700 1 --2- 172.21.15.196:0/2791559054 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6878103100 0x7f68781034e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:52.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.275+0000 7f687caa2700 1 -- 172.21.15.196:0/2791559054 >> 172.21.15.196:0/2791559054 conn(0x7f68780fe9b0 msgr2=0x7f6878100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:52.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.275+0000 7f687caa2700 1 -- 172.21.15.196:0/2791559054 shutdown_connections 2024-05-10T10:45:52.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.275+0000 7f687caa2700 1 -- 172.21.15.196:0/2791559054 wait complete. 2024-05-10T10:45:52.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.276+0000 7f687caa2700 1 Processor -- start 2024-05-10T10:45:52.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.276+0000 7f687caa2700 1 -- start start 2024-05-10T10:45:52.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.276+0000 7f687caa2700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6878103100 0x7f68780757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:52.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.276+0000 7f687caa2700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f687810d4c0 con 0x7f6878103100 2024-05-10T10:45:52.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.277+0000 7f687659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6878103100 0x7f68780757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:52.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.277+0000 7f687659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6878103100 0x7f68780757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.196:48796/0 (socket says 172.21.15.196:48796) 2024-05-10T10:45:52.511 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.277+0000 7f687659c700 1 -- 172.21.15.196:0/193385900 learned_addr learned my addr 172.21.15.196:0/193385900 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-10T10:45:52.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.277+0000 7f687659c700 1 -- 172.21.15.196:0/193385900 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6878077690 con 0x7f6878103100 2024-05-10T10:45:52.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.277+0000 7f687659c700 1 --2- 172.21.15.196:0/193385900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6878103100 0x7f68780757a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6868005780 tx=0x7f68680057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:52.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.277+0000 7f68677fe700 1 -- 172.21.15.196:0/193385900 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6868026070 con 0x7f6878103100 2024-05-10T10:45:52.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.277+0000 7f687caa2700 1 -- 172.21.15.196:0/193385900 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6878075d40 con 0x7f6878103100 2024-05-10T10:45:52.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.277+0000 7f68677fe700 1 -- 172.21.15.196:0/193385900 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6868004370 con 0x7f6878103100 2024-05-10T10:45:52.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.277+0000 7f68677fe700 1 -- 172.21.15.196:0/193385900 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6868003af0 con 0x7f6878103100 2024-05-10T10:45:52.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.277+0000 7f687caa2700 1 -- 172.21.15.196:0/193385900 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6878076200 con 0x7f6878103100 2024-05-10T10:45:52.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.278+0000 7f687caa2700 1 -- 172.21.15.196:0/193385900 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68781045e0 con 0x7f6878103100 2024-05-10T10:45:52.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.278+0000 7f68677fe700 1 -- 172.21.15.196:0/193385900 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f6868029070 con 0x7f6878103100 2024-05-10T10:45:52.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.279+0000 7f68677fe700 1 --2- 172.21.15.196:0/193385900 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f686003e510 0x7f68600409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:45:52.512 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.279+0000 7f68677fe700 1 -- 172.21.15.196:0/193385900 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f686801e070 con 0x7f6878103100 2024-05-10T10:45:52.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.279+0000 7f6875d9b700 1 --2- 172.21.15.196:0/193385900 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f686003e510 0x7f68600409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:45:52.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.279+0000 7f6875d9b700 1 --2- 172.21.15.196:0/193385900 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f686003e510 0x7f68600409d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f686c006fd0 tx=0x7f686c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:45:52.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.284+0000 7f68677fe700 1 -- 172.21.15.196:0/193385900 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f6868013070 con 0x7f6878103100 2024-05-10T10:45:52.513 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.330+0000 7f68677fe700 1 -- 172.21.15.196:0/193385900 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f686802a3b0 con 0x7f6878103100 2024-05-10T10:45:52.514 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 podman[34843]: 2024-05-10 10:45:52.267796223 +0000 UTC m=+0.523650403 container init f3ec729d9d06f14cf8d4076b94b1372d04b95871cde667c540dbff1cfe4a58bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08) 2024-05-10T10:45:52.514 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 podman[34843]: 2024-05-10 10:45:52.271144383 +0000 UTC m=+0.526998557 container start f3ec729d9d06f14cf8d4076b94b1372d04b95871cde667c540dbff1cfe4a58bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-c, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, io.buildah.version=1.33.5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-10T10:45:52.514 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: set uid:gid to 167:167 (ceph:ceph) 2024-05-10T10:45:52.514 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: ceph version 19.0.0-3449-gd39fa088 (d39fa08867836ac070c47cb66c782fa559fd480b) squid (dev), process ceph-mon, pid 2 2024-05-10T10:45:52.514 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: pidfile_write: ignore empty --pid-file 2024-05-10T10:45:52.514 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: load: jerasure load: lrc 2024-05-10T10:45:52.514 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: RocksDB version: 7.9.2 2024-05-10T10:45:52.514 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Git sha 0 2024-05-10T10:45:52.514 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Compile date 2024-05-10 01:38:55 2024-05-10T10:45:52.515 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: DB SUMMARY 2024-05-10T10:45:52.515 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: DB Session ID: GRYR4A8QB9OGF47EI3HS 2024-05-10T10:45:52.515 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: CURRENT file: CURRENT 2024-05-10T10:45:52.515 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: IDENTITY file: IDENTITY 2024-05-10T10:45:52.515 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-10T10:45:52.515 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-05-10T10:45:52.515 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-05-10T10:45:52.515 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.error_if_exists: 0 2024-05-10T10:45:52.515 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.create_if_missing: 0 2024-05-10T10:45:52.515 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.paranoid_checks: 1 2024-05-10T10:45:52.515 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-10T10:45:52.515 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-10T10:45:52.515 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-10T10:45:52.515 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.env: 0x555993ff1cc0 2024-05-10T10:45:52.515 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.fs: PosixFileSystem 2024-05-10T10:45:52.516 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.info_log: 0x555995713da0 2024-05-10T10:45:52.516 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_file_opening_threads: 16 2024-05-10T10:45:52.516 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.statistics: (nil) 2024-05-10T10:45:52.516 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.use_fsync: 0 2024-05-10T10:45:52.516 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_log_file_size: 0 2024-05-10T10:45:52.516 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-10T10:45:52.516 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-10T10:45:52.516 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.keep_log_file_num: 1000 2024-05-10T10:45:52.516 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.recycle_log_file_num: 0 2024-05-10T10:45:52.516 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.allow_fallocate: 1 2024-05-10T10:45:52.516 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.allow_mmap_reads: 0 2024-05-10T10:45:52.516 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.allow_mmap_writes: 0 2024-05-10T10:45:52.517 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.use_direct_reads: 0 2024-05-10T10:45:52.517 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-10T10:45:52.517 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.create_missing_column_families: 0 2024-05-10T10:45:52.517 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.db_log_dir: 2024-05-10T10:45:52.517 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.wal_dir: 2024-05-10T10:45:52.517 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-10T10:45:52.517 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-10T10:45:52.517 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-10T10:45:52.517 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-10T10:45:52.517 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-10T10:45:52.517 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-10T10:45:52.517 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.advise_random_on_open: 1 2024-05-10T10:45:52.517 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.db_write_buffer_size: 0 2024-05-10T10:45:52.517 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.write_buffer_manager: 0x5559956e50e0 2024-05-10T10:45:52.518 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-10T10:45:52.518 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-10T10:45:52.518 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-10T10:45:52.518 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.rate_limiter: (nil) 2024-05-10T10:45:52.518 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-10T10:45:52.518 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.wal_recovery_mode: 2 2024-05-10T10:45:52.518 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.enable_thread_tracking: 0 2024-05-10T10:45:52.518 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.enable_pipelined_write: 0 2024-05-10T10:45:52.518 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.unordered_write: 0 2024-05-10T10:45:52.518 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-10T10:45:52.518 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-10T10:45:52.518 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-10T10:45:52.518 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-10T10:45:52.518 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.row_cache: None 2024-05-10T10:45:52.519 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.wal_filter: None 2024-05-10T10:45:52.519 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-10T10:45:52.519 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.allow_ingest_behind: 0 2024-05-10T10:45:52.519 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.two_write_queues: 0 2024-05-10T10:45:52.519 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.manual_wal_flush: 0 2024-05-10T10:45:52.519 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.wal_compression: 0 2024-05-10T10:45:52.519 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.atomic_flush: 0 2024-05-10T10:45:52.519 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-10T10:45:52.519 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-10T10:45:52.519 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-10T10:45:52.519 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.log_readahead_size: 0 2024-05-10T10:45:52.519 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-10T10:45:52.519 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.best_efforts_recovery: 0 2024-05-10T10:45:52.519 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-10T10:45:52.520 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-10T10:45:52.520 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.allow_data_in_errors: 0 2024-05-10T10:45:52.520 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.db_host_id: __hostname__ 2024-05-10T10:45:52.520 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-10T10:45:52.520 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_background_jobs: 2 2024-05-10T10:45:52.520 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_background_compactions: -1 2024-05-10T10:45:52.520 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_subcompactions: 1 2024-05-10T10:45:52.520 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-10T10:45:52.520 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-10T10:45:52.520 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-10T10:45:52.520 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_total_wal_size: 0 2024-05-10T10:45:52.520 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-10T10:45:52.520 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-10T10:45:52.521 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-10T10:45:52.521 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-10T10:45:52.521 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_open_files: -1 2024-05-10T10:45:52.521 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.bytes_per_sync: 0 2024-05-10T10:45:52.521 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-10T10:45:52.521 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-10T10:45:52.521 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compaction_readahead_size: 0 2024-05-10T10:45:52.521 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_background_flushes: -1 2024-05-10T10:45:52.521 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Compression algorithms supported: 2024-05-10T10:45:52.521 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-10T10:45:52.521 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: kZSTD supported: 0 2024-05-10T10:45:52.521 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: kXpressCompression supported: 0 2024-05-10T10:45:52.521 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: kLZ4HCCompression supported: 1 2024-05-10T10:45:52.522 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: kZlibCompression supported: 1 2024-05-10T10:45:52.522 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: kSnappyCompression supported: 1 2024-05-10T10:45:52.522 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: kLZ4Compression supported: 1 2024-05-10T10:45:52.522 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: kBZip2Compression supported: 0 2024-05-10T10:45:52.522 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-10T10:45:52.522 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-10T10:45:52.522 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-05-10T10:45:52.522 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-10T10:45:52.522 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-10T10:45:52.522 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.merge_operator: 2024-05-10T10:45:52.522 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compaction_filter: None 2024-05-10T10:45:52.522 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compaction_filter_factory: None 2024-05-10T10:45:52.522 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.sst_partitioner_factory: None 2024-05-10T10:45:52.523 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-10T10:45:52.523 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-10T10:45:52.523 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555995713f60) 2024-05-10T10:45:52.523 INFO:journalctl@ceph.mon.c.smithi196.stdout: cache_index_and_filter_blocks: 1 2024-05-10T10:45:52.523 INFO:journalctl@ceph.mon.c.smithi196.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-10T10:45:52.523 INFO:journalctl@ceph.mon.c.smithi196.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-10T10:45:52.523 INFO:journalctl@ceph.mon.c.smithi196.stdout: pin_top_level_index_and_filter: 1 2024-05-10T10:45:52.523 INFO:journalctl@ceph.mon.c.smithi196.stdout: index_type: 0 2024-05-10T10:45:52.523 INFO:journalctl@ceph.mon.c.smithi196.stdout: data_block_index_type: 0 2024-05-10T10:45:52.523 INFO:journalctl@ceph.mon.c.smithi196.stdout: index_shortening: 1 2024-05-10T10:45:52.523 INFO:journalctl@ceph.mon.c.smithi196.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-10T10:45:52.523 INFO:journalctl@ceph.mon.c.smithi196.stdout: checksum: 4 2024-05-10T10:45:52.523 INFO:journalctl@ceph.mon.c.smithi196.stdout: no_block_cache: 0 2024-05-10T10:45:52.524 INFO:journalctl@ceph.mon.c.smithi196.stdout: block_cache: 0x5559957171f0 2024-05-10T10:45:52.524 INFO:journalctl@ceph.mon.c.smithi196.stdout: block_cache_name: BinnedLRUCache 2024-05-10T10:45:52.524 INFO:journalctl@ceph.mon.c.smithi196.stdout: block_cache_options: 2024-05-10T10:45:52.524 INFO:journalctl@ceph.mon.c.smithi196.stdout: capacity : 536870912 2024-05-10T10:45:52.524 INFO:journalctl@ceph.mon.c.smithi196.stdout: num_shard_bits : 4 2024-05-10T10:45:52.524 INFO:journalctl@ceph.mon.c.smithi196.stdout: strict_capacity_limit : 0 2024-05-10T10:45:52.524 INFO:journalctl@ceph.mon.c.smithi196.stdout: high_pri_pool_ratio: 0.000 2024-05-10T10:45:52.524 INFO:journalctl@ceph.mon.c.smithi196.stdout: block_cache_compressed: (nil) 2024-05-10T10:45:52.524 INFO:journalctl@ceph.mon.c.smithi196.stdout: persistent_cache: (nil) 2024-05-10T10:45:52.524 INFO:journalctl@ceph.mon.c.smithi196.stdout: block_size: 4096 2024-05-10T10:45:52.524 INFO:journalctl@ceph.mon.c.smithi196.stdout: block_size_deviation: 10 2024-05-10T10:45:52.524 INFO:journalctl@ceph.mon.c.smithi196.stdout: block_restart_interval: 16 2024-05-10T10:45:52.524 INFO:journalctl@ceph.mon.c.smithi196.stdout: index_block_restart_interval: 1 2024-05-10T10:45:52.524 INFO:journalctl@ceph.mon.c.smithi196.stdout: metadata_block_size: 4096 2024-05-10T10:45:52.524 INFO:journalctl@ceph.mon.c.smithi196.stdout: partition_filters: 0 2024-05-10T10:45:52.525 INFO:journalctl@ceph.mon.c.smithi196.stdout: use_delta_encoding: 1 2024-05-10T10:45:52.525 INFO:journalctl@ceph.mon.c.smithi196.stdout: filter_policy: bloomfilter 2024-05-10T10:45:52.525 INFO:journalctl@ceph.mon.c.smithi196.stdout: whole_key_filtering: 1 2024-05-10T10:45:52.525 INFO:journalctl@ceph.mon.c.smithi196.stdout: verify_compression: 0 2024-05-10T10:45:52.525 INFO:journalctl@ceph.mon.c.smithi196.stdout: read_amp_bytes_per_bit: 0 2024-05-10T10:45:52.525 INFO:journalctl@ceph.mon.c.smithi196.stdout: format_version: 5 2024-05-10T10:45:52.525 INFO:journalctl@ceph.mon.c.smithi196.stdout: enable_index_compression: 1 2024-05-10T10:45:52.525 INFO:journalctl@ceph.mon.c.smithi196.stdout: block_align: 0 2024-05-10T10:45:52.525 INFO:journalctl@ceph.mon.c.smithi196.stdout: max_auto_readahead_size: 262144 2024-05-10T10:45:52.525 INFO:journalctl@ceph.mon.c.smithi196.stdout: prepopulate_block_cache: 0 2024-05-10T10:45:52.525 INFO:journalctl@ceph.mon.c.smithi196.stdout: initial_auto_readahead_size: 8192 2024-05-10T10:45:52.525 INFO:journalctl@ceph.mon.c.smithi196.stdout: num_file_reads_for_auto_readahead: 2 2024-05-10T10:45:52.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.write_buffer_size: 33554432 2024-05-10T10:45:52.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_write_buffer_number: 2 2024-05-10T10:45:52.526 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compression: NoCompression 2024-05-10T10:45:52.526 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.bottommost_compression: Disabled 2024-05-10T10:45:52.526 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.prefix_extractor: nullptr 2024-05-10T10:45:52.526 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-10T10:45:52.526 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.num_levels: 7 2024-05-10T10:45:52.526 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-10T10:45:52.526 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-10T10:45:52.526 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-10T10:45:52.526 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-10T10:45:52.526 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-10T10:45:52.526 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-10T10:45:52.526 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-10T10:45:52.526 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-10T10:45:52.527 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-10T10:45:52.527 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-10T10:45:52.527 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-10T10:45:52.527 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-10T10:45:52.527 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-10T10:45:52.527 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compression_opts.level: 32767 2024-05-10T10:45:52.527 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compression_opts.strategy: 0 2024-05-10T10:45:52.527 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-10T10:45:52.527 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-10T10:45:52.527 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-10T10:45:52.527 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-10T10:45:52.527 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compression_opts.enabled: false 2024-05-10T10:45:52.527 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-10T10:45:52.527 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-10T10:45:52.528 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-10T10:45:52.528 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-10T10:45:52.528 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.target_file_size_base: 67108864 2024-05-10T10:45:52.528 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-10T10:45:52.528 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-10T10:45:52.528 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-10T10:45:52.528 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-10T10:45:52.528 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-10T10:45:52.529 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-10T10:45:52.529 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-10T10:45:52.529 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-10T10:45:52.529 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-10T10:45:52.529 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-10T10:45:52.529 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-10T10:45:52.529 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-10T10:45:52.530 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-10T10:45:52.530 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-10T10:45:52.530 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.arena_block_size: 1048576 2024-05-10T10:45:52.530 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-10T10:45:52.530 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-10T10:45:52.530 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.disable_auto_compactions: 0 2024-05-10T10:45:52.530 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-10T10:45:52.530 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-10T10:45:52.530 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-10T10:45:52.530 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-10T10:45:52.530 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-10T10:45:52.530 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-10T10:45:52.531 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-10T10:45:52.531 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-10T10:45:52.531 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-10T10:45:52.531 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-10T10:45:52.531 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-10T10:45:52.531 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.inplace_update_support: 0 2024-05-10T10:45:52.531 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-10T10:45:52.531 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-10T10:45:52.531 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-10T10:45:52.531 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-10T10:45:52.531 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.bloom_locality: 0 2024-05-10T10:45:52.531 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.max_successive_merges: 0 2024-05-10T10:45:52.531 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-10T10:45:52.531 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.paranoid_file_checks: 0 2024-05-10T10:45:52.532 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.force_consistency_checks: 1 2024-05-10T10:45:52.532 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.report_bg_io_stats: 0 2024-05-10T10:45:52.532 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.ttl: 2592000 2024-05-10T10:45:52.532 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-10T10:45:52.532 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-10T10:45:52.532 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-10T10:45:52.532 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.enable_blob_files: false 2024-05-10T10:45:52.532 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.min_blob_size: 0 2024-05-10T10:45:52.532 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.blob_file_size: 268435456 2024-05-10T10:45:52.532 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-10T10:45:52.532 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-10T10:45:52.532 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-10T10:45:52.532 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-10T10:45:52.533 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-10T10:45:52.533 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.blob_file_starting_level: 0 2024-05-10T10:45:52.533 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-10T10:45:52.533 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-10T10:45:52.533 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-10T10:45:52.533 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d21eb633-8728-4914-b9da-69a37ecfe16a 2024-05-10T10:45:52.533 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715337952301578, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-10T10:45:52.533 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-10T10:45:52.533 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715337952301996, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715337952, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d21eb633-8728-4914-b9da-69a37ecfe16a", "db_session_id": "GRYR4A8QB9OGF47EI3HS", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-10T10:45:52.533 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715337952302085, "job": 1, "event": "recovery_finished"} 2024-05-10T10:45:52.533 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-10T10:45:52.533 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-10T10:45:52.533 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555995834000 2024-05-10T10:45:52.533 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: DB pointer 0x555995820000 2024-05-10T10:45:52.534 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-10T10:45:52.534 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-10T10:45:52.534 INFO:journalctl@ceph.mon.c.smithi196.stdout: ** DB Stats ** 2024-05-10T10:45:52.534 INFO:journalctl@ceph.mon.c.smithi196.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-10T10:45:52.534 INFO:journalctl@ceph.mon.c.smithi196.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-10T10:45:52.534 INFO:journalctl@ceph.mon.c.smithi196.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-10T10:45:52.534 INFO:journalctl@ceph.mon.c.smithi196.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-10T10:45:52.534 INFO:journalctl@ceph.mon.c.smithi196.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-10T10:45:52.534 INFO:journalctl@ceph.mon.c.smithi196.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-10T10:45:52.534 INFO:journalctl@ceph.mon.c.smithi196.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-10T10:45:52.534 INFO:journalctl@ceph.mon.c.smithi196.stdout: 2024-05-10T10:45:52.534 INFO:journalctl@ceph.mon.c.smithi196.stdout: ** Compaction Stats [default] ** 2024-05-10T10:45:52.534 INFO:journalctl@ceph.mon.c.smithi196.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-10T10:45:52.534 INFO:journalctl@ceph.mon.c.smithi196.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-10T10:45:52.535 INFO:journalctl@ceph.mon.c.smithi196.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-10T10:45:52.535 INFO:journalctl@ceph.mon.c.smithi196.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-10T10:45:52.535 INFO:journalctl@ceph.mon.c.smithi196.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-10T10:45:52.535 INFO:journalctl@ceph.mon.c.smithi196.stdout: 2024-05-10T10:45:52.535 INFO:journalctl@ceph.mon.c.smithi196.stdout: ** Compaction Stats [default] ** 2024-05-10T10:45:52.535 INFO:journalctl@ceph.mon.c.smithi196.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-10T10:45:52.535 INFO:journalctl@ceph.mon.c.smithi196.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-10T10:45:52.535 INFO:journalctl@ceph.mon.c.smithi196.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-10T10:45:52.535 INFO:journalctl@ceph.mon.c.smithi196.stdout: 2024-05-10T10:45:52.535 INFO:journalctl@ceph.mon.c.smithi196.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-10T10:45:52.535 INFO:journalctl@ceph.mon.c.smithi196.stdout: 2024-05-10T10:45:52.535 INFO:journalctl@ceph.mon.c.smithi196.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-10T10:45:52.535 INFO:journalctl@ceph.mon.c.smithi196.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-10T10:45:52.536 INFO:journalctl@ceph.mon.c.smithi196.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-10T10:45:52.536 INFO:journalctl@ceph.mon.c.smithi196.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-10T10:45:52.536 INFO:journalctl@ceph.mon.c.smithi196.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-10T10:45:52.536 INFO:journalctl@ceph.mon.c.smithi196.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-10T10:45:52.536 INFO:journalctl@ceph.mon.c.smithi196.stdout: Cumulative compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-10T10:45:52.536 INFO:journalctl@ceph.mon.c.smithi196.stdout: Interval compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-10T10:45:52.536 INFO:journalctl@ceph.mon.c.smithi196.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-10T10:45:52.536 INFO:journalctl@ceph.mon.c.smithi196.stdout: Block cache BinnedLRUCache@0x5559957171f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-05-10T10:45:52.536 INFO:journalctl@ceph.mon.c.smithi196.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-10T10:45:52.536 INFO:journalctl@ceph.mon.c.smithi196.stdout: 2024-05-10T10:45:52.536 INFO:journalctl@ceph.mon.c.smithi196.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-10T10:45:52.536 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-05-10T10:45:52.536 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: using public_addr v2:172.21.15.196:0/0 -> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-05-10T10:45:52.536 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: starting mon.c rank -1 at public addrs [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] at bind addrs [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:45:52.537 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: mon.c@-1(???) e0 preinit fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:45:52.537 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: mon.c@-1(synchronizing).mds e1 new map 2024-05-10T10:45:52.537 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: mon.c@-1(synchronizing).mds e1 print_map 2024-05-10T10:45:52.537 INFO:journalctl@ceph.mon.c.smithi196.stdout: e1 2024-05-10T10:45:52.537 INFO:journalctl@ceph.mon.c.smithi196.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-10T10:45:52.537 INFO:journalctl@ceph.mon.c.smithi196.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-10T10:45:52.537 INFO:journalctl@ceph.mon.c.smithi196.stdout: legacy client fscid: -1 2024-05-10T10:45:52.537 INFO:journalctl@ceph.mon.c.smithi196.stdout: 2024-05-10T10:45:52.537 INFO:journalctl@ceph.mon.c.smithi196.stdout: No filesystems configured 2024-05-10T10:45:52.537 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-10T10:45:52.537 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-10T10:45:52.537 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-10T10:45:52.537 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-10T10:45:52.538 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-10T10:45:52.538 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-10T10:45:52.538 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-10T10:45:52.538 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-10T10:45:52.538 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-10T10:45:52.538 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-10T10:45:52.538 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:52.538 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi196", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:45:52.538 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: Deploying cephadm binary to smithi196 2024-05-10T10:45:52.538 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.538 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.538 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.538 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.538 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi184", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:45:52.539 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:45:52.539 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:45:52.539 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: Updating smithi184:/etc/ceph/ceph.conf 2024-05-10T10:45:52.539 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:52.539 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: Updating smithi184:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T10:45:52.539 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-05-10T10:45:52.539 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:52.539 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: Updating smithi184:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-10T10:45:52.539 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.539 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.539 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.539 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.539 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:45:52.539 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: Added host smithi196 2024-05-10T10:45:52.539 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.539 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.539 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:52.540 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.540 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:52.540 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:45:52.540 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:52.540 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.540 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.540 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.540 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.540 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi196", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:45:52.540 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:45:52.540 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:45:52.540 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: Updating smithi196:/etc/ceph/ceph.conf 2024-05-10T10:45:52.541 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3550072064' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-10T10:45:52.541 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: Updating smithi196:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T10:45:52.541 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.541 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.541 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.541 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: Updating smithi196:/etc/ceph/ceph.client.admin.keyring 2024-05-10T10:45:52.541 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: Updating smithi196:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-10T10:45:52.541 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3550072064' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-10T10:45:52.541 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: osdmap e4: 0 total, 0 up, 0 in 2024-05-10T10:45:52.541 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:52.541 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:52.541 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi107:172.21.15.107=a;smithi184:172.21.15.184=b;smithi196:172.21.15.196=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:45:52.541 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: Saving service mon spec with placement smithi107:172.21.15.107=a;smithi184:172.21.15.184=b;smithi196:172.21.15.196=c;count:3 2024-05-10T10:45:52.541 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.542 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:45:52.542 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:45:52.542 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:45:52.542 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:52.542 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T10:45:52.542 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:45:52.542 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: Deploying daemon mon.c on smithi196 2024-05-10T10:45:52.542 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:52.542 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 ceph-mon[34872]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-10T10:45:52.542 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 bash[34843]: f3ec729d9d06f14cf8d4076b94b1372d04b95871cde667c540dbff1cfe4a58bc 2024-05-10T10:45:52.542 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:52 smithi196 systemd[1]: Started Ceph mon.c for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:45:52.584 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:52.583+0000 7f687caa2700 1 -- 172.21.15.196:0/193385900 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f6878076d70 con 0x7f6878103100 2024-05-10T10:45:57.342 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:57.341+0000 7f68677fe700 1 -- 172.21.15.196:0/193385900 <== mon.0 v2:172.21.15.107:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f6868030020 con 0x7f6878103100 2024-05-10T10:45:57.343 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-10T10:45:57.343 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":2,"fsid":"0ba8a8e4-0eba-11ef-bc98-c7b262605968","modified":"2024-05-10T10:45:52.330773Z","created":"2024-05-10T10:44:10.080994Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-10T10:45:57.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:57.344+0000 7f687caa2700 1 -- 172.21.15.196:0/193385900 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f686003e510 msgr2=0x7f68600409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:57.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:57.344+0000 7f687caa2700 1 --2- 172.21.15.196:0/193385900 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f686003e510 0x7f68600409d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f686c006fd0 tx=0x7f686c006e40 comp rx=0 tx=0).stop 2024-05-10T10:45:57.345 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:57.344+0000 7f687caa2700 1 -- 172.21.15.196:0/193385900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6878103100 msgr2=0x7f68780757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:45:57.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:57.344+0000 7f687caa2700 1 --2- 172.21.15.196:0/193385900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6878103100 0x7f68780757a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6868005780 tx=0x7f68680057b0 comp rx=0 tx=0).stop 2024-05-10T10:45:57.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:57.344+0000 7f687caa2700 1 -- 172.21.15.196:0/193385900 shutdown_connections 2024-05-10T10:45:57.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:57.344+0000 7f687caa2700 1 --2- 172.21.15.196:0/193385900 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f686003e510 0x7f68600409d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:57.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:57.344+0000 7f687caa2700 1 --2- 172.21.15.196:0/193385900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6878103100 0x7f68780757a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:45:57.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:57.344+0000 7f687caa2700 1 -- 172.21.15.196:0/193385900 >> 172.21.15.196:0/193385900 conn(0x7f68780fe9b0 msgr2=0x7f6878105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:45:57.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:57.344+0000 7f687caa2700 1 -- 172.21.15.196:0/193385900 shutdown_connections 2024-05-10T10:45:57.346 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:45:57.344+0000 7f687caa2700 1 -- 172.21.15.196:0/193385900 wait complete. 2024-05-10T10:45:57.346 INFO:teuthology.orchestra.run.smithi196.stderr:dumped monmap epoch 2 2024-05-10T10:45:57.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:57.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T10:45:57.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: mon.a calling monitor election 2024-05-10T10:45:57.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:45:57.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: from='client.? 172.21.15.196:0/193385900' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-10T10:45:57.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:45:57.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:57.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:45:57.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: mon.c calling monitor election 2024-05-10T10:45:57.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:45:57.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:57.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:45:57.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:45:57.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-10T10:45:57.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: monmap epoch 2 2024-05-10T10:45:57.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:45:57.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: last_changed 2024-05-10T10:45:52.330773+0000 2024-05-10T10:45:57.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: created 2024-05-10T10:44:10.080994+0000 2024-05-10T10:45:57.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: min_mon_release 19 (squid) 2024-05-10T10:45:57.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: election_strategy: 1 2024-05-10T10:45:57.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: 0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-05-10T10:45:57.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-05-10T10:45:57.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: fsmap 2024-05-10T10:45:57.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: osdmap e4: 0 total, 0 up, 0 in 2024-05-10T10:45:57.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: mgrmap e13: x(active, since 49s) 2024-05-10T10:45:57.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: overall HEALTH_OK 2024-05-10T10:45:57.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:57.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:57.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:57.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T10:45:57.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:45:57.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:57.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T10:45:57.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: mon.a calling monitor election 2024-05-10T10:45:57.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:45:57.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: from='client.? 172.21.15.196:0/193385900' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-10T10:45:57.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:45:57.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:57.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:45:57.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: mon.c calling monitor election 2024-05-10T10:45:57.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:45:57.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:57.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:45:57.714 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:45:57.715 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-10T10:45:57.715 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: monmap epoch 2 2024-05-10T10:45:57.715 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:45:57.715 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: last_changed 2024-05-10T10:45:52.330773+0000 2024-05-10T10:45:57.715 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: created 2024-05-10T10:44:10.080994+0000 2024-05-10T10:45:57.715 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: min_mon_release 19 (squid) 2024-05-10T10:45:57.715 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: election_strategy: 1 2024-05-10T10:45:57.715 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: 0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-05-10T10:45:57.715 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-05-10T10:45:57.715 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: fsmap 2024-05-10T10:45:57.715 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: osdmap e4: 0 total, 0 up, 0 in 2024-05-10T10:45:57.715 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: mgrmap e13: x(active, since 49s) 2024-05-10T10:45:57.715 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: overall HEALTH_OK 2024-05-10T10:45:57.715 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:57.716 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:57.716 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:45:57.716 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T10:45:57.716 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:45:58.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:58 smithi107 ceph-mon[30373]: Deploying daemon mon.b on smithi184 2024-05-10T10:45:58.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:58 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:45:58.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:58 smithi196 ceph-mon[34872]: Deploying daemon mon.b on smithi184 2024-05-10T10:45:58.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:58 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:45:59.007 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-10T10:45:59.008 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-10T10:45:59.247 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T10:45:59.624 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:45:59 smithi196 ceph-mon[34872]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:59.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:45:59 smithi107 ceph-mon[30373]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:45:59.676 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:45:59 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:45:59.330+0000 7f63f81a2700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-10T10:46:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.814+0000 7f581b74c700 1 -- 172.21.15.196:0/2123922506 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5814103220 msgr2=0x7f5814103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.814+0000 7f581b74c700 1 --2- 172.21.15.196:0/2123922506 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5814103220 0x7f5814103600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5804009910 tx=0x7f5804009c20 comp rx=0 tx=0).stop 2024-05-10T10:46:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.814+0000 7f581b74c700 1 -- 172.21.15.196:0/2123922506 shutdown_connections 2024-05-10T10:46:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.814+0000 7f581b74c700 1 --2- 172.21.15.196:0/2123922506 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5814103220 0x7f5814103600 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:00.816 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.814+0000 7f581b74c700 1 -- 172.21.15.196:0/2123922506 >> 172.21.15.196:0/2123922506 conn(0x7f58140feab0 msgr2=0x7f5814100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:46:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.815+0000 7f581b74c700 1 -- 172.21.15.196:0/2123922506 shutdown_connections 2024-05-10T10:46:00.817 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.815+0000 7f581b74c700 1 -- 172.21.15.196:0/2123922506 wait complete. 2024-05-10T10:46:00.818 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.815+0000 7f581b74c700 1 Processor -- start 2024-05-10T10:46:00.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.816+0000 7f581b74c700 1 -- start start 2024-05-10T10:46:00.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.816+0000 7f581b74c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5814103220 0x7f581419e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:00.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.816+0000 7f581b74c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f581419edd0 0x7f5814198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:00.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.816+0000 7f581b74c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f581410d5e0 con 0x7f581419edd0 2024-05-10T10:46:00.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.816+0000 7f581b74c700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f581410d460 con 0x7f5814103220 2024-05-10T10:46:00.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.816+0000 7f58194e8700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5814103220 0x7f581419e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:00.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.816+0000 7f58194e8700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5814103220 0x7f581419e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:47908/0 (socket says 172.21.15.196:47908) 2024-05-10T10:46:00.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.816+0000 7f58194e8700 1 -- 172.21.15.196:0/277739567 learned_addr learned my addr 172.21.15.196:0/277739567 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-10T10:46:00.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.816+0000 7f58194e8700 1 -- 172.21.15.196:0/277739567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5814103220 msgr2=0x7f581419e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-10T10:46:00.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.816+0000 7f58194e8700 1 -- 172.21.15.196:0/277739567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5814103220 msgr2=0x7f581419e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-10T10:46:00.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.816+0000 7f58194e8700 1 --2- 172.21.15.196:0/277739567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5814103220 0x7f581419e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T10:46:00.819 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.816+0000 7f58194e8700 1 --2- 172.21.15.196:0/277739567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5814103220 0x7f581419e890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T10:46:00.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.816+0000 7f5818ce7700 1 --2- 172.21.15.196:0/277739567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f581419edd0 0x7f5814198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:00.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.816+0000 7f5818ce7700 1 -- 172.21.15.196:0/277739567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5814103220 msgr2=0x7f581419e890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T10:46:00.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.816+0000 7f5818ce7700 1 --2- 172.21.15.196:0/277739567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5814103220 0x7f581419e890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:00.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.816+0000 7f5818ce7700 1 -- 172.21.15.196:0/277739567 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581419f410 con 0x7f581419edd0 2024-05-10T10:46:00.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.817+0000 7f5818ce7700 1 --2- 172.21.15.196:0/277739567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f581419edd0 0x7f5814198af0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f581000b4d0 tx=0x7f581000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:46:00.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.817+0000 7f580a7fc700 1 -- 172.21.15.196:0/277739567 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5810011630 con 0x7f581419edd0 2024-05-10T10:46:00.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.817+0000 7f581b74c700 1 -- 172.21.15.196:0/277739567 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5814199030 con 0x7f581419edd0 2024-05-10T10:46:00.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.817+0000 7f581b74c700 1 -- 172.21.15.196:0/277739567 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58141995c0 con 0x7f581419edd0 2024-05-10T10:46:00.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.817+0000 7f580a7fc700 1 -- 172.21.15.196:0/277739567 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5810011ca0 con 0x7f581419edd0 2024-05-10T10:46:00.820 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.817+0000 7f580a7fc700 1 -- 172.21.15.196:0/277739567 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5810010e50 con 0x7f581419edd0 2024-05-10T10:46:00.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.818+0000 7f581b74c700 1 -- 172.21.15.196:0/277739567 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5814199930 con 0x7f581419edd0 2024-05-10T10:46:00.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.818+0000 7f580a7fc700 1 -- 172.21.15.196:0/277739567 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f5810018020 con 0x7f581419edd0 2024-05-10T10:46:00.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.818+0000 7f580a7fc700 1 --2- 172.21.15.196:0/277739567 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f580003e4a0 0x7f5800040960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:00.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.818+0000 7f580a7fc700 1 -- 172.21.15.196:0/277739567 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f58100521e0 con 0x7f581419edd0 2024-05-10T10:46:00.821 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.818+0000 7f58194e8700 1 --2- 172.21.15.196:0/277739567 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f580003e4a0 0x7f5800040960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:00.822 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.819+0000 7f58194e8700 1 --2- 172.21.15.196:0/277739567 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f580003e4a0 0x7f5800040960 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f580400b5c0 tx=0x7f580401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:46:00.825 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:00.824+0000 7f580a7fc700 1 -- 172.21.15.196:0/277739567 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f581001f020 con 0x7f581419edd0 2024-05-10T10:46:01.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:01.107+0000 7f581b74c700 1 -- 172.21.15.196:0/277739567 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f581419a020 con 0x7f581419edd0 2024-05-10T10:46:01.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:01.108+0000 7f580a7fc700 1 -- 172.21.15.196:0/277739567 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f581000ddf0 con 0x7f581419edd0 2024-05-10T10:46:01.109 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-10T10:46:01.109 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":2,"fsid":"0ba8a8e4-0eba-11ef-bc98-c7b262605968","modified":"2024-05-10T10:45:52.330773Z","created":"2024-05-10T10:44:10.080994Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-10T10:46:01.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:01.110+0000 7f581b74c700 1 -- 172.21.15.196:0/277739567 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f580003e4a0 msgr2=0x7f5800040960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:01.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:01.110+0000 7f581b74c700 1 --2- 172.21.15.196:0/277739567 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f580003e4a0 0x7f5800040960 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f580400b5c0 tx=0x7f580401a040 comp rx=0 tx=0).stop 2024-05-10T10:46:01.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:01.110+0000 7f581b74c700 1 -- 172.21.15.196:0/277739567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f581419edd0 msgr2=0x7f5814198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:01.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:01.110+0000 7f581b74c700 1 --2- 172.21.15.196:0/277739567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f581419edd0 0x7f5814198af0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f581000b4d0 tx=0x7f581000b890 comp rx=0 tx=0).stop 2024-05-10T10:46:01.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:01.110+0000 7f581b74c700 1 -- 172.21.15.196:0/277739567 shutdown_connections 2024-05-10T10:46:01.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:01.110+0000 7f581b74c700 1 --2- 172.21.15.196:0/277739567 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f580003e4a0 0x7f5800040960 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:01.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:01.110+0000 7f581b74c700 1 --2- 172.21.15.196:0/277739567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5814103220 0x7f581419e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:01.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:01.110+0000 7f581b74c700 1 --2- 172.21.15.196:0/277739567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f581419edd0 0x7f5814198af0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:01.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:01.110+0000 7f581b74c700 1 -- 172.21.15.196:0/277739567 >> 172.21.15.196:0/277739567 conn(0x7f58140feab0 msgr2=0x7f5814104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:46:01.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:01.110+0000 7f581b74c700 1 -- 172.21.15.196:0/277739567 shutdown_connections 2024-05-10T10:46:01.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:01.110+0000 7f581b74c700 1 -- 172.21.15.196:0/277739567 wait complete. 2024-05-10T10:46:01.113 INFO:teuthology.orchestra.run.smithi196.stderr:dumped monmap epoch 2 2024-05-10T10:46:01.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:01 smithi184 systemd[1]: Started Ceph mon.b for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:46:02.738 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-10T10:46:02.738 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-10T10:46:02.983 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T10:46:06.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T10:46:06.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:06.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: mon.a calling monitor election 2024-05-10T10:46:06.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: mon.c calling monitor election 2024-05-10T10:46:06.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:46:06.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:06.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:06.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:06.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: mon.b calling monitor election 2024-05-10T10:46:06.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:06.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:06.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:06.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:06.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-10T10:46:06.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: monmap epoch 3 2024-05-10T10:46:06.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:46:06.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: last_changed 2024-05-10T10:46:01.281714+0000 2024-05-10T10:46:06.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: created 2024-05-10T10:44:10.080994+0000 2024-05-10T10:46:06.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: min_mon_release 19 (squid) 2024-05-10T10:46:06.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: election_strategy: 1 2024-05-10T10:46:06.642 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: 0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-05-10T10:46:06.642 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-05-10T10:46:06.642 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: 2: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-05-10T10:46:06.642 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: fsmap 2024-05-10T10:46:06.642 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: osdmap e4: 0 total, 0 up, 0 in 2024-05-10T10:46:06.642 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: mgrmap e13: x(active, since 58s) 2024-05-10T10:46:06.642 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: overall HEALTH_OK 2024-05-10T10:46:06.642 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:06.642 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:06.642 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:06.642 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:06.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T10:46:06.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:06.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: mon.a calling monitor election 2024-05-10T10:46:06.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: mon.c calling monitor election 2024-05-10T10:46:06.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:46:06.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:06.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:06.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:06.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: mon.b calling monitor election 2024-05-10T10:46:06.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:06.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:06.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:06.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:06.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-10T10:46:06.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: monmap epoch 3 2024-05-10T10:46:06.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:46:06.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: last_changed 2024-05-10T10:46:01.281714+0000 2024-05-10T10:46:06.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: created 2024-05-10T10:44:10.080994+0000 2024-05-10T10:46:06.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: min_mon_release 19 (squid) 2024-05-10T10:46:06.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: election_strategy: 1 2024-05-10T10:46:06.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: 0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-05-10T10:46:06.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-05-10T10:46:06.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: 2: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-05-10T10:46:06.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: fsmap 2024-05-10T10:46:06.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: osdmap e4: 0 total, 0 up, 0 in 2024-05-10T10:46:06.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: mgrmap e13: x(active, since 58s) 2024-05-10T10:46:06.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: overall HEALTH_OK 2024-05-10T10:46:06.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:06.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:06.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:06.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:06.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T10:46:06.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:06.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: mon.a calling monitor election 2024-05-10T10:46:06.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: mon.c calling monitor election 2024-05-10T10:46:06.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:46:06.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:06.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:06.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:06.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: mon.b calling monitor election 2024-05-10T10:46:06.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:06.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:06.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:06.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:06.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-10T10:46:06.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: monmap epoch 3 2024-05-10T10:46:06.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:46:06.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: last_changed 2024-05-10T10:46:01.281714+0000 2024-05-10T10:46:06.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: created 2024-05-10T10:44:10.080994+0000 2024-05-10T10:46:06.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: min_mon_release 19 (squid) 2024-05-10T10:46:06.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: election_strategy: 1 2024-05-10T10:46:06.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: 0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-05-10T10:46:06.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: 1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.c 2024-05-10T10:46:06.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: 2: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2024-05-10T10:46:06.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: fsmap 2024-05-10T10:46:06.816 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: osdmap e4: 0 total, 0 up, 0 in 2024-05-10T10:46:06.816 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: mgrmap e13: x(active, since 58s) 2024-05-10T10:46:06.816 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: overall HEALTH_OK 2024-05-10T10:46:06.816 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:06.816 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:06.816 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:06.816 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:07.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.358+0000 7f4fa9a78700 1 -- 172.21.15.196:0/2759664386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f8c0035c0 msgr2=0x7f4f8c005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:07.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.358+0000 7f4fa9a78700 1 --2- 172.21.15.196:0/2759664386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f8c0035c0 0x7f4f8c005a50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4fa406b790 tx=0x7f4f9400feb0 comp rx=0 tx=0).stop 2024-05-10T10:46:07.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.358+0000 7f4fa9a78700 1 -- 172.21.15.196:0/2759664386 shutdown_connections 2024-05-10T10:46:07.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.358+0000 7f4fa9a78700 1 --2- 172.21.15.196:0/2759664386 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f8c0035c0 0x7f4f8c005a50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:07.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.358+0000 7f4fa9a78700 1 -- 172.21.15.196:0/2759664386 >> 172.21.15.196:0/2759664386 conn(0x7f4fa40fd9e0 msgr2=0x7f4fa40ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:46:07.360 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.358+0000 7f4fa9a78700 1 -- 172.21.15.196:0/2759664386 shutdown_connections 2024-05-10T10:46:07.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.358+0000 7f4fa9a78700 1 -- 172.21.15.196:0/2759664386 wait complete. 2024-05-10T10:46:07.361 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.359+0000 7f4fa9a78700 1 Processor -- start 2024-05-10T10:46:07.363 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.359+0000 7f4fa9a78700 1 -- start start 2024-05-10T10:46:07.363 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.359+0000 7f4fa9a78700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f8c0035c0 0x7f4fa419e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:07.363 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.359+0000 7f4fa9a78700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fa419ee80 0x7f4fa4198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:07.363 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.359+0000 7f4fa9a78700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fa4199040 0x7f4fa41994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:07.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.359+0000 7f4fa9a78700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa410b050 con 0x7f4fa419ee80 2024-05-10T10:46:07.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.359+0000 7f4fa9a78700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa410aed0 con 0x7f4f8c0035c0 2024-05-10T10:46:07.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.359+0000 7f4fa9a78700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa410b1d0 con 0x7f4fa4199040 2024-05-10T10:46:07.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.359+0000 7f4fa3fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fa4199040 0x7f4fa41994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:07.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.360+0000 7f4fa3fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fa4199040 0x7f4fa41994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:47922/0 (socket says 172.21.15.196:47922) 2024-05-10T10:46:07.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.360+0000 7f4fa3fff700 1 -- 172.21.15.196:0/573104500 learned_addr learned my addr 172.21.15.196:0/573104500 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-10T10:46:07.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.360+0000 7f4fa37fe700 1 --2- 172.21.15.196:0/573104500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f8c0035c0 0x7f4fa419e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:07.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.360+0000 7f4fa2ffd700 1 --2- 172.21.15.196:0/573104500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fa419ee80 0x7f4fa4198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:07.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.360+0000 7f4fa3fff700 1 -- 172.21.15.196:0/573104500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f8c0035c0 msgr2=0x7f4fa419e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:07.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.360+0000 7f4fa3fff700 1 --2- 172.21.15.196:0/573104500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f8c0035c0 0x7f4fa419e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:07.364 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.360+0000 7f4fa3fff700 1 -- 172.21.15.196:0/573104500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fa419ee80 msgr2=0x7f4fa4198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:07.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.360+0000 7f4fa3fff700 1 --2- 172.21.15.196:0/573104500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fa419ee80 0x7f4fa4198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:07.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.360+0000 7f4fa3fff700 1 -- 172.21.15.196:0/573104500 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa41a5810 con 0x7f4fa4199040 2024-05-10T10:46:07.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.360+0000 7f4fa3fff700 1 --2- 172.21.15.196:0/573104500 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fa4199040 0x7f4fa41994f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00ba50 tx=0x7f4f9c00bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:46:07.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.361+0000 7f4fa0ff9700 1 -- 172.21.15.196:0/573104500 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c019070 con 0x7f4fa4199040 2024-05-10T10:46:07.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.361+0000 7f4fa0ff9700 1 -- 172.21.15.196:0/573104500 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4f9c00ce00 con 0x7f4fa4199040 2024-05-10T10:46:07.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.361+0000 7f4fa9a78700 1 -- 172.21.15.196:0/573104500 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa41a5a40 con 0x7f4fa4199040 2024-05-10T10:46:07.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.361+0000 7f4fa0ff9700 1 -- 172.21.15.196:0/573104500 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c007350 con 0x7f4fa4199040 2024-05-10T10:46:07.365 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.362+0000 7f4fa9a78700 1 -- 172.21.15.196:0/573104500 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa41a5f80 con 0x7f4fa4199040 2024-05-10T10:46:07.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.362+0000 7f4fa0ff9700 1 -- 172.21.15.196:0/573104500 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f4f9c01c070 con 0x7f4fa4199040 2024-05-10T10:46:07.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.362+0000 7f4fa9a78700 1 -- 172.21.15.196:0/573104500 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fa4064b00 con 0x7f4fa4199040 2024-05-10T10:46:07.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.363+0000 7f4fa0ff9700 1 --2- 172.21.15.196:0/573104500 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4f9003e9a0 0x7f4f90040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:07.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.363+0000 7f4fa0ff9700 1 -- 172.21.15.196:0/573104500 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4f9c051df0 con 0x7f4fa4199040 2024-05-10T10:46:07.366 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.363+0000 7f4fa37fe700 1 --2- 172.21.15.196:0/573104500 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4f9003e9a0 0x7f4f90040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:07.367 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.363+0000 7f4fa37fe700 1 --2- 172.21.15.196:0/573104500 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4f9003e9a0 0x7f4f90040e60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400f8d0 tx=0x7f4f94001e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:46:07.369 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.368+0000 7f4fa0ff9700 1 -- 172.21.15.196:0/573104500 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4f9c017120 con 0x7f4fa4199040 2024-05-10T10:46:07.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:07 smithi196 ceph-mon[34872]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:07.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:07 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:46:07.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:07 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:07.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:07 smithi184 ceph-mon[34585]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:07.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:07 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:46:07.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:07 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:07.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.662+0000 7f4fa9a78700 1 -- 172.21.15.196:0/573104500 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f4fa41a6310 con 0x7f4fa4199040 2024-05-10T10:46:07.664 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.663+0000 7f4fa0ff9700 1 -- 172.21.15.196:0/573104500 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1289 (secure 0 0 0) 0x7f4f9c014440 con 0x7f4fa4199040 2024-05-10T10:46:07.664 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-05-10T10:46:07.664 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":3,"fsid":"0ba8a8e4-0eba-11ef-bc98-c7b262605968","modified":"2024-05-10T10:46:01.281714Z","created":"2024-05-10T10:44:10.080994Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:3300","nonce":0},{"type":"v1","addr":"172.21.15.107:6789","nonce":0}]},"addr":"172.21.15.107:6789/0","public_addr":"172.21.15.107:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:3300","nonce":0},{"type":"v1","addr":"172.21.15.196:6789","nonce":0}]},"addr":"172.21.15.196:6789/0","public_addr":"172.21.15.196:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:3300","nonce":0},{"type":"v1","addr":"172.21.15.184:6789","nonce":0}]},"addr":"172.21.15.184:6789/0","public_addr":"172.21.15.184:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-10T10:46:07.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.665+0000 7f4fa9a78700 1 -- 172.21.15.196:0/573104500 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4f9003e9a0 msgr2=0x7f4f90040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:07.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.665+0000 7f4fa9a78700 1 --2- 172.21.15.196:0/573104500 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4f9003e9a0 0x7f4f90040e60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400f8d0 tx=0x7f4f94001e50 comp rx=0 tx=0).stop 2024-05-10T10:46:07.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.665+0000 7f4fa9a78700 1 -- 172.21.15.196:0/573104500 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fa4199040 msgr2=0x7f4fa41994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:07.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.665+0000 7f4fa9a78700 1 --2- 172.21.15.196:0/573104500 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fa4199040 0x7f4fa41994f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00ba50 tx=0x7f4f9c00bd60 comp rx=0 tx=0).stop 2024-05-10T10:46:07.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.665+0000 7f4fa9a78700 1 -- 172.21.15.196:0/573104500 shutdown_connections 2024-05-10T10:46:07.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.665+0000 7f4fa9a78700 1 --2- 172.21.15.196:0/573104500 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4f9003e9a0 0x7f4f90040e60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:07.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.665+0000 7f4fa9a78700 1 --2- 172.21.15.196:0/573104500 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4fa4199040 0x7f4fa41994f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:07.667 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.665+0000 7f4fa9a78700 1 --2- 172.21.15.196:0/573104500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f8c0035c0 0x7f4fa419e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:07.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.665+0000 7f4fa9a78700 1 --2- 172.21.15.196:0/573104500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4fa419ee80 0x7f4fa4198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:07.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.665+0000 7f4fa9a78700 1 -- 172.21.15.196:0/573104500 >> 172.21.15.196:0/573104500 conn(0x7f4fa40fd9e0 msgr2=0x7f4fa40ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:46:07.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.665+0000 7f4fa9a78700 1 -- 172.21.15.196:0/573104500 shutdown_connections 2024-05-10T10:46:07.668 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:07.665+0000 7f4fa9a78700 1 -- 172.21.15.196:0/573104500 wait complete. 2024-05-10T10:46:07.668 INFO:teuthology.orchestra.run.smithi196.stderr:dumped monmap epoch 3 2024-05-10T10:46:07.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:07 smithi107 ceph-mon[30373]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:07.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:46:07.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:46:08.346 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-10T10:46:08.346 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph config generate-minimal-conf 2024-05-10T10:46:08.596 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:46:08.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:08.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='client.? 172.21.15.196:0/573104500' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-10T10:46:08.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:08.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:46:08.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: Updating smithi107:/etc/ceph/ceph.conf 2024-05-10T10:46:08.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: Updating smithi184:/etc/ceph/ceph.conf 2024-05-10T10:46:08.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: Updating smithi196:/etc/ceph/ceph.conf 2024-05-10T10:46:08.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: Updating smithi184:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T10:46:08.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: Updating smithi107:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T10:46:08.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: Updating smithi196:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T10:46:08.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T10:46:08.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-10T10:46:08.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:08.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:08.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='client.? 172.21.15.196:0/573104500' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-10T10:46:08.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:08.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:46:08.891 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: Updating smithi107:/etc/ceph/ceph.conf 2024-05-10T10:46:08.891 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: Updating smithi184:/etc/ceph/ceph.conf 2024-05-10T10:46:08.891 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: Updating smithi196:/etc/ceph/ceph.conf 2024-05-10T10:46:08.891 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: Updating smithi184:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T10:46:08.891 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: Updating smithi107:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T10:46:08.891 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: Updating smithi196:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T10:46:08.891 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.891 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.891 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.891 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.891 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.891 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.891 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.892 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.892 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.892 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.892 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:08.892 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T10:46:08.892 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-10T10:46:08.892 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:09.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:09.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:09.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='client.? 172.21.15.196:0/573104500' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-10T10:46:09.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:09.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:09.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:09.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:09.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:09.065 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:46:09.065 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: Updating smithi107:/etc/ceph/ceph.conf 2024-05-10T10:46:09.065 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: Updating smithi184:/etc/ceph/ceph.conf 2024-05-10T10:46:09.065 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: Updating smithi196:/etc/ceph/ceph.conf 2024-05-10T10:46:09.065 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: Updating smithi184:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T10:46:09.065 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: Updating smithi107:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T10:46:09.065 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: Updating smithi196:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-10T10:46:09.065 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:09.065 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:09.065 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:09.065 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:09.066 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:09.066 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:09.066 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:09.066 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:09.066 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:09.066 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:09.066 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:09.066 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T10:46:09.066 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-10T10:46:09.066 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:09.834 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:09 smithi107 ceph-mon[30373]: Reconfiguring mon.a (unknown last config time)... 2024-05-10T10:46:09.834 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:09 smithi107 ceph-mon[30373]: Reconfiguring daemon mon.a on smithi107 2024-05-10T10:46:09.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:09 smithi184 ceph-mon[34585]: Reconfiguring mon.a (unknown last config time)... 2024-05-10T10:46:09.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:09 smithi184 ceph-mon[34585]: Reconfiguring daemon mon.a on smithi107 2024-05-10T10:46:10.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:09 smithi196 ceph-mon[34872]: Reconfiguring mon.a (unknown last config time)... 2024-05-10T10:46:10.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:09 smithi196 ceph-mon[34872]: Reconfiguring daemon mon.a on smithi107 2024-05-10T10:46:10.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.170+0000 7ff276da4700 1 -- 172.21.15.107:0/1868057413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff270102010 msgr2=0x7ff2701023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:10.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.170+0000 7ff276da4700 1 --2- 172.21.15.107:0/1868057413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff270102010 0x7ff2701023f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff258009910 tx=0x7ff258009c20 comp rx=0 tx=0).stop 2024-05-10T10:46:10.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.170+0000 7ff276da4700 1 -- 172.21.15.107:0/1868057413 shutdown_connections 2024-05-10T10:46:10.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.170+0000 7ff276da4700 1 --2- 172.21.15.107:0/1868057413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff270102010 0x7ff2701023f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:10.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.170+0000 7ff276da4700 1 -- 172.21.15.107:0/1868057413 >> 172.21.15.107:0/1868057413 conn(0x7ff2700fd8a0 msgr2=0x7ff2700ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:46:10.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.170+0000 7ff276da4700 1 -- 172.21.15.107:0/1868057413 shutdown_connections 2024-05-10T10:46:10.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.170+0000 7ff276da4700 1 -- 172.21.15.107:0/1868057413 wait complete. 2024-05-10T10:46:10.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.170+0000 7ff276da4700 1 Processor -- start 2024-05-10T10:46:10.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.170+0000 7ff276da4700 1 -- start start 2024-05-10T10:46:10.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.171+0000 7ff276da4700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff270102010 0x7ff270199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:10.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.171+0000 7ff276da4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff27019a060 0x7ff27019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:10.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.171+0000 7ff276da4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2701a2b90 0x7ff2701a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:10.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.171+0000 7ff276da4700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff27010c3d0 con 0x7ff27019a060 2024-05-10T10:46:10.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.171+0000 7ff276da4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff27010c250 con 0x7ff2701a2b90 2024-05-10T10:46:10.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.171+0000 7ff276da4700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff27010c550 con 0x7ff270102010 2024-05-10T10:46:10.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.171+0000 7ff26ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff27019a060 0x7ff27019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:10.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.171+0000 7ff26ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff27019a060 0x7ff27019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53240/0 (socket says 172.21.15.107:53240) 2024-05-10T10:46:10.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.171+0000 7ff26ffff700 1 -- 172.21.15.107:0/763519700 learned_addr learned my addr 172.21.15.107:0/763519700 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:46:10.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.171+0000 7ff26ffff700 1 -- 172.21.15.107:0/763519700 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff270102010 msgr2=0x7ff270199b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:10.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.171+0000 7ff26ffff700 1 --2- 172.21.15.107:0/763519700 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff270102010 0x7ff270199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:10.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.171+0000 7ff26ffff700 1 -- 172.21.15.107:0/763519700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2701a2b90 msgr2=0x7ff2701a4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:10.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.171+0000 7ff26ffff700 1 --2- 172.21.15.107:0/763519700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2701a2b90 0x7ff2701a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:10.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.171+0000 7ff26ffff700 1 -- 172.21.15.107:0/763519700 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2701a56f0 con 0x7ff27019a060 2024-05-10T10:46:10.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.171+0000 7ff26ffff700 1 --2- 172.21.15.107:0/763519700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff27019a060 0x7ff27019a4e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff26000b780 tx=0x7ff26000bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:46:10.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.171+0000 7ff26dffb700 1 -- 172.21.15.107:0/763519700 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260004230 con 0x7ff27019a060 2024-05-10T10:46:10.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.171+0000 7ff26dffb700 1 -- 172.21.15.107:0/763519700 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff2600043d0 con 0x7ff27019a060 2024-05-10T10:46:10.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.171+0000 7ff276da4700 1 -- 172.21.15.107:0/763519700 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2701a59e0 con 0x7ff27019a060 2024-05-10T10:46:10.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.171+0000 7ff26dffb700 1 -- 172.21.15.107:0/763519700 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260011c30 con 0x7ff27019a060 2024-05-10T10:46:10.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.172+0000 7ff276da4700 1 -- 172.21.15.107:0/763519700 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2701a5f70 con 0x7ff27019a060 2024-05-10T10:46:10.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.172+0000 7ff26dffb700 1 -- 172.21.15.107:0/763519700 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7ff26001a400 con 0x7ff27019a060 2024-05-10T10:46:10.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.173+0000 7ff26dffb700 1 --2- 172.21.15.107:0/763519700 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff25c03e9a0 0x7ff25c040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:10.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.173+0000 7ff276da4700 1 -- 172.21.15.107:0/763519700 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff270064b00 con 0x7ff27019a060 2024-05-10T10:46:10.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.173+0000 7ff26dffb700 1 -- 172.21.15.107:0/763519700 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff2600525b0 con 0x7ff27019a060 2024-05-10T10:46:10.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.173+0000 7ff274b40700 1 --2- 172.21.15.107:0/763519700 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff25c03e9a0 0x7ff25c040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:10.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.173+0000 7ff274b40700 1 --2- 172.21.15.107:0/763519700 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff25c03e9a0 0x7ff25c040e60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff25800b5c0 tx=0x7ff258005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:46:10.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.178+0000 7ff26dffb700 1 -- 172.21.15.107:0/763519700 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff260003c90 con 0x7ff27019a060 2024-05-10T10:46:10.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.386+0000 7ff276da4700 1 -- 172.21.15.107:0/763519700 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7ff2701a6350 con 0x7ff27019a060 2024-05-10T10:46:10.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.386+0000 7ff26dffb700 1 -- 172.21.15.107:0/763519700 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7ff260020740 con 0x7ff27019a060 2024-05-10T10:46:10.388 INFO:teuthology.orchestra.run.smithi107.stdout:# minimal ceph.conf for 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:46:10.388 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2024-05-10T10:46:10.388 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:46:10.388 INFO:teuthology.orchestra.run.smithi107.stdout: mon_host = [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-05-10T10:46:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.389+0000 7ff276da4700 1 -- 172.21.15.107:0/763519700 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff25c03e9a0 msgr2=0x7ff25c040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.389+0000 7ff276da4700 1 --2- 172.21.15.107:0/763519700 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff25c03e9a0 0x7ff25c040e60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff25800b5c0 tx=0x7ff258005dc0 comp rx=0 tx=0).stop 2024-05-10T10:46:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.389+0000 7ff276da4700 1 -- 172.21.15.107:0/763519700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff27019a060 msgr2=0x7ff27019a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.389+0000 7ff276da4700 1 --2- 172.21.15.107:0/763519700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff27019a060 0x7ff27019a4e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff26000b780 tx=0x7ff26000bb40 comp rx=0 tx=0).stop 2024-05-10T10:46:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.389+0000 7ff276da4700 1 -- 172.21.15.107:0/763519700 shutdown_connections 2024-05-10T10:46:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.389+0000 7ff276da4700 1 --2- 172.21.15.107:0/763519700 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff25c03e9a0 0x7ff25c040e60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.389+0000 7ff276da4700 1 --2- 172.21.15.107:0/763519700 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff270102010 0x7ff270199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.389+0000 7ff276da4700 1 --2- 172.21.15.107:0/763519700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2701a2b90 0x7ff2701a4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.389+0000 7ff276da4700 1 --2- 172.21.15.107:0/763519700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff27019a060 0x7ff27019a4e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.389+0000 7ff276da4700 1 -- 172.21.15.107:0/763519700 >> 172.21.15.107:0/763519700 conn(0x7ff2700fd8a0 msgr2=0x7ff2701039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:46:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.389+0000 7ff276da4700 1 -- 172.21.15.107:0/763519700 shutdown_connections 2024-05-10T10:46:10.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:10.390+0000 7ff276da4700 1 -- 172.21.15.107:0/763519700 wait complete. 2024-05-10T10:46:10.842 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:10 smithi107 ceph-mon[30373]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:10.843 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:10 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/763519700' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:10.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:10 smithi184 ceph-mon[34585]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:10.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:10 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/763519700' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:11.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:10 smithi196 ceph-mon[34872]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:11.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:10 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/763519700' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:11.353 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-10T10:46:11.353 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T10:46:11.353 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.conf 2024-05-10T10:46:11.381 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T10:46:11.381 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-10T10:46:11.446 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-10T10:46:11.446 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.conf 2024-05-10T10:46:11.478 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-10T10:46:11.478 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-10T10:46:11.546 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-10T10:46:11.546 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.conf 2024-05-10T10:46:11.577 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-10T10:46:11.577 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-10T10:46:11.645 INFO:tasks.cephadm:Adding mgr.x on smithi107 2024-05-10T10:46:11.646 INFO:tasks.cephadm:Adding mgr.y on smithi184 2024-05-10T10:46:11.646 INFO:tasks.cephadm:Adding mgr.z on smithi196 2024-05-10T10:46:11.646 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch apply mgr '3;smithi107=x;smithi184=y;smithi196=z' 2024-05-10T10:46:11.923 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T10:46:13.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:12 smithi196 ceph-mon[34872]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:13.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:12 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:13.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:12 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:13.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:12 smithi196 ceph-mon[34872]: Reconfiguring mon.b (monmap changed)... 2024-05-10T10:46:13.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:12 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T10:46:13.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:12 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-10T10:46:13.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:12 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:13.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:12 smithi196 ceph-mon[34872]: Reconfiguring daemon mon.b on smithi184 2024-05-10T10:46:13.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:12 smithi184 ceph-mon[34585]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:13.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:12 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:13.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:12 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:13.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:12 smithi184 ceph-mon[34585]: Reconfiguring mon.b (monmap changed)... 2024-05-10T10:46:13.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:12 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T10:46:13.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:12 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-10T10:46:13.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:12 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:13.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:12 smithi184 ceph-mon[34585]: Reconfiguring daemon mon.b on smithi184 2024-05-10T10:46:13.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:12 smithi107 ceph-mon[30373]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:13.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:12 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:13.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:12 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:13.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:12 smithi107 ceph-mon[30373]: Reconfiguring mon.b (monmap changed)... 2024-05-10T10:46:13.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:12 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T10:46:13.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:12 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-10T10:46:13.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:12 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:13.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:12 smithi107 ceph-mon[30373]: Reconfiguring daemon mon.b on smithi184 2024-05-10T10:46:13.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.463+0000 7fb50df08700 1 -- 172.21.15.196:0/612368452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb508101670 msgr2=0x7fb508101a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:13.467 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.463+0000 7fb50df08700 1 --2- 172.21.15.196:0/612368452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb508101670 0x7fb508101a90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8009910 tx=0x7fb4f8009c20 comp rx=0 tx=0).stop 2024-05-10T10:46:13.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.463+0000 7fb50df08700 1 -- 172.21.15.196:0/612368452 shutdown_connections 2024-05-10T10:46:13.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.463+0000 7fb50df08700 1 --2- 172.21.15.196:0/612368452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb508101670 0x7fb508101a90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:13.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.463+0000 7fb50df08700 1 -- 172.21.15.196:0/612368452 >> 172.21.15.196:0/612368452 conn(0x7fb5080fcc10 msgr2=0x7fb5080ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:46:13.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.464+0000 7fb50df08700 1 -- 172.21.15.196:0/612368452 shutdown_connections 2024-05-10T10:46:13.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.464+0000 7fb50df08700 1 -- 172.21.15.196:0/612368452 wait complete. 2024-05-10T10:46:13.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.464+0000 7fb50df08700 1 Processor -- start 2024-05-10T10:46:13.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.464+0000 7fb50df08700 1 -- start start 2024-05-10T10:46:13.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.464+0000 7fb50df08700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb508101670 0x7fb5080fdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:13.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.464+0000 7fb50df08700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb50819b5d0 0x7fb50819d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:13.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.464+0000 7fb50df08700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb50819df50 0x7fb5081a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:13.468 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.464+0000 7fb50df08700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb5081076a0 con 0x7fb50819df50 2024-05-10T10:46:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.464+0000 7fb50df08700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb508107520 con 0x7fb50819b5d0 2024-05-10T10:46:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.464+0000 7fb50df08700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb508107820 con 0x7fb508101670 2024-05-10T10:46:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.465+0000 7fb5077fe700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb508101670 0x7fb5080fdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.465+0000 7fb5077fe700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb508101670 0x7fb5080fdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:59428/0 (socket says 172.21.15.196:59428) 2024-05-10T10:46:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.465+0000 7fb5077fe700 1 -- 172.21.15.196:0/1546034508 learned_addr learned my addr 172.21.15.196:0/1546034508 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-10T10:46:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.465+0000 7fb507fff700 1 --2- 172.21.15.196:0/1546034508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb50819df50 0x7fb5081a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.465+0000 7fb506ffd700 1 --2- 172.21.15.196:0/1546034508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb50819b5d0 0x7fb50819d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.465+0000 7fb5077fe700 1 -- 172.21.15.196:0/1546034508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb50819b5d0 msgr2=0x7fb50819d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:13.469 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.465+0000 7fb5077fe700 1 --2- 172.21.15.196:0/1546034508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb50819b5d0 0x7fb50819d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:13.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.465+0000 7fb5077fe700 1 -- 172.21.15.196:0/1546034508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb50819df50 msgr2=0x7fb5081a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:13.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.465+0000 7fb5077fe700 1 --2- 172.21.15.196:0/1546034508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb50819df50 0x7fb5081a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:13.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.465+0000 7fb5077fe700 1 -- 172.21.15.196:0/1546034508 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5081a0cb0 con 0x7fb508101670 2024-05-10T10:46:13.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.465+0000 7fb5077fe700 1 --2- 172.21.15.196:0/1546034508 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb508101670 0x7fb5080fdba0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8000c00 tx=0x7fb4f8005000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:46:13.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.465+0000 7fb504ff9700 1 -- 172.21.15.196:0/1546034508 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8027070 con 0x7fb508101670 2024-05-10T10:46:13.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.465+0000 7fb504ff9700 1 -- 172.21.15.196:0/1546034508 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb4f8022470 con 0x7fb508101670 2024-05-10T10:46:13.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.465+0000 7fb50df08700 1 -- 172.21.15.196:0/1546034508 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5081a0f40 con 0x7fb508101670 2024-05-10T10:46:13.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.465+0000 7fb504ff9700 1 -- 172.21.15.196:0/1546034508 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f800f6a0 con 0x7fb508101670 2024-05-10T10:46:13.470 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.465+0000 7fb50df08700 1 -- 172.21.15.196:0/1546034508 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5081a1420 con 0x7fb508101670 2024-05-10T10:46:13.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.466+0000 7fb504ff9700 1 -- 172.21.15.196:0/1546034508 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7fb4f802a070 con 0x7fb508101670 2024-05-10T10:46:13.471 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.467+0000 7fb50df08700 1 -- 172.21.15.196:0/1546034508 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb508064b00 con 0x7fb508101670 2024-05-10T10:46:13.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.467+0000 7fb504ff9700 1 --2- 172.21.15.196:0/1546034508 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4f003e9a0 0x7fb4f0040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:13.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.467+0000 7fb504ff9700 1 -- 172.21.15.196:0/1546034508 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb4f8053780 con 0x7fb508101670 2024-05-10T10:46:13.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.467+0000 7fb506ffd700 1 --2- 172.21.15.196:0/1546034508 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4f003e9a0 0x7fb4f0040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:13.472 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.467+0000 7fb506ffd700 1 --2- 172.21.15.196:0/1546034508 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4f003e9a0 0x7fb4f0040e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb5080fe120 tx=0x7fb4fc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:46:13.473 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.472+0000 7fb504ff9700 1 -- 172.21.15.196:0/1546034508 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb4f8013070 con 0x7fb508101670 2024-05-10T10:46:13.699 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.698+0000 7fb50df08700 1 -- 172.21.15.196:0/1546034508 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi107=x;smithi184=y;smithi196=z", "target": ["mon-mgr", ""]}) -- 0x7fb5080fe980 con 0x7fb4f003e9a0 2024-05-10T10:46:13.706 INFO:teuthology.orchestra.run.smithi196.stdout:Scheduled mgr update... 2024-05-10T10:46:13.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.704+0000 7fb504ff9700 1 -- 172.21.15.196:0/1546034508 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fb5080fe980 con 0x7fb4f003e9a0 2024-05-10T10:46:13.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.707+0000 7fb50df08700 1 -- 172.21.15.196:0/1546034508 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4f003e9a0 msgr2=0x7fb4f0040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:13.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.707+0000 7fb50df08700 1 --2- 172.21.15.196:0/1546034508 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4f003e9a0 0x7fb4f0040e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb5080fe120 tx=0x7fb4fc008040 comp rx=0 tx=0).stop 2024-05-10T10:46:13.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.707+0000 7fb50df08700 1 -- 172.21.15.196:0/1546034508 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb508101670 msgr2=0x7fb5080fdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:13.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.707+0000 7fb50df08700 1 --2- 172.21.15.196:0/1546034508 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb508101670 0x7fb5080fdba0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8000c00 tx=0x7fb4f8005000 comp rx=0 tx=0).stop 2024-05-10T10:46:13.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.707+0000 7fb50df08700 1 -- 172.21.15.196:0/1546034508 shutdown_connections 2024-05-10T10:46:13.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.707+0000 7fb50df08700 1 --2- 172.21.15.196:0/1546034508 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4f003e9a0 0x7fb4f0040e60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:13.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.707+0000 7fb50df08700 1 --2- 172.21.15.196:0/1546034508 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb508101670 0x7fb5080fdba0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:13.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.707+0000 7fb50df08700 1 --2- 172.21.15.196:0/1546034508 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb50819df50 0x7fb5081a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:13.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.707+0000 7fb50df08700 1 --2- 172.21.15.196:0/1546034508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb50819b5d0 0x7fb50819d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:13.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.707+0000 7fb50df08700 1 -- 172.21.15.196:0/1546034508 >> 172.21.15.196:0/1546034508 conn(0x7fb5080fcc10 msgr2=0x7fb5080fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:46:13.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.707+0000 7fb50df08700 1 -- 172.21.15.196:0/1546034508 shutdown_connections 2024-05-10T10:46:13.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:46:13.707+0000 7fb50df08700 1 -- 172.21.15.196:0/1546034508 wait complete. 2024-05-10T10:46:14.266 DEBUG:teuthology.orchestra.run.smithi184:mgr.y> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mgr.y.service 2024-05-10T10:46:14.269 DEBUG:teuthology.orchestra.run.smithi196:mgr.z> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mgr.z.service 2024-05-10T10:46:14.271 INFO:tasks.cephadm:Deploying OSDs... 2024-05-10T10:46:14.271 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T10:46:14.271 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T10:46:14.291 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T10:46:14.291 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-05-10T10:46:14.349 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T10:46:14.349 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T10:46:14.349 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-05-10T10:46:14.349 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T10:46:14.350 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T10:46:14.350 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-10 10:45:20.355528230 +0000 2024-05-10T10:46:14.350 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-10 10:40:09.992459598 +0000 2024-05-10T10:46:14.350 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-10 10:40:09.992459598 +0000 2024-05-10T10:46:14.350 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-05-10 10:40:09.992459598 +0000 2024-05-10T10:46:14.351 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T10:46:14.416 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-10T10:46:14.416 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-10T10:46:14.416 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000199361 s, 2.6 MB/s 2024-05-10T10:46:14.417 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T10:46:14.476 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-05-10T10:46:14.490 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:14 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:14.490 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:14 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:14.490 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:14 smithi196 ceph-mon[34872]: Reconfiguring mon.c (monmap changed)... 2024-05-10T10:46:14.490 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:14 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T10:46:14.490 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:14 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-10T10:46:14.490 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:14 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:14.491 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:14 smithi196 ceph-mon[34872]: Reconfiguring daemon mon.c on smithi196 2024-05-10T10:46:14.491 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:14 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T10:46:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T10:46:14.532 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-10T10:46:14.533 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T10:46:14.533 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T10:46:14.533 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-10 10:45:20.389527688 +0000 2024-05-10T10:46:14.533 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-10 10:40:10.344453983 +0000 2024-05-10T10:46:14.533 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-10 10:40:10.344453983 +0000 2024-05-10T10:46:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-05-10 10:40:10.344453983 +0000 2024-05-10T10:46:14.533 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T10:46:14.596 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:14 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:14.596 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:14 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:14.596 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:14 smithi107 ceph-mon[30373]: Reconfiguring mon.c (monmap changed)... 2024-05-10T10:46:14.596 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:14 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T10:46:14.596 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:14 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-10T10:46:14.596 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:14 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:14.596 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:14 smithi107 ceph-mon[30373]: Reconfiguring daemon mon.c on smithi196 2024-05-10T10:46:14.596 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:14 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:14.598 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-10T10:46:14.598 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-10T10:46:14.598 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000218246 s, 2.3 MB/s 2024-05-10T10:46:14.600 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T10:46:14.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:14 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:14.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:14 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:14.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:14 smithi184 ceph-mon[34585]: Reconfiguring mon.c (monmap changed)... 2024-05-10T10:46:14.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:14 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-10T10:46:14.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:14 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-10T10:46:14.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:14 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:14.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:14 smithi184 ceph-mon[34585]: Reconfiguring daemon mon.c on smithi196 2024-05-10T10:46:14.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:14 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:14.657 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-05-10T10:46:14.713 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T10:46:14.713 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T10:46:14.713 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-05-10T10:46:14.713 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T10:46:14.713 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T10:46:14.713 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-10 10:45:20.420527194 +0000 2024-05-10T10:46:14.713 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-10 10:40:10.700448303 +0000 2024-05-10T10:46:14.713 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-10 10:40:10.700448303 +0000 2024-05-10T10:46:14.714 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-05-10 10:40:10.700448303 +0000 2024-05-10T10:46:14.714 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T10:46:14.778 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-10T10:46:14.778 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-10T10:46:14.778 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000272269 s, 1.9 MB/s 2024-05-10T10:46:14.779 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T10:46:14.836 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-05-10T10:46:14.892 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T10:46:14.892 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T10:46:14.892 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-10T10:46:14.892 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T10:46:14.892 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T10:46:14.892 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-10 10:45:20.451526701 +0000 2024-05-10T10:46:14.892 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-10 10:40:11.048442752 +0000 2024-05-10T10:46:14.892 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-10 10:40:11.048442752 +0000 2024-05-10T10:46:14.892 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-05-10 10:40:11.048442752 +0000 2024-05-10T10:46:14.893 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T10:46:14.956 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-10T10:46:14.956 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-10T10:46:14.956 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000216882 s, 2.4 MB/s 2024-05-10T10:46:14.958 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T10:46:15.014 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-10T10:46:15.014 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T10:46:15.033 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T10:46:15.033 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2024-05-10T10:46:15.090 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T10:46:15.091 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T10:46:15.091 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-05-10T10:46:15.091 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T10:46:15.091 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T10:46:15.091 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-05-10 10:46:00.748263580 +0000 2024-05-10T10:46:15.091 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-05-10 10:40:29.192973094 +0000 2024-05-10T10:46:15.091 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-05-10 10:40:29.192973094 +0000 2024-05-10T10:46:15.091 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-05-10 10:40:29.192973094 +0000 2024-05-10T10:46:15.091 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T10:46:15.156 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-05-10T10:46:15.156 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-05-10T10:46:15.157 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000323192 s, 1.6 MB/s 2024-05-10T10:46:15.158 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T10:46:15.215 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2024-05-10T10:46:15.271 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T10:46:15.272 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T10:46:15.272 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-05-10T10:46:15.272 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T10:46:15.272 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T10:46:15.272 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-05-10 10:46:00.748263580 +0000 2024-05-10T10:46:15.272 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-05-10 10:40:29.542965778 +0000 2024-05-10T10:46:15.272 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-05-10 10:40:29.542965778 +0000 2024-05-10T10:46:15.272 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-05-10 10:40:29.542965778 +0000 2024-05-10T10:46:15.272 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T10:46:15.336 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-05-10T10:46:15.336 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-05-10T10:46:15.336 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000198191 s, 2.6 MB/s 2024-05-10T10:46:15.337 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T10:46:15.393 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2024-05-10T10:46:15.449 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T10:46:15.449 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T10:46:15.449 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-10T10:46:15.449 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T10:46:15.449 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T10:46:15.449 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-05-10 10:46:00.749263560 +0000 2024-05-10T10:46:15.449 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-05-10 10:40:29.887958567 +0000 2024-05-10T10:46:15.449 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-05-10 10:40:29.887958567 +0000 2024-05-10T10:46:15.449 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-05-10 10:40:29.887958567 +0000 2024-05-10T10:46:15.450 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T10:46:15.510 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:15 smithi184 ceph-mon[34585]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:15.510 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:15 smithi184 ceph-mon[34585]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi107=x;smithi184=y;smithi196=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:46:15.511 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:15 smithi184 ceph-mon[34585]: Saving service mgr spec with placement smithi107=x;smithi184=y;smithi196=z;count:3 2024-05-10T10:46:15.511 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:15 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:15.511 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:15 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:15.511 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:15 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:46:15.513 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-05-10T10:46:15.513 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-05-10T10:46:15.513 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000262815 s, 1.9 MB/s 2024-05-10T10:46:15.514 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T10:46:15.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:15 smithi196 ceph-mon[34872]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:15.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:15 smithi196 ceph-mon[34872]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi107=x;smithi184=y;smithi196=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:46:15.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:15 smithi196 ceph-mon[34872]: Saving service mgr spec with placement smithi107=x;smithi184=y;smithi196=z;count:3 2024-05-10T10:46:15.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:15 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:15.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:15 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:15.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:15 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:46:15.571 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2024-05-10T10:46:15.626 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T10:46:15.627 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T10:46:15.627 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-05-10T10:46:15.627 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T10:46:15.627 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T10:46:15.627 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-05-10 10:46:00.749263560 +0000 2024-05-10T10:46:15.627 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-05-10 10:40:30.255950875 +0000 2024-05-10T10:46:15.627 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-05-10 10:40:30.255950875 +0000 2024-05-10T10:46:15.627 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-05-10 10:40:30.255950875 +0000 2024-05-10T10:46:15.627 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T10:46:15.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:15 smithi107 ceph-mon[30373]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:15.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:15 smithi107 ceph-mon[30373]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi107=x;smithi184=y;smithi196=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:46:15.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:15 smithi107 ceph-mon[30373]: Saving service mgr spec with placement smithi107=x;smithi184=y;smithi196=z;count:3 2024-05-10T10:46:15.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:15 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:15.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:15 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:15.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:15 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:46:15.690 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-05-10T10:46:15.690 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-05-10T10:46:15.690 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000217947 s, 2.3 MB/s 2024-05-10T10:46:15.691 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T10:46:15.747 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-05-10T10:46:15.747 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T10:46:15.763 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T10:46:15.764 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_1 2024-05-10T10:46:15.820 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T10:46:15.820 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T10:46:15.820 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-05-10T10:46:15.820 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T10:46:15.821 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T10:46:15.821 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-05-10 10:45:51.452693798 +0000 2024-05-10T10:46:15.821 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-05-10 10:40:30.615923850 +0000 2024-05-10T10:46:15.821 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-05-10 10:40:30.615923850 +0000 2024-05-10T10:46:15.821 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-05-10 10:40:30.615923850 +0000 2024-05-10T10:46:15.821 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T10:46:15.883 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-05-10T10:46:15.883 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-05-10T10:46:15.883 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000251287 s, 2.0 MB/s 2024-05-10T10:46:15.884 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T10:46:15.940 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_2 2024-05-10T10:46:15.995 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T10:46:15.996 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T10:46:15.996 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-05-10T10:46:15.996 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T10:46:15.996 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T10:46:15.996 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-05-10 10:45:51.453693778 +0000 2024-05-10T10:46:15.996 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-05-10 10:40:30.954916510 +0000 2024-05-10T10:46:15.996 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-05-10 10:40:30.954916510 +0000 2024-05-10T10:46:15.996 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-05-10 10:40:30.954916510 +0000 2024-05-10T10:46:15.996 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T10:46:16.059 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-05-10T10:46:16.059 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-05-10T10:46:16.059 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000213625 s, 2.4 MB/s 2024-05-10T10:46:16.060 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T10:46:16.115 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_3 2024-05-10T10:46:16.169 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T10:46:16.170 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T10:46:16.170 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-05-10T10:46:16.170 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T10:46:16.170 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T10:46:16.170 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-05-10 10:45:51.453693778 +0000 2024-05-10T10:46:16.170 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-05-10 10:40:31.281909428 +0000 2024-05-10T10:46:16.170 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-05-10 10:40:31.281909428 +0000 2024-05-10T10:46:16.170 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-05-10 10:40:31.281909428 +0000 2024-05-10T10:46:16.170 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T10:46:16.232 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-05-10T10:46:16.233 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-05-10T10:46:16.233 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.00018702 s, 2.7 MB/s 2024-05-10T10:46:16.234 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T10:46:16.291 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_4 2024-05-10T10:46:16.347 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T10:46:16.347 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T10:46:16.347 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-05-10T10:46:16.347 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T10:46:16.348 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T10:46:16.348 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-05-10 10:45:51.453693778 +0000 2024-05-10T10:46:16.348 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-05-10 10:40:31.608902346 +0000 2024-05-10T10:46:16.348 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-05-10 10:40:31.608902346 +0000 2024-05-10T10:46:16.348 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-05-10 10:40:31.608902346 +0000 2024-05-10T10:46:16.348 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T10:46:16.410 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-05-10T10:46:16.411 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-05-10T10:46:16.411 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000209101 s, 2.4 MB/s 2024-05-10T10:46:16.412 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T10:46:16.468 INFO:tasks.cephadm:Deploying osd.0 on smithi107 with /dev/vg_nvme/lv_4... 2024-05-10T10:46:16.468 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-10T10:46:16.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:16 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:16.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:16 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:46:16.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:16 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:16.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:16 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-10T10:46:16.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:16 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-10T10:46:16.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:16 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-10T10:46:16.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:16 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:16.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:16 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:16.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:16 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:46:16.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:16 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:16.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:16 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-10T10:46:16.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:16 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-10T10:46:16.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:16 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-10T10:46:16.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:16 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:16.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:16 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:16.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:16 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:46:16.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:16 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:16.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:16 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-10T10:46:16.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:16 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-10T10:46:16.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:16 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-10T10:46:16.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:16 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:16.700 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:46:17.374 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:17 smithi196 ceph-mon[34872]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:17.374 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:17 smithi196 ceph-mon[34872]: Deploying daemon mgr.z on smithi196 2024-05-10T10:46:17.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:17 smithi107 ceph-mon[30373]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:17.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:17 smithi107 ceph-mon[30373]: Deploying daemon mgr.z on smithi196 2024-05-10T10:46:17.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:17 smithi184 ceph-mon[34585]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:17.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:17 smithi184 ceph-mon[34585]: Deploying daemon mgr.z on smithi196 2024-05-10T10:46:18.277 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:18 smithi196 systemd[1]: Started Ceph mgr.z for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:46:18.563 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:18 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:18.305+0000 7f00c698a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T10:46:18.563 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:18 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:18.499+0000 7f00c698a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T10:46:18.576 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-10T10:46:18.577 INFO:teuthology.orchestra.run.smithi107.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-10T10:46:18.577 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10+0 records in 2024-05-10T10:46:18.577 INFO:teuthology.orchestra.run.smithi107.stderr:10+0 records out 2024-05-10T10:46:18.577 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113722 s, 922 MB/s 2024-05-10T10:46:18.577 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping successful for: 2024-05-10T10:46:18.926 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:18 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:18.604+0000 7f00c698a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T10:46:19.163 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi107:vg_nvme/lv_4 2024-05-10T10:46:19.236 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:18 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:18.924+0000 7f00c698a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T10:46:19.236 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:19 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:19.011+0000 7f00c698a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T10:46:19.402 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:46:19.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:19 smithi107 ceph-mon[30373]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:19.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:19 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:19.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:19 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:19.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:19 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:19.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:19 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-10T10:46:19.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:19 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-10T10:46:19.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:19 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-10T10:46:19.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:19 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:19.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:19 smithi107 ceph-mon[30373]: Deploying daemon mgr.y on smithi184 2024-05-10T10:46:19.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:19 smithi196 ceph-mon[34872]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:19.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:19 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:19.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:19 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:19.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:19 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:19.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:19 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-10T10:46:19.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:19 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-10T10:46:19.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:19 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-10T10:46:19.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:19 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:19.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:19 smithi196 ceph-mon[34872]: Deploying daemon mgr.y on smithi184 2024-05-10T10:46:19.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:19 smithi184 ceph-mon[34585]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:19.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:19 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:19.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:19 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:19.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:19 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:19.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:19 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-10T10:46:19.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:19 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-10T10:46:19.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:19 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-10T10:46:19.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:19 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:19.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:19 smithi184 ceph-mon[34585]: Deploying daemon mgr.y on smithi184 2024-05-10T10:46:20.541 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:20 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:20.206+0000 7f00c698a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T10:46:20.542 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:20 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:20.371+0000 7f00c698a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T10:46:20.542 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:20 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:20.540+0000 7f00c698a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T10:46:20.788 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:20 smithi184 systemd[1]: Started Ceph mgr.y for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:46:20.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.851+0000 7f8c8ce67700 1 -- 172.21.15.107:0/3144591423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c881018a0 msgr2=0x7f8c88101cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:20.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.851+0000 7f8c8ce67700 1 --2- 172.21.15.107:0/3144591423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c881018a0 0x7f8c88101cc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009990 tx=0x7f8c78009ca0 comp rx=0 tx=0).stop 2024-05-10T10:46:20.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.851+0000 7f8c8ce67700 1 -- 172.21.15.107:0/3144591423 shutdown_connections 2024-05-10T10:46:20.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.851+0000 7f8c8ce67700 1 --2- 172.21.15.107:0/3144591423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c88102fd0 0x7f8c88103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:20.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.851+0000 7f8c8ce67700 1 --2- 172.21.15.107:0/3144591423 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c881018a0 0x7f8c88101cc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:20.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.851+0000 7f8c8ce67700 1 --2- 172.21.15.107:0/3144591423 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c88102610 0x7f8c88102a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:20.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.851+0000 7f8c8ce67700 1 -- 172.21.15.107:0/3144591423 >> 172.21.15.107:0/3144591423 conn(0x7f8c880fd200 msgr2=0x7f8c880ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:46:20.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.851+0000 7f8c8ce67700 1 -- 172.21.15.107:0/3144591423 shutdown_connections 2024-05-10T10:46:20.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.851+0000 7f8c8ce67700 1 -- 172.21.15.107:0/3144591423 wait complete. 2024-05-10T10:46:20.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.852+0000 7f8c8ce67700 1 Processor -- start 2024-05-10T10:46:20.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.852+0000 7f8c8ce67700 1 -- start start 2024-05-10T10:46:20.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.852+0000 7f8c8ce67700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c881018a0 0x7f8c8819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:20.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.852+0000 7f8c8ce67700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c88102610 0x7f8c8819bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:20.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.852+0000 7f8c8ce67700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c88102fd0 0x7f8c881a2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:20.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.852+0000 7f8c8ce67700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8c881113b0 con 0x7f8c88102610 2024-05-10T10:46:20.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.852+0000 7f8c8ce67700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8c88111230 con 0x7f8c88102fd0 2024-05-10T10:46:20.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.852+0000 7f8c8ce67700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8c88111530 con 0x7f8c881018a0 2024-05-10T10:46:20.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.852+0000 7f8c85d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c88102610 0x7f8c8819bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:20.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.852+0000 7f8c85d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c88102610 0x7f8c8819bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57120/0 (socket says 172.21.15.107:57120) 2024-05-10T10:46:20.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.852+0000 7f8c8659c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c881018a0 0x7f8c8819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:20.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.852+0000 7f8c85d9b700 1 -- 172.21.15.107:0/650280487 learned_addr learned my addr 172.21.15.107:0/650280487 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:46:20.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.852+0000 7f8c86d9d700 1 --2- 172.21.15.107:0/650280487 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c88102fd0 0x7f8c881a2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:20.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.852+0000 7f8c85d9b700 1 -- 172.21.15.107:0/650280487 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c881018a0 msgr2=0x7f8c8819b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:20.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.852+0000 7f8c85d9b700 1 --2- 172.21.15.107:0/650280487 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c881018a0 0x7f8c8819b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:20.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.852+0000 7f8c85d9b700 1 -- 172.21.15.107:0/650280487 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c88102fd0 msgr2=0x7f8c881a2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:20.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.852+0000 7f8c85d9b700 1 --2- 172.21.15.107:0/650280487 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c88102fd0 0x7f8c881a2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:20.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.852+0000 7f8c85d9b700 1 -- 172.21.15.107:0/650280487 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c881a3600 con 0x7f8c88102610 2024-05-10T10:46:20.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.853+0000 7f8c85d9b700 1 --2- 172.21.15.107:0/650280487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c88102610 0x7f8c8819bee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00d9b0 tx=0x7f8c7c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:46:20.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.853+0000 7f8c777fe700 1 -- 172.21.15.107:0/650280487 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c016070 con 0x7f8c88102610 2024-05-10T10:46:20.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.853+0000 7f8c8ce67700 1 -- 172.21.15.107:0/650280487 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c881a38f0 con 0x7f8c88102610 2024-05-10T10:46:20.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.853+0000 7f8c777fe700 1 -- 172.21.15.107:0/650280487 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8c7c004d00 con 0x7f8c88102610 2024-05-10T10:46:20.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.853+0000 7f8c777fe700 1 -- 172.21.15.107:0/650280487 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0054c0 con 0x7f8c88102610 2024-05-10T10:46:20.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.853+0000 7f8c8ce67700 1 -- 172.21.15.107:0/650280487 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c881a3e80 con 0x7f8c88102610 2024-05-10T10:46:20.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.854+0000 7f8c777fe700 1 -- 172.21.15.107:0/650280487 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 13) ==== 50279+0+0 (secure 0 0 0) 0x7f8c7c00b750 con 0x7f8c88102610 2024-05-10T10:46:20.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.854+0000 7f8c777fe700 1 --2- 172.21.15.107:0/650280487 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8c7003e750 0x7f8c70040c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:20.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.854+0000 7f8c777fe700 1 -- 172.21.15.107:0/650280487 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8c7c052780 con 0x7f8c88102610 2024-05-10T10:46:20.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.854+0000 7f8c8ce67700 1 -- 172.21.15.107:0/650280487 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c8806a190 con 0x7f8c88102610 2024-05-10T10:46:20.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.854+0000 7f8c8659c700 1 --2- 172.21.15.107:0/650280487 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8c7003e750 0x7f8c70040c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:20.857 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.854+0000 7f8c8659c700 1 --2- 172.21.15.107:0/650280487 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8c7003e750 0x7f8c70040c10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800b5c0 tx=0x7f8c78005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:46:20.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:20.859+0000 7f8c777fe700 1 -- 172.21.15.107:0/650280487 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8c7c01f020 con 0x7f8c88102610 2024-05-10T10:46:21.078 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:21.077+0000 7f8c8ce67700 1 -- 172.21.15.107:0/650280487 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f8c8802e8f0 con 0x7f8c7003e750 2024-05-10T10:46:21.091 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:20 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:20.785+0000 7fc3691b9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T10:46:21.091 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:20 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:20.975+0000 7fc3691b9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T10:46:21.091 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:21 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:21.089+0000 7fc3691b9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T10:46:21.136 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:20 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:20.830+0000 7f00c698a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T10:46:21.136 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:20 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:20.921+0000 7f00c698a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T10:46:21.136 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:21 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:21.134+0000 7f00c698a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T10:46:21.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:21 smithi184 ceph-mon[34585]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:21.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:21 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:21.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:21 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:21.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:21 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:21.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:21 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:21.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:21 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:46:21.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:21 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:46:21.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:21 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:46:21.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:21 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:21.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:21 smithi107 ceph-mon[30373]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:21.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:21 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:21.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:21 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:21.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:21 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:21.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:21 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:21.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:21 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:46:21.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:21 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:46:21.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:21 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:46:21.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:21 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:21.563 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:21 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:21.333+0000 7f00c698a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T10:46:21.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:21 smithi196 ceph-mon[34872]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:21.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:21 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:21.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:21 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:21.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:21 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:21.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:21 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:21.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:21 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:46:21.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:21 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:46:21.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:21 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:46:21.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:21 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:21.815 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:21 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:21.437+0000 7fc3691b9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T10:46:21.815 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:21 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:21.539+0000 7fc3691b9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T10:46:22.063 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:21 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:21.976+0000 7f00c698a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T10:46:22.563 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:22.200+0000 7f00c698a200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-10T10:46:22.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:22 smithi196 ceph-mon[34872]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:46:22.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:22 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:22.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:22 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:22.585 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:22 smithi107 ceph-mon[30373]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:46:22.585 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:22 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:22.585 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:22 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:22.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:22 smithi184 ceph-mon[34585]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:46:22.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:22 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:22.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:22 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:23.063 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:22.622+0000 7f00c698a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T10:46:23.063 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:22.716+0000 7f00c698a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T10:46:23.140 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:22 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:22.835+0000 7fc3691b9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T10:46:23.140 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:23 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:23.004+0000 7fc3691b9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T10:46:23.347 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:23 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:23.082+0000 7f00c698a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T10:46:23.461 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:23 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:23.175+0000 7fc3691b9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T10:46:23.461 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:23 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:23.459+0000 7fc3691b9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T10:46:23.461 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:23 smithi184 ceph-mon[34585]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:23.461 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:23 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:23.461 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:23 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:23.461 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:23 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:23.462 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:23 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:46:23.462 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:23 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:23.462 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:23 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-10T10:46:23.462 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:23 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-10T10:46:23.462 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:23 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:23.462 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:23 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:23.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:23 smithi107 ceph-mon[30373]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:23.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:23 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:23.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:23 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:23.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:23 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:23.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:23 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:46:23.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:23 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:23.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:23 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-10T10:46:23.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:23 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-10T10:46:23.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:23 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:23.677 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:23 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:23.756 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:23 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:23.550+0000 7fc3691b9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T10:46:23.756 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:23 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:23.754+0000 7fc3691b9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T10:46:23.757 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:23 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:23.429+0000 7f00c698a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T10:46:23.757 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:23 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:23.518+0000 7f00c698a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T10:46:23.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:23 smithi196 ceph-mon[34872]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:23.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:23 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:23.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:23 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:23.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:23 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:23.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:23 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:46:23.757 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:23 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:23.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:23 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-10T10:46:23.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:23 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-10T10:46:23.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:23 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:23.758 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:23 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:24.063 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:23 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:23.755+0000 7f00c698a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T10:46:24.063 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:23 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:23.885+0000 7f00c698a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T10:46:24.064 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:23 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:23.978+0000 7f00c698a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T10:46:24.139 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:23 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:23.945+0000 7fc3691b9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T10:46:24.563 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:24 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:24.303+0000 7f00c698a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T10:46:24.563 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:24 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:24.394+0000 7f00c698a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T10:46:24.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:24 smithi196 ceph-mon[34872]: Reconfiguring mgr.x (unknown last config time)... 2024-05-10T10:46:24.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:24 smithi196 ceph-mon[34872]: Reconfiguring daemon mgr.x on smithi107 2024-05-10T10:46:24.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:24 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3461043978' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "503f960c-a74b-4979-9bf9-42c90a2885a2"}]: dispatch 2024-05-10T10:46:24.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:24 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3461043978' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "503f960c-a74b-4979-9bf9-42c90a2885a2"}]': finished 2024-05-10T10:46:24.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:24 smithi196 ceph-mon[34872]: osdmap e5: 1 total, 0 up, 1 in 2024-05-10T10:46:24.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:24.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:24 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1900583853' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:46:24.640 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:24 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:24.544+0000 7fc3691b9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T10:46:24.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:24 smithi184 ceph-mon[34585]: Reconfiguring mgr.x (unknown last config time)... 2024-05-10T10:46:24.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:24 smithi184 ceph-mon[34585]: Reconfiguring daemon mgr.x on smithi107 2024-05-10T10:46:24.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:24 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3461043978' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "503f960c-a74b-4979-9bf9-42c90a2885a2"}]: dispatch 2024-05-10T10:46:24.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:24 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3461043978' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "503f960c-a74b-4979-9bf9-42c90a2885a2"}]': finished 2024-05-10T10:46:24.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:24 smithi184 ceph-mon[34585]: osdmap e5: 1 total, 0 up, 1 in 2024-05-10T10:46:24.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:24.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:24 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1900583853' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:46:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:24 smithi107 ceph-mon[30373]: Reconfiguring mgr.x (unknown last config time)... 2024-05-10T10:46:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:24 smithi107 ceph-mon[30373]: Reconfiguring daemon mgr.x on smithi107 2024-05-10T10:46:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:24 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3461043978' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "503f960c-a74b-4979-9bf9-42c90a2885a2"}]: dispatch 2024-05-10T10:46:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:24 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3461043978' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "503f960c-a74b-4979-9bf9-42c90a2885a2"}]': finished 2024-05-10T10:46:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:24 smithi107 ceph-mon[30373]: osdmap e5: 1 total, 0 up, 1 in 2024-05-10T10:46:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:24 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1900583853' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:46:25.139 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:24 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:24.762+0000 7fc3691b9200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-10T10:46:25.313 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:24 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:24.981+0000 7f00c698a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T10:46:25.314 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 10:46:25 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z[36760]: 2024-05-10T10:46:25.190+0000 7f00c698a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T10:46:25.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:25.363+0000 7f8c777fe700 1 -- 172.21.15.107:0/650280487 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 14) ==== 99938+0+0 (secure 0 0 0) 0x7f8c7c003680 con 0x7f8c88102610 2024-05-10T10:46:25.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:25 smithi184 ceph-mon[34585]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:25.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:25 smithi184 ceph-mon[34585]: Standby manager daemon z started 2024-05-10T10:46:25.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:25 smithi184 ceph-mon[34585]: from='mgr.? 172.21.15.196:0/227192416' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-10T10:46:25.642 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:25 smithi184 ceph-mon[34585]: from='mgr.? 172.21.15.196:0/227192416' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-10T10:46:25.642 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:25 smithi184 ceph-mon[34585]: from='mgr.? 172.21.15.196:0/227192416' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-10T10:46:25.642 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:25 smithi184 ceph-mon[34585]: from='mgr.? 172.21.15.196:0/227192416' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-10T10:46:25.642 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:25 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:25.182+0000 7fc3691b9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T10:46:25.642 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:25 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:25.278+0000 7fc3691b9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T10:46:25.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:25 smithi107 ceph-mon[30373]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:25.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:25 smithi107 ceph-mon[30373]: Standby manager daemon z started 2024-05-10T10:46:25.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:25 smithi107 ceph-mon[30373]: from='mgr.? 172.21.15.196:0/227192416' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-10T10:46:25.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:25 smithi107 ceph-mon[30373]: from='mgr.? 172.21.15.196:0/227192416' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-10T10:46:25.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:25 smithi107 ceph-mon[30373]: from='mgr.? 172.21.15.196:0/227192416' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-10T10:46:25.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:25 smithi107 ceph-mon[30373]: from='mgr.? 172.21.15.196:0/227192416' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-10T10:46:25.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:25 smithi196 ceph-mon[34872]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:25.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:25 smithi196 ceph-mon[34872]: Standby manager daemon z started 2024-05-10T10:46:25.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:25 smithi196 ceph-mon[34872]: from='mgr.? 172.21.15.196:0/227192416' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-10T10:46:25.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:25 smithi196 ceph-mon[34872]: from='mgr.? 172.21.15.196:0/227192416' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-10T10:46:25.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:25 smithi196 ceph-mon[34872]: from='mgr.? 172.21.15.196:0/227192416' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-10T10:46:25.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:25 smithi196 ceph-mon[34872]: from='mgr.? 172.21.15.196:0/227192416' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-10T10:46:26.004 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:25 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:25.653+0000 7fc3691b9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T10:46:26.004 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:26 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:26.002+0000 7fc3691b9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T10:46:26.338 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:26 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:26.094+0000 7fc3691b9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T10:46:26.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:26 smithi184 ceph-mon[34585]: mgrmap e14: x(active, since 77s), standbys: z 2024-05-10T10:46:26.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:26 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-10T10:46:26.640 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:26 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:26.336+0000 7fc3691b9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T10:46:26.640 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:26 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:26.471+0000 7fc3691b9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T10:46:26.640 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:26 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:26.565+0000 7fc3691b9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T10:46:26.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:26 smithi107 ceph-mon[30373]: mgrmap e14: x(active, since 77s), standbys: z 2024-05-10T10:46:26.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:26 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-10T10:46:26.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:26 smithi196 ceph-mon[34872]: mgrmap e14: x(active, since 77s), standbys: z 2024-05-10T10:46:26.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:26 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-10T10:46:27.367 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:26 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:26.894+0000 7fc3691b9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T10:46:27.417 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:26 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:26.985+0000 7fc3691b9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T10:46:27.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:27 smithi184 ceph-mon[34585]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:27.640 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:27 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:27.584+0000 7fc3691b9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T10:46:27.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:27 smithi107 ceph-mon[30373]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:27.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:27 smithi196 ceph-mon[34872]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:28.139 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 10:46:27 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y[35963]: 2024-05-10T10:46:27.798+0000 7fc3691b9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T10:46:28.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:28.379+0000 7f8c777fe700 1 -- 172.21.15.107:0/650280487 <== mon.0 v2:172.21.15.107:3300/0 8 ==== mgrmap(e 15) ==== 149597+0+0 (secure 0 0 0) 0x7f8c7c003ba0 con 0x7f8c88102610 2024-05-10T10:46:28.538 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:28 smithi107 ceph-mon[30373]: Standby manager daemon y started 2024-05-10T10:46:28.538 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:28 smithi107 ceph-mon[30373]: from='mgr.? 172.21.15.184:0/3377581142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-10T10:46:28.538 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:28 smithi107 ceph-mon[30373]: from='mgr.? 172.21.15.184:0/3377581142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-10T10:46:28.538 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:28 smithi107 ceph-mon[30373]: from='mgr.? 172.21.15.184:0/3377581142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-10T10:46:28.538 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:28 smithi107 ceph-mon[30373]: from='mgr.? 172.21.15.184:0/3377581142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-10T10:46:28.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:28 smithi184 ceph-mon[34585]: Standby manager daemon y started 2024-05-10T10:46:28.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:28 smithi184 ceph-mon[34585]: from='mgr.? 172.21.15.184:0/3377581142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-10T10:46:28.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:28 smithi184 ceph-mon[34585]: from='mgr.? 172.21.15.184:0/3377581142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-10T10:46:28.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:28 smithi184 ceph-mon[34585]: from='mgr.? 172.21.15.184:0/3377581142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-10T10:46:28.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:28 smithi184 ceph-mon[34585]: from='mgr.? 172.21.15.184:0/3377581142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-10T10:46:28.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:28 smithi196 ceph-mon[34872]: Standby manager daemon y started 2024-05-10T10:46:28.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:28 smithi196 ceph-mon[34872]: from='mgr.? 172.21.15.184:0/3377581142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-10T10:46:28.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:28 smithi196 ceph-mon[34872]: from='mgr.? 172.21.15.184:0/3377581142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-10T10:46:28.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:28 smithi196 ceph-mon[34872]: from='mgr.? 172.21.15.184:0/3377581142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-10T10:46:28.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:28 smithi196 ceph-mon[34872]: from='mgr.? 172.21.15.184:0/3377581142' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-10T10:46:29.569 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:29 smithi107 ceph-mon[30373]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:29.570 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:29 smithi107 ceph-mon[30373]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-05-10T10:46:29.570 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-10T10:46:29.570 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:29.570 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:29.570 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:46:29.570 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:29.570 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:46:29.570 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:29.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:29 smithi184 ceph-mon[34585]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:29.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:29 smithi184 ceph-mon[34585]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-05-10T10:46:29.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-10T10:46:29.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:29.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:29.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:46:29.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:29.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:46:29.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:29.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:29 smithi196 ceph-mon[34872]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:29.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:29 smithi196 ceph-mon[34872]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-05-10T10:46:29.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-10T10:46:29.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:29.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:29.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:46:29.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:29.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:46:29.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:31.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:31 smithi184 ceph-mon[34585]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:31.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:31 smithi107 ceph-mon[30373]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:31.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:31 smithi196 ceph-mon[34872]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:32.581 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:32 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-10T10:46:32.582 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:32 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:32.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:32 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-10T10:46:32.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:32 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:32.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:32 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-10T10:46:32.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:32 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:33.641 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:33 smithi107 ceph-mon[30373]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:33.641 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:33 smithi107 ceph-mon[30373]: Deploying daemon osd.0 on smithi107 2024-05-10T10:46:33.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:33 smithi196 ceph-mon[34872]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:33.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:33 smithi196 ceph-mon[34872]: Deploying daemon osd.0 on smithi107 2024-05-10T10:46:33.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:33 smithi184 ceph-mon[34585]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:33.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:33 smithi184 ceph-mon[34585]: Deploying daemon osd.0 on smithi107 2024-05-10T10:46:35.631 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:35 smithi107 ceph-mon[30373]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:35.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:35 smithi196 ceph-mon[34872]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:35.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:35 smithi184 ceph-mon[34585]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:37.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:37 smithi107 ceph-mon[30373]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:37.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:37 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:37.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:37 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:37.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:37 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:46:37.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:37 smithi196 ceph-mon[34872]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:37.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:37 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:37.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:37 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:37.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:37 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:46:37.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:37 smithi184 ceph-mon[34585]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:37.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:37 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:37.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:37 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:37.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:37 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:46:39.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:39 smithi107 ceph-mon[30373]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:39.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:39 smithi196 ceph-mon[34872]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:39.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:39 smithi184 ceph-mon[34585]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:40.625 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:40 smithi107 ceph-mon[30373]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:40.625 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:40.625 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:40.625 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:40.625 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:46:40.626 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:40.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:40 smithi184 ceph-mon[34585]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:40.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:40.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:40.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:40.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:46:40.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:41.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:40 smithi196 ceph-mon[34872]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:41.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:41.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:41.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:41.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:46:41.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:41.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:41.082+0000 7f8c777fe700 1 -- 172.21.15.107:0/650280487 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8c8802e8f0 con 0x7f8c7003e750 2024-05-10T10:46:41.084 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 0 on host 'smithi107' 2024-05-10T10:46:41.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:41.085+0000 7f8c8ce67700 1 -- 172.21.15.107:0/650280487 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8c7003e750 msgr2=0x7f8c70040c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:41.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:41.085+0000 7f8c8ce67700 1 --2- 172.21.15.107:0/650280487 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8c7003e750 0x7f8c70040c10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800b5c0 tx=0x7f8c78005fb0 comp rx=0 tx=0).stop 2024-05-10T10:46:41.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:41.085+0000 7f8c8ce67700 1 -- 172.21.15.107:0/650280487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c88102610 msgr2=0x7f8c8819bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:41.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:41.085+0000 7f8c8ce67700 1 --2- 172.21.15.107:0/650280487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c88102610 0x7f8c8819bee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00d9b0 tx=0x7f8c7c00dcc0 comp rx=0 tx=0).stop 2024-05-10T10:46:41.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:41.085+0000 7f8c8ce67700 1 -- 172.21.15.107:0/650280487 shutdown_connections 2024-05-10T10:46:41.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:41.085+0000 7f8c8ce67700 1 --2- 172.21.15.107:0/650280487 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8c7003e750 0x7f8c70040c10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:41.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:41.085+0000 7f8c8ce67700 1 --2- 172.21.15.107:0/650280487 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c881018a0 0x7f8c8819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:41.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:41.085+0000 7f8c8ce67700 1 --2- 172.21.15.107:0/650280487 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c88102fd0 0x7f8c881a2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:41.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:41.085+0000 7f8c8ce67700 1 --2- 172.21.15.107:0/650280487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c88102610 0x7f8c8819bee0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:41.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:41.085+0000 7f8c8ce67700 1 -- 172.21.15.107:0/650280487 >> 172.21.15.107:0/650280487 conn(0x7f8c880fd200 msgr2=0x7f8c880fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:46:41.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:41.085+0000 7f8c8ce67700 1 -- 172.21.15.107:0/650280487 shutdown_connections 2024-05-10T10:46:41.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:46:41.085+0000 7f8c8ce67700 1 -- 172.21.15.107:0/650280487 wait complete. 2024-05-10T10:46:41.734 DEBUG:teuthology.orchestra.run.smithi107:osd.0> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.0.service 2024-05-10T10:46:41.736 INFO:tasks.cephadm:Deploying osd.1 on smithi184 with /dev/vg_nvme/lv_4... 2024-05-10T10:46:41.736 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-10T10:46:41.979 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T10:46:42.307 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:42 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:42.307 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:42 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:42.307 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:42 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:46:42.307 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:42 smithi184 ceph-mon[34585]: from='osd.0 [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-10T10:46:42.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:42 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:42.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:42 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:42.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:42 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:46:42.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:42 smithi196 ceph-mon[34872]: from='osd.0 [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-10T10:46:42.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:42 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:42.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:42 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:42.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:42 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:46:42.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:42 smithi107 ceph-mon[30373]: from='osd.0 [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-10T10:46:43.242 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:43 smithi184 ceph-mon[34585]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:43.243 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:43 smithi184 ceph-mon[34585]: from='osd.0 [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-10T10:46:43.243 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:43 smithi184 ceph-mon[34585]: osdmap e6: 1 total, 0 up, 1 in 2024-05-10T10:46:43.243 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:43 smithi184 ceph-mon[34585]: from='osd.0 [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-05-10T10:46:43.243 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:43 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:43.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:43 smithi107 ceph-mon[30373]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:43.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:43 smithi107 ceph-mon[30373]: from='osd.0 [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-10T10:46:43.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:43 smithi107 ceph-mon[30373]: osdmap e6: 1 total, 0 up, 1 in 2024-05-10T10:46:43.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:43 smithi107 ceph-mon[30373]: from='osd.0 [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-05-10T10:46:43.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:43 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:43.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:43 smithi196 ceph-mon[34872]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:43.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:43 smithi196 ceph-mon[34872]: from='osd.0 [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-10T10:46:43.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:43 smithi196 ceph-mon[34872]: osdmap e6: 1 total, 0 up, 1 in 2024-05-10T10:46:43.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:43 smithi196 ceph-mon[34872]: from='osd.0 [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-05-10T10:46:43.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:43 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:43.825 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-10T10:46:43.825 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-10T10:46:43.826 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2024-05-10T10:46:43.826 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2024-05-10T10:46:43.826 INFO:teuthology.orchestra.run.smithi184.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011322 s, 926 MB/s 2024-05-10T10:46:43.826 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 2024-05-10T10:46:43.826 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2024-05-10T10:46:44.297 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:44 smithi107 ceph-mon[30373]: from='osd.0 [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-05-10T10:46:44.297 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:44 smithi107 ceph-mon[30373]: osdmap e7: 1 total, 0 up, 1 in 2024-05-10T10:46:44.297 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:44 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:44.297 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:44 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:44.297 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:44 smithi107 ceph-mon[30373]: from='osd.0 [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004]' entity='osd.0' 2024-05-10T10:46:44.297 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:44 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:44.298 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 10:46:43 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-0[45596]: 2024-05-10T10:46:43.985+0000 7f1a82db6700 -1 osd.0 0 waiting for initial osdmap 2024-05-10T10:46:44.298 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 10:46:44 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-0[45596]: 2024-05-10T10:46:44.168+0000 7f1a7aba1700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T10:46:44.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:44 smithi184 ceph-mon[34585]: from='osd.0 [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-05-10T10:46:44.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:44 smithi184 ceph-mon[34585]: osdmap e7: 1 total, 0 up, 1 in 2024-05-10T10:46:44.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:44 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:44.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:44 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:44.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:44 smithi184 ceph-mon[34585]: from='osd.0 [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004]' entity='osd.0' 2024-05-10T10:46:44.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:44 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:44.432 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi184:vg_nvme/lv_4 2024-05-10T10:46:44.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:44 smithi196 ceph-mon[34872]: from='osd.0 [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-05-10T10:46:44.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:44 smithi196 ceph-mon[34872]: osdmap e7: 1 total, 0 up, 1 in 2024-05-10T10:46:44.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:44 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:44.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:44 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:44.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:44 smithi196 ceph-mon[34872]: from='osd.0 [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004]' entity='osd.0' 2024-05-10T10:46:44.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:44 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:44.669 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T10:46:45.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:45 smithi184 ceph-mon[34585]: purged_snaps scrub starts 2024-05-10T10:46:45.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:45 smithi184 ceph-mon[34585]: purged_snaps scrub ok 2024-05-10T10:46:45.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:45 smithi184 ceph-mon[34585]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:45.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:45.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:45.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:46:45.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:45.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:45.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:46:45.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:45.391 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:45.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:45 smithi107 ceph-mon[30373]: purged_snaps scrub starts 2024-05-10T10:46:45.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:45 smithi107 ceph-mon[30373]: purged_snaps scrub ok 2024-05-10T10:46:45.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:45 smithi107 ceph-mon[30373]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:45.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:45.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:45.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:46:45.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:45.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:45.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:46:45.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:45.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:45.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:45 smithi196 ceph-mon[34872]: purged_snaps scrub starts 2024-05-10T10:46:45.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:45 smithi196 ceph-mon[34872]: purged_snaps scrub ok 2024-05-10T10:46:45.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:45 smithi196 ceph-mon[34872]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:45.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:45.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:45.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:46:45.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:45.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:45.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:46:45.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:46:45.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:46.119 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.115+0000 7fa2264dd700 1 -- 172.21.15.184:0/402686551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2201050d0 msgr2=0x7fa22010b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:46.119 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.115+0000 7fa2264dd700 1 --2- 172.21.15.184:0/402686551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2201050d0 0x7fa22010b980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa21800b0d0 tx=0x7fa21800b3e0 comp rx=0 tx=0).stop 2024-05-10T10:46:46.119 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.115+0000 7fa2264dd700 1 -- 172.21.15.184:0/402686551 shutdown_connections 2024-05-10T10:46:46.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.115+0000 7fa2264dd700 1 --2- 172.21.15.184:0/402686551 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa220103530 0x7fa220103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:46.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.115+0000 7fa2264dd700 1 --2- 172.21.15.184:0/402686551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2201050d0 0x7fa22010b980 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:46.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.115+0000 7fa2264dd700 1 --2- 172.21.15.184:0/402686551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa220104730 0x7fa220104b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:46.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.116+0000 7fa2264dd700 1 -- 172.21.15.184:0/402686551 >> 172.21.15.184:0/402686551 conn(0x7fa2200feab0 msgr2=0x7fa220100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:46:46.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.116+0000 7fa2264dd700 1 -- 172.21.15.184:0/402686551 shutdown_connections 2024-05-10T10:46:46.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.116+0000 7fa2264dd700 1 -- 172.21.15.184:0/402686551 wait complete. 2024-05-10T10:46:46.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.116+0000 7fa2264dd700 1 Processor -- start 2024-05-10T10:46:46.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.116+0000 7fa2264dd700 1 -- start start 2024-05-10T10:46:46.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.116+0000 7fa2264dd700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa220103530 0x7fa220199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:46.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.116+0000 7fa2264dd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa220104730 0x7fa220199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:46.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.116+0000 7fa2264dd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2201050d0 0x7fa2201a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:46.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.116+0000 7fa2264dd700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa22010f100 con 0x7fa220104730 2024-05-10T10:46:46.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.116+0000 7fa2264dd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa22010ef80 con 0x7fa2201050d0 2024-05-10T10:46:46.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.116+0000 7fa2264dd700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa22010f280 con 0x7fa220103530 2024-05-10T10:46:46.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.117+0000 7fa224a7a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2201050d0 0x7fa2201a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:46.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.117+0000 7fa224a7a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2201050d0 0x7fa2201a0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:40328/0 (socket says 172.21.15.184:40328) 2024-05-10T10:46:46.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.117+0000 7fa224a7a700 1 -- 172.21.15.184:0/3389437324 learned_addr learned my addr 172.21.15.184:0/3389437324 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-05-10T10:46:46.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.117+0000 7fa21ffff700 1 --2- 172.21.15.184:0/3389437324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa220103530 0x7fa220199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:46.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.117+0000 7fa21f7fe700 1 --2- 172.21.15.184:0/3389437324 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa220104730 0x7fa220199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:46.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.117+0000 7fa224a7a700 1 -- 172.21.15.184:0/3389437324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa220103530 msgr2=0x7fa220199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:46.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.117+0000 7fa224a7a700 1 --2- 172.21.15.184:0/3389437324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa220103530 0x7fa220199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:46.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.117+0000 7fa224a7a700 1 -- 172.21.15.184:0/3389437324 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa220104730 msgr2=0x7fa220199bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:46:46.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.117+0000 7fa224a7a700 1 --2- 172.21.15.184:0/3389437324 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa220104730 0x7fa220199bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:46:46.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.117+0000 7fa224a7a700 1 -- 172.21.15.184:0/3389437324 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2201a12e0 con 0x7fa2201050d0 2024-05-10T10:46:46.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.117+0000 7fa224a7a700 1 --2- 172.21.15.184:0/3389437324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2201050d0 0x7fa2201a0c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa218006070 tx=0x7fa2180094f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:46:46.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.117+0000 7fa21d7fa700 1 -- 172.21.15.184:0/3389437324 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218021070 con 0x7fa2201050d0 2024-05-10T10:46:46.122 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.117+0000 7fa21d7fa700 1 -- 172.21.15.184:0/3389437324 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa218007b80 con 0x7fa2201050d0 2024-05-10T10:46:46.122 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.117+0000 7fa2264dd700 1 -- 172.21.15.184:0/3389437324 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2201a1570 con 0x7fa2201050d0 2024-05-10T10:46:46.122 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.117+0000 7fa21d7fa700 1 -- 172.21.15.184:0/3389437324 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218005330 con 0x7fa2201050d0 2024-05-10T10:46:46.122 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.117+0000 7fa2264dd700 1 -- 172.21.15.184:0/3389437324 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2201a1a20 con 0x7fa2201050d0 2024-05-10T10:46:46.124 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.118+0000 7fa2264dd700 1 -- 172.21.15.184:0/3389437324 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa22006a190 con 0x7fa2201050d0 2024-05-10T10:46:46.124 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.120+0000 7fa21d7fa700 1 -- 172.21.15.184:0/3389437324 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 15) ==== 149597+0+0 (secure 0 0 0) 0x7fa218024070 con 0x7fa2201050d0 2024-05-10T10:46:46.124 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.120+0000 7fa21d7fa700 1 --2- 172.21.15.184:0/3389437324 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa2080b27f0 0x7fa2080b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:46:46.124 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.120+0000 7fa21d7fa700 1 -- 172.21.15.184:0/3389437324 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7fa21800f020 con 0x7fa2201050d0 2024-05-10T10:46:46.124 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.120+0000 7fa21ffff700 1 --2- 172.21.15.184:0/3389437324 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa2080b27f0 0x7fa2080b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:46:46.124 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.121+0000 7fa21ffff700 1 --2- 172.21.15.184:0/3389437324 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa2080b27f0 0x7fa2080b4cb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa220104590 tx=0x7fa21000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:46:46.130 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.129+0000 7fa21d7fa700 1 -- 172.21.15.184:0/3389437324 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa21802b020 con 0x7fa2201050d0 2024-05-10T10:46:46.337 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:46:46.336+0000 7fa2264dd700 1 -- 172.21.15.184:0/3389437324 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa2200638e0 con 0x7fa2080b27f0 2024-05-10T10:46:46.338 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:46 smithi184 ceph-mon[34585]: Detected new or changed devices on smithi107 2024-05-10T10:46:46.338 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:46 smithi184 ceph-mon[34585]: Adjusting osd_memory_target on smithi107 to 17088M 2024-05-10T10:46:46.338 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:46 smithi184 ceph-mon[34585]: osd.0 [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004] boot 2024-05-10T10:46:46.338 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:46 smithi184 ceph-mon[34585]: osdmap e8: 1 total, 1 up, 1 in 2024-05-10T10:46:46.339 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:46 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:46.339 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:46 smithi184 ceph-mon[34585]: osdmap e9: 1 total, 1 up, 1 in 2024-05-10T10:46:46.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:46 smithi107 ceph-mon[30373]: Detected new or changed devices on smithi107 2024-05-10T10:46:46.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:46 smithi107 ceph-mon[30373]: Adjusting osd_memory_target on smithi107 to 17088M 2024-05-10T10:46:46.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:46 smithi107 ceph-mon[30373]: osd.0 [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004] boot 2024-05-10T10:46:46.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:46 smithi107 ceph-mon[30373]: osdmap e8: 1 total, 1 up, 1 in 2024-05-10T10:46:46.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:46 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:46.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:46 smithi107 ceph-mon[30373]: osdmap e9: 1 total, 1 up, 1 in 2024-05-10T10:46:46.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:46 smithi196 ceph-mon[34872]: Detected new or changed devices on smithi107 2024-05-10T10:46:46.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:46 smithi196 ceph-mon[34872]: Adjusting osd_memory_target on smithi107 to 17088M 2024-05-10T10:46:46.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:46 smithi196 ceph-mon[34872]: osd.0 [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004] boot 2024-05-10T10:46:46.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:46 smithi196 ceph-mon[34872]: osdmap e8: 1 total, 1 up, 1 in 2024-05-10T10:46:46.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:46 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-10T10:46:46.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:46 smithi196 ceph-mon[34872]: osdmap e9: 1 total, 1 up, 1 in 2024-05-10T10:46:47.192 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:47 smithi184 ceph-mon[34585]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:47.193 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:47 smithi184 ceph-mon[34585]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:46:47.193 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:47 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:46:47.193 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:47 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:46:47.193 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:47 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:47.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:47 smithi107 ceph-mon[30373]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:47.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:47 smithi107 ceph-mon[30373]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:46:47.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:47 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:46:47.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:47 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:46:47.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:47 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:47.465 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:47 smithi196 ceph-mon[34872]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-10T10:46:47.465 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:47 smithi196 ceph-mon[34872]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:46:47.465 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:47 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:46:47.465 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:47 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:46:47.465 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:47 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:49.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:49 smithi184 ceph-mon[34585]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:46:49.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:49 smithi184 ceph-mon[34585]: from='client.? 172.21.15.184:0/1894456246' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0f89167-1aa1-40a1-b122-c7f203c587d8"}]: dispatch 2024-05-10T10:46:49.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:49 smithi184 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0f89167-1aa1-40a1-b122-c7f203c587d8"}]: dispatch 2024-05-10T10:46:49.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:49 smithi184 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0f89167-1aa1-40a1-b122-c7f203c587d8"}]': finished 2024-05-10T10:46:49.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:49 smithi184 ceph-mon[34585]: osdmap e10: 2 total, 1 up, 2 in 2024-05-10T10:46:49.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:49 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T10:46:49.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:49 smithi107 ceph-mon[30373]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:46:49.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:49 smithi107 ceph-mon[30373]: from='client.? 172.21.15.184:0/1894456246' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0f89167-1aa1-40a1-b122-c7f203c587d8"}]: dispatch 2024-05-10T10:46:49.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:49 smithi107 ceph-mon[30373]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0f89167-1aa1-40a1-b122-c7f203c587d8"}]: dispatch 2024-05-10T10:46:49.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:49 smithi107 ceph-mon[30373]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0f89167-1aa1-40a1-b122-c7f203c587d8"}]': finished 2024-05-10T10:46:49.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:49 smithi107 ceph-mon[30373]: osdmap e10: 2 total, 1 up, 2 in 2024-05-10T10:46:49.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:49 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T10:46:49.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:49 smithi196 ceph-mon[34872]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:46:49.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:49 smithi196 ceph-mon[34872]: from='client.? 172.21.15.184:0/1894456246' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0f89167-1aa1-40a1-b122-c7f203c587d8"}]: dispatch 2024-05-10T10:46:49.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:49 smithi196 ceph-mon[34872]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0f89167-1aa1-40a1-b122-c7f203c587d8"}]: dispatch 2024-05-10T10:46:49.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:49 smithi196 ceph-mon[34872]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0f89167-1aa1-40a1-b122-c7f203c587d8"}]': finished 2024-05-10T10:46:49.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:49 smithi196 ceph-mon[34872]: osdmap e10: 2 total, 1 up, 2 in 2024-05-10T10:46:49.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:49 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T10:46:50.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:50 smithi184 ceph-mon[34585]: from='client.? 172.21.15.184:0/1872971060' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:46:50.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:50 smithi107 ceph-mon[30373]: from='client.? 172.21.15.184:0/1872971060' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:46:50.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:50 smithi196 ceph-mon[34872]: from='client.? 172.21.15.184:0/1872971060' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:46:51.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:51 smithi184 ceph-mon[34585]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:46:51.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:51 smithi107 ceph-mon[30373]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:46:51.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:51 smithi196 ceph-mon[34872]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:46:53.386 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:53 smithi184 ceph-mon[34585]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:46:53.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:53 smithi107 ceph-mon[30373]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:46:53.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:53 smithi196 ceph-mon[34872]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:46:55.194 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:55 smithi184 ceph-mon[34585]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:46:55.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:55 smithi107 ceph-mon[30373]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:46:55.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:55 smithi196 ceph-mon[34872]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:46:56.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:56 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-10T10:46:56.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:56 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:56.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:56 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-10T10:46:56.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:56 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:56.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:56 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-10T10:46:56.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:56 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:46:57.379 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:57 smithi184 ceph-mon[34585]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:46:57.379 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:57 smithi184 ceph-mon[34585]: Deploying daemon osd.1 on smithi184 2024-05-10T10:46:57.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:57 smithi107 ceph-mon[30373]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:46:57.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:57 smithi107 ceph-mon[30373]: Deploying daemon osd.1 on smithi184 2024-05-10T10:46:57.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:57 smithi196 ceph-mon[34872]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:46:57.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:57 smithi196 ceph-mon[34872]: Deploying daemon osd.1 on smithi184 2024-05-10T10:46:59.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:46:59 smithi107 ceph-mon[30373]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:46:59.463 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:46:59 smithi184 ceph-mon[34585]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:46:59.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:46:59 smithi196 ceph-mon[34872]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:47:01.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:01 smithi184 ceph-mon[34585]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:47:01.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:01 smithi107 ceph-mon[30373]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:47:01.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:01 smithi196 ceph-mon[34872]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:47:02.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:02 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:47:02.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:02 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:02.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:02 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:02.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:02 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:47:02.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:02 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:02.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:02 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:02.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:02 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:47:02.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:02 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:02.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:02 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:03.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:03 smithi184 ceph-mon[34585]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:47:03.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:03 smithi107 ceph-mon[30373]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:47:03.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:03 smithi196 ceph-mon[34872]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:47:04.250 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 1 on host 'smithi184' 2024-05-10T10:47:04.250 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:04.247+0000 7fa21d7fa700 1 -- 172.21.15.184:0/3389437324 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa2200638e0 con 0x7fa2080b27f0 2024-05-10T10:47:04.252 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:04.250+0000 7fa2264dd700 1 -- 172.21.15.184:0/3389437324 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa2080b27f0 msgr2=0x7fa2080b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:47:04.252 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:04.250+0000 7fa2264dd700 1 --2- 172.21.15.184:0/3389437324 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa2080b27f0 0x7fa2080b4cb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa220104590 tx=0x7fa21000b410 comp rx=0 tx=0).stop 2024-05-10T10:47:04.252 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:04.250+0000 7fa2264dd700 1 -- 172.21.15.184:0/3389437324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2201050d0 msgr2=0x7fa2201a0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:47:04.252 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:04.250+0000 7fa2264dd700 1 --2- 172.21.15.184:0/3389437324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2201050d0 0x7fa2201a0c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa218006070 tx=0x7fa2180094f0 comp rx=0 tx=0).stop 2024-05-10T10:47:04.252 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:04.250+0000 7fa2264dd700 1 -- 172.21.15.184:0/3389437324 shutdown_connections 2024-05-10T10:47:04.252 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:04.250+0000 7fa2264dd700 1 --2- 172.21.15.184:0/3389437324 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa2080b27f0 0x7fa2080b4cb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:04.252 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:04.250+0000 7fa2264dd700 1 --2- 172.21.15.184:0/3389437324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa220103530 0x7fa220199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:04.252 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:04.250+0000 7fa2264dd700 1 --2- 172.21.15.184:0/3389437324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2201050d0 0x7fa2201a0c40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:04.252 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:04.250+0000 7fa2264dd700 1 --2- 172.21.15.184:0/3389437324 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa220104730 0x7fa220199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:04.252 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:04.250+0000 7fa2264dd700 1 -- 172.21.15.184:0/3389437324 >> 172.21.15.184:0/3389437324 conn(0x7fa2200feab0 msgr2=0x7fa2201079d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:47:04.252 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:04.250+0000 7fa2264dd700 1 -- 172.21.15.184:0/3389437324 shutdown_connections 2024-05-10T10:47:04.252 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:04.250+0000 7fa2264dd700 1 -- 172.21.15.184:0/3389437324 wait complete. 2024-05-10T10:47:04.996 DEBUG:teuthology.orchestra.run.smithi184:osd.1> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.1.service 2024-05-10T10:47:04.998 INFO:tasks.cephadm:Deploying osd.2 on smithi196 with /dev/vg_nvme/lv_4... 2024-05-10T10:47:04.999 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-10T10:47:05.245 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T10:47:05.249 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:05 smithi184 ceph-mon[34585]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:47:05.249 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:05 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:05.249 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:05 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:05.249 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:05 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:05.249 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:05 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:05.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:05 smithi196 ceph-mon[34872]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:47:05.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:05 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:05.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:05 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:05.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:05 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:05.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:05 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:05.640 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 10:47:05 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-1[39173]: 2024-05-10T10:47:05.246+0000 7fd2149ec7c0 -1 osd.1 0 log_to_monitors true 2024-05-10T10:47:05.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:05 smithi107 ceph-mon[30373]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:47:05.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:05 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:05.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:05 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:05.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:05 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:05.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:05 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:06.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:06 smithi184 ceph-mon[34585]: from='osd.1 [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-10T10:47:06.535 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:06 smithi196 ceph-mon[34872]: from='osd.1 [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-10T10:47:06.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:06 smithi107 ceph-mon[30373]: from='osd.1 [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-10T10:47:07.099 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-10T10:47:07.099 INFO:teuthology.orchestra.run.smithi196.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-10T10:47:07.099 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10+0 records in 2024-05-10T10:47:07.099 INFO:teuthology.orchestra.run.smithi196.stderr:10+0 records out 2024-05-10T10:47:07.099 INFO:teuthology.orchestra.run.smithi196.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114103 s, 919 MB/s 2024-05-10T10:47:07.099 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping successful for: 2024-05-10T10:47:07.400 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:07 smithi196 ceph-mon[34872]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:47:07.401 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:07 smithi196 ceph-mon[34872]: from='osd.1 [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-10T10:47:07.401 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:07 smithi196 ceph-mon[34872]: osdmap e11: 2 total, 1 up, 2 in 2024-05-10T10:47:07.401 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:07 smithi196 ceph-mon[34872]: from='osd.1 [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:47:07.401 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:07 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T10:47:07.598 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:07 smithi184 ceph-mon[34585]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:47:07.598 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:07 smithi184 ceph-mon[34585]: from='osd.1 [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-10T10:47:07.598 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:07 smithi184 ceph-mon[34585]: osdmap e11: 2 total, 1 up, 2 in 2024-05-10T10:47:07.598 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:07 smithi184 ceph-mon[34585]: from='osd.1 [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:47:07.598 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:07 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T10:47:07.598 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 10:47:07 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-1[39173]: 2024-05-10T10:47:07.233+0000 7fd20a050700 -1 osd.1 0 waiting for initial osdmap 2024-05-10T10:47:07.599 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 10:47:07 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-1[39173]: 2024-05-10T10:47:07.236+0000 7fd205e43700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T10:47:07.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:07 smithi107 ceph-mon[30373]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:47:07.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:07 smithi107 ceph-mon[30373]: from='osd.1 [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-10T10:47:07.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:07 smithi107 ceph-mon[30373]: osdmap e11: 2 total, 1 up, 2 in 2024-05-10T10:47:07.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:07 smithi107 ceph-mon[30373]: from='osd.1 [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:47:07.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T10:47:07.711 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi196:vg_nvme/lv_4 2024-05-10T10:47:07.971 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T10:47:08.401 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:08 smithi196 ceph-mon[34872]: from='osd.1 [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-05-10T10:47:08.401 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:08 smithi196 ceph-mon[34872]: osdmap e12: 2 total, 1 up, 2 in 2024-05-10T10:47:08.401 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T10:47:08.401 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T10:47:08.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:08 smithi184 ceph-mon[34585]: from='osd.1 [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-05-10T10:47:08.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:08 smithi184 ceph-mon[34585]: osdmap e12: 2 total, 1 up, 2 in 2024-05-10T10:47:08.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T10:47:08.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T10:47:08.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:08 smithi107 ceph-mon[30373]: from='osd.1 [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-05-10T10:47:08.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:08 smithi107 ceph-mon[30373]: osdmap e12: 2 total, 1 up, 2 in 2024-05-10T10:47:08.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T10:47:08.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T10:47:09.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: purged_snaps scrub starts 2024-05-10T10:47:09.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: purged_snaps scrub ok 2024-05-10T10:47:09.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:47:09.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T10:47:09.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: osd.1 [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160] boot 2024-05-10T10:47:09.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: osdmap e13: 2 total, 2 up, 2 in 2024-05-10T10:47:09.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T10:47:09.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: Detected new or changed devices on smithi184 2024-05-10T10:47:09.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:09.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:09.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:47:09.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: Adjusting osd_memory_target on smithi184 to 17088M 2024-05-10T10:47:09.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:09.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:09.427 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:47:09.427 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:09.427 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:47:09.427 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:09.427 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:47:09.427 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:09.451 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: purged_snaps scrub starts 2024-05-10T10:47:09.452 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: purged_snaps scrub ok 2024-05-10T10:47:09.452 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:47:09.452 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T10:47:09.452 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: osd.1 [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160] boot 2024-05-10T10:47:09.452 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: osdmap e13: 2 total, 2 up, 2 in 2024-05-10T10:47:09.452 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T10:47:09.452 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: Detected new or changed devices on smithi184 2024-05-10T10:47:09.452 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:09.452 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:09.452 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:47:09.452 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: Adjusting osd_memory_target on smithi184 to 17088M 2024-05-10T10:47:09.452 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:09.453 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:09.453 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:47:09.453 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:09.453 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:47:09.453 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:09.453 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:47:09.453 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:09.476 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.471+0000 7f88b2ee0700 1 -- 172.21.15.196:0/149119103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88ac103600 msgr2=0x7f88ac103a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:47:09.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.471+0000 7f88b2ee0700 1 --2- 172.21.15.196:0/149119103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88ac103600 0x7f88ac103a60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8898009990 tx=0x7f8898009ca0 comp rx=0 tx=0).stop 2024-05-10T10:47:09.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.471+0000 7f88b2ee0700 1 -- 172.21.15.196:0/149119103 shutdown_connections 2024-05-10T10:47:09.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.471+0000 7f88b2ee0700 1 --2- 172.21.15.196:0/149119103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88ac103fa0 0x7f88ac10a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:09.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.471+0000 7f88b2ee0700 1 --2- 172.21.15.196:0/149119103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88ac102400 0x7f88ac102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:09.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.471+0000 7f88b2ee0700 1 --2- 172.21.15.196:0/149119103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88ac103600 0x7f88ac103a60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:09.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.471+0000 7f88b2ee0700 1 -- 172.21.15.196:0/149119103 >> 172.21.15.196:0/149119103 conn(0x7f88ac0fd9a0 msgr2=0x7f88ac0ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:47:09.477 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.471+0000 7f88b2ee0700 1 -- 172.21.15.196:0/149119103 shutdown_connections 2024-05-10T10:47:09.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.472+0000 7f88b2ee0700 1 -- 172.21.15.196:0/149119103 wait complete. 2024-05-10T10:47:09.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.472+0000 7f88b2ee0700 1 Processor -- start 2024-05-10T10:47:09.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.472+0000 7f88b2ee0700 1 -- start start 2024-05-10T10:47:09.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.472+0000 7f88b2ee0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88ac102400 0x7f88ac199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:47:09.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.472+0000 7f88b2ee0700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88ac103600 0x7f88ac199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:47:09.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.472+0000 7f88b2ee0700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88ac103fa0 0x7f88ac1a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:47:09.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.472+0000 7f88b2ee0700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac10e080 con 0x7f88ac103600 2024-05-10T10:47:09.478 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.472+0000 7f88b2ee0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac10df00 con 0x7f88ac102400 2024-05-10T10:47:09.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.472+0000 7f88b2ee0700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac10e200 con 0x7f88ac103fa0 2024-05-10T10:47:09.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.472+0000 7f88b147d700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88ac103fa0 0x7f88ac1a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:47:09.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.472+0000 7f88b147d700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88ac103fa0 0x7f88ac1a0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:33836/0 (socket says 172.21.15.196:33836) 2024-05-10T10:47:09.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.472+0000 7f88b147d700 1 -- 172.21.15.196:0/2292012408 learned_addr learned my addr 172.21.15.196:0/2292012408 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-10T10:47:09.479 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.473+0000 7f88b0c7c700 1 --2- 172.21.15.196:0/2292012408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88ac102400 0x7f88ac199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:47:09.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.473+0000 7f88abfff700 1 --2- 172.21.15.196:0/2292012408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88ac103600 0x7f88ac199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:47:09.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.473+0000 7f88b147d700 1 -- 172.21.15.196:0/2292012408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88ac102400 msgr2=0x7f88ac199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:47:09.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.473+0000 7f88b147d700 1 --2- 172.21.15.196:0/2292012408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88ac102400 0x7f88ac199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:09.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.473+0000 7f88b147d700 1 -- 172.21.15.196:0/2292012408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88ac103600 msgr2=0x7f88ac199ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:47:09.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.473+0000 7f88b147d700 1 --2- 172.21.15.196:0/2292012408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88ac103600 0x7f88ac199ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:09.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.473+0000 7f88b147d700 1 -- 172.21.15.196:0/2292012408 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac1a1370 con 0x7f88ac103fa0 2024-05-10T10:47:09.480 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.473+0000 7f88b0c7c700 1 --2- 172.21.15.196:0/2292012408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88ac102400 0x7f88ac199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:47:09.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.473+0000 7f88b147d700 1 --2- 172.21.15.196:0/2292012408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88ac103fa0 0x7f88ac1a0cd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f88a400add0 tx=0x7f88a400c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:47:09.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.473+0000 7f88a9ffb700 1 -- 172.21.15.196:0/2292012408 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4017020 con 0x7f88ac103fa0 2024-05-10T10:47:09.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.473+0000 7f88a9ffb700 1 -- 172.21.15.196:0/2292012408 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f88a400ce10 con 0x7f88ac103fa0 2024-05-10T10:47:09.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.473+0000 7f88b2ee0700 1 -- 172.21.15.196:0/2292012408 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ac1a1660 con 0x7f88ac103fa0 2024-05-10T10:47:09.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.473+0000 7f88a9ffb700 1 -- 172.21.15.196:0/2292012408 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4005460 con 0x7f88ac103fa0 2024-05-10T10:47:09.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.473+0000 7f88b2ee0700 1 -- 172.21.15.196:0/2292012408 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ac1a1ba0 con 0x7f88ac103fa0 2024-05-10T10:47:09.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.474+0000 7f88b2ee0700 1 -- 172.21.15.196:0/2292012408 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ac06a190 con 0x7f88ac103fa0 2024-05-10T10:47:09.481 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.475+0000 7f88a9ffb700 1 -- 172.21.15.196:0/2292012408 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 15) ==== 149597+0+0 (secure 0 0 0) 0x7f88a4004ad0 con 0x7f88ac103fa0 2024-05-10T10:47:09.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.476+0000 7f88a9ffb700 1 --2- 172.21.15.196:0/2292012408 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f889c0b27f0 0x7f889c0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:47:09.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.476+0000 7f88a9ffb700 1 -- 172.21.15.196:0/2292012408 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f88a40e0780 con 0x7f88ac103fa0 2024-05-10T10:47:09.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.476+0000 7f88b0c7c700 1 --2- 172.21.15.196:0/2292012408 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f889c0b27f0 0x7f889c0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:47:09.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.477+0000 7f88b0c7c700 1 --2- 172.21.15.196:0/2292012408 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f889c0b27f0 0x7f889c0b4cb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f88a0005fd0 tx=0x7f88a0005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:47:09.482 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.480+0000 7f88a9ffb700 1 -- 172.21.15.196:0/2292012408 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f88a4021020 con 0x7f88ac103fa0 2024-05-10T10:47:09.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: purged_snaps scrub starts 2024-05-10T10:47:09.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: purged_snaps scrub ok 2024-05-10T10:47:09.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-10T10:47:09.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T10:47:09.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: osd.1 [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160] boot 2024-05-10T10:47:09.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: osdmap e13: 2 total, 2 up, 2 in 2024-05-10T10:47:09.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-10T10:47:09.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: Detected new or changed devices on smithi184 2024-05-10T10:47:09.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:09.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:09.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:47:09.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: Adjusting osd_memory_target on smithi184 to 17088M 2024-05-10T10:47:09.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:09.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:09.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:47:09.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:09.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:47:09.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:09.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:47:09.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:09.689 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:09.688+0000 7f88b2ee0700 1 -- 172.21.15.196:0/2292012408 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f88ac0ffbf0 con 0x7f889c0b27f0 2024-05-10T10:47:10.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:10 smithi196 ceph-mon[34872]: osdmap e14: 2 total, 2 up, 2 in 2024-05-10T10:47:10.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:10 smithi196 ceph-mon[34872]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:10.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:10 smithi196 ceph-mon[34872]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:47:10.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:10 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:47:10.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:10 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:47:10.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:10 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:10.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:10 smithi184 ceph-mon[34585]: osdmap e14: 2 total, 2 up, 2 in 2024-05-10T10:47:10.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:10 smithi184 ceph-mon[34585]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:10.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:10 smithi184 ceph-mon[34585]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:47:10.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:10 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:47:10.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:10 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:47:10.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:10 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:10.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:10 smithi107 ceph-mon[30373]: osdmap e14: 2 total, 2 up, 2 in 2024-05-10T10:47:10.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:10 smithi107 ceph-mon[30373]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:10.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:10 smithi107 ceph-mon[30373]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:47:10.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:10 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:47:10.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:10 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:47:10.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:10 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:12.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:12 smithi184 ceph-mon[34585]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:12.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:12 smithi184 ceph-mon[34585]: from='client.? 172.21.15.196:0/2554011500' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7588b9be-b935-450a-944f-3feca69c029c"}]: dispatch 2024-05-10T10:47:12.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:12 smithi184 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7588b9be-b935-450a-944f-3feca69c029c"}]: dispatch 2024-05-10T10:47:12.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:12 smithi184 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7588b9be-b935-450a-944f-3feca69c029c"}]': finished 2024-05-10T10:47:12.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:12 smithi184 ceph-mon[34585]: osdmap e15: 3 total, 2 up, 3 in 2024-05-10T10:47:12.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:12 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T10:47:12.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:12 smithi107 ceph-mon[30373]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:12.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:12 smithi107 ceph-mon[30373]: from='client.? 172.21.15.196:0/2554011500' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7588b9be-b935-450a-944f-3feca69c029c"}]: dispatch 2024-05-10T10:47:12.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:12 smithi107 ceph-mon[30373]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7588b9be-b935-450a-944f-3feca69c029c"}]: dispatch 2024-05-10T10:47:12.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:12 smithi107 ceph-mon[30373]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7588b9be-b935-450a-944f-3feca69c029c"}]': finished 2024-05-10T10:47:12.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:12 smithi107 ceph-mon[30373]: osdmap e15: 3 total, 2 up, 3 in 2024-05-10T10:47:12.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:12 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T10:47:13.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:12 smithi196 ceph-mon[34872]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:13.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:12 smithi196 ceph-mon[34872]: from='client.? 172.21.15.196:0/2554011500' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7588b9be-b935-450a-944f-3feca69c029c"}]: dispatch 2024-05-10T10:47:13.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:12 smithi196 ceph-mon[34872]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7588b9be-b935-450a-944f-3feca69c029c"}]: dispatch 2024-05-10T10:47:13.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:12 smithi196 ceph-mon[34872]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7588b9be-b935-450a-944f-3feca69c029c"}]': finished 2024-05-10T10:47:13.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:12 smithi196 ceph-mon[34872]: osdmap e15: 3 total, 2 up, 3 in 2024-05-10T10:47:13.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:12 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T10:47:13.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:13 smithi184 ceph-mon[34585]: from='client.? 172.21.15.196:0/1989420882' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:47:13.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:13 smithi107 ceph-mon[30373]: from='client.? 172.21.15.196:0/1989420882' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:47:14.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:13 smithi196 ceph-mon[34872]: from='client.? 172.21.15.196:0/1989420882' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:47:14.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:14 smithi184 ceph-mon[34585]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:14.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:14 smithi107 ceph-mon[30373]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:15.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:14 smithi196 ceph-mon[34872]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:16.698 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:16 smithi196 ceph-mon[34872]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:16.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:16 smithi184 ceph-mon[34585]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:16.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:16 smithi107 ceph-mon[30373]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:18.707 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:18 smithi196 ceph-mon[34872]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:18.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:18 smithi184 ceph-mon[34585]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:18.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:18 smithi107 ceph-mon[30373]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:19.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:19 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-10T10:47:19.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:19 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:19.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:19 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-10T10:47:19.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:19 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:20.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:19 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-10T10:47:20.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:19 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:20.617 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:20 smithi196 ceph-mon[34872]: Deploying daemon osd.2 on smithi196 2024-05-10T10:47:20.618 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:20 smithi196 ceph-mon[34872]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:20.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:20 smithi184 ceph-mon[34585]: Deploying daemon osd.2 on smithi196 2024-05-10T10:47:20.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:20 smithi184 ceph-mon[34585]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:20.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:20 smithi107 ceph-mon[30373]: Deploying daemon osd.2 on smithi196 2024-05-10T10:47:20.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:20 smithi107 ceph-mon[30373]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:22.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:22 smithi196 ceph-mon[34872]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:22.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:22 smithi184 ceph-mon[34585]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:22.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:22 smithi107 ceph-mon[30373]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:24.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:24 smithi184 ceph-mon[34585]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:24.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:24 smithi107 ceph-mon[30373]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:25.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:24 smithi196 ceph-mon[34872]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:26.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:25 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:26.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:25 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:26.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:25 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:47:26.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:25 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:26.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:25 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:26.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:25 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:47:26.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:25 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:26.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:25 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:26.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:25 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:47:26.986 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:26 smithi196 ceph-mon[34872]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:27.077 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:26 smithi107 ceph-mon[30373]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:27.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:26 smithi184 ceph-mon[34585]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:27.759 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:27.757+0000 7f88a9ffb700 1 -- 172.21.15.196:0/2292012408 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f88ac0ffbf0 con 0x7f889c0b27f0 2024-05-10T10:47:27.759 INFO:teuthology.orchestra.run.smithi196.stdout:Created osd(s) 2 on host 'smithi196' 2024-05-10T10:47:27.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:27.760+0000 7f88b2ee0700 1 -- 172.21.15.196:0/2292012408 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f889c0b27f0 msgr2=0x7f889c0b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:47:27.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:27.760+0000 7f88b2ee0700 1 --2- 172.21.15.196:0/2292012408 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f889c0b27f0 0x7f889c0b4cb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f88a0005fd0 tx=0x7f88a0005dc0 comp rx=0 tx=0).stop 2024-05-10T10:47:27.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:27.760+0000 7f88b2ee0700 1 -- 172.21.15.196:0/2292012408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88ac103fa0 msgr2=0x7f88ac1a0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:47:27.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:27.760+0000 7f88b2ee0700 1 --2- 172.21.15.196:0/2292012408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88ac103fa0 0x7f88ac1a0cd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f88a400add0 tx=0x7f88a400c330 comp rx=0 tx=0).stop 2024-05-10T10:47:27.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:27.760+0000 7f88b2ee0700 1 -- 172.21.15.196:0/2292012408 shutdown_connections 2024-05-10T10:47:27.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:27.760+0000 7f88b2ee0700 1 --2- 172.21.15.196:0/2292012408 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f889c0b27f0 0x7f889c0b4cb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:27.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:27.760+0000 7f88b2ee0700 1 --2- 172.21.15.196:0/2292012408 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f88ac103fa0 0x7f88ac1a0cd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:27.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:27.760+0000 7f88b2ee0700 1 --2- 172.21.15.196:0/2292012408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88ac102400 0x7f88ac199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:27.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:27.760+0000 7f88b2ee0700 1 --2- 172.21.15.196:0/2292012408 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88ac103600 0x7f88ac199ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:27.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:27.760+0000 7f88b2ee0700 1 -- 172.21.15.196:0/2292012408 >> 172.21.15.196:0/2292012408 conn(0x7f88ac0fd9a0 msgr2=0x7f88ac0ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:47:27.762 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:27.761+0000 7f88b2ee0700 1 -- 172.21.15.196:0/2292012408 shutdown_connections 2024-05-10T10:47:27.763 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:47:27.761+0000 7f88b2ee0700 1 -- 172.21.15.196:0/2292012408 wait complete. 2024-05-10T10:47:28.338 DEBUG:teuthology.orchestra.run.smithi196:osd.2> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.2.service 2024-05-10T10:47:28.341 INFO:tasks.cephadm:Deploying osd.3 on smithi107 with /dev/vg_nvme/lv_3... 2024-05-10T10:47:28.341 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-10T10:47:28.590 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:47:28.964 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:28 smithi107 ceph-mon[30373]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:28.964 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:28 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:28.964 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:28 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:28.964 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:28 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:28.964 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:28 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:28.964 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:28 smithi107 ceph-mon[30373]: from='osd.2 [v2:172.21.15.196:6800/137473043,v1:172.21.15.196:6801/137473043]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-10T10:47:28.964 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:28 smithi107 ceph-mon[30373]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-10T10:47:28.983 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 10:47:28 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-2[40057]: 2024-05-10T10:47:28.589+0000 7fd482b9d7c0 -1 osd.2 0 log_to_monitors true 2024-05-10T10:47:28.983 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:28 smithi196 ceph-mon[34872]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:28.983 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:28 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:28.983 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:28 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:28.983 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:28 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:28.983 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:28 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:28.983 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:28 smithi196 ceph-mon[34872]: from='osd.2 [v2:172.21.15.196:6800/137473043,v1:172.21.15.196:6801/137473043]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-10T10:47:28.983 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:28 smithi196 ceph-mon[34872]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-10T10:47:29.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:28 smithi184 ceph-mon[34585]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:29.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:28 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:29.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:28 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:29.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:28 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:29.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:28 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:29.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:28 smithi184 ceph-mon[34585]: from='osd.2 [v2:172.21.15.196:6800/137473043,v1:172.21.15.196:6801/137473043]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-10T10:47:29.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:28 smithi184 ceph-mon[34585]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-10T10:47:30.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:29 smithi196 ceph-mon[34872]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-10T10:47:30.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:29 smithi196 ceph-mon[34872]: osdmap e16: 3 total, 2 up, 3 in 2024-05-10T10:47:30.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T10:47:30.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:29 smithi196 ceph-mon[34872]: from='osd.2 [v2:172.21.15.196:6800/137473043,v1:172.21.15.196:6801/137473043]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:47:30.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:29 smithi196 ceph-mon[34872]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:47:30.064 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 10:47:29 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-2[40057]: 2024-05-10T10:47:29.804+0000 7fd478201700 -1 osd.2 0 waiting for initial osdmap 2024-05-10T10:47:30.064 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 10:47:29 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-2[40057]: 2024-05-10T10:47:29.808+0000 7fd473ff4700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T10:47:30.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:29 smithi184 ceph-mon[34585]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-10T10:47:30.142 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:29 smithi184 ceph-mon[34585]: osdmap e16: 3 total, 2 up, 3 in 2024-05-10T10:47:30.142 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T10:47:30.142 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:29 smithi184 ceph-mon[34585]: from='osd.2 [v2:172.21.15.196:6800/137473043,v1:172.21.15.196:6801/137473043]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:47:30.142 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:29 smithi184 ceph-mon[34585]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:47:30.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:29 smithi107 ceph-mon[30373]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-10T10:47:30.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:29 smithi107 ceph-mon[30373]: osdmap e16: 3 total, 2 up, 3 in 2024-05-10T10:47:30.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T10:47:30.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:29 smithi107 ceph-mon[30373]: from='osd.2 [v2:172.21.15.196:6800/137473043,v1:172.21.15.196:6801/137473043]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:47:30.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:29 smithi107 ceph-mon[30373]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:47:30.415 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-10T10:47:30.416 INFO:teuthology.orchestra.run.smithi107.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-10T10:47:30.416 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10+0 records in 2024-05-10T10:47:30.416 INFO:teuthology.orchestra.run.smithi107.stderr:10+0 records out 2024-05-10T10:47:30.416 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0134176 s, 781 MB/s 2024-05-10T10:47:30.416 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping successful for: 2024-05-10T10:47:30.995 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:30 smithi107 ceph-mon[30373]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:30.995 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:30 smithi107 ceph-mon[30373]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-05-10T10:47:30.995 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:30 smithi107 ceph-mon[30373]: osdmap e17: 3 total, 2 up, 3 in 2024-05-10T10:47:30.995 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:30 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T10:47:30.995 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:30 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T10:47:30.997 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi107:vg_nvme/lv_3 2024-05-10T10:47:31.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:30 smithi196 ceph-mon[34872]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:31.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:30 smithi196 ceph-mon[34872]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-05-10T10:47:31.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:30 smithi196 ceph-mon[34872]: osdmap e17: 3 total, 2 up, 3 in 2024-05-10T10:47:31.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:30 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T10:47:31.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:30 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T10:47:31.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:30 smithi184 ceph-mon[34585]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:31.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:30 smithi184 ceph-mon[34585]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-05-10T10:47:31.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:30 smithi184 ceph-mon[34585]: osdmap e17: 3 total, 2 up, 3 in 2024-05-10T10:47:31.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:30 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T10:47:31.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:30 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T10:47:31.241 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:47:32.050 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: purged_snaps scrub starts 2024-05-10T10:47:32.051 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: purged_snaps scrub ok 2024-05-10T10:47:32.051 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T10:47:32.051 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: osd.2 [v2:172.21.15.196:6800/137473043,v1:172.21.15.196:6801/137473043] boot 2024-05-10T10:47:32.051 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: osdmap e18: 3 total, 3 up, 3 in 2024-05-10T10:47:32.051 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T10:47:32.051 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: Detected new or changed devices on smithi196 2024-05-10T10:47:32.051 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:32.051 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:32.051 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:47:32.051 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: Adjusting osd_memory_target on smithi196 to 17088M 2024-05-10T10:47:32.051 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:32.051 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:32.052 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:47:32.052 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:32.052 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:47:32.052 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:32.052 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:47:32.052 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:32.052 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-10T10:47:32.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: purged_snaps scrub starts 2024-05-10T10:47:32.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: purged_snaps scrub ok 2024-05-10T10:47:32.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T10:47:32.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: osd.2 [v2:172.21.15.196:6800/137473043,v1:172.21.15.196:6801/137473043] boot 2024-05-10T10:47:32.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: osdmap e18: 3 total, 3 up, 3 in 2024-05-10T10:47:32.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T10:47:32.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: Detected new or changed devices on smithi196 2024-05-10T10:47:32.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:32.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:32.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:47:32.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: Adjusting osd_memory_target on smithi196 to 17088M 2024-05-10T10:47:32.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:32.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:32.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:47:32.065 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:32.065 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:47:32.065 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:32.065 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:47:32.065 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:32.065 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-10T10:47:32.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: purged_snaps scrub starts 2024-05-10T10:47:32.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: purged_snaps scrub ok 2024-05-10T10:47:32.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T10:47:32.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: osd.2 [v2:172.21.15.196:6800/137473043,v1:172.21.15.196:6801/137473043] boot 2024-05-10T10:47:32.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: osdmap e18: 3 total, 3 up, 3 in 2024-05-10T10:47:32.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-10T10:47:32.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: Detected new or changed devices on smithi196 2024-05-10T10:47:32.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:32.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:32.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:47:32.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: Adjusting osd_memory_target on smithi196 to 17088M 2024-05-10T10:47:32.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:32.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:32.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:47:32.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:32.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:47:32.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:32.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:47:32.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:32.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-10T10:47:32.860 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.858+0000 7f97a8671700 1 -- 172.21.15.107:0/3756770619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97a01034f0 msgr2=0x7f97a0103910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:47:32.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.858+0000 7f97a8671700 1 --2- 172.21.15.107:0/3756770619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97a01034f0 0x7f97a0103910 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f979c0099c0 tx=0x7f979c009cd0 comp rx=0 tx=0).stop 2024-05-10T10:47:32.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.859+0000 7f97a8671700 1 -- 172.21.15.107:0/3756770619 shutdown_connections 2024-05-10T10:47:32.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.859+0000 7f97a8671700 1 --2- 172.21.15.107:0/3756770619 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97a0105090 0x7f97a010b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:32.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.859+0000 7f97a8671700 1 --2- 172.21.15.107:0/3756770619 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97a01034f0 0x7f97a0103910 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:32.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.859+0000 7f97a8671700 1 --2- 172.21.15.107:0/3756770619 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97a01046f0 0x7f97a0104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:32.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.859+0000 7f97a8671700 1 -- 172.21.15.107:0/3756770619 >> 172.21.15.107:0/3756770619 conn(0x7f97a00fea90 msgr2=0x7f97a0100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:47:32.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.859+0000 7f97a8671700 1 -- 172.21.15.107:0/3756770619 shutdown_connections 2024-05-10T10:47:32.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.859+0000 7f97a8671700 1 -- 172.21.15.107:0/3756770619 wait complete. 2024-05-10T10:47:32.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.859+0000 7f97a8671700 1 Processor -- start 2024-05-10T10:47:32.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.859+0000 7f97a8671700 1 -- start start 2024-05-10T10:47:32.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97a8671700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97a01034f0 0x7f97a0199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:47:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97a8671700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97a01046f0 0x7f97a0199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:47:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97a8671700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97a0105090 0x7f97a01a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:47:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97a8671700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f97a010f120 con 0x7f97a0105090 2024-05-10T10:47:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97a8671700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f97a010efa0 con 0x7f97a01046f0 2024-05-10T10:47:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97a8671700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f97a010f2a0 con 0x7f97a01034f0 2024-05-10T10:47:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97a6c0e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97a0105090 0x7f97a01a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:47:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97a6c0e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97a0105090 0x7f97a01a0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58536/0 (socket says 172.21.15.107:58536) 2024-05-10T10:47:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97a6c0e700 1 -- 172.21.15.107:0/4208870663 learned_addr learned my addr 172.21.15.107:0/4208870663 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:47:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97a640d700 1 --2- 172.21.15.107:0/4208870663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97a01034f0 0x7f97a0199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:47:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97a5c0c700 1 --2- 172.21.15.107:0/4208870663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97a01046f0 0x7f97a0199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:47:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97a6c0e700 1 -- 172.21.15.107:0/4208870663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97a01034f0 msgr2=0x7f97a0199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:47:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97a6c0e700 1 --2- 172.21.15.107:0/4208870663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97a01034f0 0x7f97a0199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:32.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97a6c0e700 1 -- 172.21.15.107:0/4208870663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97a01046f0 msgr2=0x7f97a0199ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:47:32.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97a6c0e700 1 --2- 172.21.15.107:0/4208870663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97a01046f0 0x7f97a0199ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:32.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97a6c0e700 1 -- 172.21.15.107:0/4208870663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a01a13c0 con 0x7f97a0105090 2024-05-10T10:47:32.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97a5c0c700 1 --2- 172.21.15.107:0/4208870663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97a01046f0 0x7f97a0199ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:47:32.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97a6c0e700 1 --2- 172.21.15.107:0/4208870663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97a0105090 0x7f97a01a0d20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f979800b9a0 tx=0x7f979800bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:47:32.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97977fe700 1 -- 172.21.15.107:0/4208870663 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9798019070 con 0x7f97a0105090 2024-05-10T10:47:32.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97977fe700 1 -- 172.21.15.107:0/4208870663 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f979800ce00 con 0x7f97a0105090 2024-05-10T10:47:32.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.860+0000 7f97a8671700 1 -- 172.21.15.107:0/4208870663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a01a16b0 con 0x7f97a0105090 2024-05-10T10:47:32.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.861+0000 7f97977fe700 1 -- 172.21.15.107:0/4208870663 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9798007370 con 0x7f97a0105090 2024-05-10T10:47:32.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.861+0000 7f97a8671700 1 -- 172.21.15.107:0/4208870663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a01a1c40 con 0x7f97a0105090 2024-05-10T10:47:32.865 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.861+0000 7f97a8671700 1 -- 172.21.15.107:0/4208870663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97a006a190 con 0x7f97a0105090 2024-05-10T10:47:32.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.863+0000 7f97977fe700 1 -- 172.21.15.107:0/4208870663 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 15) ==== 149597+0+0 (secure 0 0 0) 0x7f979801c070 con 0x7f97a0105090 2024-05-10T10:47:32.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.864+0000 7f97977fe700 1 --2- 172.21.15.107:0/4208870663 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f978c0b2870 0x7f978c0b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:47:32.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.864+0000 7f97a640d700 1 --2- 172.21.15.107:0/4208870663 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f978c0b2870 0x7f978c0b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:47:32.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.864+0000 7f97977fe700 1 -- 172.21.15.107:0/4208870663 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3226+0+0 (secure 0 0 0) 0x7f97980e04a0 con 0x7f97a0105090 2024-05-10T10:47:32.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.864+0000 7f97a640d700 1 --2- 172.21.15.107:0/4208870663 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f978c0b2870 0x7f978c0b4d30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f979c006010 tx=0x7f979c009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:47:32.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:32.867+0000 7f97977fe700 1 -- 172.21.15.107:0/4208870663 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f97980a9680 con 0x7f97a0105090 2024-05-10T10:47:33.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:33.081+0000 7f97a8671700 1 -- 172.21.15.107:0/4208870663 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f97a00638e0 con 0x7f978c0b2870 2024-05-10T10:47:33.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:33 smithi107 ceph-mon[30373]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:33.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-10T10:47:33.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:33 smithi107 ceph-mon[30373]: osdmap e19: 3 total, 3 up, 3 in 2024-05-10T10:47:33.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-10T10:47:33.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:47:33.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:47:33.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:33.426 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 10:47:33 smithi107 sudo[49911]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-10T10:47:33.426 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 10:47:33 smithi107 sudo[49911]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T10:47:33.426 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 10:47:33 smithi107 sudo[49911]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T10:47:33.426 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 10:47:33 smithi107 sudo[49911]: pam_unix(sudo:session): session closed for user root 2024-05-10T10:47:33.426 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 10:47:33 smithi107 sudo[49914]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-10T10:47:33.426 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 10:47:33 smithi107 sudo[49914]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T10:47:33.426 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 10:47:33 smithi107 sudo[49914]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T10:47:33.426 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 10:47:33 smithi107 sudo[49914]: pam_unix(sudo:session): session closed for user root 2024-05-10T10:47:33.491 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 10:47:33 smithi196 sudo[44110]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-10T10:47:33.491 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 10:47:33 smithi196 sudo[44110]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T10:47:33.491 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 10:47:33 smithi196 sudo[44110]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T10:47:33.491 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 10:47:33 smithi196 sudo[44110]: pam_unix(sudo:session): session closed for user root 2024-05-10T10:47:33.491 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 10:47:33 smithi196 sudo[44113]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-10T10:47:33.491 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 10:47:33 smithi196 sudo[44113]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T10:47:33.491 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 10:47:33 smithi196 sudo[44113]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T10:47:33.492 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 10:47:33 smithi196 sudo[44113]: pam_unix(sudo:session): session closed for user root 2024-05-10T10:47:33.492 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:33 smithi196 ceph-mon[34872]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:33.492 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-10T10:47:33.492 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:33 smithi196 ceph-mon[34872]: osdmap e19: 3 total, 3 up, 3 in 2024-05-10T10:47:33.492 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-10T10:47:33.492 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:47:33.492 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:47:33.492 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:33.528 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:33 smithi184 ceph-mon[34585]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-10T10:47:33.528 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-10T10:47:33.528 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:33 smithi184 ceph-mon[34585]: osdmap e19: 3 total, 3 up, 3 in 2024-05-10T10:47:33.528 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-10T10:47:33.528 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:47:33.528 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:47:33.528 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:33.528 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 10:47:33 smithi184 sudo[43161]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-10T10:47:33.528 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 10:47:33 smithi184 sudo[43161]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T10:47:33.529 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 10:47:33 smithi184 sudo[43161]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T10:47:33.529 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 10:47:33 smithi184 sudo[43161]: pam_unix(sudo:session): session closed for user root 2024-05-10T10:47:33.529 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 10:47:33 smithi184 sudo[43164]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-10T10:47:33.529 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 10:47:33 smithi184 sudo[43164]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T10:47:33.529 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 10:47:33 smithi184 sudo[43164]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T10:47:33.529 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 10:47:33 smithi184 sudo[43164]: pam_unix(sudo:session): session closed for user root 2024-05-10T10:47:33.722 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:33 smithi107 sudo[49917]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-10T10:47:33.722 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:33 smithi107 sudo[49917]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T10:47:33.723 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:33 smithi107 sudo[49917]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T10:47:33.723 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:33 smithi107 sudo[49917]: pam_unix(sudo:session): session closed for user root 2024-05-10T10:47:33.723 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:33 smithi107 sudo[49920]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-10T10:47:33.723 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:33 smithi107 sudo[49920]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T10:47:33.723 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:33 smithi107 sudo[49920]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T10:47:33.723 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:33 smithi107 sudo[49920]: pam_unix(sudo:session): session closed for user root 2024-05-10T10:47:33.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:33 smithi196 sudo[44116]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-10T10:47:33.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:33 smithi196 sudo[44116]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T10:47:33.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:33 smithi196 sudo[44116]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T10:47:33.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:33 smithi196 sudo[44116]: pam_unix(sudo:session): session closed for user root 2024-05-10T10:47:33.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:33 smithi196 sudo[44119]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-10T10:47:33.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:33 smithi196 sudo[44119]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T10:47:33.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:33 smithi196 sudo[44119]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T10:47:33.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:33 smithi196 sudo[44119]: pam_unix(sudo:session): session closed for user root 2024-05-10T10:47:33.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:33 smithi184 sudo[43167]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-10T10:47:33.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:33 smithi184 sudo[43167]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T10:47:33.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:33 smithi184 sudo[43167]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T10:47:33.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:33 smithi184 sudo[43167]: pam_unix(sudo:session): session closed for user root 2024-05-10T10:47:33.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:33 smithi184 sudo[43170]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-10T10:47:33.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:33 smithi184 sudo[43170]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-10T10:47:33.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:33 smithi184 sudo[43170]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-10T10:47:33.891 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:33 smithi184 sudo[43170]: pam_unix(sudo:session): session closed for user root 2024-05-10T10:47:34.403 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:47:34.403 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-10T10:47:34.403 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: osdmap e20: 3 total, 3 up, 3 in 2024-05-10T10:47:34.403 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:34.403 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:34.403 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:34.403 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-10T10:47:34.403 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-10T10:47:34.404 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T10:47:34.404 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:47:34.404 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:47:34.404 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-10T10:47:34.404 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T10:47:34.404 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:47:34.404 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:47:34.404 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-10T10:47:34.404 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-10T10:47:34.404 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T10:47:34.404 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:47:34.404 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:47:34.404 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:34 smithi107 ceph-mon[30373]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-10T10:47:34.456 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:34.455+0000 7f97977fe700 1 -- 172.21.15.107:0/4208870663 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f97980a5210 con 0x7f97a0105090 2024-05-10T10:47:34.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:47:34.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-10T10:47:34.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: osdmap e20: 3 total, 3 up, 3 in 2024-05-10T10:47:34.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:34.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:34.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:34.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-10T10:47:34.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-10T10:47:34.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T10:47:34.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:47:34.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:47:34.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-10T10:47:34.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T10:47:34.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:47:34.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:47:34.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-10T10:47:34.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-10T10:47:34.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T10:47:34.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:47:34.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:47:34.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:34 smithi196 ceph-mon[34872]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-10T10:47:34.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:47:34.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-10T10:47:34.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: osdmap e20: 3 total, 3 up, 3 in 2024-05-10T10:47:34.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:34.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:34.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:34.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-10T10:47:34.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-10T10:47:34.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T10:47:34.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:47:34.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:47:34.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-10T10:47:34.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T10:47:34.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:47:34.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:47:34.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-10T10:47:34.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-10T10:47:34.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-10T10:47:34.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-10T10:47:34.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-10T10:47:34.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:34 smithi184 ceph-mon[34585]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-10T10:47:35.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:35 smithi196 ceph-mon[34872]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:35 smithi196 ceph-mon[34872]: osdmap e21: 3 total, 3 up, 3 in 2024-05-10T10:47:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:35 smithi196 ceph-mon[34872]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-10T10:47:35.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:35 smithi184 ceph-mon[34585]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:35 smithi184 ceph-mon[34585]: osdmap e21: 3 total, 3 up, 3 in 2024-05-10T10:47:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:35 smithi184 ceph-mon[34585]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-10T10:47:35.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:35 smithi107 ceph-mon[30373]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:35.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:35 smithi107 ceph-mon[30373]: osdmap e21: 3 total, 3 up, 3 in 2024-05-10T10:47:35.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:35 smithi107 ceph-mon[30373]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-10T10:47:36.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:36 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1109932123' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "589ec3bb-884a-4441-a9d2-1f34ab372cc4"}]: dispatch 2024-05-10T10:47:36.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:36 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1109932123' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "589ec3bb-884a-4441-a9d2-1f34ab372cc4"}]': finished 2024-05-10T10:47:36.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:36 smithi107 ceph-mon[30373]: osdmap e22: 4 total, 3 up, 4 in 2024-05-10T10:47:36.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T10:47:36.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:36 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1109932123' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "589ec3bb-884a-4441-a9d2-1f34ab372cc4"}]: dispatch 2024-05-10T10:47:36.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:36 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1109932123' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "589ec3bb-884a-4441-a9d2-1f34ab372cc4"}]': finished 2024-05-10T10:47:36.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:36 smithi196 ceph-mon[34872]: osdmap e22: 4 total, 3 up, 4 in 2024-05-10T10:47:36.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:36 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T10:47:36.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:36 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1109932123' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "589ec3bb-884a-4441-a9d2-1f34ab372cc4"}]: dispatch 2024-05-10T10:47:36.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:36 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1109932123' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "589ec3bb-884a-4441-a9d2-1f34ab372cc4"}]': finished 2024-05-10T10:47:36.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:36 smithi184 ceph-mon[34585]: osdmap e22: 4 total, 3 up, 4 in 2024-05-10T10:47:36.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:36 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T10:47:37.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:37 smithi196 ceph-mon[34872]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:37.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:37 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/540244706' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:47:37.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:37 smithi184 ceph-mon[34585]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:37.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:37 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/540244706' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:47:37.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:37 smithi107 ceph-mon[30373]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:37.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:37 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/540244706' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:47:39.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:39 smithi196 ceph-mon[34872]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:39.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:39 smithi184 ceph-mon[34585]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:39.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:39 smithi107 ceph-mon[30373]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:41.506 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:41 smithi107 ceph-mon[30373]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:41.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:41 smithi196 ceph-mon[34872]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:41.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:41 smithi184 ceph-mon[34585]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:43.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:43 smithi107 ceph-mon[30373]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:43.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:43 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-10T10:47:43.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:43 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:43.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:43 smithi196 ceph-mon[34872]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:43.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:43 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-10T10:47:43.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:43 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:43.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:43 smithi184 ceph-mon[34585]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:43.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:43 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-10T10:47:43.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:43 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:44.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:44 smithi196 ceph-mon[34872]: Deploying daemon osd.3 on smithi107 2024-05-10T10:47:44.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:44 smithi184 ceph-mon[34585]: Deploying daemon osd.3 on smithi107 2024-05-10T10:47:44.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:44 smithi107 ceph-mon[30373]: Deploying daemon osd.3 on smithi107 2024-05-10T10:47:45.347 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:45 smithi107 ceph-mon[30373]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:45.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:45 smithi196 ceph-mon[34872]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:45.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:45 smithi184 ceph-mon[34585]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:47.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:47 smithi196 ceph-mon[34872]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:47.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:47 smithi184 ceph-mon[34585]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:47.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:47 smithi107 ceph-mon[30373]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:49.368 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:49 smithi107 ceph-mon[30373]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:49.369 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:49 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:49.369 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:49 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:49.369 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:49 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:47:49.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:49 smithi196 ceph-mon[34872]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:49.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:49 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:49.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:49 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:49.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:49 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:47:49.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:49 smithi184 ceph-mon[34585]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:49.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:49 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:49.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:49 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:49.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:49 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:47:51.534 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:51 smithi107 ceph-mon[30373]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:51.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:51 smithi196 ceph-mon[34872]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:51.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:51 smithi184 ceph-mon[34585]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:52.288 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:52.286+0000 7f97977fe700 1 -- 172.21.15.107:0/4208870663 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f97a00638e0 con 0x7f978c0b2870 2024-05-10T10:47:52.288 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 3 on host 'smithi107' 2024-05-10T10:47:52.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:52.289+0000 7f97a8671700 1 -- 172.21.15.107:0/4208870663 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f978c0b2870 msgr2=0x7f978c0b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:47:52.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:52.289+0000 7f97a8671700 1 --2- 172.21.15.107:0/4208870663 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f978c0b2870 0x7f978c0b4d30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f979c006010 tx=0x7f979c009f10 comp rx=0 tx=0).stop 2024-05-10T10:47:52.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:52.289+0000 7f97a8671700 1 -- 172.21.15.107:0/4208870663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97a0105090 msgr2=0x7f97a01a0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:47:52.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:52.289+0000 7f97a8671700 1 --2- 172.21.15.107:0/4208870663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97a0105090 0x7f97a01a0d20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f979800b9a0 tx=0x7f979800bcb0 comp rx=0 tx=0).stop 2024-05-10T10:47:52.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:52.289+0000 7f97a8671700 1 -- 172.21.15.107:0/4208870663 shutdown_connections 2024-05-10T10:47:52.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:52.289+0000 7f97a8671700 1 --2- 172.21.15.107:0/4208870663 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f978c0b2870 0x7f978c0b4d30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:52.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:52.289+0000 7f97a8671700 1 --2- 172.21.15.107:0/4208870663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f97a01034f0 0x7f97a0199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:52.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:52.289+0000 7f97a8671700 1 --2- 172.21.15.107:0/4208870663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f97a0105090 0x7f97a01a0d20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:52.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:52.289+0000 7f97a8671700 1 --2- 172.21.15.107:0/4208870663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97a01046f0 0x7f97a0199ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:52.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:52.289+0000 7f97a8671700 1 -- 172.21.15.107:0/4208870663 >> 172.21.15.107:0/4208870663 conn(0x7f97a00fea90 msgr2=0x7f97a01079f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:47:52.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:52.289+0000 7f97a8671700 1 -- 172.21.15.107:0/4208870663 shutdown_connections 2024-05-10T10:47:52.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:47:52.289+0000 7f97a8671700 1 -- 172.21.15.107:0/4208870663 wait complete. 2024-05-10T10:47:52.515 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:52 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:52.515 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:52 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:52.515 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:52 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:52.515 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:52 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:47:52.515 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:52 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:52.515 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:52 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:52.516 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:52 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:52.516 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:52 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:47:52.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:52.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:52.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:52.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:47:52.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:52.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:52.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:52.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:52 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:47:52.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:52 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:52.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:52 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:52.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:52 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:52.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:52 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:47:52.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:52 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:52.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:52 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:52.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:52 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:52.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:52 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:47:52.931 DEBUG:teuthology.orchestra.run.smithi107:osd.3> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.3.service 2024-05-10T10:47:52.935 INFO:tasks.cephadm:Deploying osd.4 on smithi184 with /dev/vg_nvme/lv_3... 2024-05-10T10:47:52.935 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-10T10:47:53.177 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T10:47:53.606 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:53 smithi184 ceph-mon[34585]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:53.607 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:53 smithi184 ceph-mon[34585]: from='osd.3 [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-10T10:47:53.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:53 smithi107 ceph-mon[30373]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:53.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:53 smithi107 ceph-mon[30373]: from='osd.3 [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-10T10:47:53.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:53 smithi196 ceph-mon[34872]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:53.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:53 smithi196 ceph-mon[34872]: from='osd.3 [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-10T10:47:54.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:54 smithi184 ceph-mon[34585]: from='osd.3 [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-10T10:47:54.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:54 smithi184 ceph-mon[34585]: osdmap e23: 4 total, 3 up, 4 in 2024-05-10T10:47:54.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:54 smithi184 ceph-mon[34585]: from='osd.3 [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-05-10T10:47:54.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:54 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T10:47:54.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:54 smithi184 ceph-mon[34585]: from='osd.3 [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-05-10T10:47:54.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:54 smithi107 ceph-mon[30373]: from='osd.3 [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-10T10:47:54.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:54 smithi107 ceph-mon[30373]: osdmap e23: 4 total, 3 up, 4 in 2024-05-10T10:47:54.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:54 smithi107 ceph-mon[30373]: from='osd.3 [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-05-10T10:47:54.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:54 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T10:47:54.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:54 smithi107 ceph-mon[30373]: from='osd.3 [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-05-10T10:47:54.676 INFO:journalctl@ceph.osd.3.smithi107.stdout:May 10 10:47:54 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-3[52118]: 2024-05-10T10:47:54.320+0000 7f2c881e6700 -1 osd.3 0 waiting for initial osdmap 2024-05-10T10:47:54.676 INFO:journalctl@ceph.osd.3.smithi107.stdout:May 10 10:47:54 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-3[52118]: 2024-05-10T10:47:54.330+0000 7f2c83fd9700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T10:47:54.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:54 smithi196 ceph-mon[34872]: from='osd.3 [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-10T10:47:54.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:54 smithi196 ceph-mon[34872]: osdmap e23: 4 total, 3 up, 4 in 2024-05-10T10:47:54.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:54 smithi196 ceph-mon[34872]: from='osd.3 [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-05-10T10:47:54.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:54 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T10:47:54.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:54 smithi196 ceph-mon[34872]: from='osd.3 [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-05-10T10:47:55.023 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-10T10:47:55.023 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-10T10:47:55.023 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2024-05-10T10:47:55.023 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2024-05-10T10:47:55.023 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114282 s, 918 MB/s 2024-05-10T10:47:55.023 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2024-05-10T10:47:55.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:55 smithi107 ceph-mon[30373]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:55.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:55 smithi107 ceph-mon[30373]: osdmap e24: 4 total, 3 up, 4 in 2024-05-10T10:47:55.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:55 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T10:47:55.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:55 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T10:47:55.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:55 smithi107 ceph-mon[30373]: osd.3 [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021] boot 2024-05-10T10:47:55.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:55 smithi107 ceph-mon[30373]: osdmap e25: 4 total, 4 up, 4 in 2024-05-10T10:47:55.427 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:55 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T10:47:55.634 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:55 smithi184 ceph-mon[34585]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:55.634 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:55 smithi184 ceph-mon[34585]: osdmap e24: 4 total, 3 up, 4 in 2024-05-10T10:47:55.634 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:55 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T10:47:55.634 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:55 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T10:47:55.634 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:55 smithi184 ceph-mon[34585]: osd.3 [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021] boot 2024-05-10T10:47:55.634 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:55 smithi184 ceph-mon[34585]: osdmap e25: 4 total, 4 up, 4 in 2024-05-10T10:47:55.634 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:55 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T10:47:55.662 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi184:vg_nvme/lv_3 2024-05-10T10:47:55.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:55 smithi196 ceph-mon[34872]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-10T10:47:55.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:55 smithi196 ceph-mon[34872]: osdmap e24: 4 total, 3 up, 4 in 2024-05-10T10:47:55.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:55 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T10:47:55.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:55 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T10:47:55.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:55 smithi196 ceph-mon[34872]: osd.3 [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021] boot 2024-05-10T10:47:55.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:55 smithi196 ceph-mon[34872]: osdmap e25: 4 total, 4 up, 4 in 2024-05-10T10:47:55.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:55 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-10T10:47:55.913 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T10:47:56.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:56 smithi184 ceph-mon[34585]: purged_snaps scrub starts 2024-05-10T10:47:56.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:56 smithi184 ceph-mon[34585]: purged_snaps scrub ok 2024-05-10T10:47:56.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:56 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:56.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:56 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:56.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:56 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:47:56.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:56 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:47:56.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:56 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:56.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:56 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:56.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:56 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:47:56.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:56 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:56.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:56 smithi184 ceph-mon[34585]: osdmap e26: 4 total, 4 up, 4 in 2024-05-10T10:47:56.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:56 smithi107 ceph-mon[30373]: purged_snaps scrub starts 2024-05-10T10:47:56.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:56 smithi107 ceph-mon[30373]: purged_snaps scrub ok 2024-05-10T10:47:56.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:56 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:56.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:56 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:56.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:56 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:47:56.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:56 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:47:56.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:56 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:56.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:56 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:56.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:56 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:47:56.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:56 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:56.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:56 smithi107 ceph-mon[30373]: osdmap e26: 4 total, 4 up, 4 in 2024-05-10T10:47:56.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:56 smithi196 ceph-mon[34872]: purged_snaps scrub starts 2024-05-10T10:47:56.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:56 smithi196 ceph-mon[34872]: purged_snaps scrub ok 2024-05-10T10:47:56.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:56 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:56.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:56 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:56.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:56 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:47:56.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:56 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:47:56.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:56 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:56.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:56 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:56.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:56 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:47:56.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:56 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:47:56.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:56 smithi196 ceph-mon[34872]: osdmap e26: 4 total, 4 up, 4 in 2024-05-10T10:47:57.466 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.464+0000 7f75695b7700 1 -- 172.21.15.184:0/2052141971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7564105190 msgr2=0x7f756410ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:47:57.466 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.464+0000 7f75695b7700 1 --2- 172.21.15.184:0/2052141971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7564105190 0x7f756410ba40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f755c00b0a0 tx=0x7f755c00b3b0 comp rx=0 tx=0).stop 2024-05-10T10:47:57.467 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.464+0000 7f75695b7700 1 -- 172.21.15.184:0/2052141971 shutdown_connections 2024-05-10T10:47:57.467 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.464+0000 7f75695b7700 1 --2- 172.21.15.184:0/2052141971 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7564101810 0x7f7564101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:57.467 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.464+0000 7f75695b7700 1 --2- 172.21.15.184:0/2052141971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7564105190 0x7f756410ba40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:57.467 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.464+0000 7f75695b7700 1 --2- 172.21.15.184:0/2052141971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75641047f0 0x7f7564104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:57.467 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.464+0000 7f75695b7700 1 -- 172.21.15.184:0/2052141971 >> 172.21.15.184:0/2052141971 conn(0x7f75640fd170 msgr2=0x7f75640ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:47:57.467 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.464+0000 7f75695b7700 1 -- 172.21.15.184:0/2052141971 shutdown_connections 2024-05-10T10:47:57.467 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.464+0000 7f75695b7700 1 -- 172.21.15.184:0/2052141971 wait complete. 2024-05-10T10:47:57.467 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.465+0000 7f75695b7700 1 Processor -- start 2024-05-10T10:47:57.469 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.465+0000 7f75695b7700 1 -- start start 2024-05-10T10:47:57.469 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.465+0000 7f75695b7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7564101810 0x7f7564104150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:47:57.469 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.465+0000 7f75695b7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75641047f0 0x7f75641027a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:47:57.469 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.465+0000 7f75695b7700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7564105190 0x7f7564102ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:47:57.469 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.465+0000 7f75695b7700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f756410f110 con 0x7f75641047f0 2024-05-10T10:47:57.469 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.465+0000 7f75695b7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f756410ef90 con 0x7f7564101810 2024-05-10T10:47:57.469 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.465+0000 7f75695b7700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f756410f290 con 0x7f7564105190 2024-05-10T10:47:57.469 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.466+0000 7f7562ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7564101810 0x7f7564104150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:47:57.469 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.466+0000 7f7562ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7564101810 0x7f7564104150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:38910/0 (socket says 172.21.15.184:38910) 2024-05-10T10:47:57.469 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.466+0000 7f7562ffd700 1 -- 172.21.15.184:0/3979986649 learned_addr learned my addr 172.21.15.184:0/3979986649 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-05-10T10:47:57.470 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.466+0000 7f75637fe700 1 --2- 172.21.15.184:0/3979986649 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7564105190 0x7f7564102ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:47:57.470 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.466+0000 7f75627fc700 1 --2- 172.21.15.184:0/3979986649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75641047f0 0x7f75641027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:47:57.470 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.466+0000 7f7562ffd700 1 -- 172.21.15.184:0/3979986649 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7564105190 msgr2=0x7f7564102ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:47:57.470 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.466+0000 7f7562ffd700 1 --2- 172.21.15.184:0/3979986649 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7564105190 0x7f7564102ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:57.470 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.466+0000 7f7562ffd700 1 -- 172.21.15.184:0/3979986649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75641047f0 msgr2=0x7f75641027a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:47:57.470 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.466+0000 7f7562ffd700 1 --2- 172.21.15.184:0/3979986649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75641047f0 0x7f75641027a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:47:57.470 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.466+0000 7f7562ffd700 1 -- 172.21.15.184:0/3979986649 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7564103590 con 0x7f7564101810 2024-05-10T10:47:57.470 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.466+0000 7f7562ffd700 1 --2- 172.21.15.184:0/3979986649 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7564101810 0x7f7564104150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f755400c8f0 tx=0x7f755400cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:47:57.470 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.466+0000 7f754bfff700 1 -- 172.21.15.184:0/3979986649 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554004220 con 0x7f7564101810 2024-05-10T10:47:57.470 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.466+0000 7f754bfff700 1 -- 172.21.15.184:0/3979986649 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f75540043c0 con 0x7f7564101810 2024-05-10T10:47:57.470 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.466+0000 7f75695b7700 1 -- 172.21.15.184:0/3979986649 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75641a37f0 con 0x7f7564101810 2024-05-10T10:47:57.470 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.466+0000 7f754bfff700 1 -- 172.21.15.184:0/3979986649 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554003d10 con 0x7f7564101810 2024-05-10T10:47:57.470 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.466+0000 7f75695b7700 1 -- 172.21.15.184:0/3979986649 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75641a3d00 con 0x7f7564101810 2024-05-10T10:47:57.470 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.467+0000 7f75695b7700 1 -- 172.21.15.184:0/3979986649 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f756406a190 con 0x7f7564101810 2024-05-10T10:47:57.471 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:57 smithi184 ceph-mon[34585]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:47:57.471 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:57 smithi184 ceph-mon[34585]: Detected new or changed devices on smithi107 2024-05-10T10:47:57.471 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:57 smithi184 ceph-mon[34585]: Adjusting osd_memory_target on smithi107 to 8544M 2024-05-10T10:47:57.471 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:57 smithi184 ceph-mon[34585]: osdmap e27: 4 total, 4 up, 4 in 2024-05-10T10:47:57.471 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.469+0000 7f754bfff700 1 -- 172.21.15.184:0/3979986649 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f7554007740 con 0x7f7564101810 2024-05-10T10:47:57.472 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.470+0000 7f754bfff700 1 --2- 172.21.15.184:0/3979986649 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f754c0b2900 0x7f754c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:47:57.472 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.470+0000 7f754bfff700 1 -- 172.21.15.184:0/3979986649 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3669+0+0 (secure 0 0 0) 0x7f75540e0fe0 con 0x7f7564101810 2024-05-10T10:47:57.472 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.471+0000 7f75627fc700 1 --2- 172.21.15.184:0/3979986649 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f754c0b2900 0x7f754c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:47:57.472 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.471+0000 7f75627fc700 1 --2- 172.21.15.184:0/3979986649 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f754c0b2900 0x7f754c0b4dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7558005950 tx=0x7f75580058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:47:57.476 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.475+0000 7f754bfff700 1 -- 172.21.15.184:0/3979986649 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f7554014030 con 0x7f7564101810 2024-05-10T10:47:57.587 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:57 smithi107 ceph-mon[30373]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:47:57.588 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:57 smithi107 ceph-mon[30373]: Detected new or changed devices on smithi107 2024-05-10T10:47:57.588 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:57 smithi107 ceph-mon[30373]: Adjusting osd_memory_target on smithi107 to 8544M 2024-05-10T10:47:57.588 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:57 smithi107 ceph-mon[30373]: osdmap e27: 4 total, 4 up, 4 in 2024-05-10T10:47:57.688 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:47:57.686+0000 7f75695b7700 1 -- 172.21.15.184:0/3979986649 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f75640638e0 con 0x7f754c0b2900 2024-05-10T10:47:57.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:57 smithi196 ceph-mon[34872]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:47:57.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:57 smithi196 ceph-mon[34872]: Detected new or changed devices on smithi107 2024-05-10T10:47:57.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:57 smithi196 ceph-mon[34872]: Adjusting osd_memory_target on smithi107 to 8544M 2024-05-10T10:47:57.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:57 smithi196 ceph-mon[34872]: osdmap e27: 4 total, 4 up, 4 in 2024-05-10T10:47:58.555 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:58 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:47:58.555 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:58 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:47:58.555 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:58 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:58.627 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:58 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:47:58.628 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:58 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:47:58.628 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:58 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:58.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:58 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:47:58.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:58 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:47:58.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:58 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:47:59.449 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:59 smithi184 ceph-mon[34585]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:47:59.449 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:47:59 smithi184 ceph-mon[34585]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:47:59.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:59 smithi107 ceph-mon[30373]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:47:59.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:47:59 smithi107 ceph-mon[30373]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:47:59.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:59 smithi196 ceph-mon[34872]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:47:59.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:47:59 smithi196 ceph-mon[34872]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:48:00.627 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:00 smithi184 ceph-mon[34585]: from='client.? 172.21.15.184:0/169286600' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b72cdb50-492b-4406-8f21-37e4b2cf5a89"}]: dispatch 2024-05-10T10:48:00.627 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:00 smithi184 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b72cdb50-492b-4406-8f21-37e4b2cf5a89"}]: dispatch 2024-05-10T10:48:00.627 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:00 smithi184 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b72cdb50-492b-4406-8f21-37e4b2cf5a89"}]': finished 2024-05-10T10:48:00.627 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:00 smithi184 ceph-mon[34585]: osdmap e28: 5 total, 4 up, 5 in 2024-05-10T10:48:00.627 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:00 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:00.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:00 smithi107 ceph-mon[30373]: from='client.? 172.21.15.184:0/169286600' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b72cdb50-492b-4406-8f21-37e4b2cf5a89"}]: dispatch 2024-05-10T10:48:00.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:00 smithi107 ceph-mon[30373]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b72cdb50-492b-4406-8f21-37e4b2cf5a89"}]: dispatch 2024-05-10T10:48:00.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:00 smithi107 ceph-mon[30373]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b72cdb50-492b-4406-8f21-37e4b2cf5a89"}]': finished 2024-05-10T10:48:00.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:00 smithi107 ceph-mon[30373]: osdmap e28: 5 total, 4 up, 5 in 2024-05-10T10:48:00.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:00 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:00.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:00 smithi196 ceph-mon[34872]: from='client.? 172.21.15.184:0/169286600' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b72cdb50-492b-4406-8f21-37e4b2cf5a89"}]: dispatch 2024-05-10T10:48:00.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:00 smithi196 ceph-mon[34872]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b72cdb50-492b-4406-8f21-37e4b2cf5a89"}]: dispatch 2024-05-10T10:48:00.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:00 smithi196 ceph-mon[34872]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b72cdb50-492b-4406-8f21-37e4b2cf5a89"}]': finished 2024-05-10T10:48:00.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:00 smithi196 ceph-mon[34872]: osdmap e28: 5 total, 4 up, 5 in 2024-05-10T10:48:00.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:00 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:01.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:01 smithi184 ceph-mon[34585]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-05-10T10:48:01.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:01 smithi184 ceph-mon[34585]: from='client.? 172.21.15.184:0/3914209244' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:48:01.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:01 smithi107 ceph-mon[30373]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-05-10T10:48:01.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:01 smithi107 ceph-mon[30373]: from='client.? 172.21.15.184:0/3914209244' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:48:01.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:01 smithi196 ceph-mon[34872]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-05-10T10:48:01.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:01 smithi196 ceph-mon[34872]: from='client.? 172.21.15.184:0/3914209244' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:48:03.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:03 smithi184 ceph-mon[34585]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-10T10:48:03.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:03 smithi107 ceph-mon[30373]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-10T10:48:03.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:03 smithi196 ceph-mon[34872]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-10T10:48:05.631 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:05 smithi184 ceph-mon[34585]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-05-10T10:48:05.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:05 smithi107 ceph-mon[30373]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-05-10T10:48:05.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:05 smithi196 ceph-mon[34872]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-05-10T10:48:07.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:07 smithi184 ceph-mon[34585]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-10T10:48:07.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:07 smithi107 ceph-mon[30373]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-10T10:48:07.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:07 smithi196 ceph-mon[34872]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-10T10:48:08.584 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-10T10:48:08.584 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:08.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-10T10:48:08.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:08.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-10T10:48:08.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:09.603 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:09 smithi184 ceph-mon[34585]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T10:48:09.603 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:09 smithi184 ceph-mon[34585]: Deploying daemon osd.4 on smithi184 2024-05-10T10:48:09.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:09 smithi107 ceph-mon[30373]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T10:48:09.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:09 smithi107 ceph-mon[30373]: Deploying daemon osd.4 on smithi184 2024-05-10T10:48:09.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:09 smithi196 ceph-mon[34872]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T10:48:09.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:09 smithi196 ceph-mon[34872]: Deploying daemon osd.4 on smithi184 2024-05-10T10:48:11.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:11 smithi184 ceph-mon[34585]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:11.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:11 smithi107 ceph-mon[30373]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:11.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:11 smithi196 ceph-mon[34872]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:13.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:13 smithi184 ceph-mon[34585]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:13.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:13 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:13.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:13 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:13.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:13 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:48:13.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:13 smithi107 ceph-mon[30373]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:13.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:13 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:13.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:13 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:13.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:13 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:48:13.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:13 smithi196 ceph-mon[34872]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:13.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:13 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:13.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:13 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:13.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:13 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:48:15.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:15 smithi184 ceph-mon[34585]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:15.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:15 smithi107 ceph-mon[30373]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:15.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:15 smithi196 ceph-mon[34872]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:16.401 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 4 on host 'smithi184' 2024-05-10T10:48:16.401 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:48:16.399+0000 7f754bfff700 1 -- 172.21.15.184:0/3979986649 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f75640638e0 con 0x7f754c0b2900 2024-05-10T10:48:16.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:48:16.402+0000 7f75695b7700 1 -- 172.21.15.184:0/3979986649 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f754c0b2900 msgr2=0x7f754c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:48:16.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:48:16.402+0000 7f75695b7700 1 --2- 172.21.15.184:0/3979986649 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f754c0b2900 0x7f754c0b4dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7558005950 tx=0x7f75580058e0 comp rx=0 tx=0).stop 2024-05-10T10:48:16.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:48:16.402+0000 7f75695b7700 1 -- 172.21.15.184:0/3979986649 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7564101810 msgr2=0x7f7564104150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:48:16.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:48:16.402+0000 7f75695b7700 1 --2- 172.21.15.184:0/3979986649 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7564101810 0x7f7564104150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f755400c8f0 tx=0x7f755400cc00 comp rx=0 tx=0).stop 2024-05-10T10:48:16.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:48:16.402+0000 7f75695b7700 1 -- 172.21.15.184:0/3979986649 shutdown_connections 2024-05-10T10:48:16.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:48:16.402+0000 7f75695b7700 1 --2- 172.21.15.184:0/3979986649 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f754c0b2900 0x7f754c0b4dc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:48:16.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:48:16.402+0000 7f75695b7700 1 --2- 172.21.15.184:0/3979986649 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7564105190 0x7f7564102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:48:16.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:48:16.402+0000 7f75695b7700 1 --2- 172.21.15.184:0/3979986649 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7564101810 0x7f7564104150 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:48:16.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:48:16.402+0000 7f75695b7700 1 --2- 172.21.15.184:0/3979986649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f75641047f0 0x7f75641027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:48:16.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:48:16.402+0000 7f75695b7700 1 -- 172.21.15.184:0/3979986649 >> 172.21.15.184:0/3979986649 conn(0x7f75640fd170 msgr2=0x7f7564107a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:48:16.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:48:16.402+0000 7f75695b7700 1 -- 172.21.15.184:0/3979986649 shutdown_connections 2024-05-10T10:48:16.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:48:16.402+0000 7f75695b7700 1 -- 172.21.15.184:0/3979986649 wait complete. 2024-05-10T10:48:16.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:16 smithi184 ceph-mon[34585]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:16.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:16 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:16.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:16 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:16.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:16 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:16.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:16 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:48:16.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:16 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:16.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:16 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:16.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:16 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:16.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:16 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:48:16.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:16 smithi107 ceph-mon[30373]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:16.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:16 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:16.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:16 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:16.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:16 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:16.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:16 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:48:16.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:16 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:16.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:16 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:16.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:16 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:16.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:16 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:48:17.046 DEBUG:teuthology.orchestra.run.smithi184:osd.4> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.4.service 2024-05-10T10:48:17.049 INFO:tasks.cephadm:Deploying osd.5 on smithi196 with /dev/vg_nvme/lv_3... 2024-05-10T10:48:17.049 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-10T10:48:17.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:16 smithi196 ceph-mon[34872]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:17.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:16 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:17.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:16 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:17.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:16 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:17.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:16 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:48:17.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:16 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:17.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:16 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:17.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:16 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:17.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:16 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:48:17.295 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T10:48:17.696 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:17 smithi196 ceph-mon[34872]: from='osd.4 [v2:172.21.15.184:6808/271550329,v1:172.21.15.184:6809/271550329]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-10T10:48:17.697 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:17 smithi196 ceph-mon[34872]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-10T10:48:17.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:17 smithi184 ceph-mon[34585]: from='osd.4 [v2:172.21.15.184:6808/271550329,v1:172.21.15.184:6809/271550329]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-10T10:48:17.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:17 smithi184 ceph-mon[34585]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-10T10:48:17.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:17 smithi107 ceph-mon[30373]: from='osd.4 [v2:172.21.15.184:6808/271550329,v1:172.21.15.184:6809/271550329]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-10T10:48:17.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:17 smithi107 ceph-mon[30373]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-10T10:48:18.630 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:18 smithi196 ceph-mon[34872]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:18.631 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:18 smithi196 ceph-mon[34872]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-10T10:48:18.631 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:18 smithi196 ceph-mon[34872]: osdmap e29: 5 total, 4 up, 5 in 2024-05-10T10:48:18.631 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:18 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:18.631 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:18 smithi196 ceph-mon[34872]: from='osd.4 [v2:172.21.15.184:6808/271550329,v1:172.21.15.184:6809/271550329]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:48:18.631 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:18 smithi196 ceph-mon[34872]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:48:18.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:18 smithi184 ceph-mon[34585]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:18.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:18 smithi184 ceph-mon[34585]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-10T10:48:18.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:18 smithi184 ceph-mon[34585]: osdmap e29: 5 total, 4 up, 5 in 2024-05-10T10:48:18.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:18 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:18.642 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:18 smithi184 ceph-mon[34585]: from='osd.4 [v2:172.21.15.184:6808/271550329,v1:172.21.15.184:6809/271550329]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:48:18.642 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:18 smithi184 ceph-mon[34585]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:48:18.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:18 smithi107 ceph-mon[30373]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:18.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:18 smithi107 ceph-mon[30373]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-10T10:48:18.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:18 smithi107 ceph-mon[30373]: osdmap e29: 5 total, 4 up, 5 in 2024-05-10T10:48:18.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:18 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:18.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:18 smithi107 ceph-mon[30373]: from='osd.4 [v2:172.21.15.184:6808/271550329,v1:172.21.15.184:6809/271550329]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:48:18.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:18 smithi107 ceph-mon[30373]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:48:19.194 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-10T10:48:19.194 INFO:teuthology.orchestra.run.smithi196.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-10T10:48:19.194 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10+0 records in 2024-05-10T10:48:19.195 INFO:teuthology.orchestra.run.smithi196.stderr:10+0 records out 2024-05-10T10:48:19.195 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112617 s, 931 MB/s 2024-05-10T10:48:19.195 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping successful for: 2024-05-10T10:48:19.631 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:19 smithi184 ceph-mon[34585]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-05-10T10:48:19.631 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:19 smithi184 ceph-mon[34585]: osdmap e30: 5 total, 4 up, 5 in 2024-05-10T10:48:19.631 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:19 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:19.631 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:19 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:19.631 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:19 smithi184 ceph-mon[34585]: from='osd.4 ' entity='osd.4' 2024-05-10T10:48:19.631 INFO:journalctl@ceph.osd.4.smithi184.stdout:May 10 10:48:19 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-4[46001]: 2024-05-10T10:48:19.517+0000 7f582fa75700 -1 osd.4 0 waiting for initial osdmap 2024-05-10T10:48:19.631 INFO:journalctl@ceph.osd.4.smithi184.stdout:May 10 10:48:19 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-4[46001]: 2024-05-10T10:48:19.628+0000 7f5827860700 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T10:48:19.790 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:19 smithi196 ceph-mon[34872]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-05-10T10:48:19.790 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:19 smithi196 ceph-mon[34872]: osdmap e30: 5 total, 4 up, 5 in 2024-05-10T10:48:19.791 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:19 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:19.791 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:19 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:19.791 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:19 smithi196 ceph-mon[34872]: from='osd.4 ' entity='osd.4' 2024-05-10T10:48:19.818 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi196:vg_nvme/lv_3 2024-05-10T10:48:19.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:19 smithi107 ceph-mon[30373]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-05-10T10:48:19.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:19 smithi107 ceph-mon[30373]: osdmap e30: 5 total, 4 up, 5 in 2024-05-10T10:48:19.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:19 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:19.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:19 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:19.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:19 smithi107 ceph-mon[30373]: from='osd.4 ' entity='osd.4' 2024-05-10T10:48:20.095 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T10:48:20.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:20 smithi196 ceph-mon[34872]: purged_snaps scrub starts 2024-05-10T10:48:20.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:20 smithi196 ceph-mon[34872]: purged_snaps scrub ok 2024-05-10T10:48:20.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:20 smithi196 ceph-mon[34872]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:20.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:20 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:20.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:20 smithi196 ceph-mon[34872]: Detected new or changed devices on smithi184 2024-05-10T10:48:20.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:20 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:20.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:20 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:20.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:20 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:48:20.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:20 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:48:20.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:20 smithi196 ceph-mon[34872]: Adjusting osd_memory_target on smithi184 to 8544M 2024-05-10T10:48:20.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:20 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:20.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:20 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:20.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:20 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:48:20.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:20 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:20.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:20 smithi184 ceph-mon[34585]: purged_snaps scrub starts 2024-05-10T10:48:20.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:20 smithi184 ceph-mon[34585]: purged_snaps scrub ok 2024-05-10T10:48:20.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:20 smithi184 ceph-mon[34585]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:20.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:20 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:20.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:20 smithi184 ceph-mon[34585]: Detected new or changed devices on smithi184 2024-05-10T10:48:20.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:20 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:20.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:20 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:20.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:20 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:48:20.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:20 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:48:20.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:20 smithi184 ceph-mon[34585]: Adjusting osd_memory_target on smithi184 to 8544M 2024-05-10T10:48:20.891 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:20 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:20.891 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:20 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:20.891 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:20 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:48:20.891 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:20 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:20.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:20 smithi107 ceph-mon[30373]: purged_snaps scrub starts 2024-05-10T10:48:20.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:20 smithi107 ceph-mon[30373]: purged_snaps scrub ok 2024-05-10T10:48:20.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:20 smithi107 ceph-mon[30373]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:20.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:20.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:20 smithi107 ceph-mon[30373]: Detected new or changed devices on smithi184 2024-05-10T10:48:20.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:20.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:20.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:48:20.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:48:20.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:20 smithi107 ceph-mon[30373]: Adjusting osd_memory_target on smithi184 to 8544M 2024-05-10T10:48:20.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:20.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:20.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:48:20.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:21.554 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.551+0000 7f468cbad700 1 -- 172.21.15.196:0/3256135951 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4688103510 msgr2=0x7f4688103930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:48:21.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.551+0000 7f468cbad700 1 --2- 172.21.15.196:0/3256135951 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4688103510 0x7f4688103930 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f467c009990 tx=0x7f467c009ca0 comp rx=0 tx=0).stop 2024-05-10T10:48:21.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.551+0000 7f468cbad700 1 -- 172.21.15.196:0/3256135951 shutdown_connections 2024-05-10T10:48:21.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.551+0000 7f468cbad700 1 --2- 172.21.15.196:0/3256135951 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4688103510 0x7f4688103930 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:48:21.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.551+0000 7f468cbad700 1 --2- 172.21.15.196:0/3256135951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46881050b0 0x7f468810b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:48:21.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.551+0000 7f468cbad700 1 --2- 172.21.15.196:0/3256135951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4688104710 0x7f4688104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:48:21.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.551+0000 7f468cbad700 1 -- 172.21.15.196:0/3256135951 >> 172.21.15.196:0/3256135951 conn(0x7f46880fea70 msgr2=0x7f4688100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:48:21.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.551+0000 7f468cbad700 1 -- 172.21.15.196:0/3256135951 shutdown_connections 2024-05-10T10:48:21.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.551+0000 7f468cbad700 1 -- 172.21.15.196:0/3256135951 wait complete. 2024-05-10T10:48:21.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.552+0000 7f468cbad700 1 Processor -- start 2024-05-10T10:48:21.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.552+0000 7f468cbad700 1 -- start start 2024-05-10T10:48:21.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.552+0000 7f468cbad700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4688103510 0x7f4688199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:48:21.555 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.552+0000 7f468cbad700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4688104710 0x7f4688199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:48:21.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.552+0000 7f468cbad700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46881050b0 0x7f46881a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:48:21.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.552+0000 7f468cbad700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f468810f1c0 con 0x7f46881050b0 2024-05-10T10:48:21.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.552+0000 7f468cbad700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f468810f040 con 0x7f4688104710 2024-05-10T10:48:21.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.552+0000 7f468cbad700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f468810f340 con 0x7f4688103510 2024-05-10T10:48:21.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.552+0000 7f468659c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4688103510 0x7f4688199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:48:21.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.552+0000 7f468659c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4688103510 0x7f4688199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:59226/0 (socket says 172.21.15.196:59226) 2024-05-10T10:48:21.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.552+0000 7f468659c700 1 -- 172.21.15.196:0/68947308 learned_addr learned my addr 172.21.15.196:0/68947308 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-10T10:48:21.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.552+0000 7f4685d9b700 1 --2- 172.21.15.196:0/68947308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4688104710 0x7f4688199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:48:21.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.553+0000 7f468659c700 1 -- 172.21.15.196:0/68947308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4688104710 msgr2=0x7f4688199d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:48:21.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.553+0000 7f468659c700 1 --2- 172.21.15.196:0/68947308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4688104710 0x7f4688199d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:48:21.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.553+0000 7f468659c700 1 -- 172.21.15.196:0/68947308 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46881050b0 msgr2=0x7f46881a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:48:21.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.553+0000 7f4686d9d700 1 --2- 172.21.15.196:0/68947308 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46881050b0 0x7f46881a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:48:21.556 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.553+0000 7f468659c700 1 --2- 172.21.15.196:0/68947308 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46881050b0 0x7f46881a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:48:21.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.553+0000 7f468659c700 1 -- 172.21.15.196:0/68947308 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46881a1470 con 0x7f4688103510 2024-05-10T10:48:21.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.553+0000 7f4686d9d700 1 --2- 172.21.15.196:0/68947308 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46881050b0 0x7f46881a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:48:21.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.553+0000 7f468659c700 1 --2- 172.21.15.196:0/68947308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4688103510 0x7f4688199810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f467c003870 tx=0x7f467c0047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:48:21.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.553+0000 7f46777fe700 1 -- 172.21.15.196:0/68947308 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c003c50 con 0x7f4688103510 2024-05-10T10:48:21.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.553+0000 7f468cbad700 1 -- 172.21.15.196:0/68947308 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46881a1700 con 0x7f4688103510 2024-05-10T10:48:21.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.553+0000 7f46777fe700 1 -- 172.21.15.196:0/68947308 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f467c004830 con 0x7f4688103510 2024-05-10T10:48:21.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.553+0000 7f46777fe700 1 -- 172.21.15.196:0/68947308 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c005410 con 0x7f4688103510 2024-05-10T10:48:21.557 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.553+0000 7f468cbad700 1 -- 172.21.15.196:0/68947308 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46881a1b70 con 0x7f4688103510 2024-05-10T10:48:21.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.554+0000 7f468cbad700 1 -- 172.21.15.196:0/68947308 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f468806a190 con 0x7f4688103510 2024-05-10T10:48:21.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.555+0000 7f46777fe700 1 -- 172.21.15.196:0/68947308 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f467c0049e0 con 0x7f4688103510 2024-05-10T10:48:21.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.556+0000 7f46777fe700 1 --2- 172.21.15.196:0/68947308 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f46700b2880 0x7f46700b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:48:21.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.556+0000 7f46777fe700 1 -- 172.21.15.196:0/68947308 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4101+0+0 (secure 0 0 0) 0x7f467c0e2190 con 0x7f4688103510 2024-05-10T10:48:21.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.556+0000 7f4685d9b700 1 --2- 172.21.15.196:0/68947308 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f46700b2880 0x7f46700b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:48:21.558 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.556+0000 7f4685d9b700 1 --2- 172.21.15.196:0/68947308 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f46700b2880 0x7f46700b4d40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4678004630 tx=0x7f467800b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:48:21.562 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.561+0000 7f46777fe700 1 -- 172.21.15.196:0/68947308 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f467c013070 con 0x7f4688103510 2024-05-10T10:48:21.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:21 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:21.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:21 smithi184 ceph-mon[34585]: osd.4 [v2:172.21.15.184:6808/271550329,v1:172.21.15.184:6809/271550329] boot 2024-05-10T10:48:21.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:21 smithi184 ceph-mon[34585]: osdmap e31: 5 total, 5 up, 5 in 2024-05-10T10:48:21.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:21 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:21.771 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:21.770+0000 7f468cbad700 1 -- 172.21.15.196:0/68947308 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f46880638e0 con 0x7f46700b2880 2024-05-10T10:48:21.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:21 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:21.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:21 smithi196 ceph-mon[34872]: osd.4 [v2:172.21.15.184:6808/271550329,v1:172.21.15.184:6809/271550329] boot 2024-05-10T10:48:21.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:21 smithi196 ceph-mon[34872]: osdmap e31: 5 total, 5 up, 5 in 2024-05-10T10:48:21.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:21 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:21.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:21 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:21.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:21 smithi107 ceph-mon[30373]: osd.4 [v2:172.21.15.184:6808/271550329,v1:172.21.15.184:6809/271550329] boot 2024-05-10T10:48:21.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:21 smithi107 ceph-mon[30373]: osdmap e31: 5 total, 5 up, 5 in 2024-05-10T10:48:21.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:21 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-10T10:48:22.668 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:22 smithi196 ceph-mon[34872]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:22.669 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:22 smithi196 ceph-mon[34872]: osdmap e32: 5 total, 5 up, 5 in 2024-05-10T10:48:22.669 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:22 smithi196 ceph-mon[34872]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:48:22.669 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:22 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:48:22.669 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:22 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:48:22.669 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:22 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:22.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:22 smithi184 ceph-mon[34585]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:22.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:22 smithi184 ceph-mon[34585]: osdmap e32: 5 total, 5 up, 5 in 2024-05-10T10:48:22.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:22 smithi184 ceph-mon[34585]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:48:22.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:22 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:48:22.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:22 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:48:22.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:22 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:22.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:22 smithi107 ceph-mon[30373]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-10T10:48:22.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:22 smithi107 ceph-mon[30373]: osdmap e32: 5 total, 5 up, 5 in 2024-05-10T10:48:22.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:22 smithi107 ceph-mon[30373]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:48:22.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:22 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:48:22.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:22 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:48:22.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:22 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:24.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:24 smithi184 ceph-mon[34585]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:24.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:24 smithi184 ceph-mon[34585]: from='client.? 172.21.15.196:0/2704723495' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "05b6ad82-9153-44df-ae64-50c82d304429"}]: dispatch 2024-05-10T10:48:24.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:24 smithi184 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "05b6ad82-9153-44df-ae64-50c82d304429"}]: dispatch 2024-05-10T10:48:24.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:24 smithi184 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "05b6ad82-9153-44df-ae64-50c82d304429"}]': finished 2024-05-10T10:48:24.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:24 smithi184 ceph-mon[34585]: osdmap e33: 6 total, 5 up, 6 in 2024-05-10T10:48:24.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:24.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:24 smithi107 ceph-mon[30373]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:24.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:24 smithi107 ceph-mon[30373]: from='client.? 172.21.15.196:0/2704723495' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "05b6ad82-9153-44df-ae64-50c82d304429"}]: dispatch 2024-05-10T10:48:24.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:24 smithi107 ceph-mon[30373]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "05b6ad82-9153-44df-ae64-50c82d304429"}]: dispatch 2024-05-10T10:48:24.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:24 smithi107 ceph-mon[30373]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "05b6ad82-9153-44df-ae64-50c82d304429"}]': finished 2024-05-10T10:48:24.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:24 smithi107 ceph-mon[30373]: osdmap e33: 6 total, 5 up, 6 in 2024-05-10T10:48:24.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:25.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:24 smithi196 ceph-mon[34872]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:25.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:24 smithi196 ceph-mon[34872]: from='client.? 172.21.15.196:0/2704723495' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "05b6ad82-9153-44df-ae64-50c82d304429"}]: dispatch 2024-05-10T10:48:25.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:24 smithi196 ceph-mon[34872]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "05b6ad82-9153-44df-ae64-50c82d304429"}]: dispatch 2024-05-10T10:48:25.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:24 smithi196 ceph-mon[34872]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "05b6ad82-9153-44df-ae64-50c82d304429"}]': finished 2024-05-10T10:48:25.065 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:24 smithi196 ceph-mon[34872]: osdmap e33: 6 total, 5 up, 6 in 2024-05-10T10:48:25.065 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:25.900 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:25 smithi184 ceph-mon[34585]: from='client.? 172.21.15.196:0/2067952340' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:48:25.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:25 smithi107 ceph-mon[30373]: from='client.? 172.21.15.196:0/2067952340' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:48:26.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:25 smithi196 ceph-mon[34872]: from='client.? 172.21.15.196:0/2067952340' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:48:26.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:26 smithi184 ceph-mon[34585]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:26.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:26 smithi107 ceph-mon[30373]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:27.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:26 smithi196 ceph-mon[34872]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:28.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:28 smithi184 ceph-mon[34585]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:28.905 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:28 smithi196 ceph-mon[34872]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:28.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:28 smithi107 ceph-mon[30373]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:30.691 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:30 smithi196 ceph-mon[34872]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:30.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:30 smithi184 ceph-mon[34585]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:30.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:30 smithi107 ceph-mon[30373]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:32.906 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:32 smithi196 ceph-mon[34872]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:32.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:32 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-10T10:48:32.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:32 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:32.907 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:32 smithi196 ceph-mon[34872]: Deploying daemon osd.5 on smithi196 2024-05-10T10:48:32.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:32 smithi107 ceph-mon[30373]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:32.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:32 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-10T10:48:32.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:32 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:32.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:32 smithi107 ceph-mon[30373]: Deploying daemon osd.5 on smithi196 2024-05-10T10:48:33.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:32 smithi184 ceph-mon[34585]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:33.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:32 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-10T10:48:33.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:32 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:33.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:32 smithi184 ceph-mon[34585]: Deploying daemon osd.5 on smithi196 2024-05-10T10:48:34.785 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:34 smithi196 ceph-mon[34872]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:34.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:34 smithi107 ceph-mon[30373]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:35.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:34 smithi184 ceph-mon[34585]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:36.752 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:36 smithi196 ceph-mon[34872]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:36.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:36 smithi107 ceph-mon[30373]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:37.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:36 smithi184 ceph-mon[34585]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:38.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:38 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:38.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:38 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:38.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:38 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:48:38.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:38 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:38.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:38 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:38.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:38 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:48:38.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:38 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:38.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:38 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:38.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:38 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:48:39.155 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:39 smithi196 ceph-mon[34872]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:39.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:39 smithi184 ceph-mon[34585]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:39.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:39 smithi107 ceph-mon[30373]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:40.639 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:40.638+0000 7f46777fe700 1 -- 172.21.15.196:0/68947308 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f46880638e0 con 0x7f46700b2880 2024-05-10T10:48:40.640 INFO:teuthology.orchestra.run.smithi196.stdout:Created osd(s) 5 on host 'smithi196' 2024-05-10T10:48:40.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:40.640+0000 7f468cbad700 1 -- 172.21.15.196:0/68947308 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f46700b2880 msgr2=0x7f46700b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:48:40.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:40.640+0000 7f468cbad700 1 --2- 172.21.15.196:0/68947308 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f46700b2880 0x7f46700b4d40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4678004630 tx=0x7f467800b3c0 comp rx=0 tx=0).stop 2024-05-10T10:48:40.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:40.640+0000 7f468cbad700 1 -- 172.21.15.196:0/68947308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4688103510 msgr2=0x7f4688199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:48:40.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:40.640+0000 7f468cbad700 1 --2- 172.21.15.196:0/68947308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4688103510 0x7f4688199810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f467c003870 tx=0x7f467c0047b0 comp rx=0 tx=0).stop 2024-05-10T10:48:40.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:40.640+0000 7f468cbad700 1 -- 172.21.15.196:0/68947308 shutdown_connections 2024-05-10T10:48:40.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:40.640+0000 7f468cbad700 1 --2- 172.21.15.196:0/68947308 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f46700b2880 0x7f46700b4d40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:48:40.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:40.640+0000 7f468cbad700 1 --2- 172.21.15.196:0/68947308 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4688103510 0x7f4688199810 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:48:40.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:40.640+0000 7f468cbad700 1 --2- 172.21.15.196:0/68947308 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46881050b0 0x7f46881a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:48:40.642 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:40.640+0000 7f468cbad700 1 --2- 172.21.15.196:0/68947308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4688104710 0x7f4688199d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:48:40.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:40.640+0000 7f468cbad700 1 -- 172.21.15.196:0/68947308 >> 172.21.15.196:0/68947308 conn(0x7f46880fea70 msgr2=0x7f4688107a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:48:40.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:40.640+0000 7f468cbad700 1 -- 172.21.15.196:0/68947308 shutdown_connections 2024-05-10T10:48:40.643 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:48:40.640+0000 7f468cbad700 1 -- 172.21.15.196:0/68947308 wait complete. 2024-05-10T10:48:40.891 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:40 smithi196 ceph-mon[34872]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:40.891 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:40.891 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:40.891 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:40.891 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:48:40.891 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:40.891 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:40.891 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:40.891 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:48:41.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:40 smithi184 ceph-mon[34585]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:41.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:41.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:41.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:41.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:48:41.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:41.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:41.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:41.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:48:41.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:40 smithi107 ceph-mon[30373]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:41.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:41.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:41.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:41.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:48:41.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:41.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:41.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:41.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:48:41.264 DEBUG:teuthology.orchestra.run.smithi196:osd.5> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.5.service 2024-05-10T10:48:41.267 INFO:tasks.cephadm:Deploying osd.6 on smithi107 with /dev/vg_nvme/lv_2... 2024-05-10T10:48:41.268 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-10T10:48:41.518 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:48:41.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:41 smithi107 ceph-mon[30373]: from='osd.5 [v2:172.21.15.196:6808/3681130435,v1:172.21.15.196:6809/3681130435]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-10T10:48:41.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:41 smithi107 ceph-mon[30373]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-10T10:48:42.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:41 smithi184 ceph-mon[34585]: from='osd.5 [v2:172.21.15.196:6808/3681130435,v1:172.21.15.196:6809/3681130435]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-10T10:48:42.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:41 smithi184 ceph-mon[34585]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-10T10:48:42.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:41 smithi196 ceph-mon[34872]: from='osd.5 [v2:172.21.15.196:6808/3681130435,v1:172.21.15.196:6809/3681130435]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-10T10:48:42.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:41 smithi196 ceph-mon[34872]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-10T10:48:43.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:42 smithi184 ceph-mon[34585]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:43.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:42 smithi184 ceph-mon[34585]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-10T10:48:43.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:42 smithi184 ceph-mon[34585]: osdmap e34: 6 total, 5 up, 6 in 2024-05-10T10:48:43.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:42 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:43.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:42 smithi184 ceph-mon[34585]: from='osd.5 [v2:172.21.15.196:6808/3681130435,v1:172.21.15.196:6809/3681130435]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:48:43.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:42 smithi184 ceph-mon[34585]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:48:43.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:42 smithi107 ceph-mon[30373]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:43.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:42 smithi107 ceph-mon[30373]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-10T10:48:43.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:42 smithi107 ceph-mon[30373]: osdmap e34: 6 total, 5 up, 6 in 2024-05-10T10:48:43.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:42 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:43.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:42 smithi107 ceph-mon[30373]: from='osd.5 [v2:172.21.15.196:6808/3681130435,v1:172.21.15.196:6809/3681130435]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:48:43.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:42 smithi107 ceph-mon[30373]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:48:43.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:42 smithi196 ceph-mon[34872]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:43.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:42 smithi196 ceph-mon[34872]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-10T10:48:43.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:42 smithi196 ceph-mon[34872]: osdmap e34: 6 total, 5 up, 6 in 2024-05-10T10:48:43.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:42 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:43.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:42 smithi196 ceph-mon[34872]: from='osd.5 [v2:172.21.15.196:6808/3681130435,v1:172.21.15.196:6809/3681130435]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:48:43.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:42 smithi196 ceph-mon[34872]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:48:43.402 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-10T10:48:43.402 INFO:teuthology.orchestra.run.smithi107.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-10T10:48:43.402 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10+0 records in 2024-05-10T10:48:43.402 INFO:teuthology.orchestra.run.smithi107.stderr:10+0 records out 2024-05-10T10:48:43.402 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113399 s, 925 MB/s 2024-05-10T10:48:43.402 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping successful for: 2024-05-10T10:48:43.813 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 10:48:43 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T10:48:43.760+0000 7fb974e55700 -1 osd.5 0 waiting for initial osdmap 2024-05-10T10:48:44.034 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:43 smithi107 ceph-mon[30373]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-05-10T10:48:44.034 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:43 smithi107 ceph-mon[30373]: osdmap e35: 6 total, 5 up, 6 in 2024-05-10T10:48:44.034 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:43 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:44.034 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:43 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:44.034 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:43 smithi107 ceph-mon[30373]: osdmap e36: 6 total, 5 up, 6 in 2024-05-10T10:48:44.035 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:43 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:44.035 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:43 smithi107 ceph-mon[30373]: from='osd.5 ' entity='osd.5' 2024-05-10T10:48:44.035 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:43 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:44.060 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi107:vg_nvme/lv_2 2024-05-10T10:48:44.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:43 smithi184 ceph-mon[34585]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-05-10T10:48:44.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:43 smithi184 ceph-mon[34585]: osdmap e35: 6 total, 5 up, 6 in 2024-05-10T10:48:44.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:43 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:44.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:43 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:44.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:43 smithi184 ceph-mon[34585]: osdmap e36: 6 total, 5 up, 6 in 2024-05-10T10:48:44.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:43 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:44.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:43 smithi184 ceph-mon[34585]: from='osd.5 ' entity='osd.5' 2024-05-10T10:48:44.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:43 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:44.156 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 10:48:43 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T10:48:43.846+0000 7fb96cc40700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T10:48:44.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:43 smithi196 ceph-mon[34872]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-05-10T10:48:44.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:43 smithi196 ceph-mon[34872]: osdmap e35: 6 total, 5 up, 6 in 2024-05-10T10:48:44.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:43 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:44.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:43 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:44.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:43 smithi196 ceph-mon[34872]: osdmap e36: 6 total, 5 up, 6 in 2024-05-10T10:48:44.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:43 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:44.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:43 smithi196 ceph-mon[34872]: from='osd.5 ' entity='osd.5' 2024-05-10T10:48:44.157 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:43 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:44.320 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:48:45.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:44 smithi184 ceph-mon[34585]: purged_snaps scrub starts 2024-05-10T10:48:45.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:44 smithi184 ceph-mon[34585]: purged_snaps scrub ok 2024-05-10T10:48:45.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:44 smithi184 ceph-mon[34585]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:45.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:44 smithi184 ceph-mon[34585]: Detected new or changed devices on smithi196 2024-05-10T10:48:45.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:44 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:45.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:44 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:45.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:44 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:48:45.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:44 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:48:45.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:44 smithi184 ceph-mon[34585]: Adjusting osd_memory_target on smithi196 to 8544M 2024-05-10T10:48:45.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:44 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:45.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:44 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:45.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:44 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:48:45.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:44 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:45.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:44 smithi184 ceph-mon[34585]: osd.5 [v2:172.21.15.196:6808/3681130435,v1:172.21.15.196:6809/3681130435] boot 2024-05-10T10:48:45.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:44 smithi184 ceph-mon[34585]: osdmap e37: 6 total, 6 up, 6 in 2024-05-10T10:48:45.141 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:44 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:45.165 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:44 smithi107 ceph-mon[30373]: purged_snaps scrub starts 2024-05-10T10:48:45.165 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:44 smithi107 ceph-mon[30373]: purged_snaps scrub ok 2024-05-10T10:48:45.165 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:44 smithi107 ceph-mon[30373]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:45.165 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:44 smithi107 ceph-mon[30373]: Detected new or changed devices on smithi196 2024-05-10T10:48:45.165 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:44 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:45.165 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:44 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:45.165 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:44 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:48:45.165 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:44 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:48:45.165 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:44 smithi107 ceph-mon[30373]: Adjusting osd_memory_target on smithi196 to 8544M 2024-05-10T10:48:45.165 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:44 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:45.165 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:44 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:45.165 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:44 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:48:45.165 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:44 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:45.165 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:44 smithi107 ceph-mon[30373]: osd.5 [v2:172.21.15.196:6808/3681130435,v1:172.21.15.196:6809/3681130435] boot 2024-05-10T10:48:45.166 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:44 smithi107 ceph-mon[30373]: osdmap e37: 6 total, 6 up, 6 in 2024-05-10T10:48:45.166 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:44 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:45.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:44 smithi196 ceph-mon[34872]: purged_snaps scrub starts 2024-05-10T10:48:45.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:44 smithi196 ceph-mon[34872]: purged_snaps scrub ok 2024-05-10T10:48:45.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:44 smithi196 ceph-mon[34872]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-05-10T10:48:45.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:44 smithi196 ceph-mon[34872]: Detected new or changed devices on smithi196 2024-05-10T10:48:45.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:44 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:45.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:44 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:45.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:44 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:48:45.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:44 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:48:45.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:44 smithi196 ceph-mon[34872]: Adjusting osd_memory_target on smithi196 to 8544M 2024-05-10T10:48:45.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:44 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:45.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:44 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:45.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:44 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:48:45.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:44 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:48:45.315 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:44 smithi196 ceph-mon[34872]: osd.5 [v2:172.21.15.196:6808/3681130435,v1:172.21.15.196:6809/3681130435] boot 2024-05-10T10:48:45.315 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:44 smithi196 ceph-mon[34872]: osdmap e37: 6 total, 6 up, 6 in 2024-05-10T10:48:45.315 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:44 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-10T10:48:45.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.889+0000 7f17368b3700 1 -- 172.21.15.107:0/3222534729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1730103fa0 msgr2=0x7f173010a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:48:45.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.889+0000 7f17368b3700 1 --2- 172.21.15.107:0/3222534729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1730103fa0 0x7f173010a850 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f172800b0d0 tx=0x7f172800b3e0 comp rx=0 tx=0).stop 2024-05-10T10:48:45.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.889+0000 7f17368b3700 1 -- 172.21.15.107:0/3222534729 shutdown_connections 2024-05-10T10:48:45.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.889+0000 7f17368b3700 1 --2- 172.21.15.107:0/3222534729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1730102400 0x7f1730102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:48:45.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.889+0000 7f17368b3700 1 --2- 172.21.15.107:0/3222534729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1730103fa0 0x7f173010a850 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:48:45.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.889+0000 7f17368b3700 1 --2- 172.21.15.107:0/3222534729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1730103600 0x7f1730103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:48:45.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.889+0000 7f17368b3700 1 -- 172.21.15.107:0/3222534729 >> 172.21.15.107:0/3222534729 conn(0x7f17300fd9a0 msgr2=0x7f17300ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:48:45.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.889+0000 7f17368b3700 1 -- 172.21.15.107:0/3222534729 shutdown_connections 2024-05-10T10:48:45.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.889+0000 7f17368b3700 1 -- 172.21.15.107:0/3222534729 wait complete. 2024-05-10T10:48:45.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f17368b3700 1 Processor -- start 2024-05-10T10:48:45.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f17368b3700 1 -- start start 2024-05-10T10:48:45.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f17368b3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1730102400 0x7f173006bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:48:45.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f17368b3700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1730103600 0x7f173019e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:48:45.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f17368b3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1730103fa0 0x7f17301a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:48:45.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f17368b3700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f173010e0d0 con 0x7f1730103fa0 2024-05-10T10:48:45.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f17368b3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f173010df50 con 0x7f1730102400 2024-05-10T10:48:45.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f17368b3700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f173010e250 con 0x7f1730103600 2024-05-10T10:48:45.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f1734e50700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1730103fa0 0x7f17301a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:48:45.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f1734e50700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1730103fa0 0x7f17301a0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44330/0 (socket says 172.21.15.107:44330) 2024-05-10T10:48:45.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f1734e50700 1 -- 172.21.15.107:0/3383064306 learned_addr learned my addr 172.21.15.107:0/3383064306 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:48:45.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f172ffff700 1 --2- 172.21.15.107:0/3383064306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1730102400 0x7f173006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:48:45.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f1727fff700 1 --2- 172.21.15.107:0/3383064306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1730103600 0x7f173019e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:48:45.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f1734e50700 1 -- 172.21.15.107:0/3383064306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1730103600 msgr2=0x7f173019e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:48:45.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f1734e50700 1 --2- 172.21.15.107:0/3383064306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1730103600 0x7f173019e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:48:45.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f1734e50700 1 -- 172.21.15.107:0/3383064306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1730102400 msgr2=0x7f173006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:48:45.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f1734e50700 1 --2- 172.21.15.107:0/3383064306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1730102400 0x7f173006bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:48:45.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f1734e50700 1 -- 172.21.15.107:0/3383064306 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17301a14b0 con 0x7f1730103fa0 2024-05-10T10:48:45.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f1727fff700 1 --2- 172.21.15.107:0/3383064306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1730103600 0x7f173019e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:48:45.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.890+0000 7f1734e50700 1 --2- 172.21.15.107:0/3383064306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1730103fa0 0x7f17301a0be0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f17280062a0 tx=0x7f1728007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:48:45.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.891+0000 7f172dffb700 1 -- 172.21.15.107:0/3383064306 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172801d470 con 0x7f1730103fa0 2024-05-10T10:48:45.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.891+0000 7f172dffb700 1 -- 172.21.15.107:0/3383064306 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1728022070 con 0x7f1730103fa0 2024-05-10T10:48:45.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.891+0000 7f17368b3700 1 -- 172.21.15.107:0/3383064306 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17301a1740 con 0x7f1730103fa0 2024-05-10T10:48:45.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.891+0000 7f172dffb700 1 -- 172.21.15.107:0/3383064306 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172801b9a0 con 0x7f1730103fa0 2024-05-10T10:48:45.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.891+0000 7f17368b3700 1 -- 172.21.15.107:0/3383064306 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17301a1bc0 con 0x7f1730103fa0 2024-05-10T10:48:45.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.892+0000 7f17368b3700 1 -- 172.21.15.107:0/3383064306 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f173002e510 con 0x7f1730103fa0 2024-05-10T10:48:45.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.893+0000 7f172dffb700 1 -- 172.21.15.107:0/3383064306 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f172801dc00 con 0x7f1730103fa0 2024-05-10T10:48:45.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.894+0000 7f172dffb700 1 --2- 172.21.15.107:0/3383064306 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f171c0b2880 0x7f171c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:48:45.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.894+0000 7f172ffff700 1 --2- 172.21.15.107:0/3383064306 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f171c0b2880 0x7f171c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:48:45.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.894+0000 7f172dffb700 1 -- 172.21.15.107:0/3383064306 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4533+0+0 (secure 0 0 0) 0x7f17280e2c90 con 0x7f1730103fa0 2024-05-10T10:48:45.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.894+0000 7f172ffff700 1 --2- 172.21.15.107:0/3383064306 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f171c0b2880 0x7f171c0b4d40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1730103460 tx=0x7f1720009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:48:45.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:45.897+0000 7f172dffb700 1 -- 172.21.15.107:0/3383064306 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f17280ab900 con 0x7f1730103fa0 2024-05-10T10:48:46.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:48:46.107+0000 7f17368b3700 1 -- 172.21.15.107:0/3383064306 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f17300638e0 con 0x7f171c0b2880 2024-05-10T10:48:46.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:46 smithi184 ceph-mon[34585]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-10T10:48:46.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:46 smithi184 ceph-mon[34585]: osdmap e38: 6 total, 6 up, 6 in 2024-05-10T10:48:46.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:46 smithi184 ceph-mon[34585]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:48:46.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:46 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:48:46.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:46 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:48:46.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:46 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:46.904 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:46 smithi107 ceph-mon[30373]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-10T10:48:46.904 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:46 smithi107 ceph-mon[30373]: osdmap e38: 6 total, 6 up, 6 in 2024-05-10T10:48:46.904 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:46 smithi107 ceph-mon[30373]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:48:46.905 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:46 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:48:46.905 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:46 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:48:46.905 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:46 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:47.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:46 smithi196 ceph-mon[34872]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-10T10:48:47.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:46 smithi196 ceph-mon[34872]: osdmap e38: 6 total, 6 up, 6 in 2024-05-10T10:48:47.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:46 smithi196 ceph-mon[34872]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:48:47.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:46 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:48:47.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:46 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:48:47.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:46 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:47.817 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:47 smithi107 ceph-mon[30373]: osdmap e39: 6 total, 6 up, 6 in 2024-05-10T10:48:47.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:47 smithi184 ceph-mon[34585]: osdmap e39: 6 total, 6 up, 6 in 2024-05-10T10:48:48.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:47 smithi196 ceph-mon[34872]: osdmap e39: 6 total, 6 up, 6 in 2024-05-10T10:48:48.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:48 smithi184 ceph-mon[34585]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-10T10:48:48.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:48 smithi107 ceph-mon[30373]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-10T10:48:49.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:48 smithi196 ceph-mon[34872]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-10T10:48:49.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:49 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/4230095740' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bceadd7a-20bf-4482-aaab-46a2539cf37c"}]: dispatch 2024-05-10T10:48:49.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:49 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/4230095740' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bceadd7a-20bf-4482-aaab-46a2539cf37c"}]': finished 2024-05-10T10:48:49.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:49 smithi107 ceph-mon[30373]: osdmap e40: 7 total, 6 up, 7 in 2024-05-10T10:48:49.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:49 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T10:48:49.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:49 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2390652678' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:48:50.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:49 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/4230095740' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bceadd7a-20bf-4482-aaab-46a2539cf37c"}]: dispatch 2024-05-10T10:48:50.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:49 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/4230095740' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bceadd7a-20bf-4482-aaab-46a2539cf37c"}]': finished 2024-05-10T10:48:50.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:49 smithi196 ceph-mon[34872]: osdmap e40: 7 total, 6 up, 7 in 2024-05-10T10:48:50.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:49 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T10:48:50.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:49 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/2390652678' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:48:50.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:49 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/4230095740' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bceadd7a-20bf-4482-aaab-46a2539cf37c"}]: dispatch 2024-05-10T10:48:50.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:49 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/4230095740' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bceadd7a-20bf-4482-aaab-46a2539cf37c"}]': finished 2024-05-10T10:48:50.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:49 smithi184 ceph-mon[34585]: osdmap e40: 7 total, 6 up, 7 in 2024-05-10T10:48:50.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:49 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T10:48:50.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:49 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/2390652678' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:48:51.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:50 smithi196 ceph-mon[34872]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-05-10T10:48:51.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:50 smithi184 ceph-mon[34585]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-05-10T10:48:51.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:50 smithi107 ceph-mon[30373]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-05-10T10:48:52.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:52 smithi107 ceph-mon[30373]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-10T10:48:53.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:52 smithi196 ceph-mon[34872]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-10T10:48:53.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:52 smithi184 ceph-mon[34585]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-10T10:48:54.845 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:54 smithi107 ceph-mon[30373]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-05-10T10:48:55.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:54 smithi196 ceph-mon[34872]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-05-10T10:48:55.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:54 smithi184 ceph-mon[34585]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-05-10T10:48:57.001 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:56 smithi107 ceph-mon[30373]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-05-10T10:48:57.001 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:56 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-10T10:48:57.001 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:56 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:57.002 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:56 smithi107 ceph-mon[30373]: Deploying daemon osd.6 on smithi107 2024-05-10T10:48:57.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:56 smithi196 ceph-mon[34872]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-05-10T10:48:57.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:56 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-10T10:48:57.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:56 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:57.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:56 smithi196 ceph-mon[34872]: Deploying daemon osd.6 on smithi107 2024-05-10T10:48:57.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:56 smithi184 ceph-mon[34585]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-05-10T10:48:57.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:56 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-10T10:48:57.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:56 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:48:57.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:56 smithi184 ceph-mon[34585]: Deploying daemon osd.6 on smithi107 2024-05-10T10:48:59.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:48:58 smithi196 ceph-mon[34872]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T10:48:59.123 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:48:58 smithi107 ceph-mon[30373]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T10:48:59.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:48:58 smithi184 ceph-mon[34585]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T10:49:00.897 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:00 smithi107 ceph-mon[30373]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-05-10T10:49:01.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:00 smithi196 ceph-mon[34872]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-05-10T10:49:01.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:00 smithi184 ceph-mon[34585]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-05-10T10:49:03.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:02 smithi196 ceph-mon[34872]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-10T10:49:03.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:02 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:03.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:02 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:03.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:02 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:49:03.099 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:02 smithi107 ceph-mon[30373]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-10T10:49:03.099 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:02 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:03.100 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:02 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:03.100 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:02 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:49:03.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:02 smithi184 ceph-mon[34585]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-10T10:49:03.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:02 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:03.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:02 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:03.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:02 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:49:05.033 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:04 smithi107 ceph-mon[30373]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-10T10:49:05.033 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:04 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:05.033 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:04 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:05.034 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:04 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:05.034 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:04 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:49:05.034 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:04 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:05.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:04 smithi196 ceph-mon[34872]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-10T10:49:05.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:04 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:05.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:04 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:05.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:04 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:05.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:04 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:49:05.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:04 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:05.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:04 smithi184 ceph-mon[34585]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-10T10:49:05.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:04 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:05.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:04 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:05.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:04 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:05.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:04 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:49:05.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:04 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:05.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:05.410+0000 7f172dffb700 1 -- 172.21.15.107:0/3383064306 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f17300638e0 con 0x7f171c0b2880 2024-05-10T10:49:05.412 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 6 on host 'smithi107' 2024-05-10T10:49:05.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:05.412+0000 7f17368b3700 1 -- 172.21.15.107:0/3383064306 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f171c0b2880 msgr2=0x7f171c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:49:05.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:05.412+0000 7f17368b3700 1 --2- 172.21.15.107:0/3383064306 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f171c0b2880 0x7f171c0b4d40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1730103460 tx=0x7f1720009190 comp rx=0 tx=0).stop 2024-05-10T10:49:05.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:05.413+0000 7f17368b3700 1 -- 172.21.15.107:0/3383064306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1730103fa0 msgr2=0x7f17301a0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:49:05.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:05.413+0000 7f17368b3700 1 --2- 172.21.15.107:0/3383064306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1730103fa0 0x7f17301a0be0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f17280062a0 tx=0x7f1728007d90 comp rx=0 tx=0).stop 2024-05-10T10:49:05.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:05.413+0000 7f17368b3700 1 -- 172.21.15.107:0/3383064306 shutdown_connections 2024-05-10T10:49:05.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:05.413+0000 7f17368b3700 1 --2- 172.21.15.107:0/3383064306 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f171c0b2880 0x7f171c0b4d40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:05.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:05.413+0000 7f17368b3700 1 --2- 172.21.15.107:0/3383064306 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1730103fa0 0x7f17301a0be0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:05.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:05.413+0000 7f17368b3700 1 --2- 172.21.15.107:0/3383064306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1730102400 0x7f173006bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:05.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:05.413+0000 7f17368b3700 1 --2- 172.21.15.107:0/3383064306 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1730103600 0x7f173019e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:05.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:05.413+0000 7f17368b3700 1 -- 172.21.15.107:0/3383064306 >> 172.21.15.107:0/3383064306 conn(0x7f17300fd9a0 msgr2=0x7f1730106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:49:05.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:05.413+0000 7f17368b3700 1 -- 172.21.15.107:0/3383064306 shutdown_connections 2024-05-10T10:49:05.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:05.413+0000 7f17368b3700 1 -- 172.21.15.107:0/3383064306 wait complete. 2024-05-10T10:49:06.048 DEBUG:teuthology.orchestra.run.smithi107:osd.6> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.6.service 2024-05-10T10:49:06.050 INFO:tasks.cephadm:Deploying osd.7 on smithi184 with /dev/vg_nvme/lv_2... 2024-05-10T10:49:06.050 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-10T10:49:06.296 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T10:49:06.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:06.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:06.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:49:06.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:06 smithi107 ceph-mon[30373]: from='osd.6 [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-10T10:49:06.690 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:06.690 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:06.690 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:49:06.690 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:06 smithi184 ceph-mon[34585]: from='osd.6 [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-10T10:49:06.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:06.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:06.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:49:06.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:06 smithi196 ceph-mon[34872]: from='osd.6 [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-10T10:49:07.635 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:07 smithi184 ceph-mon[34585]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-10T10:49:07.636 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:07 smithi184 ceph-mon[34585]: from='osd.6 [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-10T10:49:07.636 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:07 smithi184 ceph-mon[34585]: osdmap e41: 7 total, 6 up, 7 in 2024-05-10T10:49:07.636 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:07 smithi184 ceph-mon[34585]: from='osd.6 [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-05-10T10:49:07.636 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:07 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T10:49:07.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:07 smithi107 ceph-mon[30373]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-10T10:49:07.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:07 smithi107 ceph-mon[30373]: from='osd.6 [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-10T10:49:07.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:07 smithi107 ceph-mon[30373]: osdmap e41: 7 total, 6 up, 7 in 2024-05-10T10:49:07.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:07 smithi107 ceph-mon[30373]: from='osd.6 [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-05-10T10:49:07.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T10:49:07.676 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 10:49:07 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T10:49:07.418+0000 7fad283e3700 -1 osd.6 0 waiting for initial osdmap 2024-05-10T10:49:07.676 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 10:49:07 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T10:49:07.429+0000 7fad241d6700 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T10:49:07.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:07 smithi196 ceph-mon[34872]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-10T10:49:07.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:07 smithi196 ceph-mon[34872]: from='osd.6 [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-10T10:49:07.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:07 smithi196 ceph-mon[34872]: osdmap e41: 7 total, 6 up, 7 in 2024-05-10T10:49:07.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:07 smithi196 ceph-mon[34872]: from='osd.6 [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-05-10T10:49:07.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:07 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T10:49:08.234 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-10T10:49:08.234 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-10T10:49:08.234 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2024-05-10T10:49:08.234 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2024-05-10T10:49:08.234 INFO:teuthology.orchestra.run.smithi184.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0119883 s, 875 MB/s 2024-05-10T10:49:08.234 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2024-05-10T10:49:08.533 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:08 smithi184 ceph-mon[34585]: from='osd.6 [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-05-10T10:49:08.533 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:08 smithi184 ceph-mon[34585]: osdmap e42: 7 total, 6 up, 7 in 2024-05-10T10:49:08.533 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T10:49:08.533 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T10:49:08.549 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:08 smithi107 ceph-mon[30373]: from='osd.6 [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-05-10T10:49:08.550 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:08 smithi107 ceph-mon[30373]: osdmap e42: 7 total, 6 up, 7 in 2024-05-10T10:49:08.550 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T10:49:08.550 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T10:49:08.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:08 smithi196 ceph-mon[34872]: from='osd.6 [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-05-10T10:49:08.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:08 smithi196 ceph-mon[34872]: osdmap e42: 7 total, 6 up, 7 in 2024-05-10T10:49:08.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T10:49:08.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T10:49:08.829 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi184:vg_nvme/lv_2 2024-05-10T10:49:09.076 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T10:49:09.504 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:09 smithi184 ceph-mon[34585]: purged_snaps scrub starts 2024-05-10T10:49:09.504 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:09 smithi184 ceph-mon[34585]: purged_snaps scrub ok 2024-05-10T10:49:09.504 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:09 smithi184 ceph-mon[34585]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-10T10:49:09.505 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:09 smithi184 ceph-mon[34585]: osd.6 [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757] boot 2024-05-10T10:49:09.505 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:09 smithi184 ceph-mon[34585]: osdmap e43: 7 total, 7 up, 7 in 2024-05-10T10:49:09.505 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T10:49:09.505 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:09.505 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:09.505 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:09.505 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:09.505 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:09.505 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:09.505 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:09.505 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:49:09.505 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:09 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:09.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:09 smithi107 ceph-mon[30373]: purged_snaps scrub starts 2024-05-10T10:49:09.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:09 smithi107 ceph-mon[30373]: purged_snaps scrub ok 2024-05-10T10:49:09.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:09 smithi107 ceph-mon[30373]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-10T10:49:09.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:09 smithi107 ceph-mon[30373]: osd.6 [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757] boot 2024-05-10T10:49:09.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:09 smithi107 ceph-mon[30373]: osdmap e43: 7 total, 7 up, 7 in 2024-05-10T10:49:09.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T10:49:09.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:09.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:09.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:09.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:09.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:09.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:09.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:09.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:49:09.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:09 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:09.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:09 smithi196 ceph-mon[34872]: purged_snaps scrub starts 2024-05-10T10:49:09.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:09 smithi196 ceph-mon[34872]: purged_snaps scrub ok 2024-05-10T10:49:09.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:09 smithi196 ceph-mon[34872]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-05-10T10:49:09.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:09 smithi196 ceph-mon[34872]: osd.6 [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757] boot 2024-05-10T10:49:09.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:09 smithi196 ceph-mon[34872]: osdmap e43: 7 total, 7 up, 7 in 2024-05-10T10:49:09.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-10T10:49:09.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:09.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:09.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:09.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:09.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:09.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:09.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:09.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:49:09.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:09 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:10.584 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.581+0000 7f21bfa5b700 1 -- 172.21.15.184:0/2522856826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b8075f00 msgr2=0x7f21b8076380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:49:10.584 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.581+0000 7f21bfa5b700 1 --2- 172.21.15.184:0/2522856826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b8075f00 0x7f21b8076380 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009990 tx=0x7f21a8009ca0 comp rx=0 tx=0).stop 2024-05-10T10:49:10.585 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.581+0000 7f21bfa5b700 1 -- 172.21.15.184:0/2522856826 shutdown_connections 2024-05-10T10:49:10.585 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.581+0000 7f21bfa5b700 1 --2- 172.21.15.184:0/2522856826 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b80774d0 0x7f21b8075930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:10.585 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.581+0000 7f21bfa5b700 1 --2- 172.21.15.184:0/2522856826 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21b810fae0 0x7f21b8111ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:10.585 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.581+0000 7f21bfa5b700 1 --2- 172.21.15.184:0/2522856826 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b8075f00 0x7f21b8076380 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:10.585 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.581+0000 7f21bfa5b700 1 -- 172.21.15.184:0/2522856826 >> 172.21.15.184:0/2522856826 conn(0x7f21b80feaa0 msgr2=0x7f21b8100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:49:10.585 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.581+0000 7f21bfa5b700 1 -- 172.21.15.184:0/2522856826 shutdown_connections 2024-05-10T10:49:10.585 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.581+0000 7f21bfa5b700 1 -- 172.21.15.184:0/2522856826 wait complete. 2024-05-10T10:49:10.585 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.581+0000 7f21bfa5b700 1 Processor -- start 2024-05-10T10:49:10.585 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.581+0000 7f21bfa5b700 1 -- start start 2024-05-10T10:49:10.585 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.581+0000 7f21bfa5b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b8075f00 0x7f21b819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:49:10.585 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.581+0000 7f21bfa5b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b80774d0 0x7f21b81a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:49:10.585 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.581+0000 7f21bfa5b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21b810fae0 0x7f21b81a7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:49:10.585 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.581+0000 7f21bfa5b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f21b81156d0 con 0x7f21b810fae0 2024-05-10T10:49:10.586 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.581+0000 7f21bfa5b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f21b8115550 con 0x7f21b80774d0 2024-05-10T10:49:10.586 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.582+0000 7f21bfa5b700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f21b8115850 con 0x7f21b8075f00 2024-05-10T10:49:10.586 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.582+0000 7f21bcff6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b80774d0 0x7f21b81a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:49:10.586 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.582+0000 7f21bcff6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b80774d0 0x7f21b81a0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:48986/0 (socket says 172.21.15.184:48986) 2024-05-10T10:49:10.586 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.582+0000 7f21bcff6700 1 -- 172.21.15.184:0/1277436915 learned_addr learned my addr 172.21.15.184:0/1277436915 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-05-10T10:49:10.586 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.582+0000 7f21bdff8700 1 --2- 172.21.15.184:0/1277436915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21b810fae0 0x7f21b81a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:49:10.586 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.582+0000 7f21bd7f7700 1 --2- 172.21.15.184:0/1277436915 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b8075f00 0x7f21b819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:49:10.586 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.582+0000 7f21bcff6700 1 -- 172.21.15.184:0/1277436915 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b8075f00 msgr2=0x7f21b819fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:49:10.586 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.582+0000 7f21bcff6700 1 --2- 172.21.15.184:0/1277436915 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b8075f00 0x7f21b819fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:10.586 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.582+0000 7f21bcff6700 1 -- 172.21.15.184:0/1277436915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21b810fae0 msgr2=0x7f21b81a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:49:10.586 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.582+0000 7f21bcff6700 1 --2- 172.21.15.184:0/1277436915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21b810fae0 0x7f21b81a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:10.586 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.582+0000 7f21bcff6700 1 -- 172.21.15.184:0/1277436915 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b81a7940 con 0x7f21b80774d0 2024-05-10T10:49:10.586 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.582+0000 7f21bd7f7700 1 --2- 172.21.15.184:0/1277436915 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b8075f00 0x7f21b819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:49:10.587 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.582+0000 7f21bcff6700 1 --2- 172.21.15.184:0/1277436915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b80774d0 0x7f21b81a0230 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f21a80059d0 tx=0x7f21a8009ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:49:10.587 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.582+0000 7f21ae7fc700 1 -- 172.21.15.184:0/1277436915 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a8027070 con 0x7f21b80774d0 2024-05-10T10:49:10.587 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.582+0000 7f21ae7fc700 1 -- 172.21.15.184:0/1277436915 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f21a8004210 con 0x7f21b80774d0 2024-05-10T10:49:10.587 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.582+0000 7f21bfa5b700 1 -- 172.21.15.184:0/1277436915 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21b81a7bd0 con 0x7f21b80774d0 2024-05-10T10:49:10.587 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.582+0000 7f21ae7fc700 1 -- 172.21.15.184:0/1277436915 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a800f460 con 0x7f21b80774d0 2024-05-10T10:49:10.587 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.582+0000 7f21bfa5b700 1 -- 172.21.15.184:0/1277436915 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b81a8020 con 0x7f21b80774d0 2024-05-10T10:49:10.587 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.583+0000 7f21bfa5b700 1 -- 172.21.15.184:0/1277436915 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21b806a190 con 0x7f21b80774d0 2024-05-10T10:49:10.588 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.584+0000 7f21ae7fc700 1 -- 172.21.15.184:0/1277436915 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f21a802a070 con 0x7f21b80774d0 2024-05-10T10:49:10.588 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.585+0000 7f21ae7fc700 1 --2- 172.21.15.184:0/1277436915 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f21a40b2880 0x7f21a40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:49:10.588 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.585+0000 7f21ae7fc700 1 -- 172.21.15.184:0/1277436915 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4965+0+0 (secure 0 0 0) 0x7f21a80e2dc0 con 0x7f21b80774d0 2024-05-10T10:49:10.588 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.585+0000 7f21bd7f7700 1 --2- 172.21.15.184:0/1277436915 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f21a40b2880 0x7f21a40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:49:10.588 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.586+0000 7f21bd7f7700 1 --2- 172.21.15.184:0/1277436915 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f21a40b2880 0x7f21a40b4d40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f21b4005fd0 tx=0x7f21b4005e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:49:10.590 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.589+0000 7f21ae7fc700 1 -- 172.21.15.184:0/1277436915 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f21a8031020 con 0x7f21b80774d0 2024-05-10T10:49:10.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:10 smithi184 ceph-mon[34585]: Detected new or changed devices on smithi107 2024-05-10T10:49:10.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:10 smithi184 ceph-mon[34585]: Adjusting osd_memory_target on smithi107 to 5696M 2024-05-10T10:49:10.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:10 smithi184 ceph-mon[34585]: osdmap e44: 7 total, 7 up, 7 in 2024-05-10T10:49:10.754 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:10 smithi107 ceph-mon[30373]: Detected new or changed devices on smithi107 2024-05-10T10:49:10.754 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:10 smithi107 ceph-mon[30373]: Adjusting osd_memory_target on smithi107 to 5696M 2024-05-10T10:49:10.754 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:10 smithi107 ceph-mon[30373]: osdmap e44: 7 total, 7 up, 7 in 2024-05-10T10:49:10.799 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:10.798+0000 7f21bfa5b700 1 -- 172.21.15.184:0/1277436915 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f21b80638e0 con 0x7f21a40b2880 2024-05-10T10:49:10.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:10 smithi196 ceph-mon[34872]: Detected new or changed devices on smithi107 2024-05-10T10:49:10.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:10 smithi196 ceph-mon[34872]: Adjusting osd_memory_target on smithi107 to 5696M 2024-05-10T10:49:10.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:10 smithi196 ceph-mon[34872]: osdmap e44: 7 total, 7 up, 7 in 2024-05-10T10:49:11.714 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:11 smithi184 ceph-mon[34585]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:11.714 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:11 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:49:11.714 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:11 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:49:11.714 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:11 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:11.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:11 smithi196 ceph-mon[34872]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:11.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:11 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:49:11.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:11 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:49:11.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:11 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:11.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:11 smithi107 ceph-mon[30373]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:11.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:11 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:49:11.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:11 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:49:11.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:11 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:12.555 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:12 smithi184 ceph-mon[34585]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:49:12.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:12 smithi196 ceph-mon[34872]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:49:12.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:12 smithi107 ceph-mon[30373]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:49:13.740 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:13 smithi184 ceph-mon[34585]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:13.741 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:13 smithi184 ceph-mon[34585]: from='client.? 172.21.15.184:0/1638545157' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d9243a6-0e16-4677-a0b0-010be4162148"}]: dispatch 2024-05-10T10:49:13.741 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:13 smithi184 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d9243a6-0e16-4677-a0b0-010be4162148"}]: dispatch 2024-05-10T10:49:13.741 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:13 smithi184 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d9243a6-0e16-4677-a0b0-010be4162148"}]': finished 2024-05-10T10:49:13.741 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:13 smithi184 ceph-mon[34585]: osdmap e45: 8 total, 7 up, 8 in 2024-05-10T10:49:13.741 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:13 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T10:49:13.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:13 smithi196 ceph-mon[34872]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:13.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:13 smithi196 ceph-mon[34872]: from='client.? 172.21.15.184:0/1638545157' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d9243a6-0e16-4677-a0b0-010be4162148"}]: dispatch 2024-05-10T10:49:13.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:13 smithi196 ceph-mon[34872]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d9243a6-0e16-4677-a0b0-010be4162148"}]: dispatch 2024-05-10T10:49:13.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:13 smithi196 ceph-mon[34872]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d9243a6-0e16-4677-a0b0-010be4162148"}]': finished 2024-05-10T10:49:13.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:13 smithi196 ceph-mon[34872]: osdmap e45: 8 total, 7 up, 8 in 2024-05-10T10:49:13.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:13 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T10:49:13.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:13 smithi107 ceph-mon[30373]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:13.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:13 smithi107 ceph-mon[30373]: from='client.? 172.21.15.184:0/1638545157' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d9243a6-0e16-4677-a0b0-010be4162148"}]: dispatch 2024-05-10T10:49:13.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:13 smithi107 ceph-mon[30373]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d9243a6-0e16-4677-a0b0-010be4162148"}]: dispatch 2024-05-10T10:49:13.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:13 smithi107 ceph-mon[30373]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d9243a6-0e16-4677-a0b0-010be4162148"}]': finished 2024-05-10T10:49:13.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:13 smithi107 ceph-mon[30373]: osdmap e45: 8 total, 7 up, 8 in 2024-05-10T10:49:13.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:13 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T10:49:14.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:14 smithi196 ceph-mon[34872]: from='client.? 172.21.15.184:0/2216393466' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:49:14.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:14 smithi184 ceph-mon[34585]: from='client.? 172.21.15.184:0/2216393466' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:49:14.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:14 smithi107 ceph-mon[30373]: from='client.? 172.21.15.184:0/2216393466' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:49:15.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:15 smithi196 ceph-mon[34872]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:15.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:15 smithi184 ceph-mon[34585]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:15.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:15 smithi107 ceph-mon[30373]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:16.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:16 smithi196 ceph-mon[34872]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:16.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:16 smithi184 ceph-mon[34585]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:16.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:16 smithi107 ceph-mon[30373]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:18.821 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:18 smithi184 ceph-mon[34585]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:18.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:18 smithi107 ceph-mon[30373]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:19.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:18 smithi196 ceph-mon[34872]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:20.824 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:20 smithi184 ceph-mon[34585]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:20.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:20 smithi107 ceph-mon[30373]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:21.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:20 smithi196 ceph-mon[34872]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:21.702 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:21 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-10T10:49:21.703 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:21 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:21.703 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:21 smithi184 ceph-mon[34585]: Deploying daemon osd.7 on smithi184 2024-05-10T10:49:21.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:21 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-10T10:49:21.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:21 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:21.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:21 smithi107 ceph-mon[30373]: Deploying daemon osd.7 on smithi184 2024-05-10T10:49:22.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:21 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-10T10:49:22.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:21 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:22.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:21 smithi196 ceph-mon[34872]: Deploying daemon osd.7 on smithi184 2024-05-10T10:49:22.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:22 smithi184 ceph-mon[34585]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:22.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:22 smithi107 ceph-mon[30373]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:23.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:22 smithi196 ceph-mon[34872]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:24.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:24 smithi184 ceph-mon[34585]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:24.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:24 smithi107 ceph-mon[30373]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:25.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:24 smithi196 ceph-mon[34872]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:27.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:27 smithi184 ceph-mon[34585]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:27.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:27 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:27.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:27 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:27.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:27 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:49:27.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:27 smithi107 ceph-mon[30373]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:27.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:27 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:27.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:27 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:27.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:27 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:49:27.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:27 smithi196 ceph-mon[34872]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:27.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:27 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:27.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:27 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:27.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:27 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:49:29.258 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:29 smithi184 ceph-mon[34585]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:29.258 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:29.258 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:29.258 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:29.258 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:49:29.258 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:29.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:29 smithi107 ceph-mon[30373]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:29.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:29.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:29.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:29.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:49:29.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:29.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:29 smithi196 ceph-mon[34872]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:29.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:29.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:29.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:29.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:49:29.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:29.913 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:29.912+0000 7f21ae7fc700 1 -- 172.21.15.184:0/1277436915 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f21b80638e0 con 0x7f21a40b2880 2024-05-10T10:49:29.913 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 7 on host 'smithi184' 2024-05-10T10:49:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:29.915+0000 7f21bfa5b700 1 -- 172.21.15.184:0/1277436915 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f21a40b2880 msgr2=0x7f21a40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:49:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:29.915+0000 7f21bfa5b700 1 --2- 172.21.15.184:0/1277436915 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f21a40b2880 0x7f21a40b4d40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f21b4005fd0 tx=0x7f21b4005e40 comp rx=0 tx=0).stop 2024-05-10T10:49:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:29.915+0000 7f21bfa5b700 1 -- 172.21.15.184:0/1277436915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b80774d0 msgr2=0x7f21b81a0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:49:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:29.915+0000 7f21bfa5b700 1 --2- 172.21.15.184:0/1277436915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b80774d0 0x7f21b81a0230 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f21a80059d0 tx=0x7f21a8009ee0 comp rx=0 tx=0).stop 2024-05-10T10:49:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:29.915+0000 7f21bfa5b700 1 -- 172.21.15.184:0/1277436915 shutdown_connections 2024-05-10T10:49:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:29.915+0000 7f21bfa5b700 1 --2- 172.21.15.184:0/1277436915 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f21a40b2880 0x7f21a40b4d40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:29.915+0000 7f21bfa5b700 1 --2- 172.21.15.184:0/1277436915 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f21b8075f00 0x7f21b819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:29.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:29.915+0000 7f21bfa5b700 1 --2- 172.21.15.184:0/1277436915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21b810fae0 0x7f21b81a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:29.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:29.915+0000 7f21bfa5b700 1 --2- 172.21.15.184:0/1277436915 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b80774d0 0x7f21b81a0230 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:29.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:29.915+0000 7f21bfa5b700 1 -- 172.21.15.184:0/1277436915 >> 172.21.15.184:0/1277436915 conn(0x7f21b80feaa0 msgr2=0x7f21b8102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:49:29.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:29.915+0000 7f21bfa5b700 1 -- 172.21.15.184:0/1277436915 shutdown_connections 2024-05-10T10:49:29.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:49:29.915+0000 7f21bfa5b700 1 -- 172.21.15.184:0/1277436915 wait complete. 2024-05-10T10:49:30.541 DEBUG:teuthology.orchestra.run.smithi184:osd.7> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.7.service 2024-05-10T10:49:30.543 INFO:tasks.cephadm:Deploying osd.8 on smithi196 with /dev/vg_nvme/lv_2... 2024-05-10T10:49:30.543 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-10T10:49:30.787 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T10:49:31.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:30 smithi184 ceph-mon[34585]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:31.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:30 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:31.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:30 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:31.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:30 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:49:31.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:30 smithi184 ceph-mon[34585]: from='osd.7 [v2:172.21.15.184:6816/2850715284,v1:172.21.15.184:6817/2850715284]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-10T10:49:31.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:30 smithi184 ceph-mon[34585]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-10T10:49:31.152 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:30 smithi196 ceph-mon[34872]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:31.152 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:30 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:31.152 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:30 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:31.152 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:30 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:49:31.152 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:30 smithi196 ceph-mon[34872]: from='osd.7 [v2:172.21.15.184:6816/2850715284,v1:172.21.15.184:6817/2850715284]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-10T10:49:31.152 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:30 smithi196 ceph-mon[34872]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-10T10:49:31.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:30 smithi107 ceph-mon[30373]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:31.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:30 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:31.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:30 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:31.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:30 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:49:31.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:30 smithi107 ceph-mon[30373]: from='osd.7 [v2:172.21.15.184:6816/2850715284,v1:172.21.15.184:6817/2850715284]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-10T10:49:31.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:30 smithi107 ceph-mon[30373]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-10T10:49:31.965 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:31 smithi184 ceph-mon[34585]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-10T10:49:31.965 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:31 smithi184 ceph-mon[34585]: osdmap e46: 8 total, 7 up, 8 in 2024-05-10T10:49:31.965 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T10:49:31.965 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:31 smithi184 ceph-mon[34585]: from='osd.7 [v2:172.21.15.184:6816/2850715284,v1:172.21.15.184:6817/2850715284]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:49:31.965 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:31 smithi184 ceph-mon[34585]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:49:31.965 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 10:49:31 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T10:49:31.922+0000 7fdb3784a700 -1 osd.7 0 waiting for initial osdmap 2024-05-10T10:49:31.965 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 10:49:31 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T10:49:31.930+0000 7fdb3363d700 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T10:49:32.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:31 smithi107 ceph-mon[30373]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-10T10:49:32.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:31 smithi107 ceph-mon[30373]: osdmap e46: 8 total, 7 up, 8 in 2024-05-10T10:49:32.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T10:49:32.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:31 smithi107 ceph-mon[30373]: from='osd.7 [v2:172.21.15.184:6816/2850715284,v1:172.21.15.184:6817/2850715284]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:49:32.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:31 smithi107 ceph-mon[30373]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:49:32.211 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:31 smithi196 ceph-mon[34872]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-10T10:49:32.211 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:31 smithi196 ceph-mon[34872]: osdmap e46: 8 total, 7 up, 8 in 2024-05-10T10:49:32.211 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T10:49:32.211 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:31 smithi196 ceph-mon[34872]: from='osd.7 [v2:172.21.15.184:6816/2850715284,v1:172.21.15.184:6817/2850715284]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:49:32.211 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:31 smithi196 ceph-mon[34872]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:49:32.657 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-10T10:49:32.657 INFO:teuthology.orchestra.run.smithi196.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-10T10:49:32.657 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10+0 records in 2024-05-10T10:49:32.657 INFO:teuthology.orchestra.run.smithi196.stderr:10+0 records out 2024-05-10T10:49:32.657 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115194 s, 910 MB/s 2024-05-10T10:49:32.657 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping successful for: 2024-05-10T10:49:33.043 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:32 smithi184 ceph-mon[34585]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:33.043 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:32 smithi184 ceph-mon[34585]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-05-10T10:49:33.043 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:32 smithi184 ceph-mon[34585]: osdmap e47: 8 total, 7 up, 8 in 2024-05-10T10:49:33.043 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:32 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T10:49:33.043 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:32 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T10:49:33.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:32 smithi107 ceph-mon[30373]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:33.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:32 smithi107 ceph-mon[30373]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-05-10T10:49:33.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:32 smithi107 ceph-mon[30373]: osdmap e47: 8 total, 7 up, 8 in 2024-05-10T10:49:33.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:32 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T10:49:33.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:32 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T10:49:33.223 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:32 smithi196 ceph-mon[34872]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:33.223 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:32 smithi196 ceph-mon[34872]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-05-10T10:49:33.223 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:32 smithi196 ceph-mon[34872]: osdmap e47: 8 total, 7 up, 8 in 2024-05-10T10:49:33.223 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:32 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T10:49:33.223 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:32 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T10:49:33.251 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi196:vg_nvme/lv_2 2024-05-10T10:49:33.496 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T10:49:34.171 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:33 smithi196 ceph-mon[34872]: purged_snaps scrub starts 2024-05-10T10:49:34.171 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:33 smithi196 ceph-mon[34872]: purged_snaps scrub ok 2024-05-10T10:49:34.171 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T10:49:34.171 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:33 smithi196 ceph-mon[34872]: osd.7 [v2:172.21.15.184:6816/2850715284,v1:172.21.15.184:6817/2850715284] boot 2024-05-10T10:49:34.171 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:33 smithi196 ceph-mon[34872]: osdmap e48: 8 total, 8 up, 8 in 2024-05-10T10:49:34.172 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T10:49:34.172 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:33 smithi196 ceph-mon[34872]: Detected new or changed devices on smithi184 2024-05-10T10:49:34.172 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:34.172 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:34.172 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:34.172 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:34.172 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:34.172 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:33 smithi196 ceph-mon[34872]: Adjusting osd_memory_target on smithi184 to 5696M 2024-05-10T10:49:34.172 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:34.172 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:34.172 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:49:34.173 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:34.173 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:33 smithi196 ceph-mon[34872]: osdmap e49: 8 total, 8 up, 8 in 2024-05-10T10:49:34.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:33 smithi107 ceph-mon[30373]: purged_snaps scrub starts 2024-05-10T10:49:34.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:33 smithi107 ceph-mon[30373]: purged_snaps scrub ok 2024-05-10T10:49:34.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T10:49:34.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:33 smithi107 ceph-mon[30373]: osd.7 [v2:172.21.15.184:6816/2850715284,v1:172.21.15.184:6817/2850715284] boot 2024-05-10T10:49:34.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:33 smithi107 ceph-mon[30373]: osdmap e48: 8 total, 8 up, 8 in 2024-05-10T10:49:34.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T10:49:34.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:33 smithi107 ceph-mon[30373]: Detected new or changed devices on smithi184 2024-05-10T10:49:34.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:34.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:34.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:34.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:34.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:34.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:33 smithi107 ceph-mon[30373]: Adjusting osd_memory_target on smithi184 to 5696M 2024-05-10T10:49:34.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:34.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:34.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:49:34.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:34.177 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:33 smithi107 ceph-mon[30373]: osdmap e49: 8 total, 8 up, 8 in 2024-05-10T10:49:34.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:33 smithi184 ceph-mon[34585]: purged_snaps scrub starts 2024-05-10T10:49:34.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:33 smithi184 ceph-mon[34585]: purged_snaps scrub ok 2024-05-10T10:49:34.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T10:49:34.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:33 smithi184 ceph-mon[34585]: osd.7 [v2:172.21.15.184:6816/2850715284,v1:172.21.15.184:6817/2850715284] boot 2024-05-10T10:49:34.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:33 smithi184 ceph-mon[34585]: osdmap e48: 8 total, 8 up, 8 in 2024-05-10T10:49:34.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-10T10:49:34.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:33 smithi184 ceph-mon[34585]: Detected new or changed devices on smithi184 2024-05-10T10:49:34.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:34.391 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:34.391 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:34.391 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:34.391 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:34.391 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:33 smithi184 ceph-mon[34585]: Adjusting osd_memory_target on smithi184 to 5696M 2024-05-10T10:49:34.391 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:34.391 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:34.391 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:49:34.391 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:34.391 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:33 smithi184 ceph-mon[34585]: osdmap e49: 8 total, 8 up, 8 in 2024-05-10T10:49:34.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.927+0000 7f98911ad700 1 -- 172.21.15.196:0/2417687916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f988c1091e0 msgr2=0x7f988c10b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:49:34.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.927+0000 7f98911ad700 1 --2- 172.21.15.196:0/2417687916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f988c1091e0 0x7f988c10b650 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f988400b0a0 tx=0x7f988400b3b0 comp rx=0 tx=0).stop 2024-05-10T10:49:34.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.927+0000 7f98911ad700 1 -- 172.21.15.196:0/2417687916 shutdown_connections 2024-05-10T10:49:34.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.927+0000 7f98911ad700 1 --2- 172.21.15.196:0/2417687916 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f988c1091e0 0x7f988c10b650 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:34.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.927+0000 7f98911ad700 1 --2- 172.21.15.196:0/2417687916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f988c103f80 0x7f988c106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:34.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.927+0000 7f98911ad700 1 --2- 172.21.15.196:0/2417687916 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f988c1068b0 0x7f988c108ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:34.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.927+0000 7f98911ad700 1 -- 172.21.15.196:0/2417687916 >> 172.21.15.196:0/2417687916 conn(0x7f988c0fd990 msgr2=0x7f988c0ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:49:34.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.927+0000 7f98911ad700 1 -- 172.21.15.196:0/2417687916 shutdown_connections 2024-05-10T10:49:34.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.927+0000 7f98911ad700 1 -- 172.21.15.196:0/2417687916 wait complete. 2024-05-10T10:49:34.930 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.927+0000 7f98911ad700 1 Processor -- start 2024-05-10T10:49:34.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.928+0000 7f98911ad700 1 -- start start 2024-05-10T10:49:34.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.928+0000 7f98911ad700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f988c103f80 0x7f988c1996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:49:34.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.928+0000 7f98911ad700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f988c1068b0 0x7f988c199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:49:34.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.928+0000 7f98911ad700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f988c1091e0 0x7f988c1a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:49:34.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.928+0000 7f98911ad700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f988c10f0d0 con 0x7f988c1068b0 2024-05-10T10:49:34.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.928+0000 7f98911ad700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f988c10ef50 con 0x7f988c1091e0 2024-05-10T10:49:34.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.928+0000 7f98911ad700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f988c10f250 con 0x7f988c103f80 2024-05-10T10:49:34.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.928+0000 7f988ad9d700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f988c103f80 0x7f988c1996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:49:34.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.928+0000 7f988ad9d700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f988c103f80 0x7f988c1996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:38200/0 (socket says 172.21.15.196:38200) 2024-05-10T10:49:34.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.928+0000 7f988ad9d700 1 -- 172.21.15.196:0/1008034114 learned_addr learned my addr 172.21.15.196:0/1008034114 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-10T10:49:34.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.928+0000 7f988b59e700 1 --2- 172.21.15.196:0/1008034114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f988c1091e0 0x7f988c1a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:49:34.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.928+0000 7f988a59c700 1 --2- 172.21.15.196:0/1008034114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f988c1068b0 0x7f988c199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:49:34.931 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.928+0000 7f988ad9d700 1 -- 172.21.15.196:0/1008034114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f988c1091e0 msgr2=0x7f988c1a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:49:34.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.928+0000 7f988ad9d700 1 --2- 172.21.15.196:0/1008034114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f988c1091e0 0x7f988c1a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:34.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.928+0000 7f988ad9d700 1 -- 172.21.15.196:0/1008034114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f988c1068b0 msgr2=0x7f988c199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:49:34.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.928+0000 7f988ad9d700 1 --2- 172.21.15.196:0/1008034114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f988c1068b0 0x7f988c199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:34.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.928+0000 7f988ad9d700 1 -- 172.21.15.196:0/1008034114 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988c1a1300 con 0x7f988c103f80 2024-05-10T10:49:34.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.928+0000 7f988a59c700 1 --2- 172.21.15.196:0/1008034114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f988c1068b0 0x7f988c199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:49:34.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.928+0000 7f988ad9d700 1 --2- 172.21.15.196:0/1008034114 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f988c103f80 0x7f988c1996a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f987c00d9b0 tx=0x7f987c00dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:49:34.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.929+0000 7f9873fff700 1 -- 172.21.15.196:0/1008034114 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c017070 con 0x7f988c103f80 2024-05-10T10:49:34.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.929+0000 7f9873fff700 1 -- 172.21.15.196:0/1008034114 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f987c005020 con 0x7f988c103f80 2024-05-10T10:49:34.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.929+0000 7f98911ad700 1 -- 172.21.15.196:0/1008034114 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f988c1a15f0 con 0x7f988c103f80 2024-05-10T10:49:34.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.929+0000 7f9873fff700 1 -- 172.21.15.196:0/1008034114 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c009bf0 con 0x7f988c103f80 2024-05-10T10:49:34.932 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.929+0000 7f98911ad700 1 -- 172.21.15.196:0/1008034114 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f988c1a1ae0 con 0x7f988c103f80 2024-05-10T10:49:34.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.930+0000 7f98911ad700 1 -- 172.21.15.196:0/1008034114 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f988c06a190 con 0x7f988c103f80 2024-05-10T10:49:34.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.932+0000 7f9873fff700 1 -- 172.21.15.196:0/1008034114 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f987c0051d0 con 0x7f988c103f80 2024-05-10T10:49:34.933 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.932+0000 7f9873fff700 1 --2- 172.21.15.196:0/1008034114 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f98740b2880 0x7f98740b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:49:34.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.932+0000 7f9873fff700 1 -- 172.21.15.196:0/1008034114 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5397+0+0 (secure 0 0 0) 0x7f987c0e19d0 con 0x7f988c103f80 2024-05-10T10:49:34.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.933+0000 7f988a59c700 1 --2- 172.21.15.196:0/1008034114 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f98740b2880 0x7f98740b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:49:34.934 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.933+0000 7f988a59c700 1 --2- 172.21.15.196:0/1008034114 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f98740b2880 0x7f98740b4d40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9880009cb0 tx=0x7f9880009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:49:34.937 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:34.936+0000 7f9873fff700 1 -- 172.21.15.196:0/1008034114 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f987c020020 con 0x7f988c103f80 2024-05-10T10:49:35.155 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:35.154+0000 7f98911ad700 1 -- 172.21.15.196:0/1008034114 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f988c0638e0 con 0x7f98740b2880 2024-05-10T10:49:35.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:35 smithi107 ceph-mon[30373]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:35.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:35 smithi107 ceph-mon[30373]: osdmap e50: 8 total, 8 up, 8 in 2024-05-10T10:49:35.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:49:35.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:49:35.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:35.767 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:35 smithi196 ceph-mon[34872]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:35.768 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:35 smithi196 ceph-mon[34872]: osdmap e50: 8 total, 8 up, 8 in 2024-05-10T10:49:35.768 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:49:35.768 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:49:35.768 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:35.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:35 smithi184 ceph-mon[34585]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-05-10T10:49:35.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:35 smithi184 ceph-mon[34585]: osdmap e50: 8 total, 8 up, 8 in 2024-05-10T10:49:35.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:49:35.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:49:35.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:36.638 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:36 smithi196 ceph-mon[34872]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:49:36.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:36 smithi184 ceph-mon[34585]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:49:36.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:36 smithi107 ceph-mon[30373]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:49:37.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:37 smithi196 ceph-mon[34872]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-05-10T10:49:37.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:37 smithi184 ceph-mon[34585]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-05-10T10:49:37.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:37 smithi107 ceph-mon[30373]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-05-10T10:49:38.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:38 smithi196 ceph-mon[34872]: from='client.? 172.21.15.196:0/2310728127' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed"}]: dispatch 2024-05-10T10:49:38.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:38 smithi196 ceph-mon[34872]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed"}]: dispatch 2024-05-10T10:49:38.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:38 smithi196 ceph-mon[34872]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed"}]': finished 2024-05-10T10:49:38.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:38 smithi196 ceph-mon[34872]: osdmap e51: 9 total, 8 up, 9 in 2024-05-10T10:49:38.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:38 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T10:49:38.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:38 smithi196 ceph-mon[34872]: from='client.? 172.21.15.196:0/1064620167' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:49:38.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:38 smithi184 ceph-mon[34585]: from='client.? 172.21.15.196:0/2310728127' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed"}]: dispatch 2024-05-10T10:49:38.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:38 smithi184 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed"}]: dispatch 2024-05-10T10:49:38.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:38 smithi184 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed"}]': finished 2024-05-10T10:49:38.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:38 smithi184 ceph-mon[34585]: osdmap e51: 9 total, 8 up, 9 in 2024-05-10T10:49:38.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:38 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T10:49:38.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:38 smithi184 ceph-mon[34585]: from='client.? 172.21.15.196:0/1064620167' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:49:38.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:38 smithi107 ceph-mon[30373]: from='client.? 172.21.15.196:0/2310728127' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed"}]: dispatch 2024-05-10T10:49:38.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:38 smithi107 ceph-mon[30373]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed"}]: dispatch 2024-05-10T10:49:38.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:38 smithi107 ceph-mon[30373]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed"}]': finished 2024-05-10T10:49:38.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:38 smithi107 ceph-mon[30373]: osdmap e51: 9 total, 8 up, 9 in 2024-05-10T10:49:38.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:38 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T10:49:38.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:38 smithi107 ceph-mon[30373]: from='client.? 172.21.15.196:0/1064620167' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:49:39.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:39 smithi196 ceph-mon[34872]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-10T10:49:39.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:39 smithi184 ceph-mon[34585]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-10T10:49:39.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:39 smithi107 ceph-mon[30373]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-10T10:49:40.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:40 smithi196 ceph-mon[34872]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-10T10:49:40.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:40 smithi184 ceph-mon[34585]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-10T10:49:40.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:40 smithi107 ceph-mon[30373]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-10T10:49:42.888 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:42 smithi196 ceph-mon[34872]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-05-10T10:49:42.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:42 smithi184 ceph-mon[34585]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-05-10T10:49:42.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:42 smithi107 ceph-mon[30373]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-05-10T10:49:44.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:44 smithi184 ceph-mon[34585]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-05-10T10:49:44.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:44 smithi107 ceph-mon[30373]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-05-10T10:49:44.952 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:44 smithi196 ceph-mon[34872]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-05-10T10:49:45.879 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-10T10:49:45.879 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:45.879 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:45 smithi196 ceph-mon[34872]: Deploying daemon osd.8 on smithi196 2024-05-10T10:49:45.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-10T10:49:45.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:45.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:45 smithi184 ceph-mon[34585]: Deploying daemon osd.8 on smithi196 2024-05-10T10:49:45.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-10T10:49:45.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:45.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:45 smithi107 ceph-mon[30373]: Deploying daemon osd.8 on smithi196 2024-05-10T10:49:46.773 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:46 smithi196 ceph-mon[34872]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T10:49:46.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:46 smithi184 ceph-mon[34585]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T10:49:46.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:46 smithi107 ceph-mon[30373]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T10:49:48.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:48 smithi196 ceph-mon[34872]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T10:49:48.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:48 smithi184 ceph-mon[34585]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T10:49:48.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:48 smithi107 ceph-mon[30373]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T10:49:51.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:51 smithi196 ceph-mon[34872]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-05-10T10:49:51.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:51 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:51.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:51 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:49:51.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:51 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:51.593 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:51 smithi184 ceph-mon[34585]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-05-10T10:49:51.593 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:51 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:51.593 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:51 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:49:51.593 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:51 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:51.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:51 smithi107 ceph-mon[30373]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-05-10T10:49:51.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:51 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:51.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:51 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:49:51.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:51 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:53.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:53 smithi196 ceph-mon[34872]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-10T10:49:53.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:53 smithi184 ceph-mon[34585]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-10T10:49:53.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:53 smithi107 ceph-mon[30373]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-10T10:49:53.969 INFO:teuthology.orchestra.run.smithi196.stdout:Created osd(s) 8 on host 'smithi196' 2024-05-10T10:49:53.970 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:53.967+0000 7f9873fff700 1 -- 172.21.15.196:0/1008034114 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f988c0638e0 con 0x7f98740b2880 2024-05-10T10:49:53.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:53.970+0000 7f98911ad700 1 -- 172.21.15.196:0/1008034114 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f98740b2880 msgr2=0x7f98740b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:49:53.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:53.970+0000 7f98911ad700 1 --2- 172.21.15.196:0/1008034114 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f98740b2880 0x7f98740b4d40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9880009cb0 tx=0x7f9880009260 comp rx=0 tx=0).stop 2024-05-10T10:49:53.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:53.970+0000 7f98911ad700 1 -- 172.21.15.196:0/1008034114 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f988c103f80 msgr2=0x7f988c1996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:49:53.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:53.970+0000 7f98911ad700 1 --2- 172.21.15.196:0/1008034114 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f988c103f80 0x7f988c1996a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f987c00d9b0 tx=0x7f987c00dcc0 comp rx=0 tx=0).stop 2024-05-10T10:49:53.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:53.970+0000 7f98911ad700 1 -- 172.21.15.196:0/1008034114 shutdown_connections 2024-05-10T10:49:53.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:53.970+0000 7f98911ad700 1 --2- 172.21.15.196:0/1008034114 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f98740b2880 0x7f98740b4d40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:53.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:53.970+0000 7f98911ad700 1 --2- 172.21.15.196:0/1008034114 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f988c103f80 0x7f988c1996a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:53.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:53.970+0000 7f98911ad700 1 --2- 172.21.15.196:0/1008034114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f988c1091e0 0x7f988c1a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:53.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:53.970+0000 7f98911ad700 1 --2- 172.21.15.196:0/1008034114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f988c1068b0 0x7f988c199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:53.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:53.970+0000 7f98911ad700 1 -- 172.21.15.196:0/1008034114 >> 172.21.15.196:0/1008034114 conn(0x7f988c0fd990 msgr2=0x7f988c1048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:49:53.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:53.971+0000 7f98911ad700 1 -- 172.21.15.196:0/1008034114 shutdown_connections 2024-05-10T10:49:53.972 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:49:53.971+0000 7f98911ad700 1 -- 172.21.15.196:0/1008034114 wait complete. 2024-05-10T10:49:54.545 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:54 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:54.546 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:54 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:54.546 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:54 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:54.546 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:54 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:49:54.546 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:54 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:54.546 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:54 smithi196 ceph-mon[34872]: from='osd.8 [v2:172.21.15.196:6816/504426486,v1:172.21.15.196:6817/504426486]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-10T10:49:54.546 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:54 smithi196 ceph-mon[34872]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-10T10:49:54.546 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:54 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:54.546 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:54 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:54.546 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:54 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:49:54.572 DEBUG:teuthology.orchestra.run.smithi196:osd.8> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.8.service 2024-05-10T10:49:54.574 INFO:tasks.cephadm:Deploying osd.9 on smithi107 with /dev/vg_nvme/lv_1... 2024-05-10T10:49:54.575 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-10T10:49:54.603 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:54 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:54.603 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:54 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:54.603 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:54 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:54.603 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:54 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:49:54.603 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:54 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:54.603 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:54 smithi107 ceph-mon[30373]: from='osd.8 [v2:172.21.15.196:6816/504426486,v1:172.21.15.196:6817/504426486]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-10T10:49:54.603 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:54 smithi107 ceph-mon[30373]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-10T10:49:54.603 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:54 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:54.603 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:54 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:54.603 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:54 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:49:54.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:54 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:54.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:54 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:54.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:54 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:54.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:54 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:49:54.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:54 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:54.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:54 smithi184 ceph-mon[34585]: from='osd.8 [v2:172.21.15.196:6816/504426486,v1:172.21.15.196:6817/504426486]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-10T10:49:54.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:54 smithi184 ceph-mon[34585]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-10T10:49:54.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:54 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:54.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:54 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:54.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:54 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:49:54.824 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:49:55.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:55 smithi196 ceph-mon[34872]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-10T10:49:55.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:55 smithi196 ceph-mon[34872]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-10T10:49:55.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:55 smithi196 ceph-mon[34872]: osdmap e52: 9 total, 8 up, 9 in 2024-05-10T10:49:55.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:55 smithi196 ceph-mon[34872]: from='osd.8 [v2:172.21.15.196:6816/504426486,v1:172.21.15.196:6817/504426486]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:49:55.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:55 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T10:49:55.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:55 smithi196 ceph-mon[34872]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:49:55.564 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 10:49:55 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T10:49:55.284+0000 7f356d12d700 -1 osd.8 0 waiting for initial osdmap 2024-05-10T10:49:55.564 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 10:49:55 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T10:49:55.294+0000 7f3568f20700 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T10:49:55.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:55 smithi184 ceph-mon[34585]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-10T10:49:55.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:55 smithi184 ceph-mon[34585]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-10T10:49:55.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:55 smithi184 ceph-mon[34585]: osdmap e52: 9 total, 8 up, 9 in 2024-05-10T10:49:55.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:55 smithi184 ceph-mon[34585]: from='osd.8 [v2:172.21.15.196:6816/504426486,v1:172.21.15.196:6817/504426486]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:49:55.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:55 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T10:49:55.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:55 smithi184 ceph-mon[34585]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:49:55.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:55 smithi107 ceph-mon[30373]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-10T10:49:55.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:55 smithi107 ceph-mon[30373]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-10T10:49:55.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:55 smithi107 ceph-mon[30373]: osdmap e52: 9 total, 8 up, 9 in 2024-05-10T10:49:55.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:55 smithi107 ceph-mon[30373]: from='osd.8 [v2:172.21.15.196:6816/504426486,v1:172.21.15.196:6817/504426486]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:49:55.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:55 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T10:49:55.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:55 smithi107 ceph-mon[30373]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:49:56.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:56 smithi196 ceph-mon[34872]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-05-10T10:49:56.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:56 smithi196 ceph-mon[34872]: osdmap e53: 9 total, 8 up, 9 in 2024-05-10T10:49:56.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:56 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T10:49:56.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:56 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T10:49:56.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:56 smithi184 ceph-mon[34585]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-05-10T10:49:56.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:56 smithi184 ceph-mon[34585]: osdmap e53: 9 total, 8 up, 9 in 2024-05-10T10:49:56.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:56 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T10:49:56.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:56 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T10:49:56.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:56 smithi107 ceph-mon[30373]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-05-10T10:49:56.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:56 smithi107 ceph-mon[30373]: osdmap e53: 9 total, 8 up, 9 in 2024-05-10T10:49:56.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:56 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T10:49:56.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:56 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T10:49:56.840 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-10T10:49:56.840 INFO:teuthology.orchestra.run.smithi107.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-10T10:49:56.841 INFO:teuthology.orchestra.run.smithi107.stderr: stderr: 10+0 records in 2024-05-10T10:49:56.841 INFO:teuthology.orchestra.run.smithi107.stderr:10+0 records out 2024-05-10T10:49:56.841 INFO:teuthology.orchestra.run.smithi107.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011267 s, 931 MB/s 2024-05-10T10:49:56.841 INFO:teuthology.orchestra.run.smithi107.stderr:--> Zapping successful for: 2024-05-10T10:49:57.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:57 smithi107 ceph-mon[30373]: purged_snaps scrub starts 2024-05-10T10:49:57.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:57 smithi107 ceph-mon[30373]: purged_snaps scrub ok 2024-05-10T10:49:57.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:57 smithi107 ceph-mon[30373]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-10T10:49:57.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:57 smithi107 ceph-mon[30373]: osd.8 [v2:172.21.15.196:6816/504426486,v1:172.21.15.196:6817/504426486] boot 2024-05-10T10:49:57.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:57 smithi107 ceph-mon[30373]: osdmap e54: 9 total, 9 up, 9 in 2024-05-10T10:49:57.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T10:49:57.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:57.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:57.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:57.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:57.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:57.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:57.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:57.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:49:57.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:57 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:57.555 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi107:vg_nvme/lv_1 2024-05-10T10:49:57.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:57 smithi196 ceph-mon[34872]: purged_snaps scrub starts 2024-05-10T10:49:57.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:57 smithi196 ceph-mon[34872]: purged_snaps scrub ok 2024-05-10T10:49:57.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:57 smithi196 ceph-mon[34872]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-10T10:49:57.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:57 smithi196 ceph-mon[34872]: osd.8 [v2:172.21.15.196:6816/504426486,v1:172.21.15.196:6817/504426486] boot 2024-05-10T10:49:57.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:57 smithi196 ceph-mon[34872]: osdmap e54: 9 total, 9 up, 9 in 2024-05-10T10:49:57.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T10:49:57.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:57.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:57.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:57.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:57.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:57.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:57.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:57.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:49:57.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:57 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:57.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:57 smithi184 ceph-mon[34585]: purged_snaps scrub starts 2024-05-10T10:49:57.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:57 smithi184 ceph-mon[34585]: purged_snaps scrub ok 2024-05-10T10:49:57.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:57 smithi184 ceph-mon[34585]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-05-10T10:49:57.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:57 smithi184 ceph-mon[34585]: osd.8 [v2:172.21.15.196:6816/504426486,v1:172.21.15.196:6817/504426486] boot 2024-05-10T10:49:57.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:57 smithi184 ceph-mon[34585]: osdmap e54: 9 total, 9 up, 9 in 2024-05-10T10:49:57.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:57 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-10T10:49:57.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:57 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:57.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:57 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:57.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:57 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:57.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:57 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:57.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:57 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:49:57.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:57 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:57.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:57 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:49:57.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:57 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:49:57.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:57 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:49:57.849 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:49:58.542 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:58 smithi107 ceph-mon[30373]: Detected new or changed devices on smithi196 2024-05-10T10:49:58.543 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:58 smithi107 ceph-mon[30373]: Adjusting osd_memory_target on smithi196 to 5696M 2024-05-10T10:49:58.543 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:58 smithi107 ceph-mon[30373]: osdmap e55: 9 total, 9 up, 9 in 2024-05-10T10:49:58.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:58 smithi196 ceph-mon[34872]: Detected new or changed devices on smithi196 2024-05-10T10:49:58.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:58 smithi196 ceph-mon[34872]: Adjusting osd_memory_target on smithi196 to 5696M 2024-05-10T10:49:58.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:58 smithi196 ceph-mon[34872]: osdmap e55: 9 total, 9 up, 9 in 2024-05-10T10:49:58.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:58 smithi184 ceph-mon[34585]: Detected new or changed devices on smithi196 2024-05-10T10:49:58.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:58 smithi184 ceph-mon[34585]: Adjusting osd_memory_target on smithi196 to 5696M 2024-05-10T10:49:58.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:58 smithi184 ceph-mon[34585]: osdmap e55: 9 total, 9 up, 9 in 2024-05-10T10:49:59.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.460+0000 7fc8e0d0e700 1 -- 172.21.15.107:0/3358668230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8dc103fb0 msgr2=0x7fc8dc10a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:49:59.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.460+0000 7fc8e0d0e700 1 --2- 172.21.15.107:0/3358668230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8dc103fb0 0x7fc8dc10a860 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400b0d0 tx=0x7fc8d400b3e0 comp rx=0 tx=0).stop 2024-05-10T10:49:59.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.460+0000 7fc8e0d0e700 1 -- 172.21.15.107:0/3358668230 shutdown_connections 2024-05-10T10:49:59.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.460+0000 7fc8e0d0e700 1 --2- 172.21.15.107:0/3358668230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc8dc102410 0x7fc8dc102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:59.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.460+0000 7fc8e0d0e700 1 --2- 172.21.15.107:0/3358668230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8dc103fb0 0x7fc8dc10a860 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:59.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.460+0000 7fc8e0d0e700 1 --2- 172.21.15.107:0/3358668230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8dc103610 0x7fc8dc103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:59.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.460+0000 7fc8e0d0e700 1 -- 172.21.15.107:0/3358668230 >> 172.21.15.107:0/3358668230 conn(0x7fc8dc0fd9d0 msgr2=0x7fc8dc0ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:49:59.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.460+0000 7fc8e0d0e700 1 -- 172.21.15.107:0/3358668230 shutdown_connections 2024-05-10T10:49:59.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.460+0000 7fc8e0d0e700 1 -- 172.21.15.107:0/3358668230 wait complete. 2024-05-10T10:49:59.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.461+0000 7fc8e0d0e700 1 Processor -- start 2024-05-10T10:49:59.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.461+0000 7fc8e0d0e700 1 -- start start 2024-05-10T10:49:59.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.461+0000 7fc8e0d0e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8dc102410 0x7fc8dc06c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:49:59.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.461+0000 7fc8e0d0e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc8dc103610 0x7fc8dc19e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:49:59.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.461+0000 7fc8e0d0e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8dc103fb0 0x7fc8dc1a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:49:59.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.461+0000 7fc8e0d0e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc10e000 con 0x7fc8dc103fb0 2024-05-10T10:49:59.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.461+0000 7fc8e0d0e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc10de80 con 0x7fc8dc102410 2024-05-10T10:49:59.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.461+0000 7fc8e0d0e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc10e180 con 0x7fc8dc103610 2024-05-10T10:49:59.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.461+0000 7fc8dad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8dc103fb0 0x7fc8dc1a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:49:59.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.461+0000 7fc8dad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8dc103fb0 0x7fc8dc1a09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58118/0 (socket says 172.21.15.107:58118) 2024-05-10T10:49:59.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.461+0000 7fc8dad9d700 1 -- 172.21.15.107:0/1736360793 learned_addr learned my addr 172.21.15.107:0/1736360793 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:49:59.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.461+0000 7fc8da59c700 1 --2- 172.21.15.107:0/1736360793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8dc102410 0x7fc8dc06c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:49:59.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.461+0000 7fc8d9d9b700 1 --2- 172.21.15.107:0/1736360793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc8dc103610 0x7fc8dc19e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:49:59.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.461+0000 7fc8dad9d700 1 -- 172.21.15.107:0/1736360793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc8dc103610 msgr2=0x7fc8dc19e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:49:59.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.461+0000 7fc8dad9d700 1 --2- 172.21.15.107:0/1736360793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc8dc103610 0x7fc8dc19e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:59.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.461+0000 7fc8dad9d700 1 -- 172.21.15.107:0/1736360793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8dc102410 msgr2=0x7fc8dc06c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:49:59.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.461+0000 7fc8dad9d700 1 --2- 172.21.15.107:0/1736360793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8dc102410 0x7fc8dc06c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:49:59.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.461+0000 7fc8dad9d700 1 -- 172.21.15.107:0/1736360793 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8dc1a1280 con 0x7fc8dc103fb0 2024-05-10T10:49:59.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.461+0000 7fc8da59c700 1 --2- 172.21.15.107:0/1736360793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8dc102410 0x7fc8dc06c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:49:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.462+0000 7fc8dad9d700 1 --2- 172.21.15.107:0/1736360793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8dc103fb0 0x7fc8dc1a09b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009cd0 tx=0x7fc8d4007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:49:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.462+0000 7fc8cb7fe700 1 -- 172.21.15.107:0/1736360793 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4003e10 con 0x7fc8dc103fb0 2024-05-10T10:49:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.462+0000 7fc8e0d0e700 1 -- 172.21.15.107:0/1736360793 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8dc1a1510 con 0x7fc8dc103fb0 2024-05-10T10:49:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.462+0000 7fc8cb7fe700 1 -- 172.21.15.107:0/1736360793 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc8d4006040 con 0x7fc8dc103fb0 2024-05-10T10:49:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.462+0000 7fc8cb7fe700 1 -- 172.21.15.107:0/1736360793 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d401b9e0 con 0x7fc8dc103fb0 2024-05-10T10:49:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.462+0000 7fc8e0d0e700 1 -- 172.21.15.107:0/1736360793 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8dc1a1960 con 0x7fc8dc103fb0 2024-05-10T10:49:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.463+0000 7fc8e0d0e700 1 -- 172.21.15.107:0/1736360793 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8dc06a190 con 0x7fc8dc103fb0 2024-05-10T10:49:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.464+0000 7fc8cb7fe700 1 -- 172.21.15.107:0/1736360793 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fc8d401dc60 con 0x7fc8dc103fb0 2024-05-10T10:49:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.465+0000 7fc8cb7fe700 1 --2- 172.21.15.107:0/1736360793 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc8c40b2880 0x7fc8c40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:49:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.465+0000 7fc8da59c700 1 --2- 172.21.15.107:0/1736360793 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc8c40b2880 0x7fc8c40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:49:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.465+0000 7fc8cb7fe700 1 -- 172.21.15.107:0/1736360793 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5829+0+0 (secure 0 0 0) 0x7fc8d400f020 con 0x7fc8dc103fb0 2024-05-10T10:49:59.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.465+0000 7fc8da59c700 1 --2- 172.21.15.107:0/1736360793 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc8c40b2880 0x7fc8c40b4d40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc005fd0 tx=0x7fc8cc005e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:49:59.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.468+0000 7fc8cb7fe700 1 -- 172.21.15.107:0/1736360793 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc8d402b020 con 0x7fc8dc103fb0 2024-05-10T10:49:59.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:59 smithi196 ceph-mon[34872]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:49:59.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:49:59 smithi196 ceph-mon[34872]: osdmap e56: 9 total, 9 up, 9 in 2024-05-10T10:49:59.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:59 smithi184 ceph-mon[34585]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:49:59.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:49:59 smithi184 ceph-mon[34585]: osdmap e56: 9 total, 9 up, 9 in 2024-05-10T10:49:59.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:59 smithi107 ceph-mon[30373]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:49:59.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:49:59 smithi107 ceph-mon[30373]: osdmap e56: 9 total, 9 up, 9 in 2024-05-10T10:49:59.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:49:59.684+0000 7fc8e0d0e700 1 -- 172.21.15.107:0/1736360793 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc8dc0638e0 con 0x7fc8c40b2880 2024-05-10T10:50:00.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:00 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:50:00.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:00 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:50:00.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:00 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:00.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:00 smithi196 ceph-mon[34872]: overall HEALTH_OK 2024-05-10T10:50:00.592 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:00 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:50:00.592 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:00 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:50:00.593 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:00 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:00.593 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:00 smithi107 ceph-mon[30373]: overall HEALTH_OK 2024-05-10T10:50:00.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:00 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:50:00.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:00 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:50:00.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:00 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:00.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:00 smithi184 ceph-mon[34585]: overall HEALTH_OK 2024-05-10T10:50:01.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:01 smithi196 ceph-mon[34872]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-05-10T10:50:01.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:01 smithi196 ceph-mon[34872]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:50:01.607 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:01 smithi107 ceph-mon[30373]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-05-10T10:50:01.607 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:01 smithi107 ceph-mon[30373]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:50:01.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:01 smithi184 ceph-mon[34585]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-05-10T10:50:01.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:01 smithi184 ceph-mon[34585]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi107:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:50:03.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:03 smithi184 ceph-mon[34585]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-10T10:50:03.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:03 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3552719800' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bcb03ec-1342-4679-9343-fcefd28dd69b"}]: dispatch 2024-05-10T10:50:03.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:03 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3552719800' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8bcb03ec-1342-4679-9343-fcefd28dd69b"}]': finished 2024-05-10T10:50:03.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:03 smithi184 ceph-mon[34585]: osdmap e57: 10 total, 9 up, 10 in 2024-05-10T10:50:03.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:03 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:03.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:03 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3881061287' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:50:03.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:03 smithi107 ceph-mon[30373]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-10T10:50:03.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:03 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3552719800' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bcb03ec-1342-4679-9343-fcefd28dd69b"}]: dispatch 2024-05-10T10:50:03.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:03 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3552719800' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8bcb03ec-1342-4679-9343-fcefd28dd69b"}]': finished 2024-05-10T10:50:03.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:03 smithi107 ceph-mon[30373]: osdmap e57: 10 total, 9 up, 10 in 2024-05-10T10:50:03.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:03 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:03.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:03 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3881061287' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:50:03.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:03 smithi196 ceph-mon[34872]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-10T10:50:03.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:03 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3552719800' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bcb03ec-1342-4679-9343-fcefd28dd69b"}]: dispatch 2024-05-10T10:50:03.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:03 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3552719800' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8bcb03ec-1342-4679-9343-fcefd28dd69b"}]': finished 2024-05-10T10:50:03.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:03 smithi196 ceph-mon[34872]: osdmap e57: 10 total, 9 up, 10 in 2024-05-10T10:50:03.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:03 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:03.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:03 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3881061287' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:50:05.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:05 smithi184 ceph-mon[34585]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-05-10T10:50:05.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:05 smithi107 ceph-mon[30373]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-05-10T10:50:05.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:05 smithi196 ceph-mon[34872]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-05-10T10:50:07.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:07 smithi107 ceph-mon[30373]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-10T10:50:07.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:07 smithi184 ceph-mon[34585]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-10T10:50:07.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:07 smithi196 ceph-mon[34872]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-10T10:50:09.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:09 smithi184 ceph-mon[34585]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-10T10:50:09.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:09 smithi107 ceph-mon[30373]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-10T10:50:09.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:09 smithi196 ceph-mon[34872]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-10T10:50:10.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:10 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-10T10:50:10.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:10 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:10.646 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:10 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-10T10:50:10.647 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:10 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:10.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:10 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-10T10:50:10.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:10 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:11.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:11 smithi184 ceph-mon[34585]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:11.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:11 smithi184 ceph-mon[34585]: Deploying daemon osd.9 on smithi107 2024-05-10T10:50:11.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:11 smithi107 ceph-mon[30373]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:11.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:11 smithi107 ceph-mon[30373]: Deploying daemon osd.9 on smithi107 2024-05-10T10:50:11.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:11 smithi196 ceph-mon[34872]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:11.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:11 smithi196 ceph-mon[34872]: Deploying daemon osd.9 on smithi107 2024-05-10T10:50:13.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:13 smithi184 ceph-mon[34585]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:13.653 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:13 smithi107 ceph-mon[30373]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:13.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:13 smithi196 ceph-mon[34872]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:15.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:15 smithi184 ceph-mon[34585]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:15.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:15 smithi107 ceph-mon[30373]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:15.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:15 smithi196 ceph-mon[34872]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:17.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:16 smithi184 ceph-mon[34585]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:17.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:16 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:17.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:16 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:17.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:16 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:50:17.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:16 smithi107 ceph-mon[30373]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:17.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:16 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:17.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:16 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:17.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:16 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:50:17.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:16 smithi196 ceph-mon[34872]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:17.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:16 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:17.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:16 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:17.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:16 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:50:18.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:18 smithi107 ceph-mon[30373]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:19.116 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:18 smithi196 ceph-mon[34872]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:19.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:18 smithi184 ceph-mon[34585]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:19.392 INFO:teuthology.orchestra.run.smithi107.stdout:Created osd(s) 9 on host 'smithi107' 2024-05-10T10:50:19.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:50:19.390+0000 7fc8cb7fe700 1 -- 172.21.15.107:0/1736360793 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc8dc0638e0 con 0x7fc8c40b2880 2024-05-10T10:50:19.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:50:19.394+0000 7fc8e0d0e700 1 -- 172.21.15.107:0/1736360793 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc8c40b2880 msgr2=0x7fc8c40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:50:19.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:50:19.394+0000 7fc8e0d0e700 1 --2- 172.21.15.107:0/1736360793 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc8c40b2880 0x7fc8c40b4d40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc005fd0 tx=0x7fc8cc005e40 comp rx=0 tx=0).stop 2024-05-10T10:50:19.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:50:19.394+0000 7fc8e0d0e700 1 -- 172.21.15.107:0/1736360793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8dc103fb0 msgr2=0x7fc8dc1a09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:50:19.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:50:19.394+0000 7fc8e0d0e700 1 --2- 172.21.15.107:0/1736360793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8dc103fb0 0x7fc8dc1a09b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009cd0 tx=0x7fc8d4007e40 comp rx=0 tx=0).stop 2024-05-10T10:50:19.395 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:50:19.394+0000 7fc8e0d0e700 1 -- 172.21.15.107:0/1736360793 shutdown_connections 2024-05-10T10:50:19.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:50:19.394+0000 7fc8e0d0e700 1 --2- 172.21.15.107:0/1736360793 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc8c40b2880 0x7fc8c40b4d40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:50:19.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:50:19.394+0000 7fc8e0d0e700 1 --2- 172.21.15.107:0/1736360793 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc8dc103fb0 0x7fc8dc1a09b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:50:19.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:50:19.394+0000 7fc8e0d0e700 1 --2- 172.21.15.107:0/1736360793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8dc102410 0x7fc8dc06c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:50:19.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:50:19.394+0000 7fc8e0d0e700 1 --2- 172.21.15.107:0/1736360793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc8dc103610 0x7fc8dc19e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:50:19.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:50:19.394+0000 7fc8e0d0e700 1 -- 172.21.15.107:0/1736360793 >> 172.21.15.107:0/1736360793 conn(0x7fc8dc0fd9d0 msgr2=0x7fc8dc106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:50:19.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:50:19.394+0000 7fc8e0d0e700 1 -- 172.21.15.107:0/1736360793 shutdown_connections 2024-05-10T10:50:19.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:50:19.394+0000 7fc8e0d0e700 1 -- 172.21.15.107:0/1736360793 wait complete. 2024-05-10T10:50:19.990 DEBUG:teuthology.orchestra.run.smithi107:osd.9> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.9.service 2024-05-10T10:50:19.992 INFO:tasks.cephadm:Deploying osd.10 on smithi184 with /dev/vg_nvme/lv_1... 2024-05-10T10:50:19.993 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-10T10:50:20.237 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T10:50:20.394 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:20 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:20.395 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:20 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:20.395 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:20 smithi196 ceph-mon[34872]: from='osd.9 [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-10T10:50:20.395 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:20 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:20.395 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:20 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:20.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:20 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:20.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:20 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:20.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:20 smithi184 ceph-mon[34585]: from='osd.9 [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-10T10:50:20.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:20 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:20.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:20 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:20.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:20.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:20.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:20 smithi107 ceph-mon[30373]: from='osd.9 [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-10T10:50:20.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:20.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:20 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:21.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:21 smithi184 ceph-mon[34585]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:21.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:21 smithi184 ceph-mon[34585]: from='osd.9 [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-10T10:50:21.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:21 smithi184 ceph-mon[34585]: osdmap e58: 10 total, 9 up, 10 in 2024-05-10T10:50:21.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:21 smithi184 ceph-mon[34585]: from='osd.9 [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-05-10T10:50:21.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:21 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:21.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:21 smithi107 ceph-mon[30373]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:21.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:21 smithi107 ceph-mon[30373]: from='osd.9 [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-10T10:50:21.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:21 smithi107 ceph-mon[30373]: osdmap e58: 10 total, 9 up, 10 in 2024-05-10T10:50:21.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:21 smithi107 ceph-mon[30373]: from='osd.9 [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-05-10T10:50:21.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:21 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:21.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:21 smithi196 ceph-mon[34872]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:21.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:21 smithi196 ceph-mon[34872]: from='osd.9 [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-10T10:50:21.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:21 smithi196 ceph-mon[34872]: osdmap e58: 10 total, 9 up, 10 in 2024-05-10T10:50:21.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:21 smithi196 ceph-mon[34872]: from='osd.9 [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]: dispatch 2024-05-10T10:50:21.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:21 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:22.378 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 10:50:22 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T10:50:22.275+0000 7f780a1d6700 -1 osd.9 0 waiting for initial osdmap 2024-05-10T10:50:22.480 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-10T10:50:22.480 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-10T10:50:22.480 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2024-05-10T10:50:22.480 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2024-05-10T10:50:22.480 INFO:teuthology.orchestra.run.smithi184.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115202 s, 910 MB/s 2024-05-10T10:50:22.480 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 2024-05-10T10:50:22.480 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2024-05-10T10:50:22.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:22 smithi184 ceph-mon[34585]: from='osd.9 [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-05-10T10:50:22.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:22 smithi184 ceph-mon[34585]: osdmap e59: 10 total, 9 up, 10 in 2024-05-10T10:50:22.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:22 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:22.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:22 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:22.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:22 smithi184 ceph-mon[34585]: from='osd.9 [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760]' entity='osd.9' 2024-05-10T10:50:22.675 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 10:50:22 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T10:50:22.413+0000 7f78017c0700 -1 osd.9 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T10:50:22.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:22 smithi107 ceph-mon[30373]: from='osd.9 [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-05-10T10:50:22.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:22 smithi107 ceph-mon[30373]: osdmap e59: 10 total, 9 up, 10 in 2024-05-10T10:50:22.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:22 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:22.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:22 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:22.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:22 smithi107 ceph-mon[30373]: from='osd.9 [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760]' entity='osd.9' 2024-05-10T10:50:22.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:22 smithi196 ceph-mon[34872]: from='osd.9 [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi107", "root=default"]}]': finished 2024-05-10T10:50:22.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:22 smithi196 ceph-mon[34872]: osdmap e59: 10 total, 9 up, 10 in 2024-05-10T10:50:22.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:22 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:22.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:22 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:22.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:22 smithi196 ceph-mon[34872]: from='osd.9 [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760]' entity='osd.9' 2024-05-10T10:50:23.059 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi184:vg_nvme/lv_1 2024-05-10T10:50:23.324 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T10:50:23.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:23 smithi184 ceph-mon[34585]: purged_snaps scrub starts 2024-05-10T10:50:23.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:23 smithi184 ceph-mon[34585]: purged_snaps scrub ok 2024-05-10T10:50:23.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:23 smithi184 ceph-mon[34585]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:23.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:23 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:23.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:23 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:23.665 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:23 smithi107 ceph-mon[30373]: purged_snaps scrub starts 2024-05-10T10:50:23.666 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:23 smithi107 ceph-mon[30373]: purged_snaps scrub ok 2024-05-10T10:50:23.666 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:23 smithi107 ceph-mon[30373]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:23.666 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:23 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:23.666 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:23 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:23.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:23 smithi196 ceph-mon[34872]: purged_snaps scrub starts 2024-05-10T10:50:23.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:23 smithi196 ceph-mon[34872]: purged_snaps scrub ok 2024-05-10T10:50:23.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:23 smithi196 ceph-mon[34872]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:23.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:23 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:23.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:23 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:24.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:24 smithi184 ceph-mon[34585]: osd.9 [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760] boot 2024-05-10T10:50:24.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:24 smithi184 ceph-mon[34585]: osdmap e60: 10 total, 10 up, 10 in 2024-05-10T10:50:24.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:24.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:24.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:24.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:24.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:24.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:24.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:24.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:24.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:24.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:50:24.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:24.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:50:24.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:24.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:50:24.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:24.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:24 smithi107 ceph-mon[30373]: osd.9 [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760] boot 2024-05-10T10:50:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:24 smithi107 ceph-mon[30373]: osdmap e60: 10 total, 10 up, 10 in 2024-05-10T10:50:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:50:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:24.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:50:24.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:24.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:50:24.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:24.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:24 smithi196 ceph-mon[34872]: osd.9 [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760] boot 2024-05-10T10:50:24.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:24 smithi196 ceph-mon[34872]: osdmap e60: 10 total, 10 up, 10 in 2024-05-10T10:50:24.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-10T10:50:24.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:24.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:24.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:24.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:24.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:24.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:24.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:24.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:24.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:50:24.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:24.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:50:24.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:24.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:50:24.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:24.853 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.852+0000 7fcbd919f700 1 -- 172.21.15.184:0/1183252635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbd4103fa0 msgr2=0x7fcbd410a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:50:24.853 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.852+0000 7fcbd919f700 1 --2- 172.21.15.184:0/1183252635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbd4103fa0 0x7fcbd410a850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00b0d0 tx=0x7fcbcc00b3e0 comp rx=0 tx=0).stop 2024-05-10T10:50:24.853 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.852+0000 7fcbd919f700 1 -- 172.21.15.184:0/1183252635 shutdown_connections 2024-05-10T10:50:24.853 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.852+0000 7fcbd919f700 1 --2- 172.21.15.184:0/1183252635 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbd4102400 0x7fcbd4102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:50:24.854 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.852+0000 7fcbd919f700 1 --2- 172.21.15.184:0/1183252635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbd4103fa0 0x7fcbd410a850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:50:24.854 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.852+0000 7fcbd919f700 1 --2- 172.21.15.184:0/1183252635 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd4103600 0x7fcbd4103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:50:24.854 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.852+0000 7fcbd919f700 1 -- 172.21.15.184:0/1183252635 >> 172.21.15.184:0/1183252635 conn(0x7fcbd40fd9a0 msgr2=0x7fcbd40ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:50:24.854 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.852+0000 7fcbd919f700 1 -- 172.21.15.184:0/1183252635 shutdown_connections 2024-05-10T10:50:24.854 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.852+0000 7fcbd919f700 1 -- 172.21.15.184:0/1183252635 wait complete. 2024-05-10T10:50:24.856 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.853+0000 7fcbd919f700 1 Processor -- start 2024-05-10T10:50:24.856 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.853+0000 7fcbd919f700 1 -- start start 2024-05-10T10:50:24.856 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.853+0000 7fcbd919f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbd4102400 0x7fcbd4199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:50:24.856 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.853+0000 7fcbd919f700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbd4103600 0x7fcbd4199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:50:24.856 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.853+0000 7fcbd919f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd4103fa0 0x7fcbd41a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:50:24.856 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.853+0000 7fcbd919f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd410e050 con 0x7fcbd4103fa0 2024-05-10T10:50:24.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.853+0000 7fcbd919f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd410ded0 con 0x7fcbd4102400 2024-05-10T10:50:24.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.853+0000 7fcbd919f700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd410e1d0 con 0x7fcbd4103600 2024-05-10T10:50:24.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.853+0000 7fcbd2d9d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbd4102400 0x7fcbd4199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:50:24.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.853+0000 7fcbd2d9d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbd4102400 0x7fcbd4199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:45976/0 (socket says 172.21.15.184:45976) 2024-05-10T10:50:24.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.853+0000 7fcbd2d9d700 1 -- 172.21.15.184:0/852821374 learned_addr learned my addr 172.21.15.184:0/852821374 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-05-10T10:50:24.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.853+0000 7fcbd359e700 1 --2- 172.21.15.184:0/852821374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd4103fa0 0x7fcbd41a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:50:24.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.853+0000 7fcbd2d9d700 1 -- 172.21.15.184:0/852821374 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbd4103600 msgr2=0x7fcbd4199ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:50:24.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.853+0000 7fcbd259c700 1 --2- 172.21.15.184:0/852821374 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbd4103600 0x7fcbd4199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:50:24.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.853+0000 7fcbd2d9d700 1 --2- 172.21.15.184:0/852821374 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbd4103600 0x7fcbd4199ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:50:24.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.853+0000 7fcbd2d9d700 1 -- 172.21.15.184:0/852821374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd4103fa0 msgr2=0x7fcbd41a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:50:24.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.853+0000 7fcbd2d9d700 1 --2- 172.21.15.184:0/852821374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd4103fa0 0x7fcbd41a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:50:24.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.853+0000 7fcbd2d9d700 1 -- 172.21.15.184:0/852821374 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd41a13c0 con 0x7fcbd4102400 2024-05-10T10:50:24.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.854+0000 7fcbd2d9d700 1 --2- 172.21.15.184:0/852821374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbd4102400 0x7fcbd4199760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400b500 tx=0x7fcbc400b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:50:24.858 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.854+0000 7fcbbbfff700 1 -- 172.21.15.184:0/852821374 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4015020 con 0x7fcbd4102400 2024-05-10T10:50:24.858 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.854+0000 7fcbd919f700 1 -- 172.21.15.184:0/852821374 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd41a16b0 con 0x7fcbd4102400 2024-05-10T10:50:24.858 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.854+0000 7fcbbbfff700 1 -- 172.21.15.184:0/852821374 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcbc4011d00 con 0x7fcbd4102400 2024-05-10T10:50:24.858 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.854+0000 7fcbbbfff700 1 -- 172.21.15.184:0/852821374 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4010e00 con 0x7fcbd4102400 2024-05-10T10:50:24.858 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.854+0000 7fcbd919f700 1 -- 172.21.15.184:0/852821374 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd41a1bf0 con 0x7fcbd4102400 2024-05-10T10:50:24.858 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.855+0000 7fcbd919f700 1 -- 172.21.15.184:0/852821374 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd406a190 con 0x7fcbd4102400 2024-05-10T10:50:24.859 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.856+0000 7fcbbbfff700 1 -- 172.21.15.184:0/852821374 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fcbc4018020 con 0x7fcbd4102400 2024-05-10T10:50:24.859 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.857+0000 7fcbbbfff700 1 --2- 172.21.15.184:0/852821374 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcbbc0b2880 0x7fcbbc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:50:24.859 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.857+0000 7fcbbbfff700 1 -- 172.21.15.184:0/852821374 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6261+0+0 (secure 0 0 0) 0x7fcbc40e16d0 con 0x7fcbd4102400 2024-05-10T10:50:24.859 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.857+0000 7fcbd259c700 1 --2- 172.21.15.184:0/852821374 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcbbc0b2880 0x7fcbbc0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:50:24.859 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.857+0000 7fcbd259c700 1 --2- 172.21.15.184:0/852821374 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcbbc0b2880 0x7fcbbc0b4d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8005fd0 tx=0x7fcbc8005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:50:24.861 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:24.861+0000 7fcbbbfff700 1 -- 172.21.15.184:0/852821374 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fcbc401f020 con 0x7fcbd4102400 2024-05-10T10:50:25.075 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:25.074+0000 7fcbd919f700 1 -- 172.21.15.184:0/852821374 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fcbd40ffb40 con 0x7fcbbc0b2880 2024-05-10T10:50:25.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:25 smithi107 ceph-mon[30373]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:25.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:25 smithi107 ceph-mon[30373]: Detected new or changed devices on smithi107 2024-05-10T10:50:25.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:25 smithi107 ceph-mon[30373]: Adjusting osd_memory_target on smithi107 to 4272M 2024-05-10T10:50:25.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:25 smithi107 ceph-mon[30373]: osdmap e61: 10 total, 10 up, 10 in 2024-05-10T10:50:25.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:25 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:50:25.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:25 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:50:25.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:25 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:25.676 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:25 smithi184 ceph-mon[34585]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:25.676 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:25 smithi184 ceph-mon[34585]: Detected new or changed devices on smithi107 2024-05-10T10:50:25.676 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:25 smithi184 ceph-mon[34585]: Adjusting osd_memory_target on smithi107 to 4272M 2024-05-10T10:50:25.676 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:25 smithi184 ceph-mon[34585]: osdmap e61: 10 total, 10 up, 10 in 2024-05-10T10:50:25.676 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:25 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:50:25.676 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:25 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:50:25.676 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:25 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:25.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:25 smithi196 ceph-mon[34872]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-05-10T10:50:25.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:25 smithi196 ceph-mon[34872]: Detected new or changed devices on smithi107 2024-05-10T10:50:25.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:25 smithi196 ceph-mon[34872]: Adjusting osd_memory_target on smithi107 to 4272M 2024-05-10T10:50:25.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:25 smithi196 ceph-mon[34872]: osdmap e61: 10 total, 10 up, 10 in 2024-05-10T10:50:25.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:25 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:50:25.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:25 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:50:25.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:25 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:26.606 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:26 smithi184 ceph-mon[34585]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:50:26.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:26 smithi107 ceph-mon[30373]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:50:26.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:26 smithi196 ceph-mon[34872]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:50:27.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:27 smithi107 ceph-mon[30373]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:27.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:27 smithi196 ceph-mon[34872]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:27.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:27 smithi184 ceph-mon[34585]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:28.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:28 smithi107 ceph-mon[30373]: from='client.? 172.21.15.184:0/212243424' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "78374015-aa7f-4288-b5ae-be64a5182bf0"}]: dispatch 2024-05-10T10:50:28.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:28 smithi107 ceph-mon[30373]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "78374015-aa7f-4288-b5ae-be64a5182bf0"}]: dispatch 2024-05-10T10:50:28.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:28 smithi107 ceph-mon[30373]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "78374015-aa7f-4288-b5ae-be64a5182bf0"}]': finished 2024-05-10T10:50:28.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:28 smithi107 ceph-mon[30373]: osdmap e62: 11 total, 10 up, 11 in 2024-05-10T10:50:28.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:28 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:28.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:28 smithi196 ceph-mon[34872]: from='client.? 172.21.15.184:0/212243424' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "78374015-aa7f-4288-b5ae-be64a5182bf0"}]: dispatch 2024-05-10T10:50:28.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:28 smithi196 ceph-mon[34872]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "78374015-aa7f-4288-b5ae-be64a5182bf0"}]: dispatch 2024-05-10T10:50:28.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:28 smithi196 ceph-mon[34872]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "78374015-aa7f-4288-b5ae-be64a5182bf0"}]': finished 2024-05-10T10:50:28.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:28 smithi196 ceph-mon[34872]: osdmap e62: 11 total, 10 up, 11 in 2024-05-10T10:50:28.815 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:28 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:28.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:28 smithi184 ceph-mon[34585]: from='client.? 172.21.15.184:0/212243424' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "78374015-aa7f-4288-b5ae-be64a5182bf0"}]: dispatch 2024-05-10T10:50:28.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:28 smithi184 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "78374015-aa7f-4288-b5ae-be64a5182bf0"}]: dispatch 2024-05-10T10:50:28.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:28 smithi184 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "78374015-aa7f-4288-b5ae-be64a5182bf0"}]': finished 2024-05-10T10:50:28.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:28 smithi184 ceph-mon[34585]: osdmap e62: 11 total, 10 up, 11 in 2024-05-10T10:50:28.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:28 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:29.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:29 smithi107 ceph-mon[30373]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:29.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:29 smithi107 ceph-mon[30373]: from='client.? 172.21.15.184:0/2391237721' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:50:29.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:29 smithi196 ceph-mon[34872]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:29.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:29 smithi196 ceph-mon[34872]: from='client.? 172.21.15.184:0/2391237721' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:50:29.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:29 smithi184 ceph-mon[34585]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:29.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:29 smithi184 ceph-mon[34585]: from='client.? 172.21.15.184:0/2391237721' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:50:31.678 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:31 smithi107 ceph-mon[30373]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:31.680 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:31 smithi184 ceph-mon[34585]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:31.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:31 smithi196 ceph-mon[34872]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:33.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:33 smithi107 ceph-mon[30373]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:33.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:33 smithi196 ceph-mon[34872]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:33.831 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:33 smithi184 ceph-mon[34585]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:35.621 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:35 smithi184 ceph-mon[34585]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:35.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:35 smithi107 ceph-mon[30373]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:35.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:35 smithi196 ceph-mon[34872]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:36.615 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:36 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-10T10:50:36.615 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:36 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:36.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-10T10:50:36.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:36.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:36 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-10T10:50:36.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:36 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:37.568 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:37 smithi184 ceph-mon[34585]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:37.568 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:37 smithi184 ceph-mon[34585]: Deploying daemon osd.10 on smithi184 2024-05-10T10:50:37.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:37 smithi196 ceph-mon[34872]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:37.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:37 smithi196 ceph-mon[34872]: Deploying daemon osd.10 on smithi184 2024-05-10T10:50:37.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:37 smithi107 ceph-mon[30373]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:37.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:37 smithi107 ceph-mon[30373]: Deploying daemon osd.10 on smithi184 2024-05-10T10:50:39.531 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:39 smithi184 ceph-mon[34585]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:39.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:39 smithi196 ceph-mon[34872]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:39.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:39 smithi107 ceph-mon[30373]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:41.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:41 smithi196 ceph-mon[34872]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:41.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:41 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:41.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:41 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:50:41.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:41 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:41.864 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:41 smithi184 ceph-mon[34585]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:41.864 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:41 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:41.864 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:41 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:50:41.864 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:41 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:41.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:41 smithi107 ceph-mon[30373]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:41.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:41 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:41.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:41 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:50:41.927 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:41 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:43.693 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:43 smithi184 ceph-mon[34585]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:43.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:43 smithi196 ceph-mon[34872]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:43.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:43 smithi107 ceph-mon[30373]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:44.893 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:44.892+0000 7fcbbbfff700 1 -- 172.21.15.184:0/852821374 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fcbd40ffb40 con 0x7fcbbc0b2880 2024-05-10T10:50:44.893 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 10 on host 'smithi184' 2024-05-10T10:50:44.895 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:44.894+0000 7fcbd919f700 1 -- 172.21.15.184:0/852821374 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcbbc0b2880 msgr2=0x7fcbbc0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:50:44.896 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:44.894+0000 7fcbd919f700 1 --2- 172.21.15.184:0/852821374 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcbbc0b2880 0x7fcbbc0b4d40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8005fd0 tx=0x7fcbc8005f60 comp rx=0 tx=0).stop 2024-05-10T10:50:44.896 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:44.894+0000 7fcbd919f700 1 -- 172.21.15.184:0/852821374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbd4102400 msgr2=0x7fcbd4199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:50:44.896 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:44.894+0000 7fcbd919f700 1 --2- 172.21.15.184:0/852821374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbd4102400 0x7fcbd4199760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400b500 tx=0x7fcbc400b810 comp rx=0 tx=0).stop 2024-05-10T10:50:44.896 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:44.894+0000 7fcbd919f700 1 -- 172.21.15.184:0/852821374 shutdown_connections 2024-05-10T10:50:44.896 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:44.894+0000 7fcbd919f700 1 --2- 172.21.15.184:0/852821374 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcbbc0b2880 0x7fcbbc0b4d40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:50:44.896 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:44.894+0000 7fcbd919f700 1 --2- 172.21.15.184:0/852821374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbd4103fa0 0x7fcbd41a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:50:44.896 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:44.894+0000 7fcbd919f700 1 --2- 172.21.15.184:0/852821374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbd4102400 0x7fcbd4199760 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:50:44.896 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:44.894+0000 7fcbd919f700 1 --2- 172.21.15.184:0/852821374 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbd4103600 0x7fcbd4199ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:50:44.896 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:44.894+0000 7fcbd919f700 1 -- 172.21.15.184:0/852821374 >> 172.21.15.184:0/852821374 conn(0x7fcbd40fd9a0 msgr2=0x7fcbd40ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:50:44.896 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:44.895+0000 7fcbd919f700 1 -- 172.21.15.184:0/852821374 shutdown_connections 2024-05-10T10:50:44.896 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-10T10:50:44.895+0000 7fcbd919f700 1 -- 172.21.15.184:0/852821374 wait complete. 2024-05-10T10:50:45.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:45 smithi184 ceph-mon[34585]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:45.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:45.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:45.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:45.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:50:45.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:45.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:45.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:45.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:50:45.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:45 smithi184 ceph-mon[34585]: from='osd.10 [v2:172.21.15.184:6824/1387541139,v1:172.21.15.184:6825/1387541139]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-10T10:50:45.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:45 smithi184 ceph-mon[34585]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-10T10:50:45.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:45 smithi196 ceph-mon[34872]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:45.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:45.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:45.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:45.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:50:45.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:45.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:45.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:45.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:50:45.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:45 smithi196 ceph-mon[34872]: from='osd.10 [v2:172.21.15.184:6824/1387541139,v1:172.21.15.184:6825/1387541139]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-10T10:50:45.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:45 smithi196 ceph-mon[34872]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-10T10:50:45.589 DEBUG:teuthology.orchestra.run.smithi184:osd.10> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.10.service 2024-05-10T10:50:45.592 INFO:tasks.cephadm:Deploying osd.11 on smithi196 with /dev/vg_nvme/lv_1... 2024-05-10T10:50:45.592 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-10T10:50:45.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:45 smithi107 ceph-mon[30373]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:45.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:45.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:45.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:45.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:50:45.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:45.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:45.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:45.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:50:45.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:45 smithi107 ceph-mon[30373]: from='osd.10 [v2:172.21.15.184:6824/1387541139,v1:172.21.15.184:6825/1387541139]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-10T10:50:45.676 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:45 smithi107 ceph-mon[30373]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-10T10:50:45.841 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T10:50:47.006 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:46 smithi184 ceph-mon[34585]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:47.006 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:46 smithi184 ceph-mon[34585]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-10T10:50:47.006 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:46 smithi184 ceph-mon[34585]: from='osd.10 [v2:172.21.15.184:6824/1387541139,v1:172.21.15.184:6825/1387541139]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:50:47.006 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:46 smithi184 ceph-mon[34585]: osdmap e63: 11 total, 10 up, 11 in 2024-05-10T10:50:47.006 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:46 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:47.006 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:46 smithi184 ceph-mon[34585]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:50:47.140 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:46 smithi196 ceph-mon[34872]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:47.141 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:46 smithi196 ceph-mon[34872]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-10T10:50:47.141 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:46 smithi196 ceph-mon[34872]: from='osd.10 [v2:172.21.15.184:6824/1387541139,v1:172.21.15.184:6825/1387541139]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:50:47.141 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:46 smithi196 ceph-mon[34872]: osdmap e63: 11 total, 10 up, 11 in 2024-05-10T10:50:47.141 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:46 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:47.141 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:46 smithi196 ceph-mon[34872]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:50:47.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:46 smithi107 ceph-mon[30373]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:47.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:46 smithi107 ceph-mon[30373]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-10T10:50:47.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:46 smithi107 ceph-mon[30373]: from='osd.10 [v2:172.21.15.184:6824/1387541139,v1:172.21.15.184:6825/1387541139]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:50:47.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:46 smithi107 ceph-mon[30373]: osdmap e63: 11 total, 10 up, 11 in 2024-05-10T10:50:47.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:46 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:47.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:46 smithi107 ceph-mon[30373]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-05-10T10:50:47.832 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-10T10:50:47.832 INFO:teuthology.orchestra.run.smithi196.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-10T10:50:47.832 INFO:teuthology.orchestra.run.smithi196.stderr: stderr: 10+0 records in 2024-05-10T10:50:47.832 INFO:teuthology.orchestra.run.smithi196.stderr:10+0 records out 2024-05-10T10:50:47.832 INFO:teuthology.orchestra.run.smithi196.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113794 s, 921 MB/s 2024-05-10T10:50:47.832 INFO:teuthology.orchestra.run.smithi196.stderr:--> Zapping successful for: 2024-05-10T10:50:48.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:47 smithi184 ceph-mon[34585]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-05-10T10:50:48.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:47 smithi184 ceph-mon[34585]: osdmap e64: 11 total, 10 up, 11 in 2024-05-10T10:50:48.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:47 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:48.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:47 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:48.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:47 smithi184 ceph-mon[34585]: from='osd.10 ' entity='osd.10' 2024-05-10T10:50:48.140 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 10:50:47 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T10:50:47.815+0000 7f087eda9700 -1 osd.10 0 waiting for initial osdmap 2024-05-10T10:50:48.140 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 10:50:47 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T10:50:47.919+0000 7f0876393700 -1 osd.10 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T10:50:48.169 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:47 smithi196 ceph-mon[34872]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-05-10T10:50:48.170 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:47 smithi196 ceph-mon[34872]: osdmap e64: 11 total, 10 up, 11 in 2024-05-10T10:50:48.170 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:47 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:48.170 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:47 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:48.170 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:47 smithi196 ceph-mon[34872]: from='osd.10 ' entity='osd.10' 2024-05-10T10:50:48.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:47 smithi107 ceph-mon[30373]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-05-10T10:50:48.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:47 smithi107 ceph-mon[30373]: osdmap e64: 11 total, 10 up, 11 in 2024-05-10T10:50:48.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:47 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:48.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:47 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:48.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:47 smithi107 ceph-mon[30373]: from='osd.10 ' entity='osd.10' 2024-05-10T10:50:48.575 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi196:vg_nvme/lv_1 2024-05-10T10:50:48.826 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T10:50:49.115 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:48 smithi196 ceph-mon[34872]: purged_snaps scrub starts 2024-05-10T10:50:49.115 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:48 smithi196 ceph-mon[34872]: purged_snaps scrub ok 2024-05-10T10:50:49.115 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:48 smithi196 ceph-mon[34872]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:49.116 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:48 smithi196 ceph-mon[34872]: osdmap e65: 11 total, 10 up, 11 in 2024-05-10T10:50:49.116 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:49.116 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:49.116 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:49.116 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:49.116 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:49.116 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:49.116 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:49.116 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:49.116 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:49.116 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:49.116 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:50:49.116 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:49.117 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:49.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:48 smithi107 ceph-mon[30373]: purged_snaps scrub starts 2024-05-10T10:50:49.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:48 smithi107 ceph-mon[30373]: purged_snaps scrub ok 2024-05-10T10:50:49.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:48 smithi107 ceph-mon[30373]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:49.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:48 smithi107 ceph-mon[30373]: osdmap e65: 11 total, 10 up, 11 in 2024-05-10T10:50:49.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:49.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:49.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:49.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:49.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:49.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:49.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:49.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:49.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:49.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:49.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:50:49.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:49.176 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:49.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:48 smithi184 ceph-mon[34585]: purged_snaps scrub starts 2024-05-10T10:50:49.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:48 smithi184 ceph-mon[34585]: purged_snaps scrub ok 2024-05-10T10:50:49.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:48 smithi184 ceph-mon[34585]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:49.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:48 smithi184 ceph-mon[34585]: osdmap e65: 11 total, 10 up, 11 in 2024-05-10T10:50:49.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:49.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:49.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:49.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:49.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:49.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:49.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:49.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:50:49.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:49.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:49.391 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:50:49.391 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:50:49.391 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:50.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:49 smithi196 ceph-mon[34872]: Detected new or changed devices on smithi184 2024-05-10T10:50:50.056 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:49 smithi196 ceph-mon[34872]: Adjusting osd_memory_target on smithi184 to 4272M 2024-05-10T10:50:50.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:49 smithi196 ceph-mon[34872]: osd.10 [v2:172.21.15.184:6824/1387541139,v1:172.21.15.184:6825/1387541139] boot 2024-05-10T10:50:50.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:49 smithi196 ceph-mon[34872]: osdmap e66: 11 total, 11 up, 11 in 2024-05-10T10:50:50.057 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:49 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:50.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:49 smithi107 ceph-mon[30373]: Detected new or changed devices on smithi184 2024-05-10T10:50:50.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:49 smithi107 ceph-mon[30373]: Adjusting osd_memory_target on smithi184 to 4272M 2024-05-10T10:50:50.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:49 smithi107 ceph-mon[30373]: osd.10 [v2:172.21.15.184:6824/1387541139,v1:172.21.15.184:6825/1387541139] boot 2024-05-10T10:50:50.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:49 smithi107 ceph-mon[30373]: osdmap e66: 11 total, 11 up, 11 in 2024-05-10T10:50:50.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:49 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:50.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.349+0000 7f7907d93700 1 -- 172.21.15.196:0/1650773890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7900103500 msgr2=0x7f7900103920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:50:50.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.349+0000 7f7907d93700 1 --2- 172.21.15.196:0/1650773890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7900103500 0x7f7900103920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009990 tx=0x7f78f0009ca0 comp rx=0 tx=0).stop 2024-05-10T10:50:50.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.349+0000 7f7907d93700 1 -- 172.21.15.196:0/1650773890 shutdown_connections 2024-05-10T10:50:50.352 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.349+0000 7f7907d93700 1 --2- 172.21.15.196:0/1650773890 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7900103500 0x7f7900103920 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:50:50.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.349+0000 7f7907d93700 1 --2- 172.21.15.196:0/1650773890 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79001050a0 0x7f790010b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:50:50.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.349+0000 7f7907d93700 1 --2- 172.21.15.196:0/1650773890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7900104700 0x7f7900104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:50:50.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.349+0000 7f7907d93700 1 -- 172.21.15.196:0/1650773890 >> 172.21.15.196:0/1650773890 conn(0x7f79000feaa0 msgr2=0x7f7900100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:50:50.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.349+0000 7f7907d93700 1 -- 172.21.15.196:0/1650773890 shutdown_connections 2024-05-10T10:50:50.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.349+0000 7f7907d93700 1 -- 172.21.15.196:0/1650773890 wait complete. 2024-05-10T10:50:50.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.350+0000 7f7907d93700 1 Processor -- start 2024-05-10T10:50:50.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.350+0000 7f7907d93700 1 -- start start 2024-05-10T10:50:50.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.350+0000 7f7907d93700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7900103500 0x7f7900077240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:50:50.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.350+0000 7f7907d93700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7900104700 0x7f7900075890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:50:50.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.350+0000 7f7907d93700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79001050a0 0x7f7900075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:50:50.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.350+0000 7f7907d93700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f790010f130 con 0x7f7900104700 2024-05-10T10:50:50.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.350+0000 7f7907d93700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f790010efb0 con 0x7f7900103500 2024-05-10T10:50:50.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.350+0000 7f7907d93700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f790010f2b0 con 0x7f79001050a0 2024-05-10T10:50:50.353 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.350+0000 7f7906330700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79001050a0 0x7f7900075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:50:50.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.350+0000 7f7906330700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79001050a0 0x7f7900075dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:34848/0 (socket says 172.21.15.196:34848) 2024-05-10T10:50:50.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.350+0000 7f7906330700 1 -- 172.21.15.196:0/3105527284 learned_addr learned my addr 172.21.15.196:0/3105527284 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-10T10:50:50.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.350+0000 7f7905b2f700 1 --2- 172.21.15.196:0/3105527284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7900103500 0x7f7900077240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:50:50.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.350+0000 7f790532e700 1 --2- 172.21.15.196:0/3105527284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7900104700 0x7f7900075890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:50:50.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.351+0000 7f7906330700 1 -- 172.21.15.196:0/3105527284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7900103500 msgr2=0x7f7900077240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:50:50.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.351+0000 7f7906330700 1 --2- 172.21.15.196:0/3105527284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7900103500 0x7f7900077240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:50:50.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.351+0000 7f7906330700 1 -- 172.21.15.196:0/3105527284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7900104700 msgr2=0x7f7900075890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:50:50.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.351+0000 7f7906330700 1 --2- 172.21.15.196:0/3105527284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7900104700 0x7f7900075890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:50:50.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.351+0000 7f7906330700 1 -- 172.21.15.196:0/3105527284 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7900076680 con 0x7f79001050a0 2024-05-10T10:50:50.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.351+0000 7f790532e700 1 --2- 172.21.15.196:0/3105527284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7900104700 0x7f7900075890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:50:50.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.351+0000 7f7906330700 1 --2- 172.21.15.196:0/3105527284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79001050a0 0x7f7900075dd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f78f8007ee0 tx=0x7f78f800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:50:50.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.351+0000 7f78f6ffd700 1 -- 172.21.15.196:0/3105527284 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f800dbd0 con 0x7f79001050a0 2024-05-10T10:50:50.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.351+0000 7f7907d93700 1 -- 172.21.15.196:0/3105527284 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79001a3940 con 0x7f79001050a0 2024-05-10T10:50:50.354 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.351+0000 7f78f6ffd700 1 -- 172.21.15.196:0/3105527284 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f78f800dd70 con 0x7f79001050a0 2024-05-10T10:50:50.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.351+0000 7f78f6ffd700 1 -- 172.21.15.196:0/3105527284 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8005a50 con 0x7f79001050a0 2024-05-10T10:50:50.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.351+0000 7f7907d93700 1 -- 172.21.15.196:0/3105527284 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79001a3f00 con 0x7f79001050a0 2024-05-10T10:50:50.355 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.352+0000 7f7907d93700 1 -- 172.21.15.196:0/3105527284 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f790006a190 con 0x7f79001050a0 2024-05-10T10:50:50.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.353+0000 7f78f6ffd700 1 -- 172.21.15.196:0/3105527284 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f78f801a020 con 0x7f79001050a0 2024-05-10T10:50:50.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.354+0000 7f78f6ffd700 1 --2- 172.21.15.196:0/3105527284 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f78ec0b2a20 0x7f78ec0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:50:50.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.354+0000 7f78f6ffd700 1 -- 172.21.15.196:0/3105527284 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6694+0+0 (secure 0 0 0) 0x7f78f80e1930 con 0x7f79001050a0 2024-05-10T10:50:50.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.354+0000 7f7905b2f700 1 --2- 172.21.15.196:0/3105527284 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f78ec0b2a20 0x7f78ec0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:50:50.356 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.355+0000 7f7905b2f700 1 --2- 172.21.15.196:0/3105527284 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f78ec0b2a20 0x7f78ec0b4ee0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f78f0003870 tx=0x7f78f0003940 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:50:50.358 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.358+0000 7f78f6ffd700 1 -- 172.21.15.196:0/3105527284 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f78f8010070 con 0x7f79001050a0 2024-05-10T10:50:50.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:49 smithi184 ceph-mon[34585]: Detected new or changed devices on smithi184 2024-05-10T10:50:50.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:49 smithi184 ceph-mon[34585]: Adjusting osd_memory_target on smithi184 to 4272M 2024-05-10T10:50:50.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:49 smithi184 ceph-mon[34585]: osd.10 [v2:172.21.15.184:6824/1387541139,v1:172.21.15.184:6825/1387541139] boot 2024-05-10T10:50:50.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:49 smithi184 ceph-mon[34585]: osdmap e66: 11 total, 11 up, 11 in 2024-05-10T10:50:50.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:49 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-10T10:50:50.567 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:50:50.566+0000 7f7907d93700 1 -- 172.21.15.196:0/3105527284 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f79000638e0 con 0x7f78ec0b2a20 2024-05-10T10:50:51.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:50 smithi107 ceph-mon[30373]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:51.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:50 smithi107 ceph-mon[30373]: osdmap e67: 11 total, 11 up, 11 in 2024-05-10T10:50:51.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:50 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:50:51.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:50 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:50:51.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:50 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:51.182 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:50 smithi196 ceph-mon[34872]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:51.182 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:50 smithi196 ceph-mon[34872]: osdmap e67: 11 total, 11 up, 11 in 2024-05-10T10:50:51.182 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:50 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:50:51.182 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:50 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:50:51.182 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:50 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:51.290 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:50 smithi184 ceph-mon[34585]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 288 MiB used, 894 GiB / 894 GiB avail 2024-05-10T10:50:51.291 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:50 smithi184 ceph-mon[34585]: osdmap e67: 11 total, 11 up, 11 in 2024-05-10T10:50:51.291 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:50 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-10T10:50:51.291 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:50 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-10T10:50:51.291 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:50 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:50:52.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:51 smithi107 ceph-mon[30373]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:50:52.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:51 smithi107 ceph-mon[30373]: osdmap e68: 11 total, 11 up, 11 in 2024-05-10T10:50:52.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:51 smithi196 ceph-mon[34872]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:50:52.192 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:51 smithi196 ceph-mon[34872]: osdmap e68: 11 total, 11 up, 11 in 2024-05-10T10:50:52.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:51 smithi184 ceph-mon[34585]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi196:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:50:52.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:51 smithi184 ceph-mon[34585]: osdmap e68: 11 total, 11 up, 11 in 2024-05-10T10:50:53.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:52 smithi107 ceph-mon[30373]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-05-10T10:50:53.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:52 smithi196 ceph-mon[34872]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-05-10T10:50:53.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:52 smithi184 ceph-mon[34585]: pgmap v230: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-05-10T10:50:54.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:53 smithi196 ceph-mon[34872]: from='client.? 172.21.15.196:0/3388268697' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4aeb2b1a-f35e-44ea-be64-f60c31a096e0"}]: dispatch 2024-05-10T10:50:54.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:53 smithi196 ceph-mon[34872]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4aeb2b1a-f35e-44ea-be64-f60c31a096e0"}]: dispatch 2024-05-10T10:50:54.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:53 smithi196 ceph-mon[34872]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4aeb2b1a-f35e-44ea-be64-f60c31a096e0"}]': finished 2024-05-10T10:50:54.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:53 smithi196 ceph-mon[34872]: osdmap e69: 12 total, 11 up, 12 in 2024-05-10T10:50:54.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:53 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T10:50:54.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:53 smithi184 ceph-mon[34585]: from='client.? 172.21.15.196:0/3388268697' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4aeb2b1a-f35e-44ea-be64-f60c31a096e0"}]: dispatch 2024-05-10T10:50:54.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:53 smithi184 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4aeb2b1a-f35e-44ea-be64-f60c31a096e0"}]: dispatch 2024-05-10T10:50:54.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:53 smithi184 ceph-mon[34585]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4aeb2b1a-f35e-44ea-be64-f60c31a096e0"}]': finished 2024-05-10T10:50:54.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:53 smithi184 ceph-mon[34585]: osdmap e69: 12 total, 11 up, 12 in 2024-05-10T10:50:54.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:53 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T10:50:54.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:53 smithi107 ceph-mon[30373]: from='client.? 172.21.15.196:0/3388268697' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4aeb2b1a-f35e-44ea-be64-f60c31a096e0"}]: dispatch 2024-05-10T10:50:54.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:53 smithi107 ceph-mon[30373]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4aeb2b1a-f35e-44ea-be64-f60c31a096e0"}]: dispatch 2024-05-10T10:50:54.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:53 smithi107 ceph-mon[30373]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4aeb2b1a-f35e-44ea-be64-f60c31a096e0"}]': finished 2024-05-10T10:50:54.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:53 smithi107 ceph-mon[30373]: osdmap e69: 12 total, 11 up, 12 in 2024-05-10T10:50:54.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:53 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T10:50:55.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:54 smithi196 ceph-mon[34872]: pgmap v232: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-05-10T10:50:55.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:54 smithi196 ceph-mon[34872]: from='client.? 172.21.15.196:0/4232893677' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:50:55.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:54 smithi184 ceph-mon[34585]: pgmap v232: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-05-10T10:50:55.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:54 smithi184 ceph-mon[34585]: from='client.? 172.21.15.196:0/4232893677' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:50:55.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:54 smithi107 ceph-mon[30373]: pgmap v232: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-05-10T10:50:55.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:54 smithi107 ceph-mon[30373]: from='client.? 172.21.15.196:0/4232893677' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-10T10:50:57.245 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:56 smithi196 ceph-mon[34872]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-10T10:50:57.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:56 smithi184 ceph-mon[34585]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-10T10:50:57.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:56 smithi107 ceph-mon[30373]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-10T10:50:59.227 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:50:58 smithi107 ceph-mon[30373]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-10T10:50:59.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:50:58 smithi196 ceph-mon[34872]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-10T10:50:59.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:50:58 smithi184 ceph-mon[34585]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-10T10:51:01.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:00 smithi196 ceph-mon[34872]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-10T10:51:01.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:00 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-10T10:51:01.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:00 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:01.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:00 smithi184 ceph-mon[34585]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-10T10:51:01.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:00 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-10T10:51:01.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:00 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:01.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:00 smithi107 ceph-mon[30373]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-10T10:51:01.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:00 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-10T10:51:01.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:00 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:02.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:01 smithi196 ceph-mon[34872]: Deploying daemon osd.11 on smithi196 2024-05-10T10:51:02.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:01 smithi184 ceph-mon[34585]: Deploying daemon osd.11 on smithi196 2024-05-10T10:51:02.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:01 smithi107 ceph-mon[30373]: Deploying daemon osd.11 on smithi196 2024-05-10T10:51:03.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:02 smithi196 ceph-mon[34872]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T10:51:03.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:02 smithi184 ceph-mon[34585]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T10:51:03.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:02 smithi107 ceph-mon[30373]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-10T10:51:05.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:04 smithi196 ceph-mon[34872]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-05-10T10:51:05.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:04 smithi184 ceph-mon[34585]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-05-10T10:51:05.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:04 smithi107 ceph-mon[30373]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-05-10T10:51:07.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:07 smithi196 ceph-mon[34872]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-05-10T10:51:07.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:07 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:07.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:07 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:07.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:07 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:51:07.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:07 smithi184 ceph-mon[34585]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-05-10T10:51:07.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:07 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:07.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:07 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:07.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:07 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:51:07.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:07 smithi107 ceph-mon[30373]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-05-10T10:51:07.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:07.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:07.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:51:09.303 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:09 smithi196 ceph-mon[34872]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-05-10T10:51:09.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:09 smithi184 ceph-mon[34585]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-05-10T10:51:09.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:09 smithi107 ceph-mon[30373]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-05-10T10:51:09.988 INFO:teuthology.orchestra.run.smithi196.stdout:Created osd(s) 11 on host 'smithi196' 2024-05-10T10:51:09.988 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:09.987+0000 7f78f6ffd700 1 -- 172.21.15.196:0/3105527284 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f79000638e0 con 0x7f78ec0b2a20 2024-05-10T10:51:09.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:09.990+0000 7f7907d93700 1 -- 172.21.15.196:0/3105527284 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f78ec0b2a20 msgr2=0x7f78ec0b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:09.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:09.990+0000 7f7907d93700 1 --2- 172.21.15.196:0/3105527284 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f78ec0b2a20 0x7f78ec0b4ee0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f78f0003870 tx=0x7f78f0003940 comp rx=0 tx=0).stop 2024-05-10T10:51:09.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:09.990+0000 7f7907d93700 1 -- 172.21.15.196:0/3105527284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79001050a0 msgr2=0x7f7900075dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:09.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:09.990+0000 7f7907d93700 1 --2- 172.21.15.196:0/3105527284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79001050a0 0x7f7900075dd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f78f8007ee0 tx=0x7f78f800d3b0 comp rx=0 tx=0).stop 2024-05-10T10:51:09.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:09.990+0000 7f7907d93700 1 -- 172.21.15.196:0/3105527284 shutdown_connections 2024-05-10T10:51:09.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:09.990+0000 7f7907d93700 1 --2- 172.21.15.196:0/3105527284 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f78ec0b2a20 0x7f78ec0b4ee0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:09.990 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:09.990+0000 7f7907d93700 1 --2- 172.21.15.196:0/3105527284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79001050a0 0x7f7900075dd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:09.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:09.990+0000 7f7907d93700 1 --2- 172.21.15.196:0/3105527284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7900103500 0x7f7900077240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:09.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:09.990+0000 7f7907d93700 1 --2- 172.21.15.196:0/3105527284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7900104700 0x7f7900075890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:09.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:09.990+0000 7f7907d93700 1 -- 172.21.15.196:0/3105527284 >> 172.21.15.196:0/3105527284 conn(0x7f79000feaa0 msgr2=0x7f7900107b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:09.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:09.990+0000 7f7907d93700 1 -- 172.21.15.196:0/3105527284 shutdown_connections 2024-05-10T10:51:09.991 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:09.990+0000 7f7907d93700 1 -- 172.21.15.196:0/3105527284 wait complete. 2024-05-10T10:51:10.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:10 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:10.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:10 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:10.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:10 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:10.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:10 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:51:10.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:10 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:10.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:10 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:10.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:10 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:10.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:10 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:51:10.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:10 smithi107 ceph-mon[30373]: from='osd.11 [v2:172.21.15.196:6824/3861964533,v1:172.21.15.196:6825/3861964533]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-10T10:51:10.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:10 smithi107 ceph-mon[30373]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-10T10:51:10.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:10 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:10.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:10 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:10.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:10 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:10.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:10 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:51:10.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:10 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:10.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:10 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:10.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:10 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:10.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:10 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:51:10.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:10 smithi196 ceph-mon[34872]: from='osd.11 [v2:172.21.15.196:6824/3861964533,v1:172.21.15.196:6825/3861964533]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-10T10:51:10.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:10 smithi196 ceph-mon[34872]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-10T10:51:10.611 DEBUG:teuthology.orchestra.run.smithi196:osd.11> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.11.service 2024-05-10T10:51:10.613 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-10T10:51:10.614 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd stat -f json 2024-05-10T10:51:10.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:10 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:10.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:10 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:10.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:10 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:10.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:10 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:51:10.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:10 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:10.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:10 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:10.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:10 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:10.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:10 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:51:10.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:10 smithi184 ceph-mon[34585]: from='osd.11 [v2:172.21.15.196:6824/3861964533,v1:172.21.15.196:6825/3861964533]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-10T10:51:10.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:10 smithi184 ceph-mon[34585]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-10T10:51:10.859 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:51:11.322 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:11 smithi107 ceph-mon[30373]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-05-10T10:51:11.322 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:11 smithi107 ceph-mon[30373]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-10T10:51:11.322 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:11 smithi107 ceph-mon[30373]: osdmap e70: 12 total, 11 up, 12 in 2024-05-10T10:51:11.322 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:11 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T10:51:11.322 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:11 smithi107 ceph-mon[30373]: from='osd.11 [v2:172.21.15.196:6824/3861964533,v1:172.21.15.196:6825/3861964533]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:51:11.322 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:11 smithi107 ceph-mon[30373]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:51:11.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:11 smithi196 ceph-mon[34872]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-05-10T10:51:11.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:11 smithi196 ceph-mon[34872]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-10T10:51:11.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:11 smithi196 ceph-mon[34872]: osdmap e70: 12 total, 11 up, 12 in 2024-05-10T10:51:11.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:11 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T10:51:11.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:11 smithi196 ceph-mon[34872]: from='osd.11 [v2:172.21.15.196:6824/3861964533,v1:172.21.15.196:6825/3861964533]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:51:11.565 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:11 smithi196 ceph-mon[34872]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:51:11.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:11 smithi184 ceph-mon[34585]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-05-10T10:51:11.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:11 smithi184 ceph-mon[34585]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-10T10:51:11.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:11 smithi184 ceph-mon[34585]: osdmap e70: 12 total, 11 up, 12 in 2024-05-10T10:51:11.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:11 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T10:51:11.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:11 smithi184 ceph-mon[34585]: from='osd.11 [v2:172.21.15.196:6824/3861964533,v1:172.21.15.196:6825/3861964533]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:51:11.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:11 smithi184 ceph-mon[34585]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]: dispatch 2024-05-10T10:51:12.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 10:51:11 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T10:51:11.986+0000 7fece8a2d700 -1 osd.11 0 waiting for initial osdmap 2024-05-10T10:51:12.314 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 10:51:12 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T10:51:12.000+0000 7fece4820700 -1 osd.11 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T10:51:12.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.656+0000 7fa3115e3700 1 -- 172.21.15.107:0/762472913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa30c1050a0 msgr2=0x7fa30c10b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:12.670 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.656+0000 7fa3115e3700 1 --2- 172.21.15.107:0/762472913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa30c1050a0 0x7fa30c10b950 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa30400b0d0 tx=0x7fa30400b3e0 comp rx=0 tx=0).stop 2024-05-10T10:51:12.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.656+0000 7fa3115e3700 1 -- 172.21.15.107:0/762472913 shutdown_connections 2024-05-10T10:51:12.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.656+0000 7fa3115e3700 1 --2- 172.21.15.107:0/762472913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa30c103500 0x7fa30c103920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:12.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.656+0000 7fa3115e3700 1 --2- 172.21.15.107:0/762472913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa30c1050a0 0x7fa30c10b950 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:12.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.656+0000 7fa3115e3700 1 --2- 172.21.15.107:0/762472913 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa30c104700 0x7fa30c104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:12.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.656+0000 7fa3115e3700 1 -- 172.21.15.107:0/762472913 >> 172.21.15.107:0/762472913 conn(0x7fa30c0feaa0 msgr2=0x7fa30c100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:12.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.656+0000 7fa3115e3700 1 -- 172.21.15.107:0/762472913 shutdown_connections 2024-05-10T10:51:12.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.656+0000 7fa3115e3700 1 -- 172.21.15.107:0/762472913 wait complete. 2024-05-10T10:51:12.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.657+0000 7fa3115e3700 1 Processor -- start 2024-05-10T10:51:12.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.657+0000 7fa3115e3700 1 -- start start 2024-05-10T10:51:12.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.657+0000 7fa3115e3700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa30c103500 0x7fa30c199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:12.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.657+0000 7fa3115e3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa30c104700 0x7fa30c199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:12.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.657+0000 7fa3115e3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa30c1050a0 0x7fa30c1a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:12.671 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.657+0000 7fa3115e3700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c10f0d0 con 0x7fa30c1050a0 2024-05-10T10:51:12.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.657+0000 7fa3115e3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c10ef50 con 0x7fa30c104700 2024-05-10T10:51:12.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.657+0000 7fa3115e3700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c10f250 con 0x7fa30c103500 2024-05-10T10:51:12.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.657+0000 7fa30b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa30c1050a0 0x7fa30c1a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:12.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.657+0000 7fa30b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa30c1050a0 0x7fa30c1a0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37102/0 (socket says 172.21.15.107:37102) 2024-05-10T10:51:12.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.657+0000 7fa30b7fe700 1 -- 172.21.15.107:0/3299173380 learned_addr learned my addr 172.21.15.107:0/3299173380 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:51:12.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.657+0000 7fa30affd700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa30c103500 0x7fa30c199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:12.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.657+0000 7fa303fff700 1 --2- 172.21.15.107:0/3299173380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa30c104700 0x7fa30c199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:12.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.657+0000 7fa30b7fe700 1 -- 172.21.15.107:0/3299173380 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa30c103500 msgr2=0x7fa30c199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:12.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.657+0000 7fa30b7fe700 1 --2- 172.21.15.107:0/3299173380 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa30c103500 0x7fa30c199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:12.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.657+0000 7fa30b7fe700 1 -- 172.21.15.107:0/3299173380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa30c104700 msgr2=0x7fa30c199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:12.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.657+0000 7fa30b7fe700 1 --2- 172.21.15.107:0/3299173380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa30c104700 0x7fa30c199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:12.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.657+0000 7fa30b7fe700 1 -- 172.21.15.107:0/3299173380 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa30c1a1280 con 0x7fa30c1050a0 2024-05-10T10:51:12.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.657+0000 7fa303fff700 1 --2- 172.21.15.107:0/3299173380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa30c104700 0x7fa30c199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:51:12.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.658+0000 7fa30b7fe700 1 --2- 172.21.15.107:0/3299173380 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa30c1050a0 0x7fa30c1a0be0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa304007d40 tx=0x7fa304007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.658+0000 7fa308ff9700 1 -- 172.21.15.107:0/3299173380 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa304021020 con 0x7fa30c1050a0 2024-05-10T10:51:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.658+0000 7fa308ff9700 1 -- 172.21.15.107:0/3299173380 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa30401d940 con 0x7fa30c1050a0 2024-05-10T10:51:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.658+0000 7fa308ff9700 1 -- 172.21.15.107:0/3299173380 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa304005560 con 0x7fa30c1050a0 2024-05-10T10:51:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.658+0000 7fa3115e3700 1 -- 172.21.15.107:0/3299173380 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa30c1a1510 con 0x7fa30c1050a0 2024-05-10T10:51:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.658+0000 7fa3115e3700 1 -- 172.21.15.107:0/3299173380 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa30c1a1910 con 0x7fa30c1050a0 2024-05-10T10:51:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.659+0000 7fa3115e3700 1 -- 172.21.15.107:0/3299173380 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa30c06a190 con 0x7fa30c1050a0 2024-05-10T10:51:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.660+0000 7fa308ff9700 1 -- 172.21.15.107:0/3299173380 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fa304024020 con 0x7fa30c1050a0 2024-05-10T10:51:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.661+0000 7fa308ff9700 1 --2- 172.21.15.107:0/3299173380 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa2f80b2880 0x7fa2f80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.661+0000 7fa30affd700 1 --2- 172.21.15.107:0/3299173380 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa2f80b2880 0x7fa2f80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.661+0000 7fa308ff9700 1 -- 172.21.15.107:0/3299173380 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6847+0+0 (secure 0 0 0) 0x7fa3040e3570 con 0x7fa30c1050a0 2024-05-10T10:51:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.661+0000 7fa30affd700 1 --2- 172.21.15.107:0/3299173380 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa2f80b2880 0x7fa2f80b4d40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa30c104560 tx=0x7fa2fc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.664+0000 7fa308ff9700 1 -- 172.21.15.107:0/3299173380 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa30402b020 con 0x7fa30c1050a0 2024-05-10T10:51:12.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.869+0000 7fa3115e3700 1 -- 172.21.15.107:0/3299173380 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fa30c02e5e0 con 0x7fa30c1050a0 2024-05-10T10:51:12.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.870+0000 7fa308ff9700 1 -- 172.21.15.107:0/3299173380 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7fa3040ab8e0 con 0x7fa30c1050a0 2024-05-10T10:51:12.871 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:51:12.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.872+0000 7fa3115e3700 1 -- 172.21.15.107:0/3299173380 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa2f80b2880 msgr2=0x7fa2f80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:12.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.872+0000 7fa3115e3700 1 --2- 172.21.15.107:0/3299173380 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa2f80b2880 0x7fa2f80b4d40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa30c104560 tx=0x7fa2fc00b410 comp rx=0 tx=0).stop 2024-05-10T10:51:12.873 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.872+0000 7fa3115e3700 1 -- 172.21.15.107:0/3299173380 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa30c1050a0 msgr2=0x7fa30c1a0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:12.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.872+0000 7fa3115e3700 1 --2- 172.21.15.107:0/3299173380 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa30c1050a0 0x7fa30c1a0be0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa304007d40 tx=0x7fa304007d70 comp rx=0 tx=0).stop 2024-05-10T10:51:12.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.872+0000 7fa3115e3700 1 -- 172.21.15.107:0/3299173380 shutdown_connections 2024-05-10T10:51:12.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.872+0000 7fa3115e3700 1 --2- 172.21.15.107:0/3299173380 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa2f80b2880 0x7fa2f80b4d40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:12.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.872+0000 7fa3115e3700 1 --2- 172.21.15.107:0/3299173380 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa30c103500 0x7fa30c199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:12.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.872+0000 7fa3115e3700 1 --2- 172.21.15.107:0/3299173380 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa30c1050a0 0x7fa30c1a0be0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:12.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.872+0000 7fa3115e3700 1 --2- 172.21.15.107:0/3299173380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa30c104700 0x7fa30c199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:12.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.872+0000 7fa3115e3700 1 -- 172.21.15.107:0/3299173380 >> 172.21.15.107:0/3299173380 conn(0x7fa30c0feaa0 msgr2=0x7fa30c107a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:12.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.873+0000 7fa3115e3700 1 -- 172.21.15.107:0/3299173380 shutdown_connections 2024-05-10T10:51:12.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:12.873+0000 7fa3115e3700 1 -- 172.21.15.107:0/3299173380 wait complete. 2024-05-10T10:51:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:12 smithi196 ceph-mon[34872]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-05-10T10:51:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:12 smithi196 ceph-mon[34872]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-05-10T10:51:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:12 smithi196 ceph-mon[34872]: osdmap e71: 12 total, 11 up, 12 in 2024-05-10T10:51:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:12 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T10:51:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:12 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T10:51:13.256 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:12 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3299173380' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-10T10:51:13.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:12 smithi107 ceph-mon[30373]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-05-10T10:51:13.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:12 smithi107 ceph-mon[30373]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-05-10T10:51:13.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:12 smithi107 ceph-mon[30373]: osdmap e71: 12 total, 11 up, 12 in 2024-05-10T10:51:13.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:12 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T10:51:13.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:12 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T10:51:13.330 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:12 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3299173380' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-10T10:51:13.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:12 smithi184 ceph-mon[34585]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-05-10T10:51:13.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:12 smithi184 ceph-mon[34585]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi196", "root=default"]}]': finished 2024-05-10T10:51:13.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:12 smithi184 ceph-mon[34585]: osdmap e71: 12 total, 11 up, 12 in 2024-05-10T10:51:13.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:12 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T10:51:13.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:12 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T10:51:13.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:12 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3299173380' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-10T10:51:13.503 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1715338248,"num_in_osds":12,"osd_in_since":1715338253,"num_remapped_pgs":0} 2024-05-10T10:51:14.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:13 smithi196 ceph-mon[34872]: purged_snaps scrub starts 2024-05-10T10:51:14.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:13 smithi196 ceph-mon[34872]: purged_snaps scrub ok 2024-05-10T10:51:14.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:13 smithi196 ceph-mon[34872]: osd.11 [v2:172.21.15.196:6824/3861964533,v1:172.21.15.196:6825/3861964533] boot 2024-05-10T10:51:14.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:13 smithi196 ceph-mon[34872]: osdmap e72: 12 total, 12 up, 12 in 2024-05-10T10:51:14.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:13 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T10:51:14.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:13 smithi196 ceph-mon[34872]: Detected new or changed devices on smithi196 2024-05-10T10:51:14.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:13 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:14.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:13 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:14.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:13 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:51:14.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:13 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:51:14.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:13 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:51:14.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:13 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:51:14.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:13 smithi196 ceph-mon[34872]: Adjusting osd_memory_target on smithi196 to 4272M 2024-05-10T10:51:14.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:13 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:14.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:13 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:14.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:13 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:51:14.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:13 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:14.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:13 smithi184 ceph-mon[34585]: purged_snaps scrub starts 2024-05-10T10:51:14.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:13 smithi184 ceph-mon[34585]: purged_snaps scrub ok 2024-05-10T10:51:14.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:13 smithi184 ceph-mon[34585]: osd.11 [v2:172.21.15.196:6824/3861964533,v1:172.21.15.196:6825/3861964533] boot 2024-05-10T10:51:14.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:13 smithi184 ceph-mon[34585]: osdmap e72: 12 total, 12 up, 12 in 2024-05-10T10:51:14.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:13 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T10:51:14.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:13 smithi184 ceph-mon[34585]: Detected new or changed devices on smithi196 2024-05-10T10:51:14.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:13 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:14.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:13 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:14.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:13 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:51:14.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:13 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:51:14.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:13 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:51:14.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:13 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:51:14.391 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:13 smithi184 ceph-mon[34585]: Adjusting osd_memory_target on smithi196 to 4272M 2024-05-10T10:51:14.391 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:13 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:14.391 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:13 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:14.391 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:13 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:51:14.391 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:13 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:14.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:13 smithi107 ceph-mon[30373]: purged_snaps scrub starts 2024-05-10T10:51:14.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:13 smithi107 ceph-mon[30373]: purged_snaps scrub ok 2024-05-10T10:51:14.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:13 smithi107 ceph-mon[30373]: osd.11 [v2:172.21.15.196:6824/3861964533,v1:172.21.15.196:6825/3861964533] boot 2024-05-10T10:51:14.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:13 smithi107 ceph-mon[30373]: osdmap e72: 12 total, 12 up, 12 in 2024-05-10T10:51:14.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:13 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-10T10:51:14.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:13 smithi107 ceph-mon[30373]: Detected new or changed devices on smithi196 2024-05-10T10:51:14.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:13 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:14.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:13 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:14.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:13 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:51:14.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:13 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:51:14.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:13 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:51:14.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:13 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-10T10:51:14.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:13 smithi107 ceph-mon[30373]: Adjusting osd_memory_target on smithi196 to 4272M 2024-05-10T10:51:14.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:13 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:14.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:13 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:14.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:13 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:51:14.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:13 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:14.504 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd stat -f json 2024-05-10T10:51:14.744 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:51:15.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:14 smithi107 ceph-mon[30373]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:15.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:14 smithi107 ceph-mon[30373]: osdmap e73: 12 total, 12 up, 12 in 2024-05-10T10:51:15.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:14 smithi196 ceph-mon[34872]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:15.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:14 smithi196 ceph-mon[34872]: osdmap e73: 12 total, 12 up, 12 in 2024-05-10T10:51:15.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:14 smithi184 ceph-mon[34585]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:15.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:14 smithi184 ceph-mon[34585]: osdmap e73: 12 total, 12 up, 12 in 2024-05-10T10:51:16.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.313+0000 7fa6f0847700 1 -- 172.21.15.107:0/788457472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6ec1035f0 msgr2=0x7fa6ec103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:16.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.313+0000 7fa6f0847700 1 --2- 172.21.15.107:0/788457472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6ec1035f0 0x7fa6ec103a50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40099c0 tx=0x7fa6d4009cd0 comp rx=0 tx=0).stop 2024-05-10T10:51:16.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.313+0000 7fa6f0847700 1 -- 172.21.15.107:0/788457472 shutdown_connections 2024-05-10T10:51:16.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.313+0000 7fa6f0847700 1 --2- 172.21.15.107:0/788457472 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa6ec1023f0 0x7fa6ec102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:16.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.313+0000 7fa6f0847700 1 --2- 172.21.15.107:0/788457472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6ec103f90 0x7fa6ec10a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:16.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.313+0000 7fa6f0847700 1 --2- 172.21.15.107:0/788457472 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6ec1035f0 0x7fa6ec103a50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:16.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.313+0000 7fa6f0847700 1 -- 172.21.15.107:0/788457472 >> 172.21.15.107:0/788457472 conn(0x7fa6ec0fd9d0 msgr2=0x7fa6ec0ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:16.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.313+0000 7fa6f0847700 1 -- 172.21.15.107:0/788457472 shutdown_connections 2024-05-10T10:51:16.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.313+0000 7fa6f0847700 1 -- 172.21.15.107:0/788457472 wait complete. 2024-05-10T10:51:16.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.314+0000 7fa6f0847700 1 Processor -- start 2024-05-10T10:51:16.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.314+0000 7fa6f0847700 1 -- start start 2024-05-10T10:51:16.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.314+0000 7fa6f0847700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa6ec1023f0 0x7fa6ec06c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:16.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.314+0000 7fa6f0847700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6ec1035f0 0x7fa6ec19e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:16.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.314+0000 7fa6f0847700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6ec103f90 0x7fa6ec1a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:16.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.314+0000 7fa6f0847700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ec10e020 con 0x7fa6ec1035f0 2024-05-10T10:51:16.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.314+0000 7fa6f0847700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ec10dea0 con 0x7fa6ec103f90 2024-05-10T10:51:16.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.314+0000 7fa6f0847700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ec10e1a0 con 0x7fa6ec1023f0 2024-05-10T10:51:16.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.314+0000 7fa6e1d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6ec1035f0 0x7fa6ec19e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:16.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.314+0000 7fa6e1d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6ec1035f0 0x7fa6ec19e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37128/0 (socket says 172.21.15.107:37128) 2024-05-10T10:51:16.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.314+0000 7fa6e1d9b700 1 -- 172.21.15.107:0/1790059818 learned_addr learned my addr 172.21.15.107:0/1790059818 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:51:16.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.315+0000 7fa6ea59c700 1 --2- 172.21.15.107:0/1790059818 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa6ec1023f0 0x7fa6ec06c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:16.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.315+0000 7fa6ead9d700 1 --2- 172.21.15.107:0/1790059818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6ec103f90 0x7fa6ec1a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:16.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.315+0000 7fa6e1d9b700 1 -- 172.21.15.107:0/1790059818 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa6ec1023f0 msgr2=0x7fa6ec06c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:16.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.315+0000 7fa6e1d9b700 1 --2- 172.21.15.107:0/1790059818 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa6ec1023f0 0x7fa6ec06c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:16.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.315+0000 7fa6e1d9b700 1 -- 172.21.15.107:0/1790059818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6ec103f90 msgr2=0x7fa6ec1a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:16.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.315+0000 7fa6e1d9b700 1 --2- 172.21.15.107:0/1790059818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6ec103f90 0x7fa6ec1a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:16.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.315+0000 7fa6e1d9b700 1 -- 172.21.15.107:0/1790059818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ec1a13c0 con 0x7fa6ec1035f0 2024-05-10T10:51:16.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.315+0000 7fa6ead9d700 1 --2- 172.21.15.107:0/1790059818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6ec103f90 0x7fa6ec1a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:51:16.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.315+0000 7fa6ea59c700 1 --2- 172.21.15.107:0/1790059818 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa6ec1023f0 0x7fa6ec06c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:51:16.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.315+0000 7fa6e1d9b700 1 --2- 172.21.15.107:0/1790059818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6ec1035f0 0x7fa6ec19e460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4005910 tx=0x7fa6d400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:16.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.315+0000 7fa6e3fff700 1 -- 172.21.15.107:0/1790059818 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d4027070 con 0x7fa6ec1035f0 2024-05-10T10:51:16.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.315+0000 7fa6f0847700 1 -- 172.21.15.107:0/1790059818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6ec1a1650 con 0x7fa6ec1035f0 2024-05-10T10:51:16.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.315+0000 7fa6e3fff700 1 -- 172.21.15.107:0/1790059818 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa6d4022940 con 0x7fa6ec1035f0 2024-05-10T10:51:16.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.315+0000 7fa6e3fff700 1 -- 172.21.15.107:0/1790059818 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d4017650 con 0x7fa6ec1035f0 2024-05-10T10:51:16.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.315+0000 7fa6f0847700 1 -- 172.21.15.107:0/1790059818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6ec1a1b00 con 0x7fa6ec1035f0 2024-05-10T10:51:16.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.316+0000 7fa6f0847700 1 -- 172.21.15.107:0/1790059818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6ec06a190 con 0x7fa6ec1035f0 2024-05-10T10:51:16.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.317+0000 7fa6e3fff700 1 -- 172.21.15.107:0/1790059818 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fa6d402a070 con 0x7fa6ec1035f0 2024-05-10T10:51:16.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.318+0000 7fa6e3fff700 1 --2- 172.21.15.107:0/1790059818 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa6d80b2880 0x7fa6d80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:16.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.318+0000 7fa6ea59c700 1 --2- 172.21.15.107:0/1790059818 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa6d80b2880 0x7fa6d80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:16.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.318+0000 7fa6e3fff700 1 -- 172.21.15.107:0/1790059818 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fa6d40e2b50 con 0x7fa6ec1035f0 2024-05-10T10:51:16.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.318+0000 7fa6ea59c700 1 --2- 172.21.15.107:0/1790059818 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa6d80b2880 0x7fa6d80b4d40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec103450 tx=0x7fa6dc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:16.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.321+0000 7fa6e3fff700 1 -- 172.21.15.107:0/1790059818 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa6d4013070 con 0x7fa6ec1035f0 2024-05-10T10:51:16.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.530+0000 7fa6f0847700 1 -- 172.21.15.107:0/1790059818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fa6ec02e510 con 0x7fa6ec1035f0 2024-05-10T10:51:16.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.530+0000 7fa6e3fff700 1 -- 172.21.15.107:0/1790059818 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7fa6d40aada0 con 0x7fa6ec1035f0 2024-05-10T10:51:16.531 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:51:16.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.532+0000 7fa6f0847700 1 -- 172.21.15.107:0/1790059818 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa6d80b2880 msgr2=0x7fa6d80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:16.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.532+0000 7fa6f0847700 1 --2- 172.21.15.107:0/1790059818 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa6d80b2880 0x7fa6d80b4d40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec103450 tx=0x7fa6dc009260 comp rx=0 tx=0).stop 2024-05-10T10:51:16.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.532+0000 7fa6f0847700 1 -- 172.21.15.107:0/1790059818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6ec1035f0 msgr2=0x7fa6ec19e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:16.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.532+0000 7fa6f0847700 1 --2- 172.21.15.107:0/1790059818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6ec1035f0 0x7fa6ec19e460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4005910 tx=0x7fa6d400fab0 comp rx=0 tx=0).stop 2024-05-10T10:51:16.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.532+0000 7fa6f0847700 1 -- 172.21.15.107:0/1790059818 shutdown_connections 2024-05-10T10:51:16.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.532+0000 7fa6f0847700 1 --2- 172.21.15.107:0/1790059818 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa6d80b2880 0x7fa6d80b4d40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:16.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.532+0000 7fa6f0847700 1 --2- 172.21.15.107:0/1790059818 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa6ec1023f0 0x7fa6ec06c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:16.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.532+0000 7fa6f0847700 1 --2- 172.21.15.107:0/1790059818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6ec103f90 0x7fa6ec1a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:16.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.532+0000 7fa6f0847700 1 --2- 172.21.15.107:0/1790059818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa6ec1035f0 0x7fa6ec19e460 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:16.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.533+0000 7fa6f0847700 1 -- 172.21.15.107:0/1790059818 >> 172.21.15.107:0/1790059818 conn(0x7fa6ec0fd9d0 msgr2=0x7fa6ec106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:16.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.533+0000 7fa6f0847700 1 -- 172.21.15.107:0/1790059818 shutdown_connections 2024-05-10T10:51:16.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:16.533+0000 7fa6f0847700 1 -- 172.21.15.107:0/1790059818 wait complete. 2024-05-10T10:51:17.126 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":73,"num_osds":12,"num_up_osds":12,"osd_up_since":1715338272,"num_in_osds":12,"osd_in_since":1715338253,"num_remapped_pgs":0} 2024-05-10T10:51:17.126 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-10T10:51:17.150 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:17 smithi107 ceph-mon[30373]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:17.150 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:17 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1790059818' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-10T10:51:17.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:17 smithi196 ceph-mon[34872]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:17.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:17 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1790059818' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-10T10:51:17.367 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:51:17.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:17 smithi184 ceph-mon[34585]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:17.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:17 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1790059818' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-10T10:51:19.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.036+0000 7f4e78c1c700 1 -- 172.21.15.107:0/2645698302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e74108880 msgr2=0x7f4e74110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:19.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.036+0000 7f4e78c1c700 1 --2- 172.21.15.107:0/2645698302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e74108880 0x7f4e74110400 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00b0d0 tx=0x7f4e6c00b3e0 comp rx=0 tx=0).stop 2024-05-10T10:51:19.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.036+0000 7f4e78c1c700 1 -- 172.21.15.107:0/2645698302 shutdown_connections 2024-05-10T10:51:19.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.036+0000 7f4e78c1c700 1 --2- 172.21.15.107:0/2645698302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e74108880 0x7f4e74110400 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:19.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.036+0000 7f4e78c1c700 1 --2- 172.21.15.107:0/2645698302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e741037b0 0x7f4e74103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:19.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.036+0000 7f4e78c1c700 1 --2- 172.21.15.107:0/2645698302 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e74104160 0x7f4e74108150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:19.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.036+0000 7f4e78c1c700 1 -- 172.21.15.107:0/2645698302 >> 172.21.15.107:0/2645698302 conn(0x7f4e7407a530 msgr2=0x7f4e7407a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:19.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.036+0000 7f4e78c1c700 1 -- 172.21.15.107:0/2645698302 shutdown_connections 2024-05-10T10:51:19.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.036+0000 7f4e78c1c700 1 -- 172.21.15.107:0/2645698302 wait complete. 2024-05-10T10:51:19.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.037+0000 7f4e78c1c700 1 Processor -- start 2024-05-10T10:51:19.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.037+0000 7f4e78c1c700 1 -- start start 2024-05-10T10:51:19.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.037+0000 7f4e78c1c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e741037b0 0x7f4e740757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:19.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.037+0000 7f4e78c1c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e74104160 0x7f4e74075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:19.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.037+0000 7f4e78c1c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e74108880 0x7f4e74076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:19.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.037+0000 7f4e78c1c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4e74113800 con 0x7f4e741037b0 2024-05-10T10:51:19.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.037+0000 7f4e78c1c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4e74113680 con 0x7f4e74108880 2024-05-10T10:51:19.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.037+0000 7f4e78c1c700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4e74113980 con 0x7f4e74104160 2024-05-10T10:51:19.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.037+0000 7f4e7259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e741037b0 0x7f4e740757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:19.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.037+0000 7f4e7259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e741037b0 0x7f4e740757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56096/0 (socket says 172.21.15.107:56096) 2024-05-10T10:51:19.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.037+0000 7f4e7259c700 1 -- 172.21.15.107:0/864043663 learned_addr learned my addr 172.21.15.107:0/864043663 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:51:19.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.037+0000 7f4e72d9d700 1 --2- 172.21.15.107:0/864043663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e74108880 0x7f4e74076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:19.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.037+0000 7f4e6bfff700 1 --2- 172.21.15.107:0/864043663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e74104160 0x7f4e74075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:19.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.038+0000 7f4e7259c700 1 -- 172.21.15.107:0/864043663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e74104160 msgr2=0x7f4e74075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:19.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.038+0000 7f4e7259c700 1 --2- 172.21.15.107:0/864043663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e74104160 0x7f4e74075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:19.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.038+0000 7f4e7259c700 1 -- 172.21.15.107:0/864043663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e74108880 msgr2=0x7f4e74076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:19.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.038+0000 7f4e7259c700 1 --2- 172.21.15.107:0/864043663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e74108880 0x7f4e74076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:19.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.038+0000 7f4e7259c700 1 -- 172.21.15.107:0/864043663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e741a80e0 con 0x7f4e741037b0 2024-05-10T10:51:19.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.038+0000 7f4e6bfff700 1 --2- 172.21.15.107:0/864043663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e74104160 0x7f4e74075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:51:19.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.038+0000 7f4e7259c700 1 --2- 172.21.15.107:0/864043663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e741037b0 0x7f4e740757a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400c920 tx=0x7f4e6400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:19.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.038+0000 7f4e6b7fe700 1 -- 172.21.15.107:0/864043663 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e64007b00 con 0x7f4e741037b0 2024-05-10T10:51:19.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.038+0000 7f4e6b7fe700 1 -- 172.21.15.107:0/864043663 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4e64004d00 con 0x7f4e741037b0 2024-05-10T10:51:19.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.038+0000 7f4e78c1c700 1 -- 172.21.15.107:0/864043663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e741a83d0 con 0x7f4e741037b0 2024-05-10T10:51:19.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.038+0000 7f4e6b7fe700 1 -- 172.21.15.107:0/864043663 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e64005650 con 0x7f4e741037b0 2024-05-10T10:51:19.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.038+0000 7f4e78c1c700 1 -- 172.21.15.107:0/864043663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e741a8910 con 0x7f4e741037b0 2024-05-10T10:51:19.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.039+0000 7f4e78c1c700 1 -- 172.21.15.107:0/864043663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e7406a190 con 0x7f4e741037b0 2024-05-10T10:51:19.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.040+0000 7f4e6b7fe700 1 -- 172.21.15.107:0/864043663 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f4e64007ca0 con 0x7f4e741037b0 2024-05-10T10:51:19.042 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.041+0000 7f4e6b7fe700 1 --2- 172.21.15.107:0/864043663 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4e600b2880 0x7f4e600b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:19.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.042+0000 7f4e6bfff700 1 --2- 172.21.15.107:0/864043663 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4e600b2880 0x7f4e600b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:19.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.042+0000 7f4e6b7fe700 1 -- 172.21.15.107:0/864043663 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f4e640e1900 con 0x7f4e741037b0 2024-05-10T10:51:19.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.042+0000 7f4e6bfff700 1 --2- 172.21.15.107:0/864043663 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4e600b2880 0x7f4e600b4d40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4e74101e70 tx=0x7f4e5c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:19.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.046+0000 7f4e6b7fe700 1 -- 172.21.15.107:0/864043663 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4e64014030 con 0x7f4e741037b0 2024-05-10T10:51:19.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:19 smithi107 ceph-mon[30373]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:19.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.255+0000 7f4e78c1c700 1 -- 172.21.15.107:0/864043663 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e7402e510 con 0x7f4e741037b0 2024-05-10T10:51:19.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.256+0000 7f4e6b7fe700 1 -- 172.21.15.107:0/864043663 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18514 (secure 0 0 0) 0x7f4e64004eb0 con 0x7f4e741037b0 2024-05-10T10:51:19.257 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:51:19.257 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":73,"fsid":"0ba8a8e4-0eba-11ef-bc98-c7b262605968","created":"2024-05-10T10:44:13.064379+0000","modified":"2024-05-10T10:51:13.989636+0000","last_up_change":"2024-05-10T10:51:12.979718+0000","last_in_change":"2024-05-10T10:50:53.297651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T10:47:31.600062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"503f960c-a74b-4979-9bf9-42c90a2885a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6803","nonce":4213004004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6805","nonce":4213004004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6809","nonce":4213004004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6807","nonce":4213004004}]},"public_addr":"172.21.15.107:6803/4213004004","cluster_addr":"172.21.15.107:6805/4213004004","heartbeat_back_addr":"172.21.15.107:6809/4213004004","heartbeat_front_addr":"172.21.15.107:6807/4213004004","state":["exists","up"]},{"osd":1,"uuid":"f0f89167-1aa1-40a1-b122-c7f203c587d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6801","nonce":3242825160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6803","nonce":3242825160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6807","nonce":3242825160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6805","nonce":3242825160}]},"public_addr":"172.21.15.184:6801/3242825160","cluster_addr":"172.21.15.184:6803/3242825160","heartbeat_back_addr":"172.21.15.184:6807/3242825160","heartbeat_front_addr":"172.21.15.184:6805/3242825160","state":["exists","up"]},{"osd":2,"uuid":"7588b9be-b935-450a-944f-3feca69c029c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6801","nonce":137473043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6803","nonce":137473043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6807","nonce":137473043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6805","nonce":137473043}]},"public_addr":"172.21.15.196:6801/137473043","cluster_addr":"172.21.15.196:6803/137473043","heartbeat_back_addr":"172.21.15.196:6807/137473043","heartbeat_front_addr":"172.21.15.196:6805/137473043","state":["exists","up"]},{"osd":3,"uuid":"589ec3bb-884a-4441-a9d2-1f34ab372cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6811","nonce":1995642021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6813","nonce":1995642021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6817","nonce":1995642021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6815","nonce":1995642021}]},"public_addr":"172.21.15.107:6811/1995642021","cluster_addr":"172.21.15.107:6813/1995642021","heartbeat_back_addr":"172.21.15.107:6817/1995642021","heartbeat_front_addr":"172.21.15.107:6815/1995642021","state":["exists","up"]},{"osd":4,"uuid":"b72cdb50-492b-4406-8f21-37e4b2cf5a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6809","nonce":271550329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6811","nonce":271550329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6815","nonce":271550329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6813","nonce":271550329}]},"public_addr":"172.21.15.184:6809/271550329","cluster_addr":"172.21.15.184:6811/271550329","heartbeat_back_addr":"172.21.15.184:6815/271550329","heartbeat_front_addr":"172.21.15.184:6813/271550329","state":["exists","up"]},{"osd":5,"uuid":"05b6ad82-9153-44df-ae64-50c82d304429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6809","nonce":3681130435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6811","nonce":3681130435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6815","nonce":3681130435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6813","nonce":3681130435}]},"public_addr":"172.21.15.196:6809/3681130435","cluster_addr":"172.21.15.196:6811/3681130435","heartbeat_back_addr":"172.21.15.196:6815/3681130435","heartbeat_front_addr":"172.21.15.196:6813/3681130435","state":["exists","up"]},{"osd":6,"uuid":"bceadd7a-20bf-4482-aaab-46a2539cf37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6819","nonce":4223253757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6821","nonce":4223253757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6825","nonce":4223253757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6823","nonce":4223253757}]},"public_addr":"172.21.15.107:6819/4223253757","cluster_addr":"172.21.15.107:6821/4223253757","heartbeat_back_addr":"172.21.15.107:6825/4223253757","heartbeat_front_addr":"172.21.15.107:6823/4223253757","state":["exists","up"]},{"osd":7,"uuid":"0d9243a6-0e16-4677-a0b0-010be4162148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6817","nonce":2850715284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6819","nonce":2850715284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6823","nonce":2850715284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6821","nonce":2850715284}]},"public_addr":"172.21.15.184:6817/2850715284","cluster_addr":"172.21.15.184:6819/2850715284","heartbeat_back_addr":"172.21.15.184:6823/2850715284","heartbeat_front_addr":"172.21.15.184:6821/2850715284","state":["exists","up"]},{"osd":8,"uuid":"24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6817","nonce":504426486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6819","nonce":504426486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6823","nonce":504426486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6821","nonce":504426486}]},"public_addr":"172.21.15.196:6817/504426486","cluster_addr":"172.21.15.196:6819/504426486","heartbeat_back_addr":"172.21.15.196:6823/504426486","heartbeat_front_addr":"172.21.15.196:6821/504426486","state":["exists","up"]},{"osd":9,"uuid":"8bcb03ec-1342-4679-9343-fcefd28dd69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6827","nonce":1533051760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6829","nonce":1533051760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6833","nonce":1533051760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6831","nonce":1533051760}]},"public_addr":"172.21.15.107:6827/1533051760","cluster_addr":"172.21.15.107:6829/1533051760","heartbeat_back_addr":"172.21.15.107:6833/1533051760","heartbeat_front_addr":"172.21.15.107:6831/1533051760","state":["exists","up"]},{"osd":10,"uuid":"78374015-aa7f-4288-b5ae-be64a5182bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6825","nonce":1387541139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6827","nonce":1387541139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6831","nonce":1387541139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6829","nonce":1387541139}]},"public_addr":"172.21.15.184:6825/1387541139","cluster_addr":"172.21.15.184:6827/1387541139","heartbeat_back_addr":"172.21.15.184:6831/1387541139","heartbeat_front_addr":"172.21.15.184:6829/1387541139","state":["exists","up"]},{"osd":11,"uuid":"4aeb2b1a-f35e-44ea-be64-f60c31a096e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6825","nonce":3861964533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6827","nonce":3861964533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6831","nonce":3861964533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6829","nonce":3861964533}]},"public_addr":"172.21.15.196:6825/3861964533","cluster_addr":"172.21.15.196:6827/3861964533","heartbeat_back_addr":"172.21.15.196:6831/3861964533","heartbeat_front_addr":"172.21.15.196:6829/3861964533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:46:42.110232+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:06.232727+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:29.623425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:53.466546+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:17.927564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:41.913454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:06.610629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:31.048807+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:54.922097+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:20.727547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:46.072303+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:51:11.022775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:0/3518338734":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/4092342993":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6800/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:6800/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3761740075":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/2215024983":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/2124974715":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3361930986":"2024-05-11T10:44:40.339608+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T10:51:19.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.258+0000 7f4e78c1c700 1 -- 172.21.15.107:0/864043663 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4e600b2880 msgr2=0x7f4e600b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:19.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.258+0000 7f4e78c1c700 1 --2- 172.21.15.107:0/864043663 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4e600b2880 0x7f4e600b4d40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4e74101e70 tx=0x7f4e5c008040 comp rx=0 tx=0).stop 2024-05-10T10:51:19.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.258+0000 7f4e78c1c700 1 -- 172.21.15.107:0/864043663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e741037b0 msgr2=0x7f4e740757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:19.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.258+0000 7f4e78c1c700 1 --2- 172.21.15.107:0/864043663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e741037b0 0x7f4e740757a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400c920 tx=0x7f4e6400cc30 comp rx=0 tx=0).stop 2024-05-10T10:51:19.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.258+0000 7f4e78c1c700 1 -- 172.21.15.107:0/864043663 shutdown_connections 2024-05-10T10:51:19.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.258+0000 7f4e78c1c700 1 --2- 172.21.15.107:0/864043663 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4e600b2880 0x7f4e600b4d40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:19.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.258+0000 7f4e78c1c700 1 --2- 172.21.15.107:0/864043663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e74108880 0x7f4e74076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:19.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.258+0000 7f4e78c1c700 1 --2- 172.21.15.107:0/864043663 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e741037b0 0x7f4e740757a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:19.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.258+0000 7f4e78c1c700 1 --2- 172.21.15.107:0/864043663 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e74104160 0x7f4e74075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:19.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.258+0000 7f4e78c1c700 1 -- 172.21.15.107:0/864043663 >> 172.21.15.107:0/864043663 conn(0x7f4e7407a530 msgr2=0x7f4e741026a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:19.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.258+0000 7f4e78c1c700 1 -- 172.21.15.107:0/864043663 shutdown_connections 2024-05-10T10:51:19.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:19.258+0000 7f4e78c1c700 1 -- 172.21.15.107:0/864043663 wait complete. 2024-05-10T10:51:19.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:19 smithi196 ceph-mon[34872]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:19.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:19 smithi184 ceph-mon[34585]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:20.018 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T10:47:31.600062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T10:51:20.019 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-10T10:51:20.298 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:51:20.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:20 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/864043663' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:51:20.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:20 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/864043663' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:51:20.421 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:20 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/864043663' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:51:21.290 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:21 smithi184 ceph-mon[34585]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:21.305 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:21 smithi107 ceph-mon[30373]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:21.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:21 smithi196 ceph-mon[34872]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:21.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.820+0000 7f3c37b44700 1 -- 172.21.15.107:0/2842940080 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c30102690 msgr2=0x7f3c30102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:21.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.820+0000 7f3c37b44700 1 --2- 172.21.15.107:0/2842940080 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c30102690 0x7f3c30102a70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00b0a0 tx=0x7f3c2c00b3b0 comp rx=0 tx=0).stop 2024-05-10T10:51:21.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.820+0000 7f3c37b44700 1 -- 172.21.15.107:0/2842940080 shutdown_connections 2024-05-10T10:51:21.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.820+0000 7f3c37b44700 1 --2- 172.21.15.107:0/2842940080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c301076e0 0x7f3c3010f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:21.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.820+0000 7f3c37b44700 1 --2- 172.21.15.107:0/2842940080 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c30102690 0x7f3c30102a70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:21.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.820+0000 7f3c37b44700 1 --2- 172.21.15.107:0/2842940080 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c30103040 0x7f3c30107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:21.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.820+0000 7f3c37b44700 1 -- 172.21.15.107:0/2842940080 >> 172.21.15.107:0/2842940080 conn(0x7f3c300783f0 msgr2=0x7f3c30078800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:21.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.820+0000 7f3c37b44700 1 -- 172.21.15.107:0/2842940080 shutdown_connections 2024-05-10T10:51:21.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.820+0000 7f3c37b44700 1 -- 172.21.15.107:0/2842940080 wait complete. 2024-05-10T10:51:21.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.821+0000 7f3c37b44700 1 Processor -- start 2024-05-10T10:51:21.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.821+0000 7f3c37b44700 1 -- start start 2024-05-10T10:51:21.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.821+0000 7f3c37b44700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c30102690 0x7f3c3010f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:21.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.821+0000 7f3c37b44700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c30103040 0x7f3c3010fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:21.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.821+0000 7f3c37b44700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c301076e0 0x7f3c30110340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:21.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.821+0000 7f3c37b44700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3c30113840 con 0x7f3c301076e0 2024-05-10T10:51:21.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.821+0000 7f3c37b44700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3c301136c0 con 0x7f3c30102690 2024-05-10T10:51:21.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.821+0000 7f3c37b44700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3c301139c0 con 0x7f3c30103040 2024-05-10T10:51:21.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.821+0000 7f3c360e1700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c301076e0 0x7f3c30110340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:21.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.821+0000 7f3c360e1700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c301076e0 0x7f3c30110340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56122/0 (socket says 172.21.15.107:56122) 2024-05-10T10:51:21.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.821+0000 7f3c360e1700 1 -- 172.21.15.107:0/3952092085 learned_addr learned my addr 172.21.15.107:0/3952092085 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:51:21.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.821+0000 7f3c350df700 1 --2- 172.21.15.107:0/3952092085 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c30103040 0x7f3c3010fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:21.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.821+0000 7f3c358e0700 1 --2- 172.21.15.107:0/3952092085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c30102690 0x7f3c3010f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:21.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.821+0000 7f3c360e1700 1 -- 172.21.15.107:0/3952092085 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c30103040 msgr2=0x7f3c3010fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:21.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.821+0000 7f3c360e1700 1 --2- 172.21.15.107:0/3952092085 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c30103040 0x7f3c3010fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:21.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.821+0000 7f3c360e1700 1 -- 172.21.15.107:0/3952092085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c30102690 msgr2=0x7f3c3010f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:21.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.821+0000 7f3c360e1700 1 --2- 172.21.15.107:0/3952092085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c30102690 0x7f3c3010f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:21.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.821+0000 7f3c360e1700 1 -- 172.21.15.107:0/3952092085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c301a8260 con 0x7f3c301076e0 2024-05-10T10:51:21.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.821+0000 7f3c360e1700 1 --2- 172.21.15.107:0/3952092085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c301076e0 0x7f3c30110340 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800b550 tx=0x7f3c2800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:21.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.822+0000 7f3c26ffd700 1 -- 172.21.15.107:0/3952092085 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c28015020 con 0x7f3c301076e0 2024-05-10T10:51:21.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.822+0000 7f3c37b44700 1 -- 172.21.15.107:0/3952092085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c301a8550 con 0x7f3c301076e0 2024-05-10T10:51:21.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.822+0000 7f3c26ffd700 1 -- 172.21.15.107:0/3952092085 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3c28011d00 con 0x7f3c301076e0 2024-05-10T10:51:21.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.822+0000 7f3c26ffd700 1 -- 172.21.15.107:0/3952092085 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c28010e40 con 0x7f3c301076e0 2024-05-10T10:51:21.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.822+0000 7f3c37b44700 1 -- 172.21.15.107:0/3952092085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c301a8a40 con 0x7f3c301076e0 2024-05-10T10:51:21.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.823+0000 7f3c37b44700 1 -- 172.21.15.107:0/3952092085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c3006a190 con 0x7f3c301076e0 2024-05-10T10:51:21.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.825+0000 7f3c26ffd700 1 -- 172.21.15.107:0/3952092085 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f3c28018020 con 0x7f3c301076e0 2024-05-10T10:51:21.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.825+0000 7f3c26ffd700 1 --2- 172.21.15.107:0/3952092085 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f3c1c0b2880 0x7f3c1c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:21.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.826+0000 7f3c358e0700 1 --2- 172.21.15.107:0/3952092085 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f3c1c0b2880 0x7f3c1c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:21.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.826+0000 7f3c26ffd700 1 -- 172.21.15.107:0/3952092085 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f3c280e1a10 con 0x7f3c301076e0 2024-05-10T10:51:21.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.826+0000 7f3c358e0700 1 --2- 172.21.15.107:0/3952092085 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f3c1c0b2880 0x7f3c1c0b4d40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0062a0 tx=0x7f3c2c0061f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:21.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:21.829+0000 7f3c26ffd700 1 -- 172.21.15.107:0/3952092085 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f3c2801f020 con 0x7f3c301076e0 2024-05-10T10:51:22.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:22.033+0000 7f3c37b44700 1 -- 172.21.15.107:0/3952092085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3c3002e510 con 0x7f3c301076e0 2024-05-10T10:51:22.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:22.034+0000 7f3c26ffd700 1 -- 172.21.15.107:0/3952092085 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f3c280a9bd0 con 0x7f3c301076e0 2024-05-10T10:51:22.035 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-05-10T10:51:22.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:22.036+0000 7f3c37b44700 1 -- 172.21.15.107:0/3952092085 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f3c1c0b2880 msgr2=0x7f3c1c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:22.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:22.036+0000 7f3c37b44700 1 --2- 172.21.15.107:0/3952092085 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f3c1c0b2880 0x7f3c1c0b4d40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0062a0 tx=0x7f3c2c0061f0 comp rx=0 tx=0).stop 2024-05-10T10:51:22.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:22.036+0000 7f3c37b44700 1 -- 172.21.15.107:0/3952092085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c301076e0 msgr2=0x7f3c30110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:22.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:22.036+0000 7f3c37b44700 1 --2- 172.21.15.107:0/3952092085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c301076e0 0x7f3c30110340 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800b550 tx=0x7f3c2800b860 comp rx=0 tx=0).stop 2024-05-10T10:51:22.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:22.036+0000 7f3c37b44700 1 -- 172.21.15.107:0/3952092085 shutdown_connections 2024-05-10T10:51:22.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:22.036+0000 7f3c37b44700 1 --2- 172.21.15.107:0/3952092085 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f3c1c0b2880 0x7f3c1c0b4d40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:22.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:22.036+0000 7f3c37b44700 1 --2- 172.21.15.107:0/3952092085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3c301076e0 0x7f3c30110340 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:22.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:22.036+0000 7f3c37b44700 1 --2- 172.21.15.107:0/3952092085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c30102690 0x7f3c3010f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:22.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:22.036+0000 7f3c37b44700 1 --2- 172.21.15.107:0/3952092085 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3c30103040 0x7f3c3010fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:22.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:22.036+0000 7f3c37b44700 1 -- 172.21.15.107:0/3952092085 >> 172.21.15.107:0/3952092085 conn(0x7f3c300783f0 msgr2=0x7f3c30106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:22.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:22.036+0000 7f3c37b44700 1 -- 172.21.15.107:0/3952092085 shutdown_connections 2024-05-10T10:51:22.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:22.036+0000 7f3c37b44700 1 -- 172.21.15.107:0/3952092085 wait complete. 2024-05-10T10:51:22.740 INFO:tasks.cephadm:Adding mds.a on smithi107 2024-05-10T10:51:22.740 INFO:tasks.cephadm:Adding mds.d on smithi107 2024-05-10T10:51:22.740 INFO:tasks.cephadm:Adding mds.g on smithi107 2024-05-10T10:51:22.740 INFO:tasks.cephadm:Adding mds.j on smithi107 2024-05-10T10:51:22.740 INFO:tasks.cephadm:Adding mds.b on smithi184 2024-05-10T10:51:22.741 INFO:tasks.cephadm:Adding mds.e on smithi184 2024-05-10T10:51:22.741 INFO:tasks.cephadm:Adding mds.h on smithi184 2024-05-10T10:51:22.741 INFO:tasks.cephadm:Adding mds.k on smithi184 2024-05-10T10:51:22.741 INFO:tasks.cephadm:Adding mds.c on smithi196 2024-05-10T10:51:22.741 INFO:tasks.cephadm:Adding mds.f on smithi196 2024-05-10T10:51:22.741 INFO:tasks.cephadm:Adding mds.i on smithi196 2024-05-10T10:51:22.741 INFO:tasks.cephadm:Adding mds.l on smithi196 2024-05-10T10:51:22.741 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph orch apply mds all '12;smithi107=a;smithi107=d;smithi107=g;smithi107=j;smithi184=b;smithi184=e;smithi184=h;smithi184=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l' 2024-05-10T10:51:22.990 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T10:51:23.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:23 smithi196 ceph-mon[34872]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:23.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:23 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3952092085' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T10:51:23.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:23 smithi184 ceph-mon[34585]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:23.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:23 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3952092085' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T10:51:23.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:23 smithi107 ceph-mon[30373]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:23.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:23 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3952092085' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T10:51:24.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.618+0000 7fdff187e700 1 -- 172.21.15.196:0/446069097 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfec104700 msgr2=0x7fdfec104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:24.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.618+0000 7fdff187e700 1 --2- 172.21.15.196:0/446069097 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfec104700 0x7fdfec104b60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc009990 tx=0x7fdfdc009ca0 comp rx=0 tx=0).stop 2024-05-10T10:51:24.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.618+0000 7fdff187e700 1 -- 172.21.15.196:0/446069097 shutdown_connections 2024-05-10T10:51:24.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.618+0000 7fdff187e700 1 --2- 172.21.15.196:0/446069097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfec1050a0 0x7fdfec10b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:24.621 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.618+0000 7fdff187e700 1 --2- 172.21.15.196:0/446069097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfec103500 0x7fdfec103920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:24.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.618+0000 7fdff187e700 1 --2- 172.21.15.196:0/446069097 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfec104700 0x7fdfec104b60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:24.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.618+0000 7fdff187e700 1 -- 172.21.15.196:0/446069097 >> 172.21.15.196:0/446069097 conn(0x7fdfec0feaa0 msgr2=0x7fdfec100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:24.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.618+0000 7fdff187e700 1 -- 172.21.15.196:0/446069097 shutdown_connections 2024-05-10T10:51:24.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.618+0000 7fdff187e700 1 -- 172.21.15.196:0/446069097 wait complete. 2024-05-10T10:51:24.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.619+0000 7fdff187e700 1 Processor -- start 2024-05-10T10:51:24.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.619+0000 7fdff187e700 1 -- start start 2024-05-10T10:51:24.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.619+0000 7fdff187e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfec103500 0x7fdfec077240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:24.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.619+0000 7fdff187e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfec104700 0x7fdfec075890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:24.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.619+0000 7fdff187e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfec1050a0 0x7fdfec075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:24.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.619+0000 7fdff187e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec10f150 con 0x7fdfec103500 2024-05-10T10:51:24.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.619+0000 7fdff187e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec10efd0 con 0x7fdfec1050a0 2024-05-10T10:51:24.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.619+0000 7fdff187e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdfec10f2d0 con 0x7fdfec104700 2024-05-10T10:51:24.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.619+0000 7fdfea7fc700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfec104700 0x7fdfec075890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:24.622 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.619+0000 7fdfea7fc700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfec104700 0x7fdfec075890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:33938/0 (socket says 172.21.15.196:33938) 2024-05-10T10:51:24.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.619+0000 7fdfea7fc700 1 -- 172.21.15.196:0/2585311141 learned_addr learned my addr 172.21.15.196:0/2585311141 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-05-10T10:51:24.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.619+0000 7fdfeaffd700 1 --2- 172.21.15.196:0/2585311141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfec103500 0x7fdfec077240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:24.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.620+0000 7fdfeb7fe700 1 --2- 172.21.15.196:0/2585311141 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfec1050a0 0x7fdfec075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:24.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.620+0000 7fdfea7fc700 1 -- 172.21.15.196:0/2585311141 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfec1050a0 msgr2=0x7fdfec075dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:24.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.620+0000 7fdfea7fc700 1 --2- 172.21.15.196:0/2585311141 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfec1050a0 0x7fdfec075dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:24.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.620+0000 7fdfea7fc700 1 -- 172.21.15.196:0/2585311141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfec103500 msgr2=0x7fdfec077240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:24.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.620+0000 7fdfea7fc700 1 --2- 172.21.15.196:0/2585311141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfec103500 0x7fdfec077240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:24.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.620+0000 7fdfea7fc700 1 -- 172.21.15.196:0/2585311141 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfec076680 con 0x7fdfec104700 2024-05-10T10:51:24.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.620+0000 7fdfea7fc700 1 --2- 172.21.15.196:0/2585311141 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfec104700 0x7fdfec075890 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0098e0 tx=0x7fdfdc0057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:24.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.620+0000 7fdff087c700 1 -- 172.21.15.196:0/2585311141 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc027070 con 0x7fdfec104700 2024-05-10T10:51:24.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.620+0000 7fdff087c700 1 -- 172.21.15.196:0/2585311141 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdfdc004120 con 0x7fdfec104700 2024-05-10T10:51:24.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.620+0000 7fdff187e700 1 -- 172.21.15.196:0/2585311141 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfec1a3860 con 0x7fdfec104700 2024-05-10T10:51:24.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.620+0000 7fdff087c700 1 -- 172.21.15.196:0/2585311141 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc00f460 con 0x7fdfec104700 2024-05-10T10:51:24.623 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.620+0000 7fdff187e700 1 -- 172.21.15.196:0/2585311141 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfec1a3d30 con 0x7fdfec104700 2024-05-10T10:51:24.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.621+0000 7fdff187e700 1 -- 172.21.15.196:0/2585311141 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfec06a190 con 0x7fdfec104700 2024-05-10T10:51:24.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.622+0000 7fdff087c700 1 -- 172.21.15.196:0/2585311141 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fdfdc02a070 con 0x7fdfec104700 2024-05-10T10:51:24.624 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.623+0000 7fdff087c700 1 --2- 172.21.15.196:0/2585311141 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fdfd40b2880 0x7fdfd40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:24.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.623+0000 7fdff087c700 1 -- 172.21.15.196:0/2585311141 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fdfdc0e31d0 con 0x7fdfec104700 2024-05-10T10:51:24.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.623+0000 7fdfeaffd700 1 --2- 172.21.15.196:0/2585311141 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fdfd40b2880 0x7fdfd40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:24.625 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.624+0000 7fdfeaffd700 1 --2- 172.21.15.196:0/2585311141 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fdfd40b2880 0x7fdfd40b4d40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdfec104560 tx=0x7fdfe0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:24.627 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.627+0000 7fdff087c700 1 -- 172.21.15.196:0/2585311141 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fdfdc013070 con 0x7fdfec104700 2024-05-10T10:51:24.837 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.836+0000 7fdff187e700 1 -- 172.21.15.196:0/2585311141 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi107=a;smithi107=d;smithi107=g;smithi107=j;smithi184=b;smithi184=e;smithi184=h;smithi184=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l", "target": ["mon-mgr", ""]}) -- 0x7fdfec063ba0 con 0x7fdfd40b2880 2024-05-10T10:51:24.845 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.845+0000 7fdff087c700 1 -- 172.21.15.196:0/2585311141 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fdfec063ba0 con 0x7fdfd40b2880 2024-05-10T10:51:24.845 INFO:teuthology.orchestra.run.smithi196.stdout:Scheduled mds.all update... 2024-05-10T10:51:24.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.847+0000 7fdff187e700 1 -- 172.21.15.196:0/2585311141 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fdfd40b2880 msgr2=0x7fdfd40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:24.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.847+0000 7fdff187e700 1 --2- 172.21.15.196:0/2585311141 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fdfd40b2880 0x7fdfd40b4d40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdfec104560 tx=0x7fdfe0009190 comp rx=0 tx=0).stop 2024-05-10T10:51:24.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.847+0000 7fdff187e700 1 -- 172.21.15.196:0/2585311141 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfec104700 msgr2=0x7fdfec075890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:24.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.847+0000 7fdff187e700 1 --2- 172.21.15.196:0/2585311141 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfec104700 0x7fdfec075890 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0098e0 tx=0x7fdfdc0057c0 comp rx=0 tx=0).stop 2024-05-10T10:51:24.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.847+0000 7fdff187e700 1 -- 172.21.15.196:0/2585311141 shutdown_connections 2024-05-10T10:51:24.848 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.847+0000 7fdff187e700 1 --2- 172.21.15.196:0/2585311141 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fdfd40b2880 0x7fdfd40b4d40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:24.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.847+0000 7fdff187e700 1 --2- 172.21.15.196:0/2585311141 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfec1050a0 0x7fdfec075dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:24.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.847+0000 7fdff187e700 1 --2- 172.21.15.196:0/2585311141 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdfec103500 0x7fdfec077240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:24.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.847+0000 7fdff187e700 1 --2- 172.21.15.196:0/2585311141 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdfec104700 0x7fdfec075890 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:24.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.847+0000 7fdff187e700 1 -- 172.21.15.196:0/2585311141 >> 172.21.15.196:0/2585311141 conn(0x7fdfec0feaa0 msgr2=0x7fdfec1079a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:24.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.847+0000 7fdff187e700 1 -- 172.21.15.196:0/2585311141 shutdown_connections 2024-05-10T10:51:24.849 INFO:teuthology.orchestra.run.smithi196.stderr:2024-05-10T10:51:24.847+0000 7fdff187e700 1 -- 172.21.15.196:0/2585311141 wait complete. 2024-05-10T10:51:25.151 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:25 smithi196 ceph-mon[34872]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:25.151 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:25 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:25.151 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:25 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:51:25.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:25 smithi184 ceph-mon[34585]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:25.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:25 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:25.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:25 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:51:25.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:25 smithi107 ceph-mon[30373]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:25.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:25 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:25.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:25 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:51:25.442 DEBUG:teuthology.orchestra.run.smithi107:mds.a> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.a.service 2024-05-10T10:51:25.445 DEBUG:teuthology.orchestra.run.smithi107:mds.d> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.d.service 2024-05-10T10:51:25.489 DEBUG:teuthology.orchestra.run.smithi107:mds.g> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.g.service 2024-05-10T10:51:25.531 DEBUG:teuthology.orchestra.run.smithi107:mds.j> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.j.service 2024-05-10T10:51:25.575 DEBUG:teuthology.orchestra.run.smithi184:mds.b> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.b.service 2024-05-10T10:51:25.578 DEBUG:teuthology.orchestra.run.smithi184:mds.e> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.e.service 2024-05-10T10:51:25.621 DEBUG:teuthology.orchestra.run.smithi184:mds.h> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.h.service 2024-05-10T10:51:25.664 DEBUG:teuthology.orchestra.run.smithi184:mds.k> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.k.service 2024-05-10T10:51:25.707 DEBUG:teuthology.orchestra.run.smithi196:mds.c> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.c.service 2024-05-10T10:51:25.709 DEBUG:teuthology.orchestra.run.smithi196:mds.f> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.f.service 2024-05-10T10:51:25.752 DEBUG:teuthology.orchestra.run.smithi196:mds.i> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.i.service 2024-05-10T10:51:25.795 DEBUG:teuthology.orchestra.run.smithi196:mds.l> sudo journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.l.service 2024-05-10T10:51:25.837 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-10T10:51:25.838 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:51:26.077 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:51:26.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:26 smithi107 ceph-mon[30373]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi107=a;smithi107=d;smithi107=g;smithi107=j;smithi184=b;smithi184=e;smithi184=h;smithi184=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:51:26.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:26 smithi107 ceph-mon[30373]: Saving service mds.all spec with placement smithi107=a;smithi107=d;smithi107=g;smithi107=j;smithi184=b;smithi184=e;smithi184=h;smithi184=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l;count:12 2024-05-10T10:51:26.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:26 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:26.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:26 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:51:26.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:26 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:26.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:26 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:26.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:26 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:26.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:26 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:26.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:26 smithi196 ceph-mon[34872]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi107=a;smithi107=d;smithi107=g;smithi107=j;smithi184=b;smithi184=e;smithi184=h;smithi184=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:51:26.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:26 smithi196 ceph-mon[34872]: Saving service mds.all spec with placement smithi107=a;smithi107=d;smithi107=g;smithi107=j;smithi184=b;smithi184=e;smithi184=h;smithi184=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l;count:12 2024-05-10T10:51:26.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:26 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:26.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:26 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:51:26.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:26 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:26.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:26 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:26.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:26 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:26.307 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:26 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:26.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:26 smithi184 ceph-mon[34585]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi107=a;smithi107=d;smithi107=g;smithi107=j;smithi184=b;smithi184=e;smithi184=h;smithi184=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:51:26.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:26 smithi184 ceph-mon[34585]: Saving service mds.all spec with placement smithi107=a;smithi107=d;smithi107=g;smithi107=j;smithi184=b;smithi184=e;smithi184=h;smithi184=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l;count:12 2024-05-10T10:51:26.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:26 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:26.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:26 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:51:26.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:26 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:26.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:26 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:26.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:26 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:26.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:26 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:27.289 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:27 smithi107 ceph-mon[30373]: Deploying daemon mds.l on smithi196 2024-05-10T10:51:27.289 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:27 smithi107 ceph-mon[30373]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:27.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:27 smithi196 ceph-mon[34872]: Deploying daemon mds.l on smithi196 2024-05-10T10:51:27.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:27 smithi196 ceph-mon[34872]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:27.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:27 smithi184 ceph-mon[34585]: Deploying daemon mds.l on smithi196 2024-05-10T10:51:27.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:27 smithi184 ceph-mon[34585]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:27.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.532+0000 7f1e1d3cc700 1 -- 172.21.15.107:0/3013113403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e18102d90 msgr2=0x7f1e1810f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:27.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.532+0000 7f1e1d3cc700 1 --2- 172.21.15.107:0/3013113403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e18102d90 0x7f1e1810f280 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1e1000b0a0 tx=0x7f1e1000b3b0 comp rx=0 tx=0).stop 2024-05-10T10:51:27.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.532+0000 7f1e1d3cc700 1 -- 172.21.15.107:0/3013113403 shutdown_connections 2024-05-10T10:51:27.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.532+0000 7f1e1d3cc700 1 --2- 172.21.15.107:0/3013113403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e18108440 0x7f1e18108820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:27.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.532+0000 7f1e1d3cc700 1 --2- 172.21.15.107:0/3013113403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e18102d90 0x7f1e1810f280 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:27.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.532+0000 7f1e1d3cc700 1 --2- 172.21.15.107:0/3013113403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e181023d0 0x7f1e18102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:27.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.532+0000 7f1e1d3cc700 1 -- 172.21.15.107:0/3013113403 >> 172.21.15.107:0/3013113403 conn(0x7f1e180793e0 msgr2=0x7f1e180797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:27.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.532+0000 7f1e1d3cc700 1 -- 172.21.15.107:0/3013113403 shutdown_connections 2024-05-10T10:51:27.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.532+0000 7f1e1d3cc700 1 -- 172.21.15.107:0/3013113403 wait complete. 2024-05-10T10:51:27.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.533+0000 7f1e1d3cc700 1 Processor -- start 2024-05-10T10:51:27.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.533+0000 7f1e1d3cc700 1 -- start start 2024-05-10T10:51:27.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.533+0000 7f1e1d3cc700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e181023d0 0x7f1e1819be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:27.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e1d3cc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e18102d90 0x7f1e1819c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:27.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e1d3cc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e18108440 0x7f1e181a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:27.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e1d3cc700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1e18112740 con 0x7f1e18108440 2024-05-10T10:51:27.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e1d3cc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1e181125c0 con 0x7f1e18102d90 2024-05-10T10:51:27.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e1d3cc700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1e181128c0 con 0x7f1e181023d0 2024-05-10T10:51:27.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e177fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e18108440 0x7f1e181a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:27.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e16ffd700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e181023d0 0x7f1e1819be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:27.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e177fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e18108440 0x7f1e181a0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59078/0 (socket says 172.21.15.107:59078) 2024-05-10T10:51:27.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e177fe700 1 -- 172.21.15.107:0/2470370849 learned_addr learned my addr 172.21.15.107:0/2470370849 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:51:27.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e16ffd700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e181023d0 0x7f1e1819be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.107:40826/0 (socket says 172.21.15.107:40826) 2024-05-10T10:51:27.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e167fc700 1 --2- 172.21.15.107:0/2470370849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e18102d90 0x7f1e1819c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:27.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e16ffd700 1 -- 172.21.15.107:0/2470370849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e18102d90 msgr2=0x7f1e1819c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:27.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e16ffd700 1 --2- 172.21.15.107:0/2470370849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e18102d90 0x7f1e1819c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:27.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e16ffd700 1 -- 172.21.15.107:0/2470370849 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e18108440 msgr2=0x7f1e181a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:27.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e16ffd700 1 --2- 172.21.15.107:0/2470370849 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e18108440 0x7f1e181a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:27.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e16ffd700 1 -- 172.21.15.107:0/2470370849 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e181a0e70 con 0x7f1e181023d0 2024-05-10T10:51:27.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e177fe700 1 --2- 172.21.15.107:0/2470370849 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e18108440 0x7f1e181a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:51:27.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e16ffd700 1 --2- 172.21.15.107:0/2470370849 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e181023d0 0x7f1e1819be60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800e9f0 tx=0x7f1e0800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:27.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1dfffff700 1 -- 172.21.15.107:0/2470370849 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0800cbd0 con 0x7f1e181023d0 2024-05-10T10:51:27.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e1d3cc700 1 -- 172.21.15.107:0/2470370849 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e181a1160 con 0x7f1e181023d0 2024-05-10T10:51:27.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1dfffff700 1 -- 172.21.15.107:0/2470370849 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1e080044f0 con 0x7f1e181023d0 2024-05-10T10:51:27.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1dfffff700 1 -- 172.21.15.107:0/2470370849 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e08005280 con 0x7f1e181023d0 2024-05-10T10:51:27.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.534+0000 7f1e1d3cc700 1 -- 172.21.15.107:0/2470370849 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e181a89e0 con 0x7f1e181023d0 2024-05-10T10:51:27.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.535+0000 7f1e1d3cc700 1 -- 172.21.15.107:0/2470370849 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e18103af0 con 0x7f1e181023d0 2024-05-10T10:51:27.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.537+0000 7f1dfffff700 1 -- 172.21.15.107:0/2470370849 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f1e08004750 con 0x7f1e181023d0 2024-05-10T10:51:27.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.537+0000 7f1dfffff700 1 --2- 172.21.15.107:0/2470370849 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1e000b2900 0x7f1e000b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:27.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.537+0000 7f1e167fc700 1 --2- 172.21.15.107:0/2470370849 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1e000b2900 0x7f1e000b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:27.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.537+0000 7f1dfffff700 1 -- 172.21.15.107:0/2470370849 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f1e080e1db0 con 0x7f1e181023d0 2024-05-10T10:51:27.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.538+0000 7f1e167fc700 1 --2- 172.21.15.107:0/2470370849 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1e000b2900 0x7f1e000b4dc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c006fd0 tx=0x7f1e0c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:27.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.541+0000 7f1dfffff700 1 -- 172.21.15.107:0/2470370849 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f1e080a9f60 con 0x7f1e181023d0 2024-05-10T10:51:27.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.790+0000 7f1e1d3cc700 1 -- 172.21.15.107:0/2470370849 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e1806a190 con 0x7f1e181023d0 2024-05-10T10:51:27.791 INFO:journalctl@ceph.mds.l.smithi196.stdout:May 10 10:51:27 smithi196 systemd[1]: Starting Ceph mds.l for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T10:51:27.791 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.790+0000 7f1dfffff700 1 -- 172.21.15.107:0/2470370849 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f1e080a9860 con 0x7f1e181023d0 2024-05-10T10:51:27.791 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:51:27.792 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-05-10T10:51:27.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.793+0000 7f1e1d3cc700 1 -- 172.21.15.107:0/2470370849 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1e000b2900 msgr2=0x7f1e000b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:27.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.793+0000 7f1e1d3cc700 1 --2- 172.21.15.107:0/2470370849 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1e000b2900 0x7f1e000b4dc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c006fd0 tx=0x7f1e0c008040 comp rx=0 tx=0).stop 2024-05-10T10:51:27.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.793+0000 7f1e1d3cc700 1 -- 172.21.15.107:0/2470370849 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e181023d0 msgr2=0x7f1e1819be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:27.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.793+0000 7f1e1d3cc700 1 --2- 172.21.15.107:0/2470370849 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e181023d0 0x7f1e1819be60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800e9f0 tx=0x7f1e0800ed00 comp rx=0 tx=0).stop 2024-05-10T10:51:27.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.793+0000 7f1e1d3cc700 1 -- 172.21.15.107:0/2470370849 shutdown_connections 2024-05-10T10:51:27.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.793+0000 7f1e1d3cc700 1 --2- 172.21.15.107:0/2470370849 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1e000b2900 0x7f1e000b4dc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:27.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.793+0000 7f1e1d3cc700 1 --2- 172.21.15.107:0/2470370849 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1e181023d0 0x7f1e1819be60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:27.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.793+0000 7f1e1d3cc700 1 --2- 172.21.15.107:0/2470370849 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1e18108440 0x7f1e181a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:27.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.793+0000 7f1e1d3cc700 1 --2- 172.21.15.107:0/2470370849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e18102d90 0x7f1e1819c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:27.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.793+0000 7f1e1d3cc700 1 -- 172.21.15.107:0/2470370849 >> 172.21.15.107:0/2470370849 conn(0x7f1e180793e0 msgr2=0x7f1e1806bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:27.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.793+0000 7f1e1d3cc700 1 -- 172.21.15.107:0/2470370849 shutdown_connections 2024-05-10T10:51:27.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:27.793+0000 7f1e1d3cc700 1 -- 172.21.15.107:0/2470370849 wait complete. 2024-05-10T10:51:27.795 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 1 2024-05-10T10:51:28.043 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:28 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/2470370849' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:28.044 INFO:journalctl@ceph.mds.l.smithi196.stdout:May 10 10:51:27 smithi196 podman[64536]: 2024-05-10 10:51:27.790357539 +0000 UTC m=+0.099513093 container create 586970b0899147fbfc34be8c10267feac9f3016526d1fff8994dc3a199f0bd84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-05-10T10:51:28.044 INFO:journalctl@ceph.mds.l.smithi196.stdout:May 10 10:51:27 smithi196 podman[64536]: 2024-05-10 10:51:27.708810426 +0000 UTC m=+0.017965949 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T10:51:28.044 INFO:journalctl@ceph.mds.l.smithi196.stdout:May 10 10:51:28 smithi196 podman[64536]: 2024-05-10 10:51:28.017563071 +0000 UTC m=+0.326718582 container init 586970b0899147fbfc34be8c10267feac9f3016526d1fff8994dc3a199f0bd84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-l, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-10T10:51:28.044 INFO:journalctl@ceph.mds.l.smithi196.stdout:May 10 10:51:28 smithi196 podman[64536]: 2024-05-10 10:51:28.020175513 +0000 UTC m=+0.329331034 container start 586970b0899147fbfc34be8c10267feac9f3016526d1fff8994dc3a199f0bd84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-l, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_BRANCH=HEAD) 2024-05-10T10:51:28.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:28 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2470370849' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:28.313 INFO:journalctl@ceph.mds.l.smithi196.stdout:May 10 10:51:28 smithi196 ceph-mds[64555]: -- 172.21.15.196:0/3712191160 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5622a58bfa40 con 0x5622a5892c00 2024-05-10T10:51:28.313 INFO:journalctl@ceph.mds.l.smithi196.stdout:May 10 10:51:28 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-l[64551]: starting mds.l at 2024-05-10T10:51:28.313 INFO:journalctl@ceph.mds.l.smithi196.stdout:May 10 10:51:28 smithi196 bash[64536]: 586970b0899147fbfc34be8c10267feac9f3016526d1fff8994dc3a199f0bd84 2024-05-10T10:51:28.313 INFO:journalctl@ceph.mds.l.smithi196.stdout:May 10 10:51:28 smithi196 systemd[1]: Started Ceph mds.l for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:51:28.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:28 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/2470370849' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:29.108 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:29 smithi184 ceph-mon[34585]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:29.108 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:29 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.196:6832/2603001203,v1:172.21.15.196:6833/2603001203] up:boot 2024-05-10T10:51:29.109 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:29 smithi184 ceph-mon[34585]: fsmap 1 up:standby 2024-05-10T10:51:29.109 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-10T10:51:29.109 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:29.109 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:29.109 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:29.109 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:29.109 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:29.109 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:29.109 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:29 smithi184 ceph-mon[34585]: Deploying daemon mds.k on smithi184 2024-05-10T10:51:29.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:29 smithi196 ceph-mon[34872]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:29.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:29 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.196:6832/2603001203,v1:172.21.15.196:6833/2603001203] up:boot 2024-05-10T10:51:29.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:29 smithi196 ceph-mon[34872]: fsmap 1 up:standby 2024-05-10T10:51:29.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-10T10:51:29.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:29.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:29.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:29.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:29.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:29.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:29.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:29 smithi196 ceph-mon[34872]: Deploying daemon mds.k on smithi184 2024-05-10T10:51:29.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:29 smithi107 ceph-mon[30373]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:29.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:29 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.196:6832/2603001203,v1:172.21.15.196:6833/2603001203] up:boot 2024-05-10T10:51:29.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:29 smithi107 ceph-mon[30373]: fsmap 1 up:standby 2024-05-10T10:51:29.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-10T10:51:29.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:29.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:29.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:29.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:29.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:29.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:29.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:29 smithi107 ceph-mon[30373]: Deploying daemon mds.k on smithi184 2024-05-10T10:51:30.389 INFO:journalctl@ceph.mds.k.smithi184.stdout:May 10 10:51:30 smithi184 systemd[1]: Starting Ceph mds.k for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T10:51:30.541 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:51:30.783 INFO:journalctl@ceph.mds.k.smithi184.stdout:May 10 10:51:30 smithi184 podman[63711]: 2024-05-10 10:51:30.398249978 +0000 UTC m=+0.018037912 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T10:51:30.784 INFO:journalctl@ceph.mds.k.smithi184.stdout:May 10 10:51:30 smithi184 podman[63711]: 2024-05-10 10:51:30.506064981 +0000 UTC m=+0.125852942 container create ff95ca875577f4b3c53f970317cf9e432b051a1322d460e8a90efa81d711af89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-k, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-10T10:51:30.784 INFO:journalctl@ceph.mds.k.smithi184.stdout:May 10 10:51:30 smithi184 podman[63711]: 2024-05-10 10:51:30.708324269 +0000 UTC m=+0.328112189 container init ff95ca875577f4b3c53f970317cf9e432b051a1322d460e8a90efa81d711af89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-10T10:51:30.784 INFO:journalctl@ceph.mds.k.smithi184.stdout:May 10 10:51:30 smithi184 podman[63711]: 2024-05-10 10:51:30.711045075 +0000 UTC m=+0.330833000 container start ff95ca875577f4b3c53f970317cf9e432b051a1322d460e8a90efa81d711af89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-k, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e) 2024-05-10T10:51:30.784 INFO:journalctl@ceph.mds.k.smithi184.stdout:May 10 10:51:30 smithi184 ceph-mds[63730]: -- 172.21.15.184:0/1244703063 <== mon.2 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5570b603fa40 con 0x5570b6012800 2024-05-10T10:51:30.784 INFO:journalctl@ceph.mds.k.smithi184.stdout:May 10 10:51:30 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-k[63726]: starting mds.k at 2024-05-10T10:51:30.784 INFO:journalctl@ceph.mds.k.smithi184.stdout:May 10 10:51:30 smithi184 bash[63711]: ff95ca875577f4b3c53f970317cf9e432b051a1322d460e8a90efa81d711af89 2024-05-10T10:51:30.786 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:51:31.058 INFO:journalctl@ceph.mds.k.smithi184.stdout:May 10 10:51:30 smithi184 systemd[1]: Started Ceph mds.k for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:51:31.162 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:31 smithi107 ceph-mon[30373]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:31.162 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:31.162 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:31.162 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:31.163 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:31.163 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:31.163 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:31.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:31 smithi196 ceph-mon[34872]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:31.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:31.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:31.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:31.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:31.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:31.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:31.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:31 smithi184 ceph-mon[34585]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:31.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:31.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:31.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:31.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:31.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:31.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:32.172 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:32 smithi107 ceph-mon[30373]: Deploying daemon mds.j on smithi107 2024-05-10T10:51:32.172 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:32 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.184:6832/3101071828,v1:172.21.15.184:6833/3101071828] up:boot 2024-05-10T10:51:32.172 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:32 smithi107 ceph-mon[30373]: fsmap 2 up:standby 2024-05-10T10:51:32.172 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:32 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-10T10:51:32.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:32 smithi184 ceph-mon[34585]: Deploying daemon mds.j on smithi107 2024-05-10T10:51:32.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:32 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.184:6832/3101071828,v1:172.21.15.184:6833/3101071828] up:boot 2024-05-10T10:51:32.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:32 smithi184 ceph-mon[34585]: fsmap 2 up:standby 2024-05-10T10:51:32.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:32 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-10T10:51:32.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:32 smithi196 ceph-mon[34872]: Deploying daemon mds.j on smithi107 2024-05-10T10:51:32.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:32 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.184:6832/3101071828,v1:172.21.15.184:6833/3101071828] up:boot 2024-05-10T10:51:32.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:32 smithi196 ceph-mon[34872]: fsmap 2 up:standby 2024-05-10T10:51:32.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:32 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-10T10:51:33.114 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:33 smithi184 ceph-mon[34585]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:33.262 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:33 smithi107 ceph-mon[30373]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:33.513 INFO:journalctl@ceph.mds.j.smithi107.stdout:May 10 10:51:33 smithi107 systemd[1]: Starting Ceph mds.j for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T10:51:33.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.511+0000 7fbd8965b700 1 -- 172.21.15.107:0/606253134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd841034f0 msgr2=0x7fbd84103970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:33.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.511+0000 7fbd8965b700 1 --2- 172.21.15.107:0/606253134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd841034f0 0x7fbd84103970 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbd780099c0 tx=0x7fbd78009cd0 comp rx=0 tx=0).stop 2024-05-10T10:51:33.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.512+0000 7fbd8965b700 1 -- 172.21.15.107:0/606253134 shutdown_connections 2024-05-10T10:51:33.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.512+0000 7fbd8965b700 1 --2- 172.21.15.107:0/606253134 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd84103eb0 0x7fbd84110370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:33.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.512+0000 7fbd8965b700 1 --2- 172.21.15.107:0/606253134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd841095a0 0x7fbd84109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:33.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.512+0000 7fbd8965b700 1 --2- 172.21.15.107:0/606253134 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd841034f0 0x7fbd84103970 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:33.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.512+0000 7fbd8965b700 1 -- 172.21.15.107:0/606253134 >> 172.21.15.107:0/606253134 conn(0x7fbd8407a650 msgr2=0x7fbd8407aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:33.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.512+0000 7fbd8965b700 1 -- 172.21.15.107:0/606253134 shutdown_connections 2024-05-10T10:51:33.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.512+0000 7fbd8965b700 1 -- 172.21.15.107:0/606253134 wait complete. 2024-05-10T10:51:33.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.512+0000 7fbd8965b700 1 Processor -- start 2024-05-10T10:51:33.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.512+0000 7fbd8965b700 1 -- start start 2024-05-10T10:51:33.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.513+0000 7fbd8965b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd841034f0 0x7fbd8419f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:33.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.513+0000 7fbd8965b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd84103eb0 0x7fbd8419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:33.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.513+0000 7fbd8965b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd841095a0 0x7fbd841999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:33.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.513+0000 7fbd8965b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbd841137d0 con 0x7fbd84103eb0 2024-05-10T10:51:33.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.513+0000 7fbd8965b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbd84113650 con 0x7fbd841034f0 2024-05-10T10:51:33.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.513+0000 7fbd8965b700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbd84113950 con 0x7fbd841095a0 2024-05-10T10:51:33.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.513+0000 7fbd827fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd84103eb0 0x7fbd8419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:33.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.513+0000 7fbd82ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd841034f0 0x7fbd8419f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:33.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.513+0000 7fbd82ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd841034f0 0x7fbd8419f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.107:57010/0 (socket says 172.21.15.107:57010) 2024-05-10T10:51:33.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.513+0000 7fbd827fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd84103eb0 0x7fbd8419fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59090/0 (socket says 172.21.15.107:59090) 2024-05-10T10:51:33.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.513+0000 7fbd82ffd700 1 -- 172.21.15.107:0/3967198494 learned_addr learned my addr 172.21.15.107:0/3967198494 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:51:33.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.513+0000 7fbd837fe700 1 --2- 172.21.15.107:0/3967198494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd841095a0 0x7fbd841999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:33.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.513+0000 7fbd82ffd700 1 -- 172.21.15.107:0/3967198494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd841095a0 msgr2=0x7fbd841999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:33.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.513+0000 7fbd82ffd700 1 --2- 172.21.15.107:0/3967198494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd841095a0 0x7fbd841999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:33.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.513+0000 7fbd82ffd700 1 -- 172.21.15.107:0/3967198494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd84103eb0 msgr2=0x7fbd8419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:33.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.513+0000 7fbd82ffd700 1 --2- 172.21.15.107:0/3967198494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd84103eb0 0x7fbd8419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:33.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.513+0000 7fbd82ffd700 1 -- 172.21.15.107:0/3967198494 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8419a110 con 0x7fbd841034f0 2024-05-10T10:51:33.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.513+0000 7fbd827fc700 1 --2- 172.21.15.107:0/3967198494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd84103eb0 0x7fbd8419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:51:33.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.513+0000 7fbd82ffd700 1 --2- 172.21.15.107:0/3967198494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd841034f0 0x7fbd8419f7f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400d950 tx=0x7fbd7400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:33.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.514+0000 7fbd6bfff700 1 -- 172.21.15.107:0/3967198494 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd74016070 con 0x7fbd841034f0 2024-05-10T10:51:33.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.514+0000 7fbd8965b700 1 -- 172.21.15.107:0/3967198494 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8419a400 con 0x7fbd841034f0 2024-05-10T10:51:33.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.514+0000 7fbd6bfff700 1 -- 172.21.15.107:0/3967198494 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbd74009e10 con 0x7fbd841034f0 2024-05-10T10:51:33.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.514+0000 7fbd6bfff700 1 -- 172.21.15.107:0/3967198494 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7400f620 con 0x7fbd841034f0 2024-05-10T10:51:33.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.514+0000 7fbd8965b700 1 -- 172.21.15.107:0/3967198494 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd841a66c0 con 0x7fbd841034f0 2024-05-10T10:51:33.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.515+0000 7fbd8965b700 1 -- 172.21.15.107:0/3967198494 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd8406a190 con 0x7fbd841034f0 2024-05-10T10:51:33.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.516+0000 7fbd6bfff700 1 -- 172.21.15.107:0/3967198494 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fbd74019070 con 0x7fbd841034f0 2024-05-10T10:51:33.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.517+0000 7fbd6bfff700 1 --2- 172.21.15.107:0/3967198494 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbd6c0b2880 0x7fbd6c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:33.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.517+0000 7fbd827fc700 1 --2- 172.21.15.107:0/3967198494 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbd6c0b2880 0x7fbd6c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:33.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.517+0000 7fbd6bfff700 1 -- 172.21.15.107:0/3967198494 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fbd740e1a00 con 0x7fbd841034f0 2024-05-10T10:51:33.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.518+0000 7fbd827fc700 1 --2- 172.21.15.107:0/3967198494 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbd6c0b2880 0x7fbd6c0b4d40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbd78009990 tx=0x7fbd78000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:33.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.520+0000 7fbd6bfff700 1 -- 172.21.15.107:0/3967198494 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fbd740a9b20 con 0x7fbd841034f0 2024-05-10T10:51:33.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:33 smithi196 ceph-mon[34872]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:33.766 INFO:journalctl@ceph.mds.j.smithi107.stdout:May 10 10:51:33 smithi107 podman[71066]: 2024-05-10 10:51:33.65785162 +0000 UTC m=+0.022624929 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T10:51:33.766 INFO:journalctl@ceph.mds.j.smithi107.stdout:May 10 10:51:33 smithi107 podman[71066]: 2024-05-10 10:51:33.765552743 +0000 UTC m=+0.130326027 container create 900920d0ceec1cbe9a5b02167488499f3ca7a0bcffcf6ba2429256aeb85ad3d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-j, GIT_BRANCH=HEAD, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS) 2024-05-10T10:51:33.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.801+0000 7fbd8965b700 1 -- 172.21.15.107:0/3967198494 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd8402e510 con 0x7fbd841034f0 2024-05-10T10:51:33.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.802+0000 7fbd6bfff700 1 -- 172.21.15.107:0/3967198494 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2224 (secure 0 0 0) 0x7fbd740a9420 con 0x7fbd841034f0 2024-05-10T10:51:33.803 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:51:33.803 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-10T10:51:33.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.805+0000 7fbd8965b700 1 -- 172.21.15.107:0/3967198494 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbd6c0b2880 msgr2=0x7fbd6c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:33.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.805+0000 7fbd8965b700 1 --2- 172.21.15.107:0/3967198494 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbd6c0b2880 0x7fbd6c0b4d40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbd78009990 tx=0x7fbd78000bc0 comp rx=0 tx=0).stop 2024-05-10T10:51:33.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.805+0000 7fbd8965b700 1 -- 172.21.15.107:0/3967198494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd841034f0 msgr2=0x7fbd8419f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:33.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.805+0000 7fbd8965b700 1 --2- 172.21.15.107:0/3967198494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd841034f0 0x7fbd8419f7f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400d950 tx=0x7fbd7400dc60 comp rx=0 tx=0).stop 2024-05-10T10:51:33.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.805+0000 7fbd8965b700 1 -- 172.21.15.107:0/3967198494 shutdown_connections 2024-05-10T10:51:33.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.805+0000 7fbd8965b700 1 --2- 172.21.15.107:0/3967198494 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbd6c0b2880 0x7fbd6c0b4d40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:33.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.805+0000 7fbd8965b700 1 --2- 172.21.15.107:0/3967198494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd841095a0 0x7fbd841999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:33.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.805+0000 7fbd8965b700 1 --2- 172.21.15.107:0/3967198494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd841034f0 0x7fbd8419f7f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:33.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.805+0000 7fbd8965b700 1 --2- 172.21.15.107:0/3967198494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd84103eb0 0x7fbd8419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:33.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.805+0000 7fbd8965b700 1 -- 172.21.15.107:0/3967198494 >> 172.21.15.107:0/3967198494 conn(0x7fbd8407a650 msgr2=0x7fbd84101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:33.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.805+0000 7fbd8965b700 1 -- 172.21.15.107:0/3967198494 shutdown_connections 2024-05-10T10:51:33.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:33.805+0000 7fbd8965b700 1 -- 172.21.15.107:0/3967198494 wait complete. 2024-05-10T10:51:33.807 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 3 2024-05-10T10:51:34.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:34 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3967198494' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:34.397 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:34 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3967198494' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:34.397 INFO:journalctl@ceph.mds.j.smithi107.stdout:May 10 10:51:34 smithi107 podman[71066]: 2024-05-10 10:51:34.144280432 +0000 UTC m=+0.509053718 container init 900920d0ceec1cbe9a5b02167488499f3ca7a0bcffcf6ba2429256aeb85ad3d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e) 2024-05-10T10:51:34.397 INFO:journalctl@ceph.mds.j.smithi107.stdout:May 10 10:51:34 smithi107 podman[71066]: 2024-05-10 10:51:34.148121039 +0000 UTC m=+0.512894323 container start 900920d0ceec1cbe9a5b02167488499f3ca7a0bcffcf6ba2429256aeb85ad3d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS) 2024-05-10T10:51:34.397 INFO:journalctl@ceph.mds.j.smithi107.stdout:May 10 10:51:34 smithi107 ceph-mds[71100]: -- 172.21.15.107:0/1800030148 <== mon.0 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559722a31a40 con 0x559722a04c00 2024-05-10T10:51:34.397 INFO:journalctl@ceph.mds.j.smithi107.stdout:May 10 10:51:34 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-j[71096]: starting mds.j at 2024-05-10T10:51:34.397 INFO:journalctl@ceph.mds.j.smithi107.stdout:May 10 10:51:34 smithi107 bash[71066]: 900920d0ceec1cbe9a5b02167488499f3ca7a0bcffcf6ba2429256aeb85ad3d4 2024-05-10T10:51:34.397 INFO:journalctl@ceph.mds.j.smithi107.stdout:May 10 10:51:34 smithi107 systemd[1]: Started Ceph mds.j for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:51:34.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:34 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3967198494' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:35 smithi107 ceph-mon[30373]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:35 smithi107 ceph-mon[30373]: Deploying daemon mds.d on smithi107 2024-05-10T10:51:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:35 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.107:6834/3020825331,v1:172.21.15.107:6835/3020825331] up:boot 2024-05-10T10:51:35.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:35 smithi107 ceph-mon[30373]: fsmap 3 up:standby 2024-05-10T10:51:35.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-10T10:51:35.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:35 smithi196 ceph-mon[34872]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:35.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:35.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:35.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:35 smithi196 ceph-mon[34872]: Deploying daemon mds.d on smithi107 2024-05-10T10:51:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:35 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.107:6834/3020825331,v1:172.21.15.107:6835/3020825331] up:boot 2024-05-10T10:51:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:35 smithi196 ceph-mon[34872]: fsmap 3 up:standby 2024-05-10T10:51:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-10T10:51:35.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:35 smithi184 ceph-mon[34585]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:35.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:35.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:35.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:35.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:35.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:35 smithi184 ceph-mon[34585]: Deploying daemon mds.d on smithi107 2024-05-10T10:51:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:35 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.107:6834/3020825331,v1:172.21.15.107:6835/3020825331] up:boot 2024-05-10T10:51:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:35 smithi184 ceph-mon[34585]: fsmap 3 up:standby 2024-05-10T10:51:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-10T10:51:36.675 INFO:journalctl@ceph.mds.d.smithi107.stdout:May 10 10:51:36 smithi107 podman[71388]: 2024-05-10 10:51:36.535366858 +0000 UTC m=+0.018093915 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T10:51:36.786 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:51:37.047 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:51:37.169 INFO:journalctl@ceph.mds.d.smithi107.stdout:May 10 10:51:36 smithi107 podman[71388]: 2024-05-10 10:51:36.843515728 +0000 UTC m=+0.326242775 container init 81890e334935a114d42ecbdce48a0a3541e3a3fb4df72f4f63ad90142a9759a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-10T10:51:37.169 INFO:journalctl@ceph.mds.d.smithi107.stdout:May 10 10:51:36 smithi107 podman[71388]: 2024-05-10 10:51:36.847043753 +0000 UTC m=+0.329770792 container start 81890e334935a114d42ecbdce48a0a3541e3a3fb4df72f4f63ad90142a9759a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e) 2024-05-10T10:51:37.170 INFO:journalctl@ceph.mds.d.smithi107.stdout:May 10 10:51:36 smithi107 ceph-mds[71425]: -- 172.21.15.107:0/3207135144 <== mon.0 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bf8f665a40 con 0x55bf8f638c00 2024-05-10T10:51:37.170 INFO:journalctl@ceph.mds.d.smithi107.stdout:May 10 10:51:36 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-d[71403]: starting mds.d at 2024-05-10T10:51:37.170 INFO:journalctl@ceph.mds.d.smithi107.stdout:May 10 10:51:36 smithi107 bash[71388]: 81890e334935a114d42ecbdce48a0a3541e3a3fb4df72f4f63ad90142a9759a6 2024-05-10T10:51:37.170 INFO:journalctl@ceph.mds.d.smithi107.stdout:May 10 10:51:36 smithi107 systemd[1]: Started Ceph mds.d for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:51:37.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:37 smithi107 ceph-mon[30373]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:37.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:37 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:37.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:37 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:37.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:37 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:37.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:37 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:37.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:37 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:37.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:37 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:37.621 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:37 smithi184 ceph-mon[34585]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:37.622 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:37 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:37.622 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:37 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:37.622 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:37 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:37.622 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:37 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:37.622 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:37 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:37.622 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:37 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:37.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:37 smithi196 ceph-mon[34872]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:37.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:37 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:37.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:37 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:37.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:37 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:37.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:37 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:37.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:37 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:37.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:37 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:38.531 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:38 smithi107 ceph-mon[30373]: Deploying daemon mds.e on smithi184 2024-05-10T10:51:38.531 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:38 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.107:6836/1680863375,v1:172.21.15.107:6837/1680863375] up:boot 2024-05-10T10:51:38.531 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:38 smithi107 ceph-mon[30373]: fsmap 4 up:standby 2024-05-10T10:51:38.531 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:38 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-10T10:51:38.532 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:38 smithi184 ceph-mon[34585]: Deploying daemon mds.e on smithi184 2024-05-10T10:51:38.532 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:38 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.107:6836/1680863375,v1:172.21.15.107:6837/1680863375] up:boot 2024-05-10T10:51:38.532 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:38 smithi184 ceph-mon[34585]: fsmap 4 up:standby 2024-05-10T10:51:38.532 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:38 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-10T10:51:38.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.733+0000 7fcbe2ed9700 1 -- 172.21.15.107:0/3570819015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbdc1030b0 msgr2=0x7fcbdc10f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:38.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.733+0000 7fcbe2ed9700 1 --2- 172.21.15.107:0/3570819015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbdc1030b0 0x7fcbdc10f230 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400b0a0 tx=0x7fcbd400b3b0 comp rx=0 tx=0).stop 2024-05-10T10:51:38.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.733+0000 7fcbe2ed9700 1 -- 172.21.15.107:0/3570819015 shutdown_connections 2024-05-10T10:51:38.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.733+0000 7fcbe2ed9700 1 --2- 172.21.15.107:0/3570819015 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbdc107420 0x7fcbdc107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:38.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.733+0000 7fcbe2ed9700 1 --2- 172.21.15.107:0/3570819015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbdc1030b0 0x7fcbdc10f230 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:38.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.733+0000 7fcbe2ed9700 1 --2- 172.21.15.107:0/3570819015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbdc1026f0 0x7fcbdc102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:38.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.733+0000 7fcbe2ed9700 1 -- 172.21.15.107:0/3570819015 >> 172.21.15.107:0/3570819015 conn(0x7fcbdc078210 msgr2=0x7fcbdc078620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:38.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.733+0000 7fcbe2ed9700 1 -- 172.21.15.107:0/3570819015 shutdown_connections 2024-05-10T10:51:38.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.733+0000 7fcbe2ed9700 1 -- 172.21.15.107:0/3570819015 wait complete. 2024-05-10T10:51:38.736 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.734+0000 7fcbe2ed9700 1 Processor -- start 2024-05-10T10:51:38.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.734+0000 7fcbe2ed9700 1 -- start start 2024-05-10T10:51:38.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.734+0000 7fcbe2ed9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbdc1026f0 0x7fcbdc19f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:38.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.734+0000 7fcbe2ed9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbdc1030b0 0x7fcbdc19fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:38.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.734+0000 7fcbe2ed9700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbdc107420 0x7fcbdc199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:38.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.734+0000 7fcbe2ed9700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc1126b0 con 0x7fcbdc1026f0 2024-05-10T10:51:38.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.734+0000 7fcbe2ed9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc112530 con 0x7fcbdc1030b0 2024-05-10T10:51:38.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.734+0000 7fcbe2ed9700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcbdc112830 con 0x7fcbdc107420 2024-05-10T10:51:38.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.734+0000 7fcbe0c75700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbdc1026f0 0x7fcbdc19f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:38.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.734+0000 7fcbe0c75700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbdc1026f0 0x7fcbdc19f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33534/0 (socket says 172.21.15.107:33534) 2024-05-10T10:51:38.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.734+0000 7fcbe0c75700 1 -- 172.21.15.107:0/514410460 learned_addr learned my addr 172.21.15.107:0/514410460 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:51:38.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.734+0000 7fcbdbfff700 1 --2- 172.21.15.107:0/514410460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbdc1030b0 0x7fcbdc19fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:38.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.734+0000 7fcbe0c75700 1 -- 172.21.15.107:0/514410460 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbdc107420 msgr2=0x7fcbdc199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:38.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.734+0000 7fcbe0c75700 1 --2- 172.21.15.107:0/514410460 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbdc107420 0x7fcbdc199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:38.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.734+0000 7fcbe0c75700 1 -- 172.21.15.107:0/514410460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbdc1030b0 msgr2=0x7fcbdc19fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:38.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.734+0000 7fcbe0c75700 1 --2- 172.21.15.107:0/514410460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbdc1030b0 0x7fcbdc19fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:38.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.734+0000 7fcbe0c75700 1 -- 172.21.15.107:0/514410460 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbdc19a230 con 0x7fcbdc1026f0 2024-05-10T10:51:38.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.734+0000 7fcbe0c75700 1 --2- 172.21.15.107:0/514410460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbdc1026f0 0x7fcbdc19f910 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000d980 tx=0x7fcbd000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:38.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.734+0000 7fcbd9ffb700 1 -- 172.21.15.107:0/514410460 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0017070 con 0x7fcbdc1026f0 2024-05-10T10:51:38.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.735+0000 7fcbe2ed9700 1 -- 172.21.15.107:0/514410460 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbdc19a520 con 0x7fcbdc1026f0 2024-05-10T10:51:38.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.735+0000 7fcbd9ffb700 1 -- 172.21.15.107:0/514410460 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcbd0009e00 con 0x7fcbdc1026f0 2024-05-10T10:51:38.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.735+0000 7fcbd9ffb700 1 -- 172.21.15.107:0/514410460 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd000f3c0 con 0x7fcbdc1026f0 2024-05-10T10:51:38.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.735+0000 7fcbe2ed9700 1 -- 172.21.15.107:0/514410460 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbdc1a67e0 con 0x7fcbdc1026f0 2024-05-10T10:51:38.738 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.736+0000 7fcbe2ed9700 1 -- 172.21.15.107:0/514410460 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbdc103b10 con 0x7fcbdc1026f0 2024-05-10T10:51:38.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.737+0000 7fcbd9ffb700 1 -- 172.21.15.107:0/514410460 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fcbd0010710 con 0x7fcbdc1026f0 2024-05-10T10:51:38.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.738+0000 7fcbd9ffb700 1 --2- 172.21.15.107:0/514410460 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcbcc0b2880 0x7fcbcc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:38.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.738+0000 7fcbdbfff700 1 --2- 172.21.15.107:0/514410460 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcbcc0b2880 0x7fcbcc0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:38.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.738+0000 7fcbd9ffb700 1 -- 172.21.15.107:0/514410460 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fcbd00e1830 con 0x7fcbdc1026f0 2024-05-10T10:51:38.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.738+0000 7fcbdbfff700 1 --2- 172.21.15.107:0/514410460 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcbcc0b2880 0x7fcbcc0b4d40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc078930 tx=0x7fcbc8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:38.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.743+0000 7fcbd9ffb700 1 -- 172.21.15.107:0/514410460 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fcbd00a99f0 con 0x7fcbdc1026f0 2024-05-10T10:51:38.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:38 smithi196 ceph-mon[34872]: Deploying daemon mds.e on smithi184 2024-05-10T10:51:38.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:38 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.107:6836/1680863375,v1:172.21.15.107:6837/1680863375] up:boot 2024-05-10T10:51:38.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:38 smithi196 ceph-mon[34872]: fsmap 4 up:standby 2024-05-10T10:51:38.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:38 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-10T10:51:38.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.988+0000 7fcbe2ed9700 1 -- 172.21.15.107:0/514410460 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcbdc02e510 con 0x7fcbdc1026f0 2024-05-10T10:51:38.989 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.988+0000 7fcbd9ffb700 1 -- 172.21.15.107:0/514410460 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3880 (secure 0 0 0) 0x7fcbd00a92f0 con 0x7fcbdc1026f0 2024-05-10T10:51:38.989 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:51:38.989 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-10T10:51:38.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.991+0000 7fcbe2ed9700 1 -- 172.21.15.107:0/514410460 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcbcc0b2880 msgr2=0x7fcbcc0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:38.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.991+0000 7fcbe2ed9700 1 --2- 172.21.15.107:0/514410460 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcbcc0b2880 0x7fcbcc0b4d40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc078930 tx=0x7fcbc8009260 comp rx=0 tx=0).stop 2024-05-10T10:51:38.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.991+0000 7fcbe2ed9700 1 -- 172.21.15.107:0/514410460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbdc1026f0 msgr2=0x7fcbdc19f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:38.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.991+0000 7fcbe2ed9700 1 --2- 172.21.15.107:0/514410460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbdc1026f0 0x7fcbdc19f910 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcbd000d980 tx=0x7fcbd000dc90 comp rx=0 tx=0).stop 2024-05-10T10:51:38.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.991+0000 7fcbe2ed9700 1 -- 172.21.15.107:0/514410460 shutdown_connections 2024-05-10T10:51:38.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.991+0000 7fcbe2ed9700 1 --2- 172.21.15.107:0/514410460 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcbcc0b2880 0x7fcbcc0b4d40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:38.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.991+0000 7fcbe2ed9700 1 --2- 172.21.15.107:0/514410460 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbdc107420 0x7fcbdc199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:38.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.991+0000 7fcbe2ed9700 1 --2- 172.21.15.107:0/514410460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcbdc1026f0 0x7fcbdc19f910 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:38.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.991+0000 7fcbe2ed9700 1 --2- 172.21.15.107:0/514410460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcbdc1030b0 0x7fcbdc19fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:38.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.991+0000 7fcbe2ed9700 1 -- 172.21.15.107:0/514410460 >> 172.21.15.107:0/514410460 conn(0x7fcbdc078210 msgr2=0x7fcbdc06bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:38.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.991+0000 7fcbe2ed9700 1 -- 172.21.15.107:0/514410460 shutdown_connections 2024-05-10T10:51:38.992 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:38.991+0000 7fcbe2ed9700 1 -- 172.21.15.107:0/514410460 wait complete. 2024-05-10T10:51:38.993 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 5 2024-05-10T10:51:39.139 INFO:journalctl@ceph.mds.e.smithi184.stdout:May 10 10:51:39 smithi184 systemd[1]: Starting Ceph mds.e for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T10:51:39.496 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:39 smithi184 ceph-mon[34585]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:39.496 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:39 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/514410460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:39.497 INFO:journalctl@ceph.mds.e.smithi184.stdout:May 10 10:51:39 smithi184 podman[64027]: 2024-05-10 10:51:39.131182757 +0000 UTC m=+0.018284353 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T10:51:39.497 INFO:journalctl@ceph.mds.e.smithi184.stdout:May 10 10:51:39 smithi184 podman[64027]: 2024-05-10 10:51:39.250975324 +0000 UTC m=+0.138076907 container create 80f2671169082307ad7654587e85c750bf75db6b839afc3d8e6405ba4e1b805c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-10T10:51:39.497 INFO:journalctl@ceph.mds.e.smithi184.stdout:May 10 10:51:39 smithi184 podman[64027]: 2024-05-10 10:51:39.470492342 +0000 UTC m=+0.357593923 container init 80f2671169082307ad7654587e85c750bf75db6b839afc3d8e6405ba4e1b805c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-e, io.buildah.version=1.33.5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507) 2024-05-10T10:51:39.497 INFO:journalctl@ceph.mds.e.smithi184.stdout:May 10 10:51:39 smithi184 podman[64027]: 2024-05-10 10:51:39.473068632 +0000 UTC m=+0.360170213 container start 80f2671169082307ad7654587e85c750bf75db6b839afc3d8e6405ba4e1b805c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.build-date=20240507) 2024-05-10T10:51:39.497 INFO:journalctl@ceph.mds.e.smithi184.stdout:May 10 10:51:39 smithi184 ceph-mds[64046]: -- 172.21.15.184:0/3579065761 <== mon.2 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dc369c9a40 con 0x55dc3699d000 2024-05-10T10:51:39.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:39 smithi107 ceph-mon[30373]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:39.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:39 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/514410460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:39.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:39 smithi196 ceph-mon[34872]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:39.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:39 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/514410460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:39.889 INFO:journalctl@ceph.mds.e.smithi184.stdout:May 10 10:51:39 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-e[64042]: starting mds.e at 2024-05-10T10:51:39.889 INFO:journalctl@ceph.mds.e.smithi184.stdout:May 10 10:51:39 smithi184 bash[64027]: 80f2671169082307ad7654587e85c750bf75db6b839afc3d8e6405ba4e1b805c 2024-05-10T10:51:39.889 INFO:journalctl@ceph.mds.e.smithi184.stdout:May 10 10:51:39 smithi184 systemd[1]: Started Ceph mds.e for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:51:40.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:40.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:40.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:40 smithi184 ceph-mon[34585]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:40.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:40.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:40.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:40.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:40.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:40 smithi184 ceph-mon[34585]: Deploying daemon mds.f on smithi196 2024-05-10T10:51:40.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:40 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] up:boot 2024-05-10T10:51:40.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:40 smithi184 ceph-mon[34585]: fsmap 5 up:standby 2024-05-10T10:51:40.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:40 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-10T10:51:40.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:40.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:40.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:40 smithi107 ceph-mon[30373]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:40.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:40.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:40.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:40.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:40.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:40 smithi107 ceph-mon[30373]: Deploying daemon mds.f on smithi196 2024-05-10T10:51:40.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:40 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] up:boot 2024-05-10T10:51:40.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:40 smithi107 ceph-mon[30373]: fsmap 5 up:standby 2024-05-10T10:51:40.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:40 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-10T10:51:41.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:41.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:41.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:40 smithi196 ceph-mon[34872]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:41.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:41.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:41.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:41.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:41.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:40 smithi196 ceph-mon[34872]: Deploying daemon mds.f on smithi196 2024-05-10T10:51:41.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:40 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] up:boot 2024-05-10T10:51:41.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:40 smithi196 ceph-mon[34872]: fsmap 5 up:standby 2024-05-10T10:51:41.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:40 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-10T10:51:41.813 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 10:51:41 smithi196 systemd[1]: Starting Ceph mds.f for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T10:51:41.825 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:51:42.081 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:51:42.145 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 10:51:41 smithi196 podman[64842]: 2024-05-10 10:51:41.841910796 +0000 UTC m=+0.111313044 container create 6dba30ac6ec5deae97409a5fd0f06344f3b66913e2c8ef5d2dff49689d9475d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-10T10:51:42.145 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 10:51:41 smithi196 podman[64842]: 2024-05-10 10:51:41.748434951 +0000 UTC m=+0.017837215 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T10:51:42.145 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 10:51:42 smithi196 podman[64842]: 2024-05-10 10:51:42.052865603 +0000 UTC m=+0.322267851 container init 6dba30ac6ec5deae97409a5fd0f06344f3b66913e2c8ef5d2dff49689d9475d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-f, ceph=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-10T10:51:42.145 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 10:51:42 smithi196 podman[64842]: 2024-05-10 10:51:42.055385444 +0000 UTC m=+0.324787695 container start 6dba30ac6ec5deae97409a5fd0f06344f3b66913e2c8ef5d2dff49689d9475d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-f, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-10T10:51:42.146 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 10:51:42 smithi196 ceph-mds[64861]: -- 172.21.15.196:0/2431202798 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5639d23a7a40 con 0x5639d237b000 2024-05-10T10:51:42.146 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 10:51:42 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-f[64857]: starting mds.f at 2024-05-10T10:51:42.146 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 10:51:42 smithi196 bash[64842]: 6dba30ac6ec5deae97409a5fd0f06344f3b66913e2c8ef5d2dff49689d9475d2 2024-05-10T10:51:42.563 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 10:51:42 smithi196 systemd[1]: Started Ceph mds.f for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:51:43.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:43 smithi107 ceph-mon[30373]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:43.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:43 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:43.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:43 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:43.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:43 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:43.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:43 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:43.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:43 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:43.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:43 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:43.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:43 smithi107 ceph-mon[30373]: Deploying daemon mds.c on smithi196 2024-05-10T10:51:43.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:43 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.196:6834/3609693196,v1:172.21.15.196:6835/3609693196] up:boot 2024-05-10T10:51:43.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:43 smithi107 ceph-mon[30373]: fsmap 6 up:standby 2024-05-10T10:51:43.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:43 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-10T10:51:43.546 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:43 smithi184 ceph-mon[34585]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:43.546 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:43 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:43.546 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:43 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:43.546 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:43 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:43.547 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:43 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:43.547 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:43 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:43.547 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:43 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:43.547 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:43 smithi184 ceph-mon[34585]: Deploying daemon mds.c on smithi196 2024-05-10T10:51:43.547 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:43 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.196:6834/3609693196,v1:172.21.15.196:6835/3609693196] up:boot 2024-05-10T10:51:43.547 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:43 smithi184 ceph-mon[34585]: fsmap 6 up:standby 2024-05-10T10:51:43.547 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:43 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-10T10:51:43.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:43 smithi196 ceph-mon[34872]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:43.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:43 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:43.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:43 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:43.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:43 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:43.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:43 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:43.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:43 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:43.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:43 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:43.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:43 smithi196 ceph-mon[34872]: Deploying daemon mds.c on smithi196 2024-05-10T10:51:43.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:43 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.196:6834/3609693196,v1:172.21.15.196:6835/3609693196] up:boot 2024-05-10T10:51:43.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:43 smithi196 ceph-mon[34872]: fsmap 6 up:standby 2024-05-10T10:51:43.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:43 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-10T10:51:44.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.042+0000 7fd59d6ae700 1 -- 172.21.15.107:0/3483194639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd598109540 msgr2=0x7fd598109920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:44.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.042+0000 7fd59d6ae700 1 --2- 172.21.15.107:0/3483194639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd598109540 0x7fd598109920 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd588009990 tx=0x7fd588009ca0 comp rx=0 tx=0).stop 2024-05-10T10:51:44.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.042+0000 7fd59d6ae700 1 -- 172.21.15.107:0/3483194639 shutdown_connections 2024-05-10T10:51:44.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.042+0000 7fd59d6ae700 1 --2- 172.21.15.107:0/3483194639 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd59806c530 0x7fd598110360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:44.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.042+0000 7fd59d6ae700 1 --2- 172.21.15.107:0/3483194639 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd598109540 0x7fd598109920 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:44.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.042+0000 7fd59d6ae700 1 --2- 172.21.15.107:0/3483194639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd59806bb70 0x7fd59806bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:44.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.042+0000 7fd59d6ae700 1 -- 172.21.15.107:0/3483194639 >> 172.21.15.107:0/3483194639 conn(0x7fd5980793e0 msgr2=0x7fd5980797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:44.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.042+0000 7fd59d6ae700 1 -- 172.21.15.107:0/3483194639 shutdown_connections 2024-05-10T10:51:44.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.042+0000 7fd59d6ae700 1 -- 172.21.15.107:0/3483194639 wait complete. 2024-05-10T10:51:44.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.042+0000 7fd59d6ae700 1 Processor -- start 2024-05-10T10:51:44.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.043+0000 7fd59d6ae700 1 -- start start 2024-05-10T10:51:44.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.043+0000 7fd59d6ae700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd59806bb70 0x7fd59819f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:44.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.043+0000 7fd59d6ae700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd59806c530 0x7fd59819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:44.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.043+0000 7fd59d6ae700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd598109540 0x7fd5981999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:44.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.043+0000 7fd59d6ae700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd598113790 con 0x7fd59806c530 2024-05-10T10:51:44.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.043+0000 7fd59d6ae700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd598113610 con 0x7fd59806bb70 2024-05-10T10:51:44.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.043+0000 7fd59d6ae700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd598113910 con 0x7fd598109540 2024-05-10T10:51:44.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.043+0000 7fd5967fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd59806c530 0x7fd59819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:44.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.043+0000 7fd5977fe700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd598109540 0x7fd5981999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:44.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.043+0000 7fd5967fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd59806c530 0x7fd59819fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33552/0 (socket says 172.21.15.107:33552) 2024-05-10T10:51:44.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.043+0000 7fd5967fc700 1 -- 172.21.15.107:0/387342056 learned_addr learned my addr 172.21.15.107:0/387342056 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:51:44.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.043+0000 7fd596ffd700 1 --2- 172.21.15.107:0/387342056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd59806bb70 0x7fd59819f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:44.046 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.043+0000 7fd5967fc700 1 -- 172.21.15.107:0/387342056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd598109540 msgr2=0x7fd5981999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:44.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.043+0000 7fd5967fc700 1 --2- 172.21.15.107:0/387342056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd598109540 0x7fd5981999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:44.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.043+0000 7fd5967fc700 1 -- 172.21.15.107:0/387342056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd59806bb70 msgr2=0x7fd59819f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:44.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.043+0000 7fd5967fc700 1 --2- 172.21.15.107:0/387342056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd59806bb70 0x7fd59819f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:44.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.043+0000 7fd5967fc700 1 -- 172.21.15.107:0/387342056 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59819a110 con 0x7fd59806c530 2024-05-10T10:51:44.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.044+0000 7fd5967fc700 1 --2- 172.21.15.107:0/387342056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd59806c530 0x7fd59819fd30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00c9b0 tx=0x7fd58c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:44.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.044+0000 7fd57ffff700 1 -- 172.21.15.107:0/387342056 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58c007b00 con 0x7fd59806c530 2024-05-10T10:51:44.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.044+0000 7fd57ffff700 1 -- 172.21.15.107:0/387342056 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd58c00ce50 con 0x7fd59806c530 2024-05-10T10:51:44.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.044+0000 7fd59d6ae700 1 -- 172.21.15.107:0/387342056 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59819a400 con 0x7fd59806c530 2024-05-10T10:51:44.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.044+0000 7fd57ffff700 1 -- 172.21.15.107:0/387342056 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58c018660 con 0x7fd59806c530 2024-05-10T10:51:44.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.044+0000 7fd59d6ae700 1 -- 172.21.15.107:0/387342056 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5981a66c0 con 0x7fd59806c530 2024-05-10T10:51:44.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.045+0000 7fd59d6ae700 1 -- 172.21.15.107:0/387342056 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd59810ba20 con 0x7fd59806c530 2024-05-10T10:51:44.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.046+0000 7fd57ffff700 1 -- 172.21.15.107:0/387342056 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fd58c00f450 con 0x7fd59806c530 2024-05-10T10:51:44.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.047+0000 7fd57ffff700 1 --2- 172.21.15.107:0/387342056 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd5800b2880 0x7fd5800b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:44.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.047+0000 7fd596ffd700 1 --2- 172.21.15.107:0/387342056 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd5800b2880 0x7fd5800b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:44.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.047+0000 7fd57ffff700 1 -- 172.21.15.107:0/387342056 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fd58c0e1f80 con 0x7fd59806c530 2024-05-10T10:51:44.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.047+0000 7fd596ffd700 1 --2- 172.21.15.107:0/387342056 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd5800b2880 0x7fd5800b4d40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd588006010 tx=0x7fd58800b560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:44.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.050+0000 7fd57ffff700 1 -- 172.21.15.107:0/387342056 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd58c014030 con 0x7fd59806c530 2024-05-10T10:51:44.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.308+0000 7fd59d6ae700 1 -- 172.21.15.107:0/387342056 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd59819af10 con 0x7fd59806c530 2024-05-10T10:51:44.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.308+0000 7fd57ffff700 1 -- 172.21.15.107:0/387342056 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5533 (secure 0 0 0) 0x7fd59819af10 con 0x7fd59806c530 2024-05-10T10:51:44.309 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:51:44.309 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-10T10:51:44.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.311+0000 7fd59d6ae700 1 -- 172.21.15.107:0/387342056 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd5800b2880 msgr2=0x7fd5800b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:44.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.311+0000 7fd59d6ae700 1 --2- 172.21.15.107:0/387342056 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd5800b2880 0x7fd5800b4d40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd588006010 tx=0x7fd58800b560 comp rx=0 tx=0).stop 2024-05-10T10:51:44.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.311+0000 7fd59d6ae700 1 -- 172.21.15.107:0/387342056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd59806c530 msgr2=0x7fd59819fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:44.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.311+0000 7fd59d6ae700 1 --2- 172.21.15.107:0/387342056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd59806c530 0x7fd59819fd30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00c9b0 tx=0x7fd58c00ccc0 comp rx=0 tx=0).stop 2024-05-10T10:51:44.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.311+0000 7fd59d6ae700 1 -- 172.21.15.107:0/387342056 shutdown_connections 2024-05-10T10:51:44.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.311+0000 7fd59d6ae700 1 --2- 172.21.15.107:0/387342056 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd5800b2880 0x7fd5800b4d40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:44.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.311+0000 7fd59d6ae700 1 --2- 172.21.15.107:0/387342056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd598109540 0x7fd5981999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:44.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.311+0000 7fd59d6ae700 1 --2- 172.21.15.107:0/387342056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd59806bb70 0x7fd59819f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:44.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.311+0000 7fd59d6ae700 1 --2- 172.21.15.107:0/387342056 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd59806c530 0x7fd59819fd30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:44.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.311+0000 7fd59d6ae700 1 -- 172.21.15.107:0/387342056 >> 172.21.15.107:0/387342056 conn(0x7fd5980793e0 msgr2=0x7fd598100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:44.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.311+0000 7fd59d6ae700 1 -- 172.21.15.107:0/387342056 shutdown_connections 2024-05-10T10:51:44.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:44.311+0000 7fd59d6ae700 1 -- 172.21.15.107:0/387342056 wait complete. 2024-05-10T10:51:44.313 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 7 2024-05-10T10:51:44.531 INFO:journalctl@ceph.mds.c.smithi196.stdout:May 10 10:51:44 smithi196 systemd[1]: Starting Ceph mds.c for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T10:51:44.790 INFO:journalctl@ceph.mds.c.smithi196.stdout:May 10 10:51:44 smithi196 podman[65150]: 2024-05-10 10:51:44.433702355 +0000 UTC m=+0.018507456 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T10:51:44.790 INFO:journalctl@ceph.mds.c.smithi196.stdout:May 10 10:51:44 smithi196 podman[65150]: 2024-05-10 10:51:44.579263571 +0000 UTC m=+0.164068648 container create e6c2d4962e753997c3af5ce6ce585ec37fa4d9801d48c5fad38b29ae7e1c3b22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS) 2024-05-10T10:51:44.790 INFO:journalctl@ceph.mds.c.smithi196.stdout:May 10 10:51:44 smithi196 podman[65150]: 2024-05-10 10:51:44.790392972 +0000 UTC m=+0.375198050 container init e6c2d4962e753997c3af5ce6ce585ec37fa4d9801d48c5fad38b29ae7e1c3b22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-05-10T10:51:45.063 INFO:journalctl@ceph.mds.c.smithi196.stdout:May 10 10:51:44 smithi196 podman[65150]: 2024-05-10 10:51:44.793000663 +0000 UTC m=+0.377805740 container start e6c2d4962e753997c3af5ce6ce585ec37fa4d9801d48c5fad38b29ae7e1c3b22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-c, org.label-schema.schema-version=1.0, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.build-date=20240507, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-05-10T10:51:45.063 INFO:journalctl@ceph.mds.c.smithi196.stdout:May 10 10:51:44 smithi196 ceph-mds[65169]: -- 172.21.15.196:0/2269443391 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b32057da40 con 0x55b320551000 2024-05-10T10:51:45.063 INFO:journalctl@ceph.mds.c.smithi196.stdout:May 10 10:51:44 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-c[65165]: starting mds.c at 2024-05-10T10:51:45.063 INFO:journalctl@ceph.mds.c.smithi196.stdout:May 10 10:51:44 smithi196 bash[65150]: e6c2d4962e753997c3af5ce6ce585ec37fa4d9801d48c5fad38b29ae7e1c3b22 2024-05-10T10:51:45.063 INFO:journalctl@ceph.mds.c.smithi196.stdout:May 10 10:51:44 smithi196 systemd[1]: Started Ceph mds.c for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:51:45.416 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:45 smithi107 ceph-mon[30373]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:45.416 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:45 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/387342056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:45.416 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:45.416 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:45.417 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:45.417 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:45.417 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:45.417 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:45 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:45.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:45 smithi196 ceph-mon[34872]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:45.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:45 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/387342056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:45.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:45.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:45.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:45.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:45.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:45.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:45 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:45.604 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:45 smithi184 ceph-mon[34585]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:45.605 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:45 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/387342056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:45.605 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:45.605 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:45.605 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:45.605 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:45.605 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:45.605 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:45 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:46.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:46 smithi196 ceph-mon[34872]: Deploying daemon mds.h on smithi184 2024-05-10T10:51:46.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:46 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] up:boot 2024-05-10T10:51:46.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:46 smithi196 ceph-mon[34872]: fsmap 7 up:standby 2024-05-10T10:51:46.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:46 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-10T10:51:46.608 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:46 smithi184 ceph-mon[34585]: Deploying daemon mds.h on smithi184 2024-05-10T10:51:46.608 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:46 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] up:boot 2024-05-10T10:51:46.608 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:46 smithi184 ceph-mon[34585]: fsmap 7 up:standby 2024-05-10T10:51:46.609 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:46 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-10T10:51:46.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:46 smithi107 ceph-mon[30373]: Deploying daemon mds.h on smithi184 2024-05-10T10:51:46.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:46 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] up:boot 2024-05-10T10:51:46.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:46 smithi107 ceph-mon[30373]: fsmap 7 up:standby 2024-05-10T10:51:46.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:46 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-10T10:51:47.063 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:51:47.209 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 10:51:47 smithi184 systemd[1]: Starting Ceph mds.h for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T10:51:47.320 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:51:47.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:47 smithi107 ceph-mon[30373]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:47.470 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:47 smithi184 ceph-mon[34585]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:47.470 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 10:51:47 smithi184 podman[64338]: 2024-05-10 10:51:47.238480851 +0000 UTC m=+0.018244350 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T10:51:47.470 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 10:51:47 smithi184 podman[64338]: 2024-05-10 10:51:47.338267733 +0000 UTC m=+0.118031208 container create 06982656a9f6667587d81827925974c86ee3fc038553227acd6fc1ae72ddafb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-h, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-10T10:51:47.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:47 smithi196 ceph-mon[34872]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:47.889 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 10:51:47 smithi184 podman[64338]: 2024-05-10 10:51:47.607604981 +0000 UTC m=+0.387368455 container init 06982656a9f6667587d81827925974c86ee3fc038553227acd6fc1ae72ddafb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-h, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-10T10:51:47.890 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 10:51:47 smithi184 podman[64338]: 2024-05-10 10:51:47.610111212 +0000 UTC m=+0.389874687 container start 06982656a9f6667587d81827925974c86ee3fc038553227acd6fc1ae72ddafb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-h, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, maintainer=Guillaume Abrioux , RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True) 2024-05-10T10:51:47.890 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 10:51:47 smithi184 ceph-mds[64358]: -- 172.21.15.184:0/2256474480 <== mon.2 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b131d23a40 con 0x55b131cf6800 2024-05-10T10:51:47.890 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 10:51:47 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-h[64354]: starting mds.h at 2024-05-10T10:51:47.890 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 10:51:47 smithi184 bash[64338]: 06982656a9f6667587d81827925974c86ee3fc038553227acd6fc1ae72ddafb7 2024-05-10T10:51:47.890 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 10:51:47 smithi184 systemd[1]: Started Ceph mds.h for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:51:48.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.953+0000 7f874b389700 1 -- 172.21.15.107:0/2898306482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8744109510 msgr2=0x7f87441098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:48.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.953+0000 7f874b389700 1 --2- 172.21.15.107:0/2898306482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8744109510 0x7f87441098f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8734009990 tx=0x7f8734009ca0 comp rx=0 tx=0).stop 2024-05-10T10:51:48.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.953+0000 7f874b389700 1 -- 172.21.15.107:0/2898306482 shutdown_connections 2024-05-10T10:51:48.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.953+0000 7f874b389700 1 --2- 172.21.15.107:0/2898306482 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f874406c5b0 0x7f8744110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:48.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.953+0000 7f874b389700 1 --2- 172.21.15.107:0/2898306482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8744109510 0x7f87441098f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:48.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.953+0000 7f874b389700 1 --2- 172.21.15.107:0/2898306482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f874406bbf0 0x7f874406c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:48.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.953+0000 7f874b389700 1 -- 172.21.15.107:0/2898306482 >> 172.21.15.107:0/2898306482 conn(0x7f8744079370 msgr2=0x7f8744079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:48.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.953+0000 7f874b389700 1 -- 172.21.15.107:0/2898306482 shutdown_connections 2024-05-10T10:51:48.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.953+0000 7f874b389700 1 -- 172.21.15.107:0/2898306482 wait complete. 2024-05-10T10:51:48.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.954+0000 7f874b389700 1 Processor -- start 2024-05-10T10:51:48.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.954+0000 7f874b389700 1 -- start start 2024-05-10T10:51:48.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.954+0000 7f874b389700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f874406bbf0 0x7f874419f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:48.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.954+0000 7f874b389700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f874406c5b0 0x7f874419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:48.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.954+0000 7f874b389700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8744109510 0x7f8744199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:48.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.954+0000 7f874b389700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8744113780 con 0x7f8744109510 2024-05-10T10:51:48.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.954+0000 7f874b389700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8744113600 con 0x7f874406bbf0 2024-05-10T10:51:48.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.954+0000 7f874b389700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8744113900 con 0x7f874406c5b0 2024-05-10T10:51:48.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.954+0000 7f8749926700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8744109510 0x7f8744199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:48.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.954+0000 7f8749926700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8744109510 0x7f8744199a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54824/0 (socket says 172.21.15.107:54824) 2024-05-10T10:51:48.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.954+0000 7f8749926700 1 -- 172.21.15.107:0/1282937661 learned_addr learned my addr 172.21.15.107:0/1282937661 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:51:48.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.955+0000 7f8748924700 1 --2- 172.21.15.107:0/1282937661 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f874406c5b0 0x7f874419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:48.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.955+0000 7f8749125700 1 --2- 172.21.15.107:0/1282937661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f874406bbf0 0x7f874419f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:48.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.955+0000 7f8749926700 1 -- 172.21.15.107:0/1282937661 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f874406c5b0 msgr2=0x7f874419fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:48.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.955+0000 7f8749926700 1 --2- 172.21.15.107:0/1282937661 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f874406c5b0 0x7f874419fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:48.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.955+0000 7f8749926700 1 -- 172.21.15.107:0/1282937661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f874406bbf0 msgr2=0x7f874419f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:48.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.955+0000 7f8749926700 1 --2- 172.21.15.107:0/1282937661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f874406bbf0 0x7f874419f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:48.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.955+0000 7f8749926700 1 -- 172.21.15.107:0/1282937661 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874419a1c0 con 0x7f8744109510 2024-05-10T10:51:48.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.955+0000 7f8749926700 1 --2- 172.21.15.107:0/1282937661 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8744109510 0x7f8744199a60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f873c00ef30 tx=0x7f873c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:48.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.955+0000 7f873a7fc700 1 -- 172.21.15.107:0/1282937661 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c0092e0 con 0x7f8744109510 2024-05-10T10:51:48.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.955+0000 7f873a7fc700 1 -- 172.21.15.107:0/1282937661 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f873c004bb0 con 0x7f8744109510 2024-05-10T10:51:48.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.955+0000 7f873a7fc700 1 -- 172.21.15.107:0/1282937661 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c004280 con 0x7f8744109510 2024-05-10T10:51:48.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.955+0000 7f874b389700 1 -- 172.21.15.107:0/1282937661 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f874419a450 con 0x7f8744109510 2024-05-10T10:51:48.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.955+0000 7f874b389700 1 -- 172.21.15.107:0/1282937661 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87441a6770 con 0x7f8744109510 2024-05-10T10:51:48.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.956+0000 7f874b389700 1 -- 172.21.15.107:0/1282937661 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f874410b9f0 con 0x7f8744109510 2024-05-10T10:51:48.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.957+0000 7f873a7fc700 1 -- 172.21.15.107:0/1282937661 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f873c01b030 con 0x7f8744109510 2024-05-10T10:51:48.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.958+0000 7f873a7fc700 1 --2- 172.21.15.107:0/1282937661 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87300b2880 0x7f87300b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:48.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.958+0000 7f8749125700 1 --2- 172.21.15.107:0/1282937661 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87300b2880 0x7f87300b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:48.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.958+0000 7f873a7fc700 1 -- 172.21.15.107:0/1282937661 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f873c0e2230 con 0x7f8744109510 2024-05-10T10:51:48.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.959+0000 7f8749125700 1 --2- 172.21.15.107:0/1282937661 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87300b2880 0x7f87300b4d40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f873400b2e0 tx=0x7f873401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:48.962 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:48.962+0000 7f873a7fc700 1 -- 172.21.15.107:0/1282937661 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f873c022020 con 0x7f8744109510 2024-05-10T10:51:49.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:48 smithi196 ceph-mon[34872]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:49.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:49.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:49.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:49.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:49.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:49.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:49.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:48 smithi196 ceph-mon[34872]: Deploying daemon mds.i on smithi196 2024-05-10T10:51:49.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:48 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] up:boot 2024-05-10T10:51:49.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:48 smithi196 ceph-mon[34872]: fsmap 8 up:standby 2024-05-10T10:51:49.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:48 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-10T10:51:49.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:48 smithi184 ceph-mon[34585]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:49.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:49.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:49.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:49.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:49.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:49.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:49.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:48 smithi184 ceph-mon[34585]: Deploying daemon mds.i on smithi196 2024-05-10T10:51:49.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:48 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] up:boot 2024-05-10T10:51:49.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:48 smithi184 ceph-mon[34585]: fsmap 8 up:standby 2024-05-10T10:51:49.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:48 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-10T10:51:49.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:48 smithi107 ceph-mon[30373]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:49.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:49.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:49.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:49.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:49.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:49.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:49.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:48 smithi107 ceph-mon[30373]: Deploying daemon mds.i on smithi196 2024-05-10T10:51:49.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:48 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] up:boot 2024-05-10T10:51:49.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:48 smithi107 ceph-mon[30373]: fsmap 8 up:standby 2024-05-10T10:51:49.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:48 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-10T10:51:49.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:49.216+0000 7f874b389700 1 -- 172.21.15.107:0/1282937661 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f874419af90 con 0x7f8744109510 2024-05-10T10:51:49.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:49.217+0000 7f873a7fc700 1 -- 172.21.15.107:0/1282937661 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7189 (secure 0 0 0) 0x7f873c010040 con 0x7f8744109510 2024-05-10T10:51:49.218 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:51:49.218 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-10T10:51:49.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:49.219+0000 7f874b389700 1 -- 172.21.15.107:0/1282937661 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87300b2880 msgr2=0x7f87300b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:49.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:49.219+0000 7f874b389700 1 --2- 172.21.15.107:0/1282937661 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87300b2880 0x7f87300b4d40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f873400b2e0 tx=0x7f873401a040 comp rx=0 tx=0).stop 2024-05-10T10:51:49.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:49.219+0000 7f874b389700 1 -- 172.21.15.107:0/1282937661 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8744109510 msgr2=0x7f8744199a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:49.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:49.219+0000 7f874b389700 1 --2- 172.21.15.107:0/1282937661 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8744109510 0x7f8744199a60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f873c00ef30 tx=0x7f873c00c3a0 comp rx=0 tx=0).stop 2024-05-10T10:51:49.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:49.219+0000 7f874b389700 1 -- 172.21.15.107:0/1282937661 shutdown_connections 2024-05-10T10:51:49.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:49.219+0000 7f874b389700 1 --2- 172.21.15.107:0/1282937661 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87300b2880 0x7f87300b4d40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:49.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:49.219+0000 7f874b389700 1 --2- 172.21.15.107:0/1282937661 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8744109510 0x7f8744199a60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:49.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:49.219+0000 7f874b389700 1 --2- 172.21.15.107:0/1282937661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f874406bbf0 0x7f874419f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:49.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:49.219+0000 7f874b389700 1 --2- 172.21.15.107:0/1282937661 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f874406c5b0 0x7f874419fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:49.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:49.219+0000 7f874b389700 1 -- 172.21.15.107:0/1282937661 >> 172.21.15.107:0/1282937661 conn(0x7f8744079370 msgr2=0x7f8744100fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:49.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:49.219+0000 7f874b389700 1 -- 172.21.15.107:0/1282937661 shutdown_connections 2024-05-10T10:51:49.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:49.219+0000 7f874b389700 1 -- 172.21.15.107:0/1282937661 wait complete. 2024-05-10T10:51:49.221 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 9 2024-05-10T10:51:49.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:49 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1282937661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:50.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:49 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1282937661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:50.063 INFO:journalctl@ceph.mds.i.smithi196.stdout:May 10 10:51:49 smithi196 systemd[1]: Starting Ceph mds.i for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T10:51:50.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:49 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1282937661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:50.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:May 10 10:51:50 smithi196 podman[65452]: 2024-05-10 10:51:50.112341134 +0000 UTC m=+0.102706955 container create 3e5cf6aa9a3066a68d1c10f8ac60632e50deb07a2d9a091545a986f7b70546af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-i, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e) 2024-05-10T10:51:50.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:May 10 10:51:50 smithi196 podman[65452]: 2024-05-10 10:51:50.027931247 +0000 UTC m=+0.018297076 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T10:51:50.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:May 10 10:51:50 smithi196 podman[65452]: 2024-05-10 10:51:50.322815699 +0000 UTC m=+0.313181521 container init 3e5cf6aa9a3066a68d1c10f8ac60632e50deb07a2d9a091545a986f7b70546af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-i, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-10T10:51:50.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:May 10 10:51:50 smithi196 podman[65452]: 2024-05-10 10:51:50.325767229 +0000 UTC m=+0.316133052 container start 3e5cf6aa9a3066a68d1c10f8ac60632e50deb07a2d9a091545a986f7b70546af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, CEPH_POINT_RELEASE=) 2024-05-10T10:51:50.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:May 10 10:51:50 smithi196 ceph-mds[65472]: -- 172.21.15.196:0/611259466 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5638c566fa40 con 0x5638c5642800 2024-05-10T10:51:50.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:May 10 10:51:50 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-i[65467]: starting mds.i at 2024-05-10T10:51:50.398 INFO:journalctl@ceph.mds.i.smithi196.stdout:May 10 10:51:50 smithi196 bash[65452]: 3e5cf6aa9a3066a68d1c10f8ac60632e50deb07a2d9a091545a986f7b70546af 2024-05-10T10:51:50.673 INFO:journalctl@ceph.mds.i.smithi196.stdout:May 10 10:51:50 smithi196 systemd[1]: Started Ceph mds.i for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:51:51.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:51 smithi196 ceph-mon[34872]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:51.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:51 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:51.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:51 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:51.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:51 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:51.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:51 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:51.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:51 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:51.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:51 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:51.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:51 smithi196 ceph-mon[34872]: Deploying daemon mds.g on smithi107 2024-05-10T10:51:51.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:51 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] up:boot 2024-05-10T10:51:51.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:51 smithi196 ceph-mon[34872]: fsmap 9 up:standby 2024-05-10T10:51:51.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:51 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-10T10:51:51.869 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:51:51.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:51 smithi184 ceph-mon[34585]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:51.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:51 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:51.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:51 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:51.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:51 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:51.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:51 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:51.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:51 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:51.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:51 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:51.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:51 smithi184 ceph-mon[34585]: Deploying daemon mds.g on smithi107 2024-05-10T10:51:51.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:51 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] up:boot 2024-05-10T10:51:51.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:51 smithi184 ceph-mon[34585]: fsmap 9 up:standby 2024-05-10T10:51:51.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:51 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-10T10:51:51.892 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:51 smithi107 ceph-mon[30373]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:51.892 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:51 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:51.892 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:51 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:51.893 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:51 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:51.893 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:51 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:51.893 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:51 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:51.893 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:51 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:51.893 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:51 smithi107 ceph-mon[30373]: Deploying daemon mds.g on smithi107 2024-05-10T10:51:51.893 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:51 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] up:boot 2024-05-10T10:51:51.893 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:51 smithi107 ceph-mon[30373]: fsmap 9 up:standby 2024-05-10T10:51:51.893 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:51 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-10T10:51:52.146 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:51:53.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:53 smithi107 ceph-mon[30373]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:53.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:53 smithi196 ceph-mon[34872]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:53.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:53 smithi184 ceph-mon[34585]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:53.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.951+0000 7fc34e62e700 1 -- 172.21.15.107:0/3922500884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3481023f0 msgr2=0x7fc348110360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:53.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.951+0000 7fc34e62e700 1 --2- 172.21.15.107:0/3922500884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3481023f0 0x7fc348110360 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc340009f90 tx=0x7fc34000b330 comp rx=0 tx=0).stop 2024-05-10T10:51:53.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.951+0000 7fc34e62e700 1 -- 172.21.15.107:0/3922500884 shutdown_connections 2024-05-10T10:51:53.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.951+0000 7fc34e62e700 1 --2- 172.21.15.107:0/3922500884 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3481023f0 0x7fc348110360 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:53.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.951+0000 7fc34e62e700 1 --2- 172.21.15.107:0/3922500884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc348109540 0x7fc348109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:53.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.952+0000 7fc34e62e700 1 --2- 172.21.15.107:0/3922500884 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc348101a30 0x7fc348101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:53.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.952+0000 7fc34e62e700 1 -- 172.21.15.107:0/3922500884 >> 172.21.15.107:0/3922500884 conn(0x7fc3480789a0 msgr2=0x7fc3480ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:53.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.952+0000 7fc34e62e700 1 -- 172.21.15.107:0/3922500884 shutdown_connections 2024-05-10T10:51:53.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.952+0000 7fc34e62e700 1 -- 172.21.15.107:0/3922500884 wait complete. 2024-05-10T10:51:53.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.952+0000 7fc34e62e700 1 Processor -- start 2024-05-10T10:51:53.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.952+0000 7fc34e62e700 1 -- start start 2024-05-10T10:51:53.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc34e62e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc348101a30 0x7fc348102c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:53.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc34e62e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3481023f0 0x7fc348103150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:53.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc34e62e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc348109540 0x7fc348103690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:53.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc34e62e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc3481137b0 con 0x7fc348101a30 2024-05-10T10:51:53.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc34e62e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc348113630 con 0x7fc3481023f0 2024-05-10T10:51:53.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc34e62e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc348113930 con 0x7fc348109540 2024-05-10T10:51:53.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc347fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc348101a30 0x7fc348102c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:53.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc347fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc348101a30 0x7fc348102c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54840/0 (socket says 172.21.15.107:54840) 2024-05-10T10:51:53.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc347fff700 1 -- 172.21.15.107:0/2143847300 learned_addr learned my addr 172.21.15.107:0/2143847300 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:51:53.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc3477fe700 1 --2- 172.21.15.107:0/2143847300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3481023f0 0x7fc348103150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:53.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc34cbcb700 1 --2- 172.21.15.107:0/2143847300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc348109540 0x7fc348103690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:53.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc347fff700 1 -- 172.21.15.107:0/2143847300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc348109540 msgr2=0x7fc348103690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:53.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc347fff700 1 --2- 172.21.15.107:0/2143847300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc348109540 0x7fc348103690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:53.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc347fff700 1 -- 172.21.15.107:0/2143847300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3481023f0 msgr2=0x7fc348103150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:53.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc347fff700 1 --2- 172.21.15.107:0/2143847300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3481023f0 0x7fc348103150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:53.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc347fff700 1 -- 172.21.15.107:0/2143847300 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3481a80b0 con 0x7fc348101a30 2024-05-10T10:51:53.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc347fff700 1 --2- 172.21.15.107:0/2143847300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc348101a30 0x7fc348102c10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc33800ec10 tx=0x7fc33800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:53.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc3457fa700 1 -- 172.21.15.107:0/2143847300 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33800cd40 con 0x7fc348101a30 2024-05-10T10:51:53.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc3457fa700 1 -- 172.21.15.107:0/2143847300 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc3380044f0 con 0x7fc348101a30 2024-05-10T10:51:53.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc34e62e700 1 -- 172.21.15.107:0/2143847300 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3481a83a0 con 0x7fc348101a30 2024-05-10T10:51:53.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc3457fa700 1 -- 172.21.15.107:0/2143847300 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338010690 con 0x7fc348101a30 2024-05-10T10:51:53.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.953+0000 7fc34e62e700 1 -- 172.21.15.107:0/2143847300 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3481a88e0 con 0x7fc348101a30 2024-05-10T10:51:53.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.954+0000 7fc34e62e700 1 -- 172.21.15.107:0/2143847300 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc34806a190 con 0x7fc348101a30 2024-05-10T10:51:53.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.956+0000 7fc3457fa700 1 -- 172.21.15.107:0/2143847300 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fc338003f00 con 0x7fc348101a30 2024-05-10T10:51:53.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.956+0000 7fc3457fa700 1 --2- 172.21.15.107:0/2143847300 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc3300b2880 0x7fc3300b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:53.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.956+0000 7fc3477fe700 1 --2- 172.21.15.107:0/2143847300 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc3300b2880 0x7fc3300b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:53.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.956+0000 7fc3457fa700 1 -- 172.21.15.107:0/2143847300 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fc3380e2100 con 0x7fc348101a30 2024-05-10T10:51:53.960 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.957+0000 7fc3477fe700 1 --2- 172.21.15.107:0/2143847300 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc3300b2880 0x7fc3300b4d40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc348108b50 tx=0x7fc33c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:53.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:53.960+0000 7fc3457fa700 1 -- 172.21.15.107:0/2143847300 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc3380aa350 con 0x7fc348101a30 2024-05-10T10:51:54.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:54.219+0000 7fc34e62e700 1 -- 172.21.15.107:0/2143847300 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc34802e6d0 con 0x7fc348101a30 2024-05-10T10:51:54.220 INFO:journalctl@ceph.mds.g.smithi107.stdout:May 10 10:51:54 smithi107 podman[72306]: 2024-05-10 10:51:54.091354183 +0000 UTC m=+0.354823453 container create 3687aec8903906ce7739e12511492d173f3d895c94ee339bd2b5efd0f3c76a7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-g, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.schema-version=1.0, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507) 2024-05-10T10:51:54.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:54.220+0000 7fc3457fa700 1 -- 172.21.15.107:0/2143847300 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8019 (secure 0 0 0) 0x7fc3380a9c50 con 0x7fc348101a30 2024-05-10T10:51:54.221 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:51:54.221 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-10T10:51:54.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:54.222+0000 7fc34e62e700 1 -- 172.21.15.107:0/2143847300 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc3300b2880 msgr2=0x7fc3300b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:54.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:54.222+0000 7fc34e62e700 1 --2- 172.21.15.107:0/2143847300 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc3300b2880 0x7fc3300b4d40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc348108b50 tx=0x7fc33c009260 comp rx=0 tx=0).stop 2024-05-10T10:51:54.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:54.222+0000 7fc34e62e700 1 -- 172.21.15.107:0/2143847300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc348101a30 msgr2=0x7fc348102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:54.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:54.222+0000 7fc34e62e700 1 --2- 172.21.15.107:0/2143847300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc348101a30 0x7fc348102c10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc33800ec10 tx=0x7fc33800ef20 comp rx=0 tx=0).stop 2024-05-10T10:51:54.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:54.222+0000 7fc34e62e700 1 -- 172.21.15.107:0/2143847300 shutdown_connections 2024-05-10T10:51:54.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:54.222+0000 7fc34e62e700 1 --2- 172.21.15.107:0/2143847300 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc3300b2880 0x7fc3300b4d40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:54.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:54.222+0000 7fc34e62e700 1 --2- 172.21.15.107:0/2143847300 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc348109540 0x7fc348103690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:54.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:54.222+0000 7fc34e62e700 1 --2- 172.21.15.107:0/2143847300 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc348101a30 0x7fc348102c10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:54.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:54.222+0000 7fc34e62e700 1 --2- 172.21.15.107:0/2143847300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3481023f0 0x7fc348103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:54.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:54.222+0000 7fc34e62e700 1 -- 172.21.15.107:0/2143847300 >> 172.21.15.107:0/2143847300 conn(0x7fc3480789a0 msgr2=0x7fc3480ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:54.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:54.222+0000 7fc34e62e700 1 -- 172.21.15.107:0/2143847300 shutdown_connections 2024-05-10T10:51:54.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:54.222+0000 7fc34e62e700 1 -- 172.21.15.107:0/2143847300 wait complete. 2024-05-10T10:51:54.224 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 10 2024-05-10T10:51:54.580 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:54 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2143847300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:54.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:54 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/2143847300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:54.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:54 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/2143847300' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:55.174 INFO:journalctl@ceph.mds.g.smithi107.stdout:May 10 10:51:54 smithi107 podman[72306]: 2024-05-10 10:51:54.998459255 +0000 UTC m=+1.261928529 container init 3687aec8903906ce7739e12511492d173f3d895c94ee339bd2b5efd0f3c76a7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-g, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-10T10:51:55.175 INFO:journalctl@ceph.mds.g.smithi107.stdout:May 10 10:51:55 smithi107 podman[72306]: 2024-05-10 10:51:55.001411462 +0000 UTC m=+1.264880734 container start 3687aec8903906ce7739e12511492d173f3d895c94ee339bd2b5efd0f3c76a7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-10T10:51:55.175 INFO:journalctl@ceph.mds.g.smithi107.stdout:May 10 10:51:55 smithi107 ceph-mds[72364]: -- 172.21.15.107:0/3637674374 <== mon.0 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ad46087a40 con 0x55ad4605a800 2024-05-10T10:51:55.175 INFO:journalctl@ceph.mds.g.smithi107.stdout:May 10 10:51:55 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-g[72347]: starting mds.g at 2024-05-10T10:51:55.175 INFO:journalctl@ceph.mds.g.smithi107.stdout:May 10 10:51:55 smithi107 bash[72306]: 3687aec8903906ce7739e12511492d173f3d895c94ee339bd2b5efd0f3c76a7c 2024-05-10T10:51:55.175 INFO:journalctl@ceph.mds.g.smithi107.stdout:May 10 10:51:55 smithi107 systemd[1]: Started Ceph mds.g for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:51:55.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:55 smithi196 ceph-mon[34872]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:55.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:55 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:55.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:55 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:55.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:55 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:55.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:55 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:55.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:55 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:55.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:55 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:55.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:55 smithi107 ceph-mon[30373]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:55.829 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:55 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:55.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:55 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:55.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:55 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:55.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:55 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:55.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:55 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:55.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:55 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:55.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:55 smithi184 ceph-mon[34585]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:55.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:55 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:55.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:55 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:55.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:55 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:55.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:55 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:51:55.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:55 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:51:55.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:55 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:51:56.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:56 smithi196 ceph-mon[34872]: Deploying daemon mds.a on smithi107 2024-05-10T10:51:56.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:56 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.107:6838/1923447762,v1:172.21.15.107:6839/1923447762] up:boot 2024-05-10T10:51:56.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:56 smithi196 ceph-mon[34872]: fsmap 10 up:standby 2024-05-10T10:51:56.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:56 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-10T10:51:56.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:56 smithi107 ceph-mon[30373]: Deploying daemon mds.a on smithi107 2024-05-10T10:51:56.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:56 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.107:6838/1923447762,v1:172.21.15.107:6839/1923447762] up:boot 2024-05-10T10:51:56.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:56 smithi107 ceph-mon[30373]: fsmap 10 up:standby 2024-05-10T10:51:56.830 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:56 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-10T10:51:56.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:56 smithi184 ceph-mon[34585]: Deploying daemon mds.a on smithi107 2024-05-10T10:51:56.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:56 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.107:6838/1923447762,v1:172.21.15.107:6839/1923447762] up:boot 2024-05-10T10:51:56.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:56 smithi184 ceph-mon[34585]: fsmap 10 up:standby 2024-05-10T10:51:56.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:56 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-10T10:51:56.916 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:51:57.336 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 10:51:57 smithi107 systemd[1]: Starting Ceph mds.a for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T10:51:57.350 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:51:57.743 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:57 smithi107 ceph-mon[30373]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:57.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:57 smithi196 ceph-mon[34872]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:57.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:57 smithi184 ceph-mon[34585]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:58.981 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 10:51:58 smithi107 podman[72768]: 2024-05-10 10:51:58.743452633 +0000 UTC m=+0.022092307 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T10:51:58.981 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 10:51:58 smithi107 podman[72768]: 2024-05-10 10:51:58.867126779 +0000 UTC m=+0.145766447 container create 0cb620bb952d4047a4eaff1e1343efba1b2fd2a5b71ac7a8387aec26d6fa8374 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-a, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e) 2024-05-10T10:51:59.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.196+0000 7fcabc9f1700 1 -- 172.21.15.107:0/566802715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcab8102d60 msgr2=0x7fcab810f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:59.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.196+0000 7fcabc9f1700 1 --2- 172.21.15.107:0/566802715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcab8102d60 0x7fcab810f250 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcab000b0a0 tx=0x7fcab000b3b0 comp rx=0 tx=0).stop 2024-05-10T10:51:59.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.196+0000 7fcabc9f1700 1 -- 172.21.15.107:0/566802715 shutdown_connections 2024-05-10T10:51:59.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.196+0000 7fcabc9f1700 1 --2- 172.21.15.107:0/566802715 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcab8108410 0x7fcab81087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:59.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.196+0000 7fcabc9f1700 1 --2- 172.21.15.107:0/566802715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcab8102d60 0x7fcab810f250 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:59.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.196+0000 7fcabc9f1700 1 --2- 172.21.15.107:0/566802715 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcab81023a0 0x7fcab8102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:59.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.196+0000 7fcabc9f1700 1 -- 172.21.15.107:0/566802715 >> 172.21.15.107:0/566802715 conn(0x7fcab8079350 msgr2=0x7fcab8079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:59.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.196+0000 7fcabc9f1700 1 -- 172.21.15.107:0/566802715 shutdown_connections 2024-05-10T10:51:59.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.196+0000 7fcabc9f1700 1 -- 172.21.15.107:0/566802715 wait complete. 2024-05-10T10:51:59.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.197+0000 7fcabc9f1700 1 Processor -- start 2024-05-10T10:51:59.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.197+0000 7fcabc9f1700 1 -- start start 2024-05-10T10:51:59.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.197+0000 7fcabc9f1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcab81023a0 0x7fcab8199d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:59.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.197+0000 7fcabc9f1700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcab8102d60 0x7fcab819a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:59.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.197+0000 7fcabc9f1700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcab8108410 0x7fcab819e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:59.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.197+0000 7fcabc9f1700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcab8112770 con 0x7fcab8102d60 2024-05-10T10:51:59.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.197+0000 7fcabc9f1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcab81125f0 con 0x7fcab81023a0 2024-05-10T10:51:59.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.197+0000 7fcabc9f1700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcab81128f0 con 0x7fcab8108410 2024-05-10T10:51:59.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.197+0000 7fcab5d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcab8102d60 0x7fcab819a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:59.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.197+0000 7fcab5d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcab8102d60 0x7fcab819a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45228/0 (socket says 172.21.15.107:45228) 2024-05-10T10:51:59.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.197+0000 7fcab5d9b700 1 -- 172.21.15.107:0/1239922593 learned_addr learned my addr 172.21.15.107:0/1239922593 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:51:59.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.197+0000 7fcab6d9d700 1 --2- 172.21.15.107:0/1239922593 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcab8108410 0x7fcab819e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:59.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.198+0000 7fcab659c700 1 --2- 172.21.15.107:0/1239922593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcab81023a0 0x7fcab8199d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:59.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.198+0000 7fcab5d9b700 1 -- 172.21.15.107:0/1239922593 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcab8108410 msgr2=0x7fcab819e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:59.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.198+0000 7fcab5d9b700 1 --2- 172.21.15.107:0/1239922593 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcab8108410 0x7fcab819e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:59.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.198+0000 7fcab5d9b700 1 -- 172.21.15.107:0/1239922593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcab81023a0 msgr2=0x7fcab8199d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:59.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.198+0000 7fcab5d9b700 1 --2- 172.21.15.107:0/1239922593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcab81023a0 0x7fcab8199d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:59.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.198+0000 7fcab5d9b700 1 -- 172.21.15.107:0/1239922593 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab819ed40 con 0x7fcab8102d60 2024-05-10T10:51:59.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.198+0000 7fcab5d9b700 1 --2- 172.21.15.107:0/1239922593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcab8102d60 0x7fcab819a270 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcaac00b530 tx=0x7fcaac00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:59.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.198+0000 7fcaa77fe700 1 -- 172.21.15.107:0/1239922593 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaac015020 con 0x7fcab8102d60 2024-05-10T10:51:59.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.198+0000 7fcaa77fe700 1 -- 172.21.15.107:0/1239922593 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcaac011d00 con 0x7fcab8102d60 2024-05-10T10:51:59.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.198+0000 7fcabc9f1700 1 -- 172.21.15.107:0/1239922593 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcab819f030 con 0x7fcab8102d60 2024-05-10T10:51:59.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.198+0000 7fcaa77fe700 1 -- 172.21.15.107:0/1239922593 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaac010e60 con 0x7fcab8102d60 2024-05-10T10:51:59.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.198+0000 7fcabc9f1700 1 -- 172.21.15.107:0/1239922593 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcab81a68b0 con 0x7fcab8102d60 2024-05-10T10:51:59.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.199+0000 7fcabc9f1700 1 -- 172.21.15.107:0/1239922593 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcab806a190 con 0x7fcab8102d60 2024-05-10T10:51:59.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.200+0000 7fcaa77fe700 1 -- 172.21.15.107:0/1239922593 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fcaac018020 con 0x7fcab8102d60 2024-05-10T10:51:59.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.201+0000 7fcaa77fe700 1 --2- 172.21.15.107:0/1239922593 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcaa00b2900 0x7fcaa00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:51:59.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.201+0000 7fcab659c700 1 --2- 172.21.15.107:0/1239922593 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcaa00b2900 0x7fcaa00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:51:59.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.201+0000 7fcaa77fe700 1 -- 172.21.15.107:0/1239922593 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fcaac0e18d0 con 0x7fcab8102d60 2024-05-10T10:51:59.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.202+0000 7fcab659c700 1 --2- 172.21.15.107:0/1239922593 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcaa00b2900 0x7fcaa00b4dc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8006fd0 tx=0x7fcaa8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:51:59.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.205+0000 7fcaa77fe700 1 -- 172.21.15.107:0/1239922593 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fcaac01f030 con 0x7fcab8102d60 2024-05-10T10:51:59.396 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 10:51:59 smithi107 podman[72768]: 2024-05-10 10:51:59.296526308 +0000 UTC m=+0.575165979 container init 0cb620bb952d4047a4eaff1e1343efba1b2fd2a5b71ac7a8387aec26d6fa8374 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-10T10:51:59.396 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 10:51:59 smithi107 podman[72768]: 2024-05-10 10:51:59.29979938 +0000 UTC m=+0.578439053 container start 0cb620bb952d4047a4eaff1e1343efba1b2fd2a5b71ac7a8387aec26d6fa8374 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, CEPH_POINT_RELEASE=) 2024-05-10T10:51:59.396 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 10:51:59 smithi107 ceph-mds[72813]: -- 172.21.15.107:0/1735008279 <== mon.0 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5651f0d41a40 con 0x5651f0d15000 2024-05-10T10:51:59.397 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 10:51:59 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-a[72787]: starting mds.a at 2024-05-10T10:51:59.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.463+0000 7fcabc9f1700 1 -- 172.21.15.107:0/1239922593 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcab819b090 con 0x7fcab8102d60 2024-05-10T10:51:59.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.464+0000 7fcaa77fe700 1 -- 172.21.15.107:0/1239922593 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8848 (secure 0 0 0) 0x7fcab819b090 con 0x7fcab8102d60 2024-05-10T10:51:59.465 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:51:59.465 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-10T10:51:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.468+0000 7fcabc9f1700 1 -- 172.21.15.107:0/1239922593 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcaa00b2900 msgr2=0x7fcaa00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.468+0000 7fcabc9f1700 1 --2- 172.21.15.107:0/1239922593 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcaa00b2900 0x7fcaa00b4dc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8006fd0 tx=0x7fcaa8008040 comp rx=0 tx=0).stop 2024-05-10T10:51:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.468+0000 7fcabc9f1700 1 -- 172.21.15.107:0/1239922593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcab8102d60 msgr2=0x7fcab819a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:51:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.468+0000 7fcabc9f1700 1 --2- 172.21.15.107:0/1239922593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcab8102d60 0x7fcab819a270 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcaac00b530 tx=0x7fcaac00b8f0 comp rx=0 tx=0).stop 2024-05-10T10:51:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.468+0000 7fcabc9f1700 1 -- 172.21.15.107:0/1239922593 shutdown_connections 2024-05-10T10:51:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.468+0000 7fcabc9f1700 1 --2- 172.21.15.107:0/1239922593 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcaa00b2900 0x7fcaa00b4dc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.468+0000 7fcabc9f1700 1 --2- 172.21.15.107:0/1239922593 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcab8108410 0x7fcab819e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.468+0000 7fcabc9f1700 1 --2- 172.21.15.107:0/1239922593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcab81023a0 0x7fcab8199d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:59.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.468+0000 7fcabc9f1700 1 --2- 172.21.15.107:0/1239922593 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcab8102d60 0x7fcab819a270 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:51:59.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.468+0000 7fcabc9f1700 1 -- 172.21.15.107:0/1239922593 >> 172.21.15.107:0/1239922593 conn(0x7fcab8079350 msgr2=0x7fcab8101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:51:59.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.468+0000 7fcabc9f1700 1 -- 172.21.15.107:0/1239922593 shutdown_connections 2024-05-10T10:51:59.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:51:59.468+0000 7fcabc9f1700 1 -- 172.21.15.107:0/1239922593 wait complete. 2024-05-10T10:51:59.470 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 11 2024-05-10T10:51:59.675 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 10:51:59 smithi107 bash[72768]: 0cb620bb952d4047a4eaff1e1343efba1b2fd2a5b71ac7a8387aec26d6fa8374 2024-05-10T10:51:59.675 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 10:51:59 smithi107 systemd[1]: Started Ceph mds.a for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:51:59.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:59 smithi107 ceph-mon[30373]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:59.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:59 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:59.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:59 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1239922593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:59.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:51:59 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:59.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:59 smithi196 ceph-mon[34872]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:59.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:59 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:59.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:59 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1239922593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:59.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:51:59 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:59.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:59 smithi184 ceph-mon[34585]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:51:59.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:59 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:51:59.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:59 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1239922593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:51:59.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:51:59 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:00.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:00 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.107:6840/2332963094,v1:172.21.15.107:6841/2332963094] up:boot 2024-05-10T10:52:00.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:00 smithi196 ceph-mon[34872]: fsmap 11 up:standby 2024-05-10T10:52:00.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:00 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-10T10:52:00.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:00 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:00.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:00 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:52:00.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:00 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:52:00.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:00 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:52:00.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:00 smithi196 ceph-mon[34872]: Deploying daemon mds.b on smithi184 2024-05-10T10:52:00.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:00 smithi196 ceph-mon[34872]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:00.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:00 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.107:6840/2332963094,v1:172.21.15.107:6841/2332963094] up:boot 2024-05-10T10:52:00.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:00 smithi184 ceph-mon[34585]: fsmap 11 up:standby 2024-05-10T10:52:00.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:00 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-10T10:52:00.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:00 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:00.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:00 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:52:00.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:00 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:52:00.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:00 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:52:00.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:00 smithi184 ceph-mon[34585]: Deploying daemon mds.b on smithi184 2024-05-10T10:52:00.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:00 smithi184 ceph-mon[34585]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:00.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:00 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.107:6840/2332963094,v1:172.21.15.107:6841/2332963094] up:boot 2024-05-10T10:52:00.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:00 smithi107 ceph-mon[30373]: fsmap 11 up:standby 2024-05-10T10:52:00.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:00 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-10T10:52:00.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:00 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:00.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:00 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-10T10:52:00.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:00 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-10T10:52:00.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:00 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:52:00.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:00 smithi107 ceph-mon[30373]: Deploying daemon mds.b on smithi184 2024-05-10T10:52:00.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:00 smithi107 ceph-mon[30373]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:01.883 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 10:52:01 smithi184 systemd[1]: Starting Ceph mds.b for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T10:52:02.139 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 10:52:01 smithi184 podman[64657]: 2024-05-10 10:52:01.785189767 +0000 UTC m=+0.017839397 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T10:52:02.139 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 10:52:01 smithi184 podman[64657]: 2024-05-10 10:52:01.883762568 +0000 UTC m=+0.116412204 container create c3a0475128d67b95715942f511cbe972dd092e016d0c33d04fa7318419ea00af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-b, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-05-10T10:52:02.139 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 10:52:02 smithi184 podman[64657]: 2024-05-10 10:52:02.094679656 +0000 UTC m=+0.327329286 container init c3a0475128d67b95715942f511cbe972dd092e016d0c33d04fa7318419ea00af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-b, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-10T10:52:02.139 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 10:52:02 smithi184 podman[64657]: 2024-05-10 10:52:02.097126441 +0000 UTC m=+0.329776072 container start c3a0475128d67b95715942f511cbe972dd092e016d0c33d04fa7318419ea00af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08) 2024-05-10T10:52:02.140 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 10:52:02 smithi184 ceph-mds[64676]: -- 172.21.15.184:0/3780370174 <== mon.2 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564c1a2d5a40 con 0x564c1a2a8c00 2024-05-10T10:52:02.140 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 10:52:02 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-b[64672]: starting mds.b at 2024-05-10T10:52:02.262 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:52:02.532 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:52:02.639 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 10:52:02 smithi184 bash[64657]: c3a0475128d67b95715942f511cbe972dd092e016d0c33d04fa7318419ea00af 2024-05-10T10:52:02.639 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 10:52:02 smithi184 systemd[1]: Started Ceph mds.b for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T10:52:03.524 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:03 smithi196 ceph-mon[34872]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:03.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:03 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:03.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:03 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:03.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:03 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:03.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:03 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:03.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:03 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:03.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:03 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:52:03.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:03 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:03.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:03 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] up:boot 2024-05-10T10:52:03.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:03 smithi196 ceph-mon[34872]: fsmap 12 up:standby 2024-05-10T10:52:03.525 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:03 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-10T10:52:03.563 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:03 smithi184 ceph-mon[34585]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:03.563 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:03 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:03.563 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:03 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:03.564 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:03 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:03.564 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:03 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:03.564 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:03 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:03.564 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:03 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:52:03.564 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:03 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:03.564 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:03 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] up:boot 2024-05-10T10:52:03.564 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:03 smithi184 ceph-mon[34585]: fsmap 12 up:standby 2024-05-10T10:52:03.564 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:03 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-10T10:52:03.607 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:03 smithi107 ceph-mon[30373]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:03.608 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:03 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:03.608 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:03 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:03.608 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:03 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:03.608 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:03 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:03.608 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:03 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:03.608 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:03 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:52:03.608 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:03 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:03.608 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:03 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] up:boot 2024-05-10T10:52:03.608 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:03 smithi107 ceph-mon[30373]: fsmap 12 up:standby 2024-05-10T10:52:03.608 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:03 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-10T10:52:04.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.155+0000 7f13b34b3700 1 -- 172.21.15.107:0/1465378412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13ac06c5f0 msgr2=0x7f13ac110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:04.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.155+0000 7f13b34b3700 1 --2- 172.21.15.107:0/1465378412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13ac06c5f0 0x7f13ac110330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f13a400b0a0 tx=0x7f13a400b3b0 comp rx=0 tx=0).stop 2024-05-10T10:52:04.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.155+0000 7f13b34b3700 1 -- 172.21.15.107:0/1465378412 shutdown_connections 2024-05-10T10:52:04.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.155+0000 7f13b34b3700 1 --2- 172.21.15.107:0/1465378412 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f13ac109510 0x7f13ac1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:04.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.155+0000 7f13b34b3700 1 --2- 172.21.15.107:0/1465378412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13ac06c5f0 0x7f13ac110330 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:04.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.155+0000 7f13b34b3700 1 --2- 172.21.15.107:0/1465378412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13ac06bc30 0x7f13ac06c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:04.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.155+0000 7f13b34b3700 1 -- 172.21.15.107:0/1465378412 >> 172.21.15.107:0/1465378412 conn(0x7f13ac079350 msgr2=0x7f13ac079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:04.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.155+0000 7f13b34b3700 1 -- 172.21.15.107:0/1465378412 shutdown_connections 2024-05-10T10:52:04.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.155+0000 7f13b34b3700 1 -- 172.21.15.107:0/1465378412 wait complete. 2024-05-10T10:52:04.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.155+0000 7f13b34b3700 1 Processor -- start 2024-05-10T10:52:04.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.156+0000 7f13b34b3700 1 -- start start 2024-05-10T10:52:04.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.156+0000 7f13b34b3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13ac06bc30 0x7f13ac102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:04.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.156+0000 7f13b34b3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13ac06c5f0 0x7f13ac1029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:04.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.156+0000 7f13b34b3700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f13ac109510 0x7f13ac102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:04.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.156+0000 7f13b34b3700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac113770 con 0x7f13ac06bc30 2024-05-10T10:52:04.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.156+0000 7f13b34b3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac1135f0 con 0x7f13ac06c5f0 2024-05-10T10:52:04.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.156+0000 7f13b34b3700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f13ac1138f0 con 0x7f13ac109510 2024-05-10T10:52:04.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.156+0000 7f13b124f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13ac06bc30 0x7f13ac102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:04.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.156+0000 7f13b124f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13ac06bc30 0x7f13ac102470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45260/0 (socket says 172.21.15.107:45260) 2024-05-10T10:52:04.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.156+0000 7f13b124f700 1 -- 172.21.15.107:0/1343670866 learned_addr learned my addr 172.21.15.107:0/1343670866 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:52:04.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.156+0000 7f13b0a4e700 1 --2- 172.21.15.107:0/1343670866 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13ac06c5f0 0x7f13ac1029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:04.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.156+0000 7f13b1a50700 1 --2- 172.21.15.107:0/1343670866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f13ac109510 0x7f13ac102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:04.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.156+0000 7f13b124f700 1 -- 172.21.15.107:0/1343670866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f13ac109510 msgr2=0x7f13ac102ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:04.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.156+0000 7f13b124f700 1 --2- 172.21.15.107:0/1343670866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f13ac109510 0x7f13ac102ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:04.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.156+0000 7f13b124f700 1 -- 172.21.15.107:0/1343670866 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13ac06c5f0 msgr2=0x7f13ac1029b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:04.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.156+0000 7f13b124f700 1 --2- 172.21.15.107:0/1343670866 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13ac06c5f0 0x7f13ac1029b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:04.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.156+0000 7f13b124f700 1 -- 172.21.15.107:0/1343670866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13ac1a8070 con 0x7f13ac06bc30 2024-05-10T10:52:04.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.156+0000 7f13b124f700 1 --2- 172.21.15.107:0/1343670866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13ac06bc30 0x7f13ac102470 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f13a000c9b0 tx=0x7f13a000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:04.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.157+0000 7f139e7fc700 1 -- 172.21.15.107:0/1343670866 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a0007b00 con 0x7f13ac06bc30 2024-05-10T10:52:04.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.157+0000 7f139e7fc700 1 -- 172.21.15.107:0/1343670866 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f13a000ce50 con 0x7f13ac06bc30 2024-05-10T10:52:04.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.157+0000 7f139e7fc700 1 -- 172.21.15.107:0/1343670866 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a0018660 con 0x7f13ac06bc30 2024-05-10T10:52:04.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.157+0000 7f13b34b3700 1 -- 172.21.15.107:0/1343670866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13ac1a8360 con 0x7f13ac06bc30 2024-05-10T10:52:04.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.157+0000 7f13b34b3700 1 -- 172.21.15.107:0/1343670866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13ac1a8820 con 0x7f13ac06bc30 2024-05-10T10:52:04.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.159+0000 7f13b34b3700 1 -- 172.21.15.107:0/1343670866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13ac06a190 con 0x7f13ac06bc30 2024-05-10T10:52:04.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.160+0000 7f139e7fc700 1 -- 172.21.15.107:0/1343670866 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f13a000f450 con 0x7f13ac06bc30 2024-05-10T10:52:04.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.160+0000 7f139e7fc700 1 --2- 172.21.15.107:0/1343670866 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f13980b2900 0x7f13980b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:04.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.161+0000 7f13b0a4e700 1 --2- 172.21.15.107:0/1343670866 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f13980b2900 0x7f13980b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:04.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.161+0000 7f139e7fc700 1 -- 172.21.15.107:0/1343670866 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f13a00e2040 con 0x7f13ac06bc30 2024-05-10T10:52:04.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.161+0000 7f13b0a4e700 1 --2- 172.21.15.107:0/1343670866 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f13980b2900 0x7f13980b4dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f13ac079870 tx=0x7f13a80073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:04.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.165+0000 7f139e7fc700 1 -- 172.21.15.107:0/1343670866 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f13a0014030 con 0x7f13ac06bc30 2024-05-10T10:52:04.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.430+0000 7f13b34b3700 1 -- 172.21.15.107:0/1343670866 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13ac02e5b0 con 0x7f13ac06bc30 2024-05-10T10:52:04.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.431+0000 7f139e7fc700 1 -- 172.21.15.107:0/1343670866 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10500 (secure 0 0 0) 0x7f13a00aa260 con 0x7f13ac06bc30 2024-05-10T10:52:04.432 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:52:04.432 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14604,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6841/2332963094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":2332963094},{"type":"v1","addr":"172.21.15.107:6841","nonce":2332963094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24418,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24431,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24482,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/16501252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":16501252},{"type":"v1","addr":"172.21.15.184:6839","nonce":16501252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-05-10T10:52:04.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.433+0000 7f13b34b3700 1 -- 172.21.15.107:0/1343670866 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f13980b2900 msgr2=0x7f13980b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:04.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.433+0000 7f13b34b3700 1 --2- 172.21.15.107:0/1343670866 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f13980b2900 0x7f13980b4dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f13ac079870 tx=0x7f13a80073d0 comp rx=0 tx=0).stop 2024-05-10T10:52:04.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.433+0000 7f13b34b3700 1 -- 172.21.15.107:0/1343670866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13ac06bc30 msgr2=0x7f13ac102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:04.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.433+0000 7f13b34b3700 1 --2- 172.21.15.107:0/1343670866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13ac06bc30 0x7f13ac102470 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f13a000c9b0 tx=0x7f13a000ccc0 comp rx=0 tx=0).stop 2024-05-10T10:52:04.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.433+0000 7f13b34b3700 1 -- 172.21.15.107:0/1343670866 shutdown_connections 2024-05-10T10:52:04.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.433+0000 7f13b34b3700 1 --2- 172.21.15.107:0/1343670866 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f13980b2900 0x7f13980b4dc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:04.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.433+0000 7f13b34b3700 1 --2- 172.21.15.107:0/1343670866 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f13ac109510 0x7f13ac102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:04.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.433+0000 7f13b34b3700 1 --2- 172.21.15.107:0/1343670866 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f13ac06bc30 0x7f13ac102470 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:04.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.433+0000 7f13b34b3700 1 --2- 172.21.15.107:0/1343670866 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13ac06c5f0 0x7f13ac1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:04.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.433+0000 7f13b34b3700 1 -- 172.21.15.107:0/1343670866 >> 172.21.15.107:0/1343670866 conn(0x7f13ac079350 msgr2=0x7f13ac100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:04.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.433+0000 7f13b34b3700 1 -- 172.21.15.107:0/1343670866 shutdown_connections 2024-05-10T10:52:04.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:04.433+0000 7f13b34b3700 1 -- 172.21.15.107:0/1343670866 wait complete. 2024-05-10T10:52:04.435 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 13 2024-05-10T10:52:05.370 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:05 smithi107 ceph-mon[30373]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:05.370 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:05 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:05.370 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:05 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:05.371 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:05 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:05.371 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:05 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:05.371 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:05 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1343670866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:52:05.399 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-05-10T10:52:05.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:05 smithi196 ceph-mon[34872]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:05.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:05 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:05.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:05 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:05.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:05 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:05.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:05 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:05.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:05 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1343670866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:52:05.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:05 smithi184 ceph-mon[34585]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:05.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:05 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:05.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:05 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:05.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:05 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:05.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:05 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:05.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:05 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1343670866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:52:05.676 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:52:07.073 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:06 smithi107 ceph-mon[30373]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:07.073 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:07.073 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:07.073 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:52:07.073 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:52:07.073 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:07.073 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:06 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:52:07.218 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:06 smithi184 ceph-mon[34585]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:07.218 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:07.218 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:07.218 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:52:07.218 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:52:07.218 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:07.218 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:06 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:52:07.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.292+0000 7fb984cb5700 1 -- 172.21.15.107:0/1132572456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9801023a0 msgr2=0x7fb980102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:07.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.292+0000 7fb984cb5700 1 --2- 172.21.15.107:0/1132572456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9801023a0 0x7fb980102820 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb968009990 tx=0x7fb968009ca0 comp rx=0 tx=0).stop 2024-05-10T10:52:07.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.292+0000 7fb984cb5700 1 -- 172.21.15.107:0/1132572456 shutdown_connections 2024-05-10T10:52:07.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.292+0000 7fb984cb5700 1 --2- 172.21.15.107:0/1132572456 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb980108410 0x7fb9801087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:07.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.292+0000 7fb984cb5700 1 --2- 172.21.15.107:0/1132572456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb980102d60 0x7fb98010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:07.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.292+0000 7fb984cb5700 1 --2- 172.21.15.107:0/1132572456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9801023a0 0x7fb980102820 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:07.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.292+0000 7fb984cb5700 1 -- 172.21.15.107:0/1132572456 >> 172.21.15.107:0/1132572456 conn(0x7fb980079350 msgr2=0x7fb980079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:07.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.292+0000 7fb984cb5700 1 -- 172.21.15.107:0/1132572456 shutdown_connections 2024-05-10T10:52:07.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.292+0000 7fb984cb5700 1 -- 172.21.15.107:0/1132572456 wait complete. 2024-05-10T10:52:07.295 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.293+0000 7fb984cb5700 1 Processor -- start 2024-05-10T10:52:07.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.293+0000 7fb984cb5700 1 -- start start 2024-05-10T10:52:07.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.293+0000 7fb984cb5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9801023a0 0x7fb98019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:07.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.293+0000 7fb984cb5700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb980102d60 0x7fb98019afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:07.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.293+0000 7fb984cb5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb980108410 0x7fb9801a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:07.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.293+0000 7fb984cb5700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb980112690 con 0x7fb9801023a0 2024-05-10T10:52:07.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.293+0000 7fb984cb5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb980112510 con 0x7fb980108410 2024-05-10T10:52:07.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.293+0000 7fb984cb5700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb980112810 con 0x7fb980102d60 2024-05-10T10:52:07.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.294+0000 7fb97e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9801023a0 0x7fb98019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:07.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.294+0000 7fb97e59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9801023a0 0x7fb98019aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52658/0 (socket says 172.21.15.107:52658) 2024-05-10T10:52:07.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.294+0000 7fb97e59c700 1 -- 172.21.15.107:0/2674369370 learned_addr learned my addr 172.21.15.107:0/2674369370 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:52:07.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.294+0000 7fb977fff700 1 --2- 172.21.15.107:0/2674369370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb980102d60 0x7fb98019afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:07.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.294+0000 7fb97ed9d700 1 --2- 172.21.15.107:0/2674369370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb980108410 0x7fb9801a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:07.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.294+0000 7fb97e59c700 1 -- 172.21.15.107:0/2674369370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb980102d60 msgr2=0x7fb98019afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:07.296 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.294+0000 7fb97e59c700 1 --2- 172.21.15.107:0/2674369370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb980102d60 0x7fb98019afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:07.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.294+0000 7fb97e59c700 1 -- 172.21.15.107:0/2674369370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb980108410 msgr2=0x7fb9801a5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:07.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.294+0000 7fb97e59c700 1 --2- 172.21.15.107:0/2674369370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb980108410 0x7fb9801a5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:07.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.294+0000 7fb97e59c700 1 -- 172.21.15.107:0/2674369370 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9801a6030 con 0x7fb9801023a0 2024-05-10T10:52:07.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.294+0000 7fb97e59c700 1 --2- 172.21.15.107:0/2674369370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9801023a0 0x7fb98019aa70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb97000e9c0 tx=0x7fb97000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:07.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.294+0000 7fb9777fe700 1 -- 172.21.15.107:0/2674369370 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97000cbd0 con 0x7fb9801023a0 2024-05-10T10:52:07.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.294+0000 7fb9777fe700 1 -- 172.21.15.107:0/2674369370 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb97000ee60 con 0x7fb9801023a0 2024-05-10T10:52:07.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.294+0000 7fb9777fe700 1 -- 172.21.15.107:0/2674369370 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb970005670 con 0x7fb9801023a0 2024-05-10T10:52:07.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.294+0000 7fb984cb5700 1 -- 172.21.15.107:0/2674369370 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9801a62c0 con 0x7fb9801023a0 2024-05-10T10:52:07.297 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.294+0000 7fb984cb5700 1 -- 172.21.15.107:0/2674369370 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9801a6780 con 0x7fb9801023a0 2024-05-10T10:52:07.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.295+0000 7fb984cb5700 1 -- 172.21.15.107:0/2674369370 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb980103ac0 con 0x7fb9801023a0 2024-05-10T10:52:07.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.297+0000 7fb9777fe700 1 -- 172.21.15.107:0/2674369370 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fb970004750 con 0x7fb9801023a0 2024-05-10T10:52:07.298 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.298+0000 7fb9777fe700 1 --2- 172.21.15.107:0/2674369370 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb9600b2900 0x7fb9600b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:07.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.298+0000 7fb977fff700 1 --2- 172.21.15.107:0/2674369370 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb9600b2900 0x7fb9600b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:07.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.298+0000 7fb9777fe700 1 -- 172.21.15.107:0/2674369370 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fb9700e2160 con 0x7fb9801023a0 2024-05-10T10:52:07.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.298+0000 7fb977fff700 1 --2- 172.21.15.107:0/2674369370 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb9600b2900 0x7fb9600b4dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb96800b2e0 tx=0x7fb968005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:07.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.301+0000 7fb9777fe700 1 -- 172.21.15.107:0/2674369370 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb970054d70 con 0x7fb9801023a0 2024-05-10T10:52:07.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:06 smithi196 ceph-mon[34872]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:07.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:07.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:07.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:52:07.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:52:07.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:07.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:06 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:52:07.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.520+0000 7fb984cb5700 1 -- 172.21.15.107:0/2674369370 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb98002e510 con 0x7fb9801023a0 2024-05-10T10:52:07.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.520+0000 7fb9777fe700 1 -- 172.21.15.107:0/2674369370 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) ==== 84+0+65 (secure 0 0 0) 0x7fb9700aa320 con 0x7fb9801023a0 2024-05-10T10:52:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:52:07.521 INFO:teuthology.orchestra.run.smithi107.stdout:[ 2024-05-10T10:52:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T10:52:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: "poolnum": 1, 2024-05-10T10:52:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: "poolname": ".mgr" 2024-05-10T10:52:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:52:07.521 INFO:teuthology.orchestra.run.smithi107.stdout:] 2024-05-10T10:52:07.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.522+0000 7fb984cb5700 1 -- 172.21.15.107:0/2674369370 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb9600b2900 msgr2=0x7fb9600b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:07.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.522+0000 7fb984cb5700 1 --2- 172.21.15.107:0/2674369370 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb9600b2900 0x7fb9600b4dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb96800b2e0 tx=0x7fb968005960 comp rx=0 tx=0).stop 2024-05-10T10:52:07.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.522+0000 7fb984cb5700 1 -- 172.21.15.107:0/2674369370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9801023a0 msgr2=0x7fb98019aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:07.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.522+0000 7fb984cb5700 1 --2- 172.21.15.107:0/2674369370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9801023a0 0x7fb98019aa70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb97000e9c0 tx=0x7fb97000ecd0 comp rx=0 tx=0).stop 2024-05-10T10:52:07.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.522+0000 7fb984cb5700 1 -- 172.21.15.107:0/2674369370 shutdown_connections 2024-05-10T10:52:07.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.522+0000 7fb984cb5700 1 --2- 172.21.15.107:0/2674369370 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb9600b2900 0x7fb9600b4dc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:07.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.522+0000 7fb984cb5700 1 --2- 172.21.15.107:0/2674369370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb980108410 0x7fb9801a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:07.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.522+0000 7fb984cb5700 1 --2- 172.21.15.107:0/2674369370 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9801023a0 0x7fb98019aa70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:07.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.522+0000 7fb984cb5700 1 --2- 172.21.15.107:0/2674369370 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb980102d60 0x7fb98019afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:07.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.522+0000 7fb984cb5700 1 -- 172.21.15.107:0/2674369370 >> 172.21.15.107:0/2674369370 conn(0x7fb980079350 msgr2=0x7fb980100ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:07.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.522+0000 7fb984cb5700 1 -- 172.21.15.107:0/2674369370 shutdown_connections 2024-05-10T10:52:07.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:07.522+0000 7fb984cb5700 1 -- 172.21.15.107:0/2674369370 wait complete. 2024-05-10T10:52:08.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:07 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2674369370' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-10T10:52:08.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:08.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:08.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:08.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:08.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:07 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/2674369370' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-10T10:52:08.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:07 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:08.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:07 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:08.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:07 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:08.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:07 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:08.323 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T10:52:08.324 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T10:52:08.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:07 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/2674369370' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-10T10:52:08.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:07 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:08.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:07 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:08.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:07 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:08.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:07 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:08.757 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:52:09.132 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:08 smithi107 ceph-mon[30373]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:09.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:08 smithi196 ceph-mon[34872]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:09.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:08 smithi184 ceph-mon[34585]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:10.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.461+0000 7fe7d7d9a700 1 -- 172.21.15.107:0/3747386681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7d0109520 msgr2=0x7fe7d0109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:10.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.461+0000 7fe7d7d9a700 1 --2- 172.21.15.107:0/3747386681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7d0109520 0x7fe7d0109900 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009990 tx=0x7fe7cc009ca0 comp rx=0 tx=0).stop 2024-05-10T10:52:10.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.461+0000 7fe7d7d9a700 1 -- 172.21.15.107:0/3747386681 shutdown_connections 2024-05-10T10:52:10.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.461+0000 7fe7d7d9a700 1 --2- 172.21.15.107:0/3747386681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7d0102450 0x7fe7d0110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:10.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.461+0000 7fe7d7d9a700 1 --2- 172.21.15.107:0/3747386681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7d0109520 0x7fe7d0109900 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:10.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.461+0000 7fe7d7d9a700 1 --2- 172.21.15.107:0/3747386681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe7d0101a90 0x7fe7d0101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:10.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.461+0000 7fe7d7d9a700 1 -- 172.21.15.107:0/3747386681 >> 172.21.15.107:0/3747386681 conn(0x7fe7d0078a10 msgr2=0x7fe7d00ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:10.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.461+0000 7fe7d7d9a700 1 -- 172.21.15.107:0/3747386681 shutdown_connections 2024-05-10T10:52:10.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.461+0000 7fe7d7d9a700 1 -- 172.21.15.107:0/3747386681 wait complete. 2024-05-10T10:52:10.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.462+0000 7fe7d7d9a700 1 Processor -- start 2024-05-10T10:52:10.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.462+0000 7fe7d7d9a700 1 -- start start 2024-05-10T10:52:10.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.462+0000 7fe7d7d9a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7d0101a90 0x7fe7d019f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:10.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.462+0000 7fe7d7d9a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7d0102450 0x7fe7d019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:10.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.462+0000 7fe7d7d9a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe7d0109520 0x7fe7d01999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:10.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.462+0000 7fe7d7d9a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d0113780 con 0x7fe7d0102450 2024-05-10T10:52:10.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.462+0000 7fe7d7d9a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d0113600 con 0x7fe7d0101a90 2024-05-10T10:52:10.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.462+0000 7fe7d7d9a700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d0113900 con 0x7fe7d0109520 2024-05-10T10:52:10.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.462+0000 7fe7d5335700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7d0102450 0x7fe7d019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:10.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.462+0000 7fe7d5335700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7d0102450 0x7fe7d019fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52670/0 (socket says 172.21.15.107:52670) 2024-05-10T10:52:10.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.462+0000 7fe7d5335700 1 -- 172.21.15.107:0/3631584337 learned_addr learned my addr 172.21.15.107:0/3631584337 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:52:10.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.462+0000 7fe7d5b36700 1 --2- 172.21.15.107:0/3631584337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7d0101a90 0x7fe7d019f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:10.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.462+0000 7fe7d6337700 1 --2- 172.21.15.107:0/3631584337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe7d0109520 0x7fe7d01999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:10.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.462+0000 7fe7d5335700 1 -- 172.21.15.107:0/3631584337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe7d0109520 msgr2=0x7fe7d01999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:10.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.462+0000 7fe7d5335700 1 --2- 172.21.15.107:0/3631584337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe7d0109520 0x7fe7d01999c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:10.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.462+0000 7fe7d5335700 1 -- 172.21.15.107:0/3631584337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7d0101a90 msgr2=0x7fe7d019f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:10.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.462+0000 7fe7d5335700 1 --2- 172.21.15.107:0/3631584337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7d0101a90 0x7fe7d019f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:10.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.462+0000 7fe7d5335700 1 -- 172.21.15.107:0/3631584337 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d019a120 con 0x7fe7d0102450 2024-05-10T10:52:10.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.462+0000 7fe7d5335700 1 --2- 172.21.15.107:0/3631584337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7d0102450 0x7fe7d019fd40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe7c000c9b0 tx=0x7fe7c000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:10.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.463+0000 7fe7c6ffd700 1 -- 172.21.15.107:0/3631584337 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0007b00 con 0x7fe7d0102450 2024-05-10T10:52:10.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.463+0000 7fe7c6ffd700 1 -- 172.21.15.107:0/3631584337 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe7c0007ca0 con 0x7fe7d0102450 2024-05-10T10:52:10.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.463+0000 7fe7d7d9a700 1 -- 172.21.15.107:0/3631584337 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d019a410 con 0x7fe7d0102450 2024-05-10T10:52:10.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.463+0000 7fe7c6ffd700 1 -- 172.21.15.107:0/3631584337 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0018680 con 0x7fe7d0102450 2024-05-10T10:52:10.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.463+0000 7fe7d7d9a700 1 -- 172.21.15.107:0/3631584337 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d01a66d0 con 0x7fe7d0102450 2024-05-10T10:52:10.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.464+0000 7fe7d7d9a700 1 -- 172.21.15.107:0/3631584337 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7d010ba00 con 0x7fe7d0102450 2024-05-10T10:52:10.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.466+0000 7fe7c6ffd700 1 -- 172.21.15.107:0/3631584337 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fe7c000f450 con 0x7fe7d0102450 2024-05-10T10:52:10.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.467+0000 7fe7c6ffd700 1 --2- 172.21.15.107:0/3631584337 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe7bc0b2880 0x7fe7bc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:10.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.467+0000 7fe7d5b36700 1 --2- 172.21.15.107:0/3631584337 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe7bc0b2880 0x7fe7bc0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:10.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.467+0000 7fe7c6ffd700 1 -- 172.21.15.107:0/3631584337 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fe7c00e2080 con 0x7fe7d0102450 2024-05-10T10:52:10.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.467+0000 7fe7d5b36700 1 --2- 172.21.15.107:0/3631584337 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe7bc0b2880 0x7fe7bc0b4d40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe7d019ab00 tx=0x7fe7cc005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:10.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.470+0000 7fe7c6ffd700 1 -- 172.21.15.107:0/3631584337 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe7c0014030 con 0x7fe7d0102450 2024-05-10T10:52:10.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:10.698+0000 7fe7d7d9a700 1 -- 172.21.15.107:0/3631584337 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe7d006a190 con 0x7fe7d0102450 2024-05-10T10:52:11.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:10 smithi196 ceph-mon[34872]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:11.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:10 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:11.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:10 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:11.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:10 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3631584337' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-10T10:52:11.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:10 smithi184 ceph-mon[34585]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:11.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:10 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:11.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:10 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:11.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:10 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3631584337' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-10T10:52:11.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:10 smithi107 ceph-mon[30373]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:11.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:10 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:11.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:10 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:11.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:10 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3631584337' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-10T10:52:11.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:11.513+0000 7fe7c6ffd700 1 -- 172.21.15.107:0/3631584337 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) ==== 138+0+0 (secure 0 0 0) 0x7fe7c00aa2d0 con 0x7fe7d0102450 2024-05-10T10:52:11.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:11.515+0000 7fe7d7d9a700 1 -- 172.21.15.107:0/3631584337 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe7bc0b2880 msgr2=0x7fe7bc0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:11.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:11.515+0000 7fe7d7d9a700 1 --2- 172.21.15.107:0/3631584337 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe7bc0b2880 0x7fe7bc0b4d40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe7d019ab00 tx=0x7fe7cc005960 comp rx=0 tx=0).stop 2024-05-10T10:52:11.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:11.515+0000 7fe7d7d9a700 1 -- 172.21.15.107:0/3631584337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7d0102450 msgr2=0x7fe7d019fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:11.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:11.515+0000 7fe7d7d9a700 1 --2- 172.21.15.107:0/3631584337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7d0102450 0x7fe7d019fd40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe7c000c9b0 tx=0x7fe7c000ccc0 comp rx=0 tx=0).stop 2024-05-10T10:52:11.515 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:11.515+0000 7fe7d7d9a700 1 -- 172.21.15.107:0/3631584337 shutdown_connections 2024-05-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:11.515+0000 7fe7d7d9a700 1 --2- 172.21.15.107:0/3631584337 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe7bc0b2880 0x7fe7bc0b4d40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:11.515+0000 7fe7d7d9a700 1 --2- 172.21.15.107:0/3631584337 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe7d0109520 0x7fe7d01999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:11.515+0000 7fe7d7d9a700 1 --2- 172.21.15.107:0/3631584337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7d0101a90 0x7fe7d019f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:11.515+0000 7fe7d7d9a700 1 --2- 172.21.15.107:0/3631584337 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7d0102450 0x7fe7d019fd40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:11.515+0000 7fe7d7d9a700 1 -- 172.21.15.107:0/3631584337 >> 172.21.15.107:0/3631584337 conn(0x7fe7d0078a10 msgr2=0x7fe7d0100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:11.516+0000 7fe7d7d9a700 1 -- 172.21.15.107:0/3631584337 shutdown_connections 2024-05-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:11.516+0000 7fe7d7d9a700 1 -- 172.21.15.107:0/3631584337 wait complete. 2024-05-10T10:52:11.516 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_metadata' created 2024-05-10T10:52:12.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:11 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:52:12.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:11 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:52:12.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:11 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:12.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:11 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3631584337' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-10T10:52:12.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:11 smithi107 ceph-mon[30373]: osdmap e74: 12 total, 12 up, 12 in 2024-05-10T10:52:12.203 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T10:52:12.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:11 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:52:12.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:11 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:52:12.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:11 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:12.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:11 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3631584337' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-10T10:52:12.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:11 smithi196 ceph-mon[34872]: osdmap e74: 12 total, 12 up, 12 in 2024-05-10T10:52:12.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:11 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:52:12.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:11 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:52:12.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:11 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:52:12.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:11 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3631584337' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-10T10:52:12.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:11 smithi184 ceph-mon[34585]: osdmap e74: 12 total, 12 up, 12 in 2024-05-10T10:52:12.445 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:52:13.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:12 smithi107 ceph-mon[30373]: pgmap v276: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:13.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:12 smithi107 ceph-mon[30373]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-10T10:52:13.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:12 smithi107 ceph-mon[30373]: osdmap e75: 12 total, 12 up, 12 in 2024-05-10T10:52:13.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:12 smithi196 ceph-mon[34872]: pgmap v276: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:13.715 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:12 smithi196 ceph-mon[34872]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-10T10:52:13.715 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:12 smithi196 ceph-mon[34872]: osdmap e75: 12 total, 12 up, 12 in 2024-05-10T10:52:13.716 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:12 smithi184 ceph-mon[34585]: pgmap v276: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:13.716 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:12 smithi184 ceph-mon[34585]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-10T10:52:13.716 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:12 smithi184 ceph-mon[34585]: osdmap e75: 12 total, 12 up, 12 in 2024-05-10T10:52:14.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.153+0000 7fe31cca9700 1 -- 172.21.15.107:0/794747814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe318103f00 msgr2=0x7fe3181103b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:14.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.153+0000 7fe31cca9700 1 --2- 172.21.15.107:0/794747814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe318103f00 0x7fe3181103b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe31000b0d0 tx=0x7fe31000b3e0 comp rx=0 tx=0).stop 2024-05-10T10:52:14.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.153+0000 7fe31cca9700 1 -- 172.21.15.107:0/794747814 shutdown_connections 2024-05-10T10:52:14.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.153+0000 7fe31cca9700 1 --2- 172.21.15.107:0/794747814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe318103f00 0x7fe3181103b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:14.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.153+0000 7fe31cca9700 1 --2- 172.21.15.107:0/794747814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3181095e0 0x7fe3181099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:14.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.153+0000 7fe31cca9700 1 --2- 172.21.15.107:0/794747814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe318103540 0x7fe3181039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:14.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.153+0000 7fe31cca9700 1 -- 172.21.15.107:0/794747814 >> 172.21.15.107:0/794747814 conn(0x7fe31807a650 msgr2=0x7fe31807aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:14.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.153+0000 7fe31cca9700 1 -- 172.21.15.107:0/794747814 shutdown_connections 2024-05-10T10:52:14.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.153+0000 7fe31cca9700 1 -- 172.21.15.107:0/794747814 wait complete. 2024-05-10T10:52:14.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.154+0000 7fe31cca9700 1 Processor -- start 2024-05-10T10:52:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.154+0000 7fe31cca9700 1 -- start start 2024-05-10T10:52:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.155+0000 7fe31cca9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe318103540 0x7fe3180757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.155+0000 7fe31cca9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe318103f00 0x7fe318075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.155+0000 7fe31cca9700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe3181095e0 0x7fe318076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.155+0000 7fe31cca9700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe318113880 con 0x7fe318103540 2024-05-10T10:52:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.155+0000 7fe31cca9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe318113700 con 0x7fe318103f00 2024-05-10T10:52:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.155+0000 7fe31cca9700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe318113a00 con 0x7fe3181095e0 2024-05-10T10:52:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.155+0000 7fe31659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe318103540 0x7fe3180757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.155+0000 7fe31659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe318103540 0x7fe3180757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52682/0 (socket says 172.21.15.107:52682) 2024-05-10T10:52:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.155+0000 7fe31659c700 1 -- 172.21.15.107:0/3805407776 learned_addr learned my addr 172.21.15.107:0/3805407776 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:52:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.155+0000 7fe316d9d700 1 --2- 172.21.15.107:0/3805407776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe3181095e0 0x7fe318076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.155+0000 7fe315d9b700 1 --2- 172.21.15.107:0/3805407776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe318103f00 0x7fe318075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:14.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.155+0000 7fe31659c700 1 -- 172.21.15.107:0/3805407776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe3181095e0 msgr2=0x7fe318076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.155+0000 7fe31659c700 1 --2- 172.21.15.107:0/3805407776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe3181095e0 0x7fe318076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.155+0000 7fe31659c700 1 -- 172.21.15.107:0/3805407776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe318103f00 msgr2=0x7fe318075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.155+0000 7fe31659c700 1 --2- 172.21.15.107:0/3805407776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe318103f00 0x7fe318075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.155+0000 7fe31659c700 1 -- 172.21.15.107:0/3805407776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3181a8120 con 0x7fe318103540 2024-05-10T10:52:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.155+0000 7fe31659c700 1 --2- 172.21.15.107:0/3805407776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe318103540 0x7fe3180757a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe30800d950 tx=0x7fe30800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.156+0000 7fe3077fe700 1 -- 172.21.15.107:0/3805407776 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe308016070 con 0x7fe318103540 2024-05-10T10:52:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.156+0000 7fe3077fe700 1 -- 172.21.15.107:0/3805407776 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe308009e10 con 0x7fe318103540 2024-05-10T10:52:14.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.156+0000 7fe31cca9700 1 -- 172.21.15.107:0/3805407776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3181a8410 con 0x7fe318103540 2024-05-10T10:52:14.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.156+0000 7fe3077fe700 1 -- 172.21.15.107:0/3805407776 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30800f620 con 0x7fe318103540 2024-05-10T10:52:14.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.156+0000 7fe31cca9700 1 -- 172.21.15.107:0/3805407776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3181a8950 con 0x7fe318103540 2024-05-10T10:52:14.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.157+0000 7fe31cca9700 1 -- 172.21.15.107:0/3805407776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe318104c50 con 0x7fe318103540 2024-05-10T10:52:14.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.159+0000 7fe3077fe700 1 -- 172.21.15.107:0/3805407776 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fe308019070 con 0x7fe318103540 2024-05-10T10:52:14.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.159+0000 7fe3077fe700 1 --2- 172.21.15.107:0/3805407776 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe3000b2880 0x7fe3000b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:14.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.159+0000 7fe315d9b700 1 --2- 172.21.15.107:0/3805407776 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe3000b2880 0x7fe3000b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:14.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.159+0000 7fe3077fe700 1 -- 172.21.15.107:0/3805407776 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7497+0+0 (secure 0 0 0) 0x7fe3080e1af0 con 0x7fe318103540 2024-05-10T10:52:14.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.160+0000 7fe315d9b700 1 --2- 172.21.15.107:0/3805407776 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe3000b2880 0x7fe3000b4d40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe30c006fd0 tx=0x7fe30c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:14.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.163+0000 7fe3077fe700 1 -- 172.21.15.107:0/3805407776 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe3080a9b20 con 0x7fe318103540 2024-05-10T10:52:14.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.372+0000 7fe31cca9700 1 -- 172.21.15.107:0/3805407776 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe31806a190 con 0x7fe318103540 2024-05-10T10:52:14.662 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:14 smithi107 ceph-mon[30373]: osdmap e76: 12 total, 12 up, 12 in 2024-05-10T10:52:14.662 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:14 smithi107 ceph-mon[30373]: pgmap v279: 33 pgs: 12 creating+peering, 1 active+clean, 20 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:14.662 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:14 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3805407776' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-10T10:52:14.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.660+0000 7fe3077fe700 1 -- 172.21.15.107:0/3805407776 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) ==== 170+0+0 (secure 0 0 0) 0x7fe3080a9420 con 0x7fe318103540 2024-05-10T10:52:14.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.663+0000 7fe31cca9700 1 -- 172.21.15.107:0/3805407776 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe3000b2880 msgr2=0x7fe3000b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:14.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.663+0000 7fe31cca9700 1 --2- 172.21.15.107:0/3805407776 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe3000b2880 0x7fe3000b4d40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe30c006fd0 tx=0x7fe30c008040 comp rx=0 tx=0).stop 2024-05-10T10:52:14.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.664+0000 7fe31cca9700 1 -- 172.21.15.107:0/3805407776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe318103540 msgr2=0x7fe3180757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:14.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.664+0000 7fe31cca9700 1 --2- 172.21.15.107:0/3805407776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe318103540 0x7fe3180757a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe30800d950 tx=0x7fe30800dc60 comp rx=0 tx=0).stop 2024-05-10T10:52:14.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.664+0000 7fe31cca9700 1 -- 172.21.15.107:0/3805407776 shutdown_connections 2024-05-10T10:52:14.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.664+0000 7fe31cca9700 1 --2- 172.21.15.107:0/3805407776 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe3000b2880 0x7fe3000b4d40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:14.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.664+0000 7fe31cca9700 1 --2- 172.21.15.107:0/3805407776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe3181095e0 0x7fe318076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:14.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.664+0000 7fe31cca9700 1 --2- 172.21.15.107:0/3805407776 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe318103540 0x7fe3180757a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:14.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.664+0000 7fe31cca9700 1 --2- 172.21.15.107:0/3805407776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe318103f00 0x7fe318075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:14.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.664+0000 7fe31cca9700 1 -- 172.21.15.107:0/3805407776 >> 172.21.15.107:0/3805407776 conn(0x7fe31807a650 msgr2=0x7fe318101ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:14.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.664+0000 7fe31cca9700 1 -- 172.21.15.107:0/3805407776 shutdown_connections 2024-05-10T10:52:14.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:14.664+0000 7fe31cca9700 1 -- 172.21.15.107:0/3805407776 wait complete. 2024-05-10T10:52:14.666 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_data' created 2024-05-10T10:52:14.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:14 smithi196 ceph-mon[34872]: osdmap e76: 12 total, 12 up, 12 in 2024-05-10T10:52:14.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:14 smithi196 ceph-mon[34872]: pgmap v279: 33 pgs: 12 creating+peering, 1 active+clean, 20 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:14.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:14 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3805407776' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-10T10:52:14.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:14 smithi184 ceph-mon[34585]: osdmap e76: 12 total, 12 up, 12 in 2024-05-10T10:52:14.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:14 smithi184 ceph-mon[34585]: pgmap v279: 33 pgs: 12 creating+peering, 1 active+clean, 20 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:14.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:14 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3805407776' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-10T10:52:15.252 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T10:52:15.510 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:52:15.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:15 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3805407776' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-10T10:52:15.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:15 smithi107 ceph-mon[30373]: osdmap e77: 12 total, 12 up, 12 in 2024-05-10T10:52:16.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:15 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3805407776' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-10T10:52:16.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:15 smithi196 ceph-mon[34872]: osdmap e77: 12 total, 12 up, 12 in 2024-05-10T10:52:16.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:15 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3805407776' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-10T10:52:16.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:15 smithi184 ceph-mon[34585]: osdmap e77: 12 total, 12 up, 12 in 2024-05-10T10:52:16.886 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:16 smithi107 ceph-mon[30373]: pgmap v281: 97 pgs: 21 active+clean, 29 creating+peering, 47 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:16.886 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:16 smithi107 ceph-mon[30373]: osdmap e78: 12 total, 12 up, 12 in 2024-05-10T10:52:17.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:16 smithi196 ceph-mon[34872]: pgmap v281: 97 pgs: 21 active+clean, 29 creating+peering, 47 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:17.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:16 smithi196 ceph-mon[34872]: osdmap e78: 12 total, 12 up, 12 in 2024-05-10T10:52:17.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.104+0000 7f95bcad8700 1 -- 172.21.15.107:0/1122227732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95b806c3d0 msgr2=0x7f95b8110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:17.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.104+0000 7f95bcad8700 1 --2- 172.21.15.107:0/1122227732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95b806c3d0 0x7f95b8110320 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f95b000b0a0 tx=0x7f95b000b3b0 comp rx=0 tx=0).stop 2024-05-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.104+0000 7f95bcad8700 1 -- 172.21.15.107:0/1122227732 shutdown_connections 2024-05-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.104+0000 7f95bcad8700 1 --2- 172.21.15.107:0/1122227732 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95b806c3d0 0x7f95b8110320 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.104+0000 7f95bcad8700 1 --2- 172.21.15.107:0/1122227732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95b8109500 0x7f95b81098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.104+0000 7f95bcad8700 1 --2- 172.21.15.107:0/1122227732 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95b806ba10 0x7f95b806be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.104+0000 7f95bcad8700 1 -- 172.21.15.107:0/1122227732 >> 172.21.15.107:0/1122227732 conn(0x7f95b8079310 msgr2=0x7f95b8079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.104+0000 7f95bcad8700 1 -- 172.21.15.107:0/1122227732 shutdown_connections 2024-05-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.104+0000 7f95bcad8700 1 -- 172.21.15.107:0/1122227732 wait complete. 2024-05-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.105+0000 7f95bcad8700 1 Processor -- start 2024-05-10T10:52:17.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.105+0000 7f95bcad8700 1 -- start start 2024-05-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.105+0000 7f95bcad8700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95b806ba10 0x7f95b819f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.105+0000 7f95bcad8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95b806c3d0 0x7f95b819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.105+0000 7f95bcad8700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95b8109500 0x7f95b81999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.105+0000 7f95bcad8700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f95b8113770 con 0x7f95b8109500 2024-05-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.105+0000 7f95bcad8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f95b81135f0 con 0x7f95b806c3d0 2024-05-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.105+0000 7f95bcad8700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f95b81138f0 con 0x7f95b806ba10 2024-05-10T10:52:17.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.105+0000 7f95b6d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95b8109500 0x7f95b81999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.105+0000 7f95b6d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95b8109500 0x7f95b81999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50290/0 (socket says 172.21.15.107:50290) 2024-05-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.105+0000 7f95b6d9d700 1 -- 172.21.15.107:0/983565075 learned_addr learned my addr 172.21.15.107:0/983565075 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.105+0000 7f95b659c700 1 --2- 172.21.15.107:0/983565075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95b806ba10 0x7f95b819f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.106+0000 7f95add9b700 1 --2- 172.21.15.107:0/983565075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95b806c3d0 0x7f95b819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.106+0000 7f95b6d9d700 1 -- 172.21.15.107:0/983565075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95b806ba10 msgr2=0x7f95b819f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.106+0000 7f95b6d9d700 1 --2- 172.21.15.107:0/983565075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95b806ba10 0x7f95b819f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.106+0000 7f95b6d9d700 1 -- 172.21.15.107:0/983565075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95b806c3d0 msgr2=0x7f95b819fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.106+0000 7f95b6d9d700 1 --2- 172.21.15.107:0/983565075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95b806c3d0 0x7f95b819fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.106+0000 7f95b6d9d700 1 -- 172.21.15.107:0/983565075 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b819a130 con 0x7f95b8109500 2024-05-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.106+0000 7f95b6d9d700 1 --2- 172.21.15.107:0/983565075 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95b8109500 0x7f95b81999d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95b000b070 tx=0x7f95b0007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.106+0000 7f95affff700 1 -- 172.21.15.107:0/983565075 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b0021070 con 0x7f95b8109500 2024-05-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.106+0000 7f95bcad8700 1 -- 172.21.15.107:0/983565075 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b819a3c0 con 0x7f95b8109500 2024-05-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.106+0000 7f95affff700 1 -- 172.21.15.107:0/983565075 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f95b001db20 con 0x7f95b8109500 2024-05-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.106+0000 7f95affff700 1 -- 172.21.15.107:0/983565075 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b001bb50 con 0x7f95b8109500 2024-05-10T10:52:17.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.106+0000 7f95bcad8700 1 -- 172.21.15.107:0/983565075 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b81a66e0 con 0x7f95b8109500 2024-05-10T10:52:17.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.107+0000 7f95bcad8700 1 -- 172.21.15.107:0/983565075 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b806a190 con 0x7f95b8109500 2024-05-10T10:52:17.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.109+0000 7f95affff700 1 -- 172.21.15.107:0/983565075 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f95b0024070 con 0x7f95b8109500 2024-05-10T10:52:17.110 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.110+0000 7f95affff700 1 --2- 172.21.15.107:0/983565075 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f95a40b2880 0x7f95a40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:17.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.110+0000 7f95b659c700 1 --2- 172.21.15.107:0/983565075 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f95a40b2880 0x7f95a40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:17.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.110+0000 7f95affff700 1 -- 172.21.15.107:0/983565075 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7f95b000f020 con 0x7f95b8109500 2024-05-10T10:52:17.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.110+0000 7f95b659c700 1 --2- 172.21.15.107:0/983565075 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f95a40b2880 0x7f95a40b4d40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f95a8005950 tx=0x7f95a800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:17.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.113+0000 7f95affff700 1 -- 172.21.15.107:0/983565075 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f95b002b020 con 0x7f95b8109500 2024-05-10T10:52:17.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:16 smithi184 ceph-mon[34585]: pgmap v281: 97 pgs: 21 active+clean, 29 creating+peering, 47 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:17.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:16 smithi184 ceph-mon[34585]: osdmap e78: 12 total, 12 up, 12 in 2024-05-10T10:52:17.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.366+0000 7f95bcad8700 1 -- 172.21.15.107:0/983565075 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f95b802e510 con 0x7f95b8109500 2024-05-10T10:52:17.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.680+0000 7f95affff700 1 -- 172.21.15.107:0/983565075 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f95b00abcf0 con 0x7f95b8109500 2024-05-10T10:52:17.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.683+0000 7f95bcad8700 1 -- 172.21.15.107:0/983565075 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f95a40b2880 msgr2=0x7f95a40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:17.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.683+0000 7f95bcad8700 1 --2- 172.21.15.107:0/983565075 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f95a40b2880 0x7f95a40b4d40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f95a8005950 tx=0x7f95a800a300 comp rx=0 tx=0).stop 2024-05-10T10:52:17.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.683+0000 7f95bcad8700 1 -- 172.21.15.107:0/983565075 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95b8109500 msgr2=0x7f95b81999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:17.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.683+0000 7f95bcad8700 1 --2- 172.21.15.107:0/983565075 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95b8109500 0x7f95b81999d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95b000b070 tx=0x7f95b0007a20 comp rx=0 tx=0).stop 2024-05-10T10:52:17.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.683+0000 7f95bcad8700 1 -- 172.21.15.107:0/983565075 shutdown_connections 2024-05-10T10:52:17.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.683+0000 7f95bcad8700 1 --2- 172.21.15.107:0/983565075 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f95a40b2880 0x7f95a40b4d40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:17.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.683+0000 7f95bcad8700 1 --2- 172.21.15.107:0/983565075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f95b806ba10 0x7f95b819f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:17.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.683+0000 7f95bcad8700 1 --2- 172.21.15.107:0/983565075 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f95b8109500 0x7f95b81999d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:17.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.683+0000 7f95bcad8700 1 --2- 172.21.15.107:0/983565075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95b806c3d0 0x7f95b819fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:17.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.683+0000 7f95bcad8700 1 -- 172.21.15.107:0/983565075 >> 172.21.15.107:0/983565075 conn(0x7f95b8079310 msgr2=0x7f95b8100f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:17.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.683+0000 7f95bcad8700 1 -- 172.21.15.107:0/983565075 shutdown_connections 2024-05-10T10:52:17.684 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:17.683+0000 7f95bcad8700 1 -- 172.21.15.107:0/983565075 wait complete. 2024-05-10T10:52:17.685 INFO:teuthology.orchestra.run.smithi107.stderr:new fs with metadata pool 2 and data pool 3 2024-05-10T10:52:18.030 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:17 smithi107 ceph-mon[30373]: osdmap e79: 12 total, 12 up, 12 in 2024-05-10T10:52:18.030 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:17 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/983565075' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-10T10:52:18.030 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:17 smithi107 ceph-mon[30373]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-10T10:52:18.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:17 smithi196 ceph-mon[34872]: osdmap e79: 12 total, 12 up, 12 in 2024-05-10T10:52:18.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:17 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/983565075' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-10T10:52:18.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:17 smithi196 ceph-mon[34872]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-10T10:52:18.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:17 smithi184 ceph-mon[34585]: osdmap e79: 12 total, 12 up, 12 in 2024-05-10T10:52:18.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:17 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/983565075' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-10T10:52:18.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:17 smithi184 ceph-mon[34585]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-10T10:52:18.340 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-10T10:52:18.583 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:52:19.008 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:18 smithi107 ceph-mon[30373]: pgmap v284: 97 pgs: 51 active+clean, 17 creating+peering, 29 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:19.008 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:18 smithi107 ceph-mon[30373]: osdmap e80: 12 total, 12 up, 12 in 2024-05-10T10:52:19.009 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:18 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/983565075' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-10T10:52:19.009 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:18 smithi107 ceph-mon[30373]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-10T10:52:19.009 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:18 smithi107 ceph-mon[30373]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-10T10:52:19.009 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:18 smithi107 ceph-mon[30373]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-10T10:52:19.009 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:18 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] up:active 2024-05-10T10:52:19.009 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:18 smithi107 ceph-mon[30373]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T10:52:19.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:18 smithi196 ceph-mon[34872]: pgmap v284: 97 pgs: 51 active+clean, 17 creating+peering, 29 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:19.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:18 smithi196 ceph-mon[34872]: osdmap e80: 12 total, 12 up, 12 in 2024-05-10T10:52:19.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:18 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/983565075' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-10T10:52:19.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:18 smithi196 ceph-mon[34872]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-10T10:52:19.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:18 smithi196 ceph-mon[34872]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-10T10:52:19.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:18 smithi196 ceph-mon[34872]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-10T10:52:19.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:18 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] up:active 2024-05-10T10:52:19.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:18 smithi196 ceph-mon[34872]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T10:52:19.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:18 smithi184 ceph-mon[34585]: pgmap v284: 97 pgs: 51 active+clean, 17 creating+peering, 29 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T10:52:19.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:18 smithi184 ceph-mon[34585]: osdmap e80: 12 total, 12 up, 12 in 2024-05-10T10:52:19.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:18 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/983565075' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-10T10:52:19.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:18 smithi184 ceph-mon[34585]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-10T10:52:19.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:18 smithi184 ceph-mon[34585]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-10T10:52:19.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:18 smithi184 ceph-mon[34585]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-10T10:52:19.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:18 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] up:active 2024-05-10T10:52:19.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:18 smithi184 ceph-mon[34585]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T10:52:19.906 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:19 smithi107 ceph-mon[30373]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-10T10:52:19.906 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:19 smithi107 ceph-mon[30373]: Cluster is now healthy 2024-05-10T10:52:20.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:19 smithi196 ceph-mon[34872]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-10T10:52:20.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:19 smithi196 ceph-mon[34872]: Cluster is now healthy 2024-05-10T10:52:20.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.117+0000 7f71b14d4700 1 -- 172.21.15.107:0/641681731 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71ac1081b0 msgr2=0x7f71ac108630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:20.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.117+0000 7f71b14d4700 1 --2- 172.21.15.107:0/641681731 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71ac1081b0 0x7f71ac108630 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f71a00099c0 tx=0x7f71a0009cd0 comp rx=0 tx=0).stop 2024-05-10T10:52:20.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.117+0000 7f71b14d4700 1 -- 172.21.15.107:0/641681731 shutdown_connections 2024-05-10T10:52:20.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.117+0000 7f71b14d4700 1 --2- 172.21.15.107:0/641681731 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71ac108b70 0x7f71ac10f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:20.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.117+0000 7f71b14d4700 1 --2- 172.21.15.107:0/641681731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71ac106340 0x7f71ac106720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:20.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.117+0000 7f71b14d4700 1 --2- 172.21.15.107:0/641681731 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71ac1081b0 0x7f71ac108630 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:20.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.117+0000 7f71b14d4700 1 -- 172.21.15.107:0/641681731 >> 172.21.15.107:0/641681731 conn(0x7f71ac0776c0 msgr2=0x7f71ac077ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:20.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.117+0000 7f71b14d4700 1 -- 172.21.15.107:0/641681731 shutdown_connections 2024-05-10T10:52:20.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.117+0000 7f71b14d4700 1 -- 172.21.15.107:0/641681731 wait complete. 2024-05-10T10:52:20.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.118+0000 7f71b14d4700 1 Processor -- start 2024-05-10T10:52:20.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.118+0000 7f71b14d4700 1 -- start start 2024-05-10T10:52:20.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.118+0000 7f71b14d4700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71ac106340 0x7f71ac19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:20.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.118+0000 7f71b14d4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71ac1081b0 0x7f71ac19afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:20.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.118+0000 7f71b14d4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71ac108b70 0x7f71ac1a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:20.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.118+0000 7f71b14d4700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac112790 con 0x7f71ac108b70 2024-05-10T10:52:20.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.118+0000 7f71b14d4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac112610 con 0x7f71ac1081b0 2024-05-10T10:52:20.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.118+0000 7f71b14d4700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac112910 con 0x7f71ac106340 2024-05-10T10:52:20.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.119+0000 7f71ab7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71ac108b70 0x7f71ac1a5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:20.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.119+0000 7f71ab7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71ac108b70 0x7f71ac1a5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50306/0 (socket says 172.21.15.107:50306) 2024-05-10T10:52:20.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.119+0000 7f71ab7fe700 1 -- 172.21.15.107:0/1213950409 learned_addr learned my addr 172.21.15.107:0/1213950409 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:52:20.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.119+0000 7f71aaffd700 1 --2- 172.21.15.107:0/1213950409 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71ac106340 0x7f71ac19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:20.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.119+0000 7f71aa7fc700 1 --2- 172.21.15.107:0/1213950409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71ac1081b0 0x7f71ac19afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:20.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.119+0000 7f71ab7fe700 1 -- 172.21.15.107:0/1213950409 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71ac106340 msgr2=0x7f71ac19aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:20.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.119+0000 7f71ab7fe700 1 --2- 172.21.15.107:0/1213950409 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71ac106340 0x7f71ac19aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:20.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.119+0000 7f71ab7fe700 1 -- 172.21.15.107:0/1213950409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71ac1081b0 msgr2=0x7f71ac19afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:20.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.119+0000 7f71ab7fe700 1 --2- 172.21.15.107:0/1213950409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71ac1081b0 0x7f71ac19afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:20.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.119+0000 7f71ab7fe700 1 -- 172.21.15.107:0/1213950409 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ac1a6050 con 0x7f71ac108b70 2024-05-10T10:52:20.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.119+0000 7f71ab7fe700 1 --2- 172.21.15.107:0/1213950409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71ac108b70 0x7f71ac1a5b10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f71a4007ee0 tx=0x7f71a400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:20.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.119+0000 7f7193fff700 1 -- 172.21.15.107:0/1213950409 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a400dbd0 con 0x7f71ac108b70 2024-05-10T10:52:20.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.119+0000 7f71b14d4700 1 -- 172.21.15.107:0/1213950409 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71ac1a6280 con 0x7f71ac108b70 2024-05-10T10:52:20.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.119+0000 7f7193fff700 1 -- 172.21.15.107:0/1213950409 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f71a400dd70 con 0x7f71ac108b70 2024-05-10T10:52:20.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.119+0000 7f7193fff700 1 -- 172.21.15.107:0/1213950409 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4005a50 con 0x7f71ac108b70 2024-05-10T10:52:20.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.119+0000 7f71b14d4700 1 -- 172.21.15.107:0/1213950409 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71ac1a6790 con 0x7f71ac108b70 2024-05-10T10:52:20.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.120+0000 7f71b14d4700 1 -- 172.21.15.107:0/1213950409 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71ac06a190 con 0x7f71ac108b70 2024-05-10T10:52:20.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.122+0000 7f7193fff700 1 -- 172.21.15.107:0/1213950409 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f71a401a020 con 0x7f71ac108b70 2024-05-10T10:52:20.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.122+0000 7f7193fff700 1 --2- 172.21.15.107:0/1213950409 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f71940b2a20 0x7f71940b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:20.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.122+0000 7f71aaffd700 1 --2- 172.21.15.107:0/1213950409 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f71940b2a20 0x7f71940b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:20.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.122+0000 7f7193fff700 1 -- 172.21.15.107:0/1213950409 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f71a40e1e00 con 0x7f71ac108b70 2024-05-10T10:52:20.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.123+0000 7f71aaffd700 1 --2- 172.21.15.107:0/1213950409 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f71940b2a20 0x7f71940b4ee0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f719c005950 tx=0x7f719c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:20.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.126+0000 7f7193fff700 1 -- 172.21.15.107:0/1213950409 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f71a4010070 con 0x7f71ac108b70 2024-05-10T10:52:20.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:19 smithi184 ceph-mon[34585]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-10T10:52:20.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:19 smithi184 ceph-mon[34585]: Cluster is now healthy 2024-05-10T10:52:20.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.336+0000 7f71b14d4700 1 -- 172.21.15.107:0/1213950409 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71ac02e510 con 0x7f71ac108b70 2024-05-10T10:52:20.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.337+0000 7f7193fff700 1 -- 172.21.15.107:0/1213950409 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22277 (secure 0 0 0) 0x7f71a40a9c70 con 0x7f71ac108b70 2024-05-10T10:52:20.338 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:52:20.339 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":80,"fsid":"0ba8a8e4-0eba-11ef-bc98-c7b262605968","created":"2024-05-10T10:44:13.064379+0000","modified":"2024-05-10T10:52:17.367774+0000","last_up_change":"2024-05-10T10:51:12.979718+0000","last_in_change":"2024-05-10T10:50:53.297651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T10:47:31.600062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T10:52:10.705022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T10:52:14.377732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"503f960c-a74b-4979-9bf9-42c90a2885a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6803","nonce":4213004004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6805","nonce":4213004004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6809","nonce":4213004004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6807","nonce":4213004004}]},"public_addr":"172.21.15.107:6803/4213004004","cluster_addr":"172.21.15.107:6805/4213004004","heartbeat_back_addr":"172.21.15.107:6809/4213004004","heartbeat_front_addr":"172.21.15.107:6807/4213004004","state":["exists","up"]},{"osd":1,"uuid":"f0f89167-1aa1-40a1-b122-c7f203c587d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6801","nonce":3242825160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6803","nonce":3242825160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6807","nonce":3242825160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6805","nonce":3242825160}]},"public_addr":"172.21.15.184:6801/3242825160","cluster_addr":"172.21.15.184:6803/3242825160","heartbeat_back_addr":"172.21.15.184:6807/3242825160","heartbeat_front_addr":"172.21.15.184:6805/3242825160","state":["exists","up"]},{"osd":2,"uuid":"7588b9be-b935-450a-944f-3feca69c029c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6801","nonce":137473043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6803","nonce":137473043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6807","nonce":137473043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6805","nonce":137473043}]},"public_addr":"172.21.15.196:6801/137473043","cluster_addr":"172.21.15.196:6803/137473043","heartbeat_back_addr":"172.21.15.196:6807/137473043","heartbeat_front_addr":"172.21.15.196:6805/137473043","state":["exists","up"]},{"osd":3,"uuid":"589ec3bb-884a-4441-a9d2-1f34ab372cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6811","nonce":1995642021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6813","nonce":1995642021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6817","nonce":1995642021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6815","nonce":1995642021}]},"public_addr":"172.21.15.107:6811/1995642021","cluster_addr":"172.21.15.107:6813/1995642021","heartbeat_back_addr":"172.21.15.107:6817/1995642021","heartbeat_front_addr":"172.21.15.107:6815/1995642021","state":["exists","up"]},{"osd":4,"uuid":"b72cdb50-492b-4406-8f21-37e4b2cf5a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6809","nonce":271550329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6811","nonce":271550329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6815","nonce":271550329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6813","nonce":271550329}]},"public_addr":"172.21.15.184:6809/271550329","cluster_addr":"172.21.15.184:6811/271550329","heartbeat_back_addr":"172.21.15.184:6815/271550329","heartbeat_front_addr":"172.21.15.184:6813/271550329","state":["exists","up"]},{"osd":5,"uuid":"05b6ad82-9153-44df-ae64-50c82d304429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6809","nonce":3681130435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6811","nonce":3681130435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6815","nonce":3681130435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6813","nonce":3681130435}]},"public_addr":"172.21.15.196:6809/3681130435","cluster_addr":"172.21.15.196:6811/3681130435","heartbeat_back_addr":"172.21.15.196:6815/3681130435","heartbeat_front_addr":"172.21.15.196:6813/3681130435","state":["exists","up"]},{"osd":6,"uuid":"bceadd7a-20bf-4482-aaab-46a2539cf37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6819","nonce":4223253757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6821","nonce":4223253757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6825","nonce":4223253757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6823","nonce":4223253757}]},"public_addr":"172.21.15.107:6819/4223253757","cluster_addr":"172.21.15.107:6821/4223253757","heartbeat_back_addr":"172.21.15.107:6825/4223253757","heartbeat_front_addr":"172.21.15.107:6823/4223253757","state":["exists","up"]},{"osd":7,"uuid":"0d9243a6-0e16-4677-a0b0-010be4162148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6817","nonce":2850715284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6819","nonce":2850715284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6823","nonce":2850715284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6821","nonce":2850715284}]},"public_addr":"172.21.15.184:6817/2850715284","cluster_addr":"172.21.15.184:6819/2850715284","heartbeat_back_addr":"172.21.15.184:6823/2850715284","heartbeat_front_addr":"172.21.15.184:6821/2850715284","state":["exists","up"]},{"osd":8,"uuid":"24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6817","nonce":504426486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6819","nonce":504426486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6823","nonce":504426486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6821","nonce":504426486}]},"public_addr":"172.21.15.196:6817/504426486","cluster_addr":"172.21.15.196:6819/504426486","heartbeat_back_addr":"172.21.15.196:6823/504426486","heartbeat_front_addr":"172.21.15.196:6821/504426486","state":["exists","up"]},{"osd":9,"uuid":"8bcb03ec-1342-4679-9343-fcefd28dd69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6827","nonce":1533051760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6829","nonce":1533051760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6833","nonce":1533051760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6831","nonce":1533051760}]},"public_addr":"172.21.15.107:6827/1533051760","cluster_addr":"172.21.15.107:6829/1533051760","heartbeat_back_addr":"172.21.15.107:6833/1533051760","heartbeat_front_addr":"172.21.15.107:6831/1533051760","state":["exists","up"]},{"osd":10,"uuid":"78374015-aa7f-4288-b5ae-be64a5182bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6825","nonce":1387541139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6827","nonce":1387541139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6831","nonce":1387541139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6829","nonce":1387541139}]},"public_addr":"172.21.15.184:6825/1387541139","cluster_addr":"172.21.15.184:6827/1387541139","heartbeat_back_addr":"172.21.15.184:6831/1387541139","heartbeat_front_addr":"172.21.15.184:6829/1387541139","state":["exists","up"]},{"osd":11,"uuid":"4aeb2b1a-f35e-44ea-be64-f60c31a096e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6825","nonce":3861964533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6827","nonce":3861964533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6831","nonce":3861964533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6829","nonce":3861964533}]},"public_addr":"172.21.15.196:6825/3861964533","cluster_addr":"172.21.15.196:6827/3861964533","heartbeat_back_addr":"172.21.15.196:6831/3861964533","heartbeat_front_addr":"172.21.15.196:6829/3861964533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:46:42.110232+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:06.232727+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:29.623425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:53.466546+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:17.927564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:41.913454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:06.610629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:31.048807+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:54.922097+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:20.727547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:46.072303+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:51:11.022775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:0/3518338734":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/4092342993":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6800/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:6800/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3761740075":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/2215024983":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/2124974715":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3361930986":"2024-05-11T10:44:40.339608+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T10:52:20.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.339+0000 7f71b14d4700 1 -- 172.21.15.107:0/1213950409 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f71940b2a20 msgr2=0x7f71940b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:20.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.339+0000 7f71b14d4700 1 --2- 172.21.15.107:0/1213950409 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f71940b2a20 0x7f71940b4ee0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f719c005950 tx=0x7f719c00b410 comp rx=0 tx=0).stop 2024-05-10T10:52:20.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.340+0000 7f71b14d4700 1 -- 172.21.15.107:0/1213950409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71ac108b70 msgr2=0x7f71ac1a5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:20.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.340+0000 7f71b14d4700 1 --2- 172.21.15.107:0/1213950409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71ac108b70 0x7f71ac1a5b10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f71a4007ee0 tx=0x7f71a400d3b0 comp rx=0 tx=0).stop 2024-05-10T10:52:20.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.340+0000 7f71b14d4700 1 -- 172.21.15.107:0/1213950409 shutdown_connections 2024-05-10T10:52:20.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.340+0000 7f71b14d4700 1 --2- 172.21.15.107:0/1213950409 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f71940b2a20 0x7f71940b4ee0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:20.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.340+0000 7f71b14d4700 1 --2- 172.21.15.107:0/1213950409 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f71ac106340 0x7f71ac19aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:20.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.340+0000 7f71b14d4700 1 --2- 172.21.15.107:0/1213950409 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f71ac108b70 0x7f71ac1a5b10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:20.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.340+0000 7f71b14d4700 1 --2- 172.21.15.107:0/1213950409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71ac1081b0 0x7f71ac19afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:20.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.340+0000 7f71b14d4700 1 -- 172.21.15.107:0/1213950409 >> 172.21.15.107:0/1213950409 conn(0x7f71ac0776c0 msgr2=0x7f71ac0ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:20.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.340+0000 7f71b14d4700 1 -- 172.21.15.107:0/1213950409 shutdown_connections 2024-05-10T10:52:20.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:20.340+0000 7f71b14d4700 1 -- 172.21.15.107:0/1213950409 wait complete. 2024-05-10T10:52:20.945 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:20 smithi107 ceph-mon[30373]: pgmap v286: 97 pgs: 80 active+clean, 17 creating+peering; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 207 B/s wr, 1 op/s 2024-05-10T10:52:20.946 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:20 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1213950409' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:52:20.947 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-10T10:52:21.040 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:20 smithi184 ceph-mon[34585]: pgmap v286: 97 pgs: 80 active+clean, 17 creating+peering; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 207 B/s wr, 1 op/s 2024-05-10T10:52:21.040 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:20 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1213950409' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:52:21.062 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:20 smithi196 ceph-mon[34872]: pgmap v286: 97 pgs: 80 active+clean, 17 creating+peering; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 207 B/s wr, 1 op/s 2024-05-10T10:52:21.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:20 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1213950409' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:52:21.189 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:52:22.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.799+0000 7f42eb4c5700 1 -- 172.21.15.107:0/3909617590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42e4103560 msgr2=0x7f42e41039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:22.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.799+0000 7f42eb4c5700 1 --2- 172.21.15.107:0/3909617590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42e4103560 0x7f42e41039e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f42d40099c0 tx=0x7f42d4009cd0 comp rx=0 tx=0).stop 2024-05-10T10:52:22.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.799+0000 7f42eb4c5700 1 -- 172.21.15.107:0/3909617590 shutdown_connections 2024-05-10T10:52:22.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.799+0000 7f42eb4c5700 1 --2- 172.21.15.107:0/3909617590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42e4109540 0x7f42e4109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:22.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.799+0000 7f42eb4c5700 1 --2- 172.21.15.107:0/3909617590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42e4103f20 0x7f42e4110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:22.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.799+0000 7f42eb4c5700 1 --2- 172.21.15.107:0/3909617590 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42e4103560 0x7f42e41039e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:22.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.799+0000 7f42eb4c5700 1 -- 172.21.15.107:0/3909617590 >> 172.21.15.107:0/3909617590 conn(0x7f42e407a660 msgr2=0x7f42e407aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:22.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.800+0000 7f42eb4c5700 1 -- 172.21.15.107:0/3909617590 shutdown_connections 2024-05-10T10:52:22.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.800+0000 7f42eb4c5700 1 -- 172.21.15.107:0/3909617590 wait complete. 2024-05-10T10:52:22.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.800+0000 7f42eb4c5700 1 Processor -- start 2024-05-10T10:52:22.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.800+0000 7f42eb4c5700 1 -- start start 2024-05-10T10:52:22.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.800+0000 7f42eb4c5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42e4103560 0x7f42e419f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:22.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.800+0000 7f42eb4c5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42e4103f20 0x7f42e419fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:22.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.800+0000 7f42eb4c5700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42e4109540 0x7f42e4199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:22.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.800+0000 7f42eb4c5700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f42e4113830 con 0x7f42e4103f20 2024-05-10T10:52:22.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.800+0000 7f42eb4c5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f42e41136b0 con 0x7f42e4103560 2024-05-10T10:52:22.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.800+0000 7f42eb4c5700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f42e41139b0 con 0x7f42e4109540 2024-05-10T10:52:22.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.800+0000 7f42e8a60700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42e4103f20 0x7f42e419fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:22.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.800+0000 7f42e8a60700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42e4103f20 0x7f42e419fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50324/0 (socket says 172.21.15.107:50324) 2024-05-10T10:52:22.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.800+0000 7f42e8a60700 1 -- 172.21.15.107:0/3187946677 learned_addr learned my addr 172.21.15.107:0/3187946677 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:52:22.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.801+0000 7f42e9261700 1 --2- 172.21.15.107:0/3187946677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42e4103560 0x7f42e419f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:22.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.801+0000 7f42e9a62700 1 --2- 172.21.15.107:0/3187946677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42e4109540 0x7f42e4199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:22.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.801+0000 7f42e8a60700 1 -- 172.21.15.107:0/3187946677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42e4109540 msgr2=0x7f42e4199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:22.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.801+0000 7f42e8a60700 1 --2- 172.21.15.107:0/3187946677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42e4109540 0x7f42e4199b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:22.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.801+0000 7f42e8a60700 1 -- 172.21.15.107:0/3187946677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42e4103560 msgr2=0x7f42e419f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:22.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.801+0000 7f42e8a60700 1 --2- 172.21.15.107:0/3187946677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42e4103560 0x7f42e419f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:22.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.801+0000 7f42e8a60700 1 -- 172.21.15.107:0/3187946677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e419a2b0 con 0x7f42e4103f20 2024-05-10T10:52:22.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.801+0000 7f42e9261700 1 --2- 172.21.15.107:0/3187946677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42e4103560 0x7f42e419f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:52:22.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.801+0000 7f42e8a60700 1 --2- 172.21.15.107:0/3187946677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42e4103f20 0x7f42e419fe80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009990 tx=0x7f42d40037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:22.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.801+0000 7f42da7fc700 1 -- 172.21.15.107:0/3187946677 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d4027070 con 0x7f42e4103f20 2024-05-10T10:52:22.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.801+0000 7f42da7fc700 1 -- 172.21.15.107:0/3187946677 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f42d40041a0 con 0x7f42e4103f20 2024-05-10T10:52:22.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.801+0000 7f42eb4c5700 1 -- 172.21.15.107:0/3187946677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e419a540 con 0x7f42e4103f20 2024-05-10T10:52:22.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.801+0000 7f42da7fc700 1 -- 172.21.15.107:0/3187946677 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d400f460 con 0x7f42e4103f20 2024-05-10T10:52:22.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.801+0000 7f42eb4c5700 1 -- 172.21.15.107:0/3187946677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e41a6810 con 0x7f42e4103f20 2024-05-10T10:52:22.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.802+0000 7f42eb4c5700 1 -- 172.21.15.107:0/3187946677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e406a190 con 0x7f42e4103f20 2024-05-10T10:52:22.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.803+0000 7f42da7fc700 1 -- 172.21.15.107:0/3187946677 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f42d402a070 con 0x7f42e4103f20 2024-05-10T10:52:22.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.804+0000 7f42da7fc700 1 --2- 172.21.15.107:0/3187946677 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f42d00b2900 0x7f42d00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:22.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.804+0000 7f42e9261700 1 --2- 172.21.15.107:0/3187946677 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f42d00b2900 0x7f42d00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:22.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.804+0000 7f42da7fc700 1 -- 172.21.15.107:0/3187946677 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f42d40e3550 con 0x7f42e4103f20 2024-05-10T10:52:22.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.805+0000 7f42e9261700 1 --2- 172.21.15.107:0/3187946677 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f42d00b2900 0x7f42d00b4dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f42e0005fd0 tx=0x7f42e0005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:22.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:22.808+0000 7f42da7fc700 1 -- 172.21.15.107:0/3187946677 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f42d4031070 con 0x7f42e4103f20 2024-05-10T10:52:22.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:22 smithi107 ceph-mon[30373]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 3 op/s 2024-05-10T10:52:23.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:23.018+0000 7f42eb4c5700 1 -- 172.21.15.107:0/3187946677 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42e402e510 con 0x7f42e4103f20 2024-05-10T10:52:23.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:23.020+0000 7f42da7fc700 1 -- 172.21.15.107:0/3187946677 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22277 (secure 0 0 0) 0x7f42d4013070 con 0x7f42e4103f20 2024-05-10T10:52:23.021 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:52:23.021 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":80,"fsid":"0ba8a8e4-0eba-11ef-bc98-c7b262605968","created":"2024-05-10T10:44:13.064379+0000","modified":"2024-05-10T10:52:17.367774+0000","last_up_change":"2024-05-10T10:51:12.979718+0000","last_in_change":"2024-05-10T10:50:53.297651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T10:47:31.600062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T10:52:10.705022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T10:52:14.377732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"503f960c-a74b-4979-9bf9-42c90a2885a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6803","nonce":4213004004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6805","nonce":4213004004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6809","nonce":4213004004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6807","nonce":4213004004}]},"public_addr":"172.21.15.107:6803/4213004004","cluster_addr":"172.21.15.107:6805/4213004004","heartbeat_back_addr":"172.21.15.107:6809/4213004004","heartbeat_front_addr":"172.21.15.107:6807/4213004004","state":["exists","up"]},{"osd":1,"uuid":"f0f89167-1aa1-40a1-b122-c7f203c587d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6801","nonce":3242825160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6803","nonce":3242825160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6807","nonce":3242825160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6805","nonce":3242825160}]},"public_addr":"172.21.15.184:6801/3242825160","cluster_addr":"172.21.15.184:6803/3242825160","heartbeat_back_addr":"172.21.15.184:6807/3242825160","heartbeat_front_addr":"172.21.15.184:6805/3242825160","state":["exists","up"]},{"osd":2,"uuid":"7588b9be-b935-450a-944f-3feca69c029c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6801","nonce":137473043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6803","nonce":137473043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6807","nonce":137473043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6805","nonce":137473043}]},"public_addr":"172.21.15.196:6801/137473043","cluster_addr":"172.21.15.196:6803/137473043","heartbeat_back_addr":"172.21.15.196:6807/137473043","heartbeat_front_addr":"172.21.15.196:6805/137473043","state":["exists","up"]},{"osd":3,"uuid":"589ec3bb-884a-4441-a9d2-1f34ab372cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6811","nonce":1995642021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6813","nonce":1995642021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6817","nonce":1995642021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6815","nonce":1995642021}]},"public_addr":"172.21.15.107:6811/1995642021","cluster_addr":"172.21.15.107:6813/1995642021","heartbeat_back_addr":"172.21.15.107:6817/1995642021","heartbeat_front_addr":"172.21.15.107:6815/1995642021","state":["exists","up"]},{"osd":4,"uuid":"b72cdb50-492b-4406-8f21-37e4b2cf5a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6809","nonce":271550329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6811","nonce":271550329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6815","nonce":271550329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6813","nonce":271550329}]},"public_addr":"172.21.15.184:6809/271550329","cluster_addr":"172.21.15.184:6811/271550329","heartbeat_back_addr":"172.21.15.184:6815/271550329","heartbeat_front_addr":"172.21.15.184:6813/271550329","state":["exists","up"]},{"osd":5,"uuid":"05b6ad82-9153-44df-ae64-50c82d304429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6809","nonce":3681130435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6811","nonce":3681130435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6815","nonce":3681130435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6813","nonce":3681130435}]},"public_addr":"172.21.15.196:6809/3681130435","cluster_addr":"172.21.15.196:6811/3681130435","heartbeat_back_addr":"172.21.15.196:6815/3681130435","heartbeat_front_addr":"172.21.15.196:6813/3681130435","state":["exists","up"]},{"osd":6,"uuid":"bceadd7a-20bf-4482-aaab-46a2539cf37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6819","nonce":4223253757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6821","nonce":4223253757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6825","nonce":4223253757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6823","nonce":4223253757}]},"public_addr":"172.21.15.107:6819/4223253757","cluster_addr":"172.21.15.107:6821/4223253757","heartbeat_back_addr":"172.21.15.107:6825/4223253757","heartbeat_front_addr":"172.21.15.107:6823/4223253757","state":["exists","up"]},{"osd":7,"uuid":"0d9243a6-0e16-4677-a0b0-010be4162148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6817","nonce":2850715284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6819","nonce":2850715284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6823","nonce":2850715284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6821","nonce":2850715284}]},"public_addr":"172.21.15.184:6817/2850715284","cluster_addr":"172.21.15.184:6819/2850715284","heartbeat_back_addr":"172.21.15.184:6823/2850715284","heartbeat_front_addr":"172.21.15.184:6821/2850715284","state":["exists","up"]},{"osd":8,"uuid":"24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6817","nonce":504426486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6819","nonce":504426486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6823","nonce":504426486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6821","nonce":504426486}]},"public_addr":"172.21.15.196:6817/504426486","cluster_addr":"172.21.15.196:6819/504426486","heartbeat_back_addr":"172.21.15.196:6823/504426486","heartbeat_front_addr":"172.21.15.196:6821/504426486","state":["exists","up"]},{"osd":9,"uuid":"8bcb03ec-1342-4679-9343-fcefd28dd69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6827","nonce":1533051760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6829","nonce":1533051760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6833","nonce":1533051760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6831","nonce":1533051760}]},"public_addr":"172.21.15.107:6827/1533051760","cluster_addr":"172.21.15.107:6829/1533051760","heartbeat_back_addr":"172.21.15.107:6833/1533051760","heartbeat_front_addr":"172.21.15.107:6831/1533051760","state":["exists","up"]},{"osd":10,"uuid":"78374015-aa7f-4288-b5ae-be64a5182bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6825","nonce":1387541139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6827","nonce":1387541139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6831","nonce":1387541139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6829","nonce":1387541139}]},"public_addr":"172.21.15.184:6825/1387541139","cluster_addr":"172.21.15.184:6827/1387541139","heartbeat_back_addr":"172.21.15.184:6831/1387541139","heartbeat_front_addr":"172.21.15.184:6829/1387541139","state":["exists","up"]},{"osd":11,"uuid":"4aeb2b1a-f35e-44ea-be64-f60c31a096e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6825","nonce":3861964533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6827","nonce":3861964533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6831","nonce":3861964533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6829","nonce":3861964533}]},"public_addr":"172.21.15.196:6825/3861964533","cluster_addr":"172.21.15.196:6827/3861964533","heartbeat_back_addr":"172.21.15.196:6831/3861964533","heartbeat_front_addr":"172.21.15.196:6829/3861964533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:46:42.110232+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:06.232727+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:29.623425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:53.466546+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:17.927564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:41.913454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:06.610629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:31.048807+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:54.922097+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:20.727547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:46.072303+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:51:11.022775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:0/3518338734":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/4092342993":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6800/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:6800/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3761740075":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/2215024983":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/2124974715":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3361930986":"2024-05-11T10:44:40.339608+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T10:52:23.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:23.022+0000 7f42eb4c5700 1 -- 172.21.15.107:0/3187946677 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f42d00b2900 msgr2=0x7f42d00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:23.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:23.022+0000 7f42eb4c5700 1 --2- 172.21.15.107:0/3187946677 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f42d00b2900 0x7f42d00b4dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f42e0005fd0 tx=0x7f42e0005dc0 comp rx=0 tx=0).stop 2024-05-10T10:52:23.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:23.022+0000 7f42eb4c5700 1 -- 172.21.15.107:0/3187946677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42e4103f20 msgr2=0x7f42e419fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:23.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:23.022+0000 7f42eb4c5700 1 --2- 172.21.15.107:0/3187946677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42e4103f20 0x7f42e419fe80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009990 tx=0x7f42d40037a0 comp rx=0 tx=0).stop 2024-05-10T10:52:23.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:23.022+0000 7f42eb4c5700 1 -- 172.21.15.107:0/3187946677 shutdown_connections 2024-05-10T10:52:23.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:23.022+0000 7f42eb4c5700 1 --2- 172.21.15.107:0/3187946677 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f42d00b2900 0x7f42d00b4dc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:23.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:23.022+0000 7f42eb4c5700 1 --2- 172.21.15.107:0/3187946677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42e4109540 0x7f42e4199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:23.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:23.022+0000 7f42eb4c5700 1 --2- 172.21.15.107:0/3187946677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42e4103560 0x7f42e419f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:23.023 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:23.022+0000 7f42eb4c5700 1 --2- 172.21.15.107:0/3187946677 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f42e4103f20 0x7f42e419fe80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:23.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:23.022+0000 7f42eb4c5700 1 -- 172.21.15.107:0/3187946677 >> 172.21.15.107:0/3187946677 conn(0x7f42e407a660 msgr2=0x7f42e4102170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:23.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:23.022+0000 7f42eb4c5700 1 -- 172.21.15.107:0/3187946677 shutdown_connections 2024-05-10T10:52:23.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:23.022+0000 7f42eb4c5700 1 -- 172.21.15.107:0/3187946677 wait complete. 2024-05-10T10:52:23.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:22 smithi196 ceph-mon[34872]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 3 op/s 2024-05-10T10:52:23.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:22 smithi184 ceph-mon[34585]: pgmap v287: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 3 op/s 2024-05-10T10:52:23.140 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 10:52:22 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-b[64672]: 2024-05-10T10:52:22.660+0000 7f3defcab700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T10:52:23.732 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-05-10T10:52:23.974 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:52:24.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:23 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3187946677' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:52:24.097 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:23 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3187946677' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:52:24.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:23 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3187946677' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:52:25.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:24 smithi196 ceph-mon[34872]: pgmap v288: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-05-10T10:52:25.085 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:24 smithi107 ceph-mon[30373]: pgmap v288: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-05-10T10:52:25.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:24 smithi184 ceph-mon[34585]: pgmap v288: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-05-10T10:52:25.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.592+0000 7fd662715700 1 -- 172.21.15.107:0/291213466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65c108410 msgr2=0x7fd65c1087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:25.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.592+0000 7fd662715700 1 --2- 172.21.15.107:0/291213466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65c108410 0x7fd65c1087f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009990 tx=0x7fd64c009ca0 comp rx=0 tx=0).stop 2024-05-10T10:52:25.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.592+0000 7fd662715700 1 -- 172.21.15.107:0/291213466 shutdown_connections 2024-05-10T10:52:25.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.592+0000 7fd662715700 1 --2- 172.21.15.107:0/291213466 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd65c102d60 0x7fd65c10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:25.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.592+0000 7fd662715700 1 --2- 172.21.15.107:0/291213466 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65c108410 0x7fd65c1087f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:25.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.592+0000 7fd662715700 1 --2- 172.21.15.107:0/291213466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd65c1023a0 0x7fd65c102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:25.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.592+0000 7fd662715700 1 -- 172.21.15.107:0/291213466 >> 172.21.15.107:0/291213466 conn(0x7fd65c079350 msgr2=0x7fd65c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:25.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.592+0000 7fd662715700 1 -- 172.21.15.107:0/291213466 shutdown_connections 2024-05-10T10:52:25.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.592+0000 7fd662715700 1 -- 172.21.15.107:0/291213466 wait complete. 2024-05-10T10:52:25.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.593+0000 7fd662715700 1 Processor -- start 2024-05-10T10:52:25.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.593+0000 7fd662715700 1 -- start start 2024-05-10T10:52:25.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.593+0000 7fd662715700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65c1023a0 0x7fd65c19f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:25.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.593+0000 7fd662715700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd65c102d60 0x7fd65c19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:25.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.593+0000 7fd662715700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd65c108410 0x7fd65c199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:25.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.593+0000 7fd662715700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c1126f0 con 0x7fd65c1023a0 2024-05-10T10:52:25.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.593+0000 7fd662715700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c112570 con 0x7fd65c108410 2024-05-10T10:52:25.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.593+0000 7fd662715700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c112870 con 0x7fd65c102d60 2024-05-10T10:52:25.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.593+0000 7fd65bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65c1023a0 0x7fd65c19f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:25.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.593+0000 7fd65bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65c1023a0 0x7fd65c19f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:50336/0 (socket says 172.21.15.107:50336) 2024-05-10T10:52:25.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.593+0000 7fd65bfff700 1 -- 172.21.15.107:0/485305208 learned_addr learned my addr 172.21.15.107:0/485305208 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:52:25.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.594+0000 7fd653fff700 1 --2- 172.21.15.107:0/485305208 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd65c102d60 0x7fd65c19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:25.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.594+0000 7fd660cb2700 1 --2- 172.21.15.107:0/485305208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd65c108410 0x7fd65c199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:25.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.594+0000 7fd65bfff700 1 -- 172.21.15.107:0/485305208 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd65c102d60 msgr2=0x7fd65c19fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:25.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.594+0000 7fd65bfff700 1 --2- 172.21.15.107:0/485305208 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd65c102d60 0x7fd65c19fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:25.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.594+0000 7fd65bfff700 1 -- 172.21.15.107:0/485305208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd65c108410 msgr2=0x7fd65c199a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:25.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.594+0000 7fd65bfff700 1 --2- 172.21.15.107:0/485305208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd65c108410 0x7fd65c199a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:25.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.594+0000 7fd65bfff700 1 -- 172.21.15.107:0/485305208 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd65c19a170 con 0x7fd65c1023a0 2024-05-10T10:52:25.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.594+0000 7fd660cb2700 1 --2- 172.21.15.107:0/485305208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd65c108410 0x7fd65c199a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:52:25.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.594+0000 7fd65bfff700 1 --2- 172.21.15.107:0/485305208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65c1023a0 0x7fd65c19f850 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd64c000c00 tx=0x7fd64c0037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:25.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.594+0000 7fd659ffb700 1 -- 172.21.15.107:0/485305208 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c027070 con 0x7fd65c1023a0 2024-05-10T10:52:25.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.594+0000 7fd662715700 1 -- 172.21.15.107:0/485305208 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd65c19a400 con 0x7fd65c1023a0 2024-05-10T10:52:25.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.594+0000 7fd659ffb700 1 -- 172.21.15.107:0/485305208 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd64c0041e0 con 0x7fd65c1023a0 2024-05-10T10:52:25.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.594+0000 7fd659ffb700 1 -- 172.21.15.107:0/485305208 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c00f460 con 0x7fd65c1023a0 2024-05-10T10:52:25.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.594+0000 7fd662715700 1 -- 172.21.15.107:0/485305208 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd65c1a6720 con 0x7fd65c1023a0 2024-05-10T10:52:25.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.595+0000 7fd662715700 1 -- 172.21.15.107:0/485305208 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd65c06a190 con 0x7fd65c1023a0 2024-05-10T10:52:25.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.597+0000 7fd659ffb700 1 -- 172.21.15.107:0/485305208 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fd64c02a070 con 0x7fd65c1023a0 2024-05-10T10:52:25.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.597+0000 7fd659ffb700 1 --2- 172.21.15.107:0/485305208 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd6480b2880 0x7fd6480b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:25.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.597+0000 7fd653fff700 1 --2- 172.21.15.107:0/485305208 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd6480b2880 0x7fd6480b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:25.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.598+0000 7fd659ffb700 1 -- 172.21.15.107:0/485305208 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fd64c0e3170 con 0x7fd65c1023a0 2024-05-10T10:52:25.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.598+0000 7fd653fff700 1 --2- 172.21.15.107:0/485305208 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd6480b2880 0x7fd6480b4d40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd644005ea0 tx=0x7fd644005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:25.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.601+0000 7fd659ffb700 1 -- 172.21.15.107:0/485305208 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd64c013070 con 0x7fd65c1023a0 2024-05-10T10:52:25.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:25.852+0000 7fd662715700 1 -- 172.21.15.107:0/485305208 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd65c19af40 con 0x7fd65c1023a0 2024-05-10T10:52:26.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:26.754+0000 7fd659ffb700 1 -- 172.21.15.107:0/485305208 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7fd64c0ab070 con 0x7fd65c1023a0 2024-05-10T10:52:26.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:26.758+0000 7fd662715700 1 -- 172.21.15.107:0/485305208 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd6480b2880 msgr2=0x7fd6480b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:26.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:26.758+0000 7fd662715700 1 --2- 172.21.15.107:0/485305208 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd6480b2880 0x7fd6480b4d40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd644005ea0 tx=0x7fd644005e30 comp rx=0 tx=0).stop 2024-05-10T10:52:26.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:26.758+0000 7fd662715700 1 -- 172.21.15.107:0/485305208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65c1023a0 msgr2=0x7fd65c19f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:26.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:26.758+0000 7fd662715700 1 --2- 172.21.15.107:0/485305208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65c1023a0 0x7fd65c19f850 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd64c000c00 tx=0x7fd64c0037a0 comp rx=0 tx=0).stop 2024-05-10T10:52:26.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:26.758+0000 7fd662715700 1 -- 172.21.15.107:0/485305208 shutdown_connections 2024-05-10T10:52:26.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:26.758+0000 7fd662715700 1 --2- 172.21.15.107:0/485305208 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd6480b2880 0x7fd6480b4d40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:26.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:26.758+0000 7fd662715700 1 --2- 172.21.15.107:0/485305208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd65c108410 0x7fd65c199a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:26.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:26.758+0000 7fd662715700 1 --2- 172.21.15.107:0/485305208 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd65c1023a0 0x7fd65c19f850 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:26.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:26.758+0000 7fd662715700 1 --2- 172.21.15.107:0/485305208 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd65c102d60 0x7fd65c19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:26.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:26.758+0000 7fd662715700 1 -- 172.21.15.107:0/485305208 >> 172.21.15.107:0/485305208 conn(0x7fd65c079350 msgr2=0x7fd65c1015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:26.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:26.758+0000 7fd662715700 1 -- 172.21.15.107:0/485305208 shutdown_connections 2024-05-10T10:52:26.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:26.758+0000 7fd662715700 1 -- 172.21.15.107:0/485305208 wait complete. 2024-05-10T10:52:27.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:26 smithi196 ceph-mon[34872]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-05-10T10:52:27.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:26 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/485305208' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-10T10:52:27.066 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:26 smithi107 ceph-mon[30373]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-05-10T10:52:27.066 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:26 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/485305208' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-10T10:52:27.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:26 smithi184 ceph-mon[34585]: pgmap v289: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-05-10T10:52:27.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:26 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/485305208' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-10T10:52:27.341 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-05-10T10:52:27.341 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-05-10T10:52:27.588 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:52:27.962 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:27 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/485305208' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-10T10:52:27.962 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:27 smithi107 ceph-mon[30373]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T10:52:28.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:27 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/485305208' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-10T10:52:28.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:27 smithi196 ceph-mon[34872]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T10:52:28.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:27 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/485305208' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-10T10:52:28.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:27 smithi184 ceph-mon[34585]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T10:52:29.013 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:28 smithi107 ceph-mon[30373]: pgmap v290: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-10T10:52:29.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:28 smithi196 ceph-mon[34872]: pgmap v290: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-10T10:52:29.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:28 smithi184 ceph-mon[34585]: pgmap v290: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-10T10:52:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.219+0000 7fe740f5a700 1 -- 172.21.15.107:0/935220921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c101a90 msgr2=0x7fe73c101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.219+0000 7fe740f5a700 1 --2- 172.21.15.107:0/935220921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c101a90 0x7fe73c101f10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe72c009990 tx=0x7fe72c009ca0 comp rx=0 tx=0).stop 2024-05-10T10:52:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.219+0000 7fe740f5a700 1 -- 172.21.15.107:0/935220921 shutdown_connections 2024-05-10T10:52:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.219+0000 7fe740f5a700 1 --2- 172.21.15.107:0/935220921 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe73c109520 0x7fe73c109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.219+0000 7fe740f5a700 1 --2- 172.21.15.107:0/935220921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe73c102450 0x7fe73c110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.219+0000 7fe740f5a700 1 --2- 172.21.15.107:0/935220921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c101a90 0x7fe73c101f10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.219+0000 7fe740f5a700 1 -- 172.21.15.107:0/935220921 >> 172.21.15.107:0/935220921 conn(0x7fe73c078a10 msgr2=0x7fe73c0ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.219+0000 7fe740f5a700 1 -- 172.21.15.107:0/935220921 shutdown_connections 2024-05-10T10:52:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.219+0000 7fe740f5a700 1 -- 172.21.15.107:0/935220921 wait complete. 2024-05-10T10:52:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.219+0000 7fe740f5a700 1 Processor -- start 2024-05-10T10:52:29.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.220+0000 7fe740f5a700 1 -- start start 2024-05-10T10:52:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.220+0000 7fe740f5a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c101a90 0x7fe73c199d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.220+0000 7fe740f5a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe73c102450 0x7fe73c19a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.220+0000 7fe740f5a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe73c109520 0x7fe73c19e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.220+0000 7fe740f5a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c113870 con 0x7fe73c101a90 2024-05-10T10:52:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.220+0000 7fe740f5a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c1136f0 con 0x7fe73c102450 2024-05-10T10:52:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.220+0000 7fe740f5a700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c1139f0 con 0x7fe73c109520 2024-05-10T10:52:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.220+0000 7fe73a59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c101a90 0x7fe73c199d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.220+0000 7fe73a59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c101a90 0x7fe73c199d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60554/0 (socket says 172.21.15.107:60554) 2024-05-10T10:52:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.220+0000 7fe73a59c700 1 -- 172.21.15.107:0/1770664852 learned_addr learned my addr 172.21.15.107:0/1770664852 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:52:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.220+0000 7fe739d9b700 1 --2- 172.21.15.107:0/1770664852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe73c102450 0x7fe73c19a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.220+0000 7fe73ad9d700 1 --2- 172.21.15.107:0/1770664852 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe73c109520 0x7fe73c19e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.220+0000 7fe73a59c700 1 -- 172.21.15.107:0/1770664852 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe73c109520 msgr2=0x7fe73c19e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.220+0000 7fe73a59c700 1 --2- 172.21.15.107:0/1770664852 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe73c109520 0x7fe73c19e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:29.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.220+0000 7fe73a59c700 1 -- 172.21.15.107:0/1770664852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe73c102450 msgr2=0x7fe73c19a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:29.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.220+0000 7fe73a59c700 1 --2- 172.21.15.107:0/1770664852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe73c102450 0x7fe73c19a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:29.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.220+0000 7fe73a59c700 1 -- 172.21.15.107:0/1770664852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73c19ed90 con 0x7fe73c101a90 2024-05-10T10:52:29.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.220+0000 7fe73a59c700 1 --2- 172.21.15.107:0/1770664852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c101a90 0x7fe73c199d80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe73000b530 tx=0x7fe73000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:29.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.221+0000 7fe72b7fe700 1 -- 172.21.15.107:0/1770664852 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe730015020 con 0x7fe73c101a90 2024-05-10T10:52:29.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.221+0000 7fe72b7fe700 1 -- 172.21.15.107:0/1770664852 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe730011d00 con 0x7fe73c101a90 2024-05-10T10:52:29.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.221+0000 7fe740f5a700 1 -- 172.21.15.107:0/1770664852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe73c19f080 con 0x7fe73c101a90 2024-05-10T10:52:29.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.221+0000 7fe72b7fe700 1 -- 172.21.15.107:0/1770664852 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe730010e40 con 0x7fe73c101a90 2024-05-10T10:52:29.224 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.221+0000 7fe740f5a700 1 -- 172.21.15.107:0/1770664852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe73c1a6900 con 0x7fe73c101a90 2024-05-10T10:52:29.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.222+0000 7fe740f5a700 1 -- 172.21.15.107:0/1770664852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe73c10ba00 con 0x7fe73c101a90 2024-05-10T10:52:29.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.223+0000 7fe72b7fe700 1 -- 172.21.15.107:0/1770664852 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fe730018020 con 0x7fe73c101a90 2024-05-10T10:52:29.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.224+0000 7fe72b7fe700 1 --2- 172.21.15.107:0/1770664852 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe7240b2880 0x7fe7240b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:29.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.224+0000 7fe739d9b700 1 --2- 172.21.15.107:0/1770664852 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe7240b2880 0x7fe7240b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:29.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.224+0000 7fe72b7fe700 1 -- 172.21.15.107:0/1770664852 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fe7300e1bf0 con 0x7fe73c101a90 2024-05-10T10:52:29.225 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.224+0000 7fe739d9b700 1 --2- 172.21.15.107:0/1770664852 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe7240b2880 0x7fe7240b4d40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00b5c0 tx=0x7fe72c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:29.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.227+0000 7fe72b7fe700 1 -- 172.21.15.107:0/1770664852 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe73001f020 con 0x7fe73c101a90 2024-05-10T10:52:29.490 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.489+0000 7fe740f5a700 1 -- 172.21.15.107:0/1770664852 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fe73c19b0e0 con 0x7fe73c101a90 2024-05-10T10:52:29.773 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.772+0000 7fe72b7fe700 1 -- 172.21.15.107:0/1770664852 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v17) ==== 105+0+0 (secure 0 0 0) 0x7fe7300a9a60 con 0x7fe73c101a90 2024-05-10T10:52:29.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.775+0000 7fe740f5a700 1 -- 172.21.15.107:0/1770664852 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe7240b2880 msgr2=0x7fe7240b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:29.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.775+0000 7fe740f5a700 1 --2- 172.21.15.107:0/1770664852 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe7240b2880 0x7fe7240b4d40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00b5c0 tx=0x7fe72c005960 comp rx=0 tx=0).stop 2024-05-10T10:52:29.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.775+0000 7fe740f5a700 1 -- 172.21.15.107:0/1770664852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c101a90 msgr2=0x7fe73c199d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:29.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.775+0000 7fe740f5a700 1 --2- 172.21.15.107:0/1770664852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c101a90 0x7fe73c199d80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe73000b530 tx=0x7fe73000b840 comp rx=0 tx=0).stop 2024-05-10T10:52:29.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.775+0000 7fe740f5a700 1 -- 172.21.15.107:0/1770664852 shutdown_connections 2024-05-10T10:52:29.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.775+0000 7fe740f5a700 1 --2- 172.21.15.107:0/1770664852 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe7240b2880 0x7fe7240b4d40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:29.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.775+0000 7fe740f5a700 1 --2- 172.21.15.107:0/1770664852 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe73c109520 0x7fe73c19e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:29.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.775+0000 7fe740f5a700 1 --2- 172.21.15.107:0/1770664852 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe73c101a90 0x7fe73c199d80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:29.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.775+0000 7fe740f5a700 1 --2- 172.21.15.107:0/1770664852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe73c102450 0x7fe73c19a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:29.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.775+0000 7fe740f5a700 1 -- 172.21.15.107:0/1770664852 >> 172.21.15.107:0/1770664852 conn(0x7fe73c078a10 msgr2=0x7fe73c100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:29.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.775+0000 7fe740f5a700 1 -- 172.21.15.107:0/1770664852 shutdown_connections 2024-05-10T10:52:29.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:29.775+0000 7fe740f5a700 1 -- 172.21.15.107:0/1770664852 wait complete. 2024-05-10T10:52:30.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:29 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1770664852' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-10T10:52:30.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:29 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1770664852' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-10T10:52:30.139 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:29 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1770664852' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-10T10:52:30.592 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-05-10T10:52:30.839 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:52:30.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:30 smithi107 ceph-mon[30373]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-10T10:52:30.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:30 smithi107 ceph-mon[30373]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-10T10:52:30.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:30 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1770664852' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-10T10:52:30.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:30 smithi107 ceph-mon[30373]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-10T10:52:30.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:30 smithi107 ceph-mon[30373]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T10:52:30.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:30 smithi107 ceph-mon[30373]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-10T10:52:30.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:30 smithi107 ceph-mon[30373]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-10T10:52:31.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:30 smithi196 ceph-mon[34872]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-10T10:52:31.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:30 smithi196 ceph-mon[34872]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-10T10:52:31.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:30 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1770664852' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-10T10:52:31.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:30 smithi196 ceph-mon[34872]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-10T10:52:31.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:30 smithi196 ceph-mon[34872]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T10:52:31.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:30 smithi196 ceph-mon[34872]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-10T10:52:31.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:30 smithi196 ceph-mon[34872]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-10T10:52:31.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:30 smithi184 ceph-mon[34585]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-10T10:52:31.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:30 smithi184 ceph-mon[34585]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-10T10:52:31.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:30 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1770664852' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-10T10:52:31.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:30 smithi184 ceph-mon[34585]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-10T10:52:31.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:30 smithi184 ceph-mon[34585]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-10T10:52:31.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:30 smithi184 ceph-mon[34585]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-10T10:52:31.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:30 smithi184 ceph-mon[34585]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-10T10:52:31.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:31 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] up:active 2024-05-10T10:52:31.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:31 smithi107 ceph-mon[30373]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-10T10:52:31.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:31 smithi107 ceph-mon[30373]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-10T10:52:31.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:31 smithi107 ceph-mon[30373]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-05-10T10:52:31.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:31 smithi107 ceph-mon[30373]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-05-10T10:52:32.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:31 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] up:active 2024-05-10T10:52:32.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:31 smithi196 ceph-mon[34872]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-10T10:52:32.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:31 smithi196 ceph-mon[34872]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-10T10:52:32.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:31 smithi196 ceph-mon[34872]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-05-10T10:52:32.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:31 smithi196 ceph-mon[34872]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-05-10T10:52:32.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:31 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] up:active 2024-05-10T10:52:32.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:31 smithi184 ceph-mon[34585]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-10T10:52:32.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:31 smithi184 ceph-mon[34585]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-10T10:52:32.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:31 smithi184 ceph-mon[34585]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-05-10T10:52:32.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:31 smithi184 ceph-mon[34585]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-05-10T10:52:32.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.448+0000 7fdf26399700 1 -- 172.21.15.107:0/748653958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf20102630 msgr2=0x7fdf20102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:32.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.448+0000 7fdf26399700 1 --2- 172.21.15.107:0/748653958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf20102630 0x7fdf20102a10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdf100099c0 tx=0x7fdf10009cd0 comp rx=0 tx=0).stop 2024-05-10T10:52:32.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.448+0000 7fdf26399700 1 -- 172.21.15.107:0/748653958 shutdown_connections 2024-05-10T10:52:32.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.448+0000 7fdf26399700 1 --2- 172.21.15.107:0/748653958 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf201076c0 0x7fdf2010f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:32.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.448+0000 7fdf26399700 1 --2- 172.21.15.107:0/748653958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf20102630 0x7fdf20102a10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:32.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.448+0000 7fdf26399700 1 --2- 172.21.15.107:0/748653958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf20102fe0 0x7fdf20106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:32.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.448+0000 7fdf26399700 1 -- 172.21.15.107:0/748653958 >> 172.21.15.107:0/748653958 conn(0x7fdf20079350 msgr2=0x7fdf20079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:32.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.448+0000 7fdf26399700 1 -- 172.21.15.107:0/748653958 shutdown_connections 2024-05-10T10:52:32.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.448+0000 7fdf26399700 1 -- 172.21.15.107:0/748653958 wait complete. 2024-05-10T10:52:32.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.449+0000 7fdf26399700 1 Processor -- start 2024-05-10T10:52:32.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.449+0000 7fdf26399700 1 -- start start 2024-05-10T10:52:32.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.449+0000 7fdf26399700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf20102630 0x7fdf20199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:32.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.449+0000 7fdf26399700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf20102fe0 0x7fdf2019a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:32.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf26399700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf201076c0 0x7fdf2019e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:32.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf26399700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20112710 con 0x7fdf201076c0 2024-05-10T10:52:32.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf26399700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20112590 con 0x7fdf20102630 2024-05-10T10:52:32.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf26399700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20112890 con 0x7fdf20102fe0 2024-05-10T10:52:32.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf24936700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf201076c0 0x7fdf2019e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:32.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf1ffff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf20102630 0x7fdf20199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:32.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf24936700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf201076c0 0x7fdf2019e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60574/0 (socket says 172.21.15.107:60574) 2024-05-10T10:52:32.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf24936700 1 -- 172.21.15.107:0/2940227814 learned_addr learned my addr 172.21.15.107:0/2940227814 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:52:32.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf1f7fe700 1 --2- 172.21.15.107:0/2940227814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf20102fe0 0x7fdf2019a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:32.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf24936700 1 -- 172.21.15.107:0/2940227814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf20102fe0 msgr2=0x7fdf2019a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:32.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf24936700 1 --2- 172.21.15.107:0/2940227814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf20102fe0 0x7fdf2019a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:32.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf24936700 1 -- 172.21.15.107:0/2940227814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf20102630 msgr2=0x7fdf20199d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:32.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf24936700 1 --2- 172.21.15.107:0/2940227814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf20102630 0x7fdf20199d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:32.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf24936700 1 -- 172.21.15.107:0/2940227814 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2019ed20 con 0x7fdf201076c0 2024-05-10T10:52:32.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf24936700 1 --2- 172.21.15.107:0/2940227814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf201076c0 0x7fdf2019e5e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800b970 tx=0x7fdf1800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:32.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf1d7fa700 1 -- 172.21.15.107:0/2940227814 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18019070 con 0x7fdf201076c0 2024-05-10T10:52:32.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf26399700 1 -- 172.21.15.107:0/2940227814 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf2019f010 con 0x7fdf201076c0 2024-05-10T10:52:32.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf1d7fa700 1 -- 172.21.15.107:0/2940227814 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdf1800ce00 con 0x7fdf201076c0 2024-05-10T10:52:32.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf1d7fa700 1 -- 172.21.15.107:0/2940227814 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18007370 con 0x7fdf201076c0 2024-05-10T10:52:32.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.450+0000 7fdf26399700 1 -- 172.21.15.107:0/2940227814 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf201a6890 con 0x7fdf201076c0 2024-05-10T10:52:32.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.451+0000 7fdf26399700 1 -- 172.21.15.107:0/2940227814 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf2006a190 con 0x7fdf201076c0 2024-05-10T10:52:32.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.453+0000 7fdf1d7fa700 1 -- 172.21.15.107:0/2940227814 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fdf1801c070 con 0x7fdf201076c0 2024-05-10T10:52:32.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.454+0000 7fdf1d7fa700 1 --2- 172.21.15.107:0/2940227814 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fdf080b2880 0x7fdf080b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:32.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.454+0000 7fdf1ffff700 1 --2- 172.21.15.107:0/2940227814 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fdf080b2880 0x7fdf080b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:32.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.454+0000 7fdf1d7fa700 1 -- 172.21.15.107:0/2940227814 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fdf180e1980 con 0x7fdf201076c0 2024-05-10T10:52:32.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.455+0000 7fdf1ffff700 1 --2- 172.21.15.107:0/2940227814 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fdf080b2880 0x7fdf080b4d40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009990 tx=0x7fdf100096b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:32.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.458+0000 7fdf1d7fa700 1 -- 172.21.15.107:0/2940227814 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fdf180a9750 con 0x7fdf201076c0 2024-05-10T10:52:32.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.705+0000 7fdf26399700 1 -- 172.21.15.107:0/2940227814 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fdf2002e510 con 0x7fdf201076c0 2024-05-10T10:52:32.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.799+0000 7fdf1d7fa700 1 -- 172.21.15.107:0/2940227814 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7fdf180a9050 con 0x7fdf201076c0 2024-05-10T10:52:32.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.801+0000 7fdf26399700 1 -- 172.21.15.107:0/2940227814 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fdf080b2880 msgr2=0x7fdf080b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:32.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.801+0000 7fdf26399700 1 --2- 172.21.15.107:0/2940227814 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fdf080b2880 0x7fdf080b4d40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009990 tx=0x7fdf100096b0 comp rx=0 tx=0).stop 2024-05-10T10:52:32.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.801+0000 7fdf26399700 1 -- 172.21.15.107:0/2940227814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf201076c0 msgr2=0x7fdf2019e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:32.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.801+0000 7fdf26399700 1 --2- 172.21.15.107:0/2940227814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf201076c0 0x7fdf2019e5e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdf1800b970 tx=0x7fdf1800bc80 comp rx=0 tx=0).stop 2024-05-10T10:52:32.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.801+0000 7fdf26399700 1 -- 172.21.15.107:0/2940227814 shutdown_connections 2024-05-10T10:52:32.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.801+0000 7fdf26399700 1 --2- 172.21.15.107:0/2940227814 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fdf080b2880 0x7fdf080b4d40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:32.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.801+0000 7fdf26399700 1 --2- 172.21.15.107:0/2940227814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdf201076c0 0x7fdf2019e5e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:32.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.801+0000 7fdf26399700 1 --2- 172.21.15.107:0/2940227814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf20102630 0x7fdf20199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:32.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.801+0000 7fdf26399700 1 --2- 172.21.15.107:0/2940227814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdf20102fe0 0x7fdf2019a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:32.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.801+0000 7fdf26399700 1 -- 172.21.15.107:0/2940227814 >> 172.21.15.107:0/2940227814 conn(0x7fdf20079350 msgr2=0x7fdf2006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:32.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.801+0000 7fdf26399700 1 -- 172.21.15.107:0/2940227814 shutdown_connections 2024-05-10T10:52:32.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:32.801+0000 7fdf26399700 1 -- 172.21.15.107:0/2940227814 wait complete. 2024-05-10T10:52:33.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:32 smithi196 ceph-mon[34872]: pgmap v292: 97 pgs: 97 active+clean; 580 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-05-10T10:52:33.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:32 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] up:active 2024-05-10T10:52:33.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:32 smithi196 ceph-mon[34872]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-10T10:52:33.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:32 smithi196 ceph-mon[34872]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-05-10T10:52:33.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:32 smithi196 ceph-mon[34872]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-05-10T10:52:33.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:32 smithi196 ceph-mon[34872]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-05-10T10:52:33.064 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:32 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/2940227814' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-10T10:52:33.139 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 10:52:32 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-b[64672]: 2024-05-10T10:52:32.660+0000 7f3defcab700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-05-10T10:52:33.139 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 10:52:32 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-b[64672]: 2024-05-10T10:52:32.660+0000 7f3defcab700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-05-10T10:52:33.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:32 smithi184 ceph-mon[34585]: pgmap v292: 97 pgs: 97 active+clean; 580 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-05-10T10:52:33.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:32 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] up:active 2024-05-10T10:52:33.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:32 smithi184 ceph-mon[34585]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-10T10:52:33.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:32 smithi184 ceph-mon[34585]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-05-10T10:52:33.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:32 smithi184 ceph-mon[34585]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-05-10T10:52:33.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:32 smithi184 ceph-mon[34585]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-05-10T10:52:33.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:32 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/2940227814' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-10T10:52:33.156 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:32 smithi107 ceph-mon[30373]: pgmap v292: 97 pgs: 97 active+clean; 580 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-05-10T10:52:33.156 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:32 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] up:active 2024-05-10T10:52:33.156 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:32 smithi107 ceph-mon[30373]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-10T10:52:33.156 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:32 smithi107 ceph-mon[30373]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-05-10T10:52:33.156 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:32 smithi107 ceph-mon[30373]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-05-10T10:52:33.156 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:32 smithi107 ceph-mon[30373]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-05-10T10:52:33.156 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:32 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2940227814' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-10T10:52:33.495 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-05-10T10:52:33.742 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:52:34.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:33 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/2940227814' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-10T10:52:34.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:33 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] up:active 2024-05-10T10:52:34.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:33 smithi196 ceph-mon[34872]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-10T10:52:34.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:33 smithi196 ceph-mon[34872]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-10T10:52:34.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:33 smithi196 ceph-mon[34872]: Cluster is now healthy 2024-05-10T10:52:34.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:33 smithi196 ceph-mon[34872]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-05-10T10:52:34.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:33 smithi196 ceph-mon[34872]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-10T10:52:34.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:33 smithi196 ceph-mon[34872]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-05-10T10:52:34.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:33 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] up:active 2024-05-10T10:52:34.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:33 smithi196 ceph-mon[34872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:52:34.083 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:33 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2940227814' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-10T10:52:34.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:33 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] up:active 2024-05-10T10:52:34.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:33 smithi107 ceph-mon[30373]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-10T10:52:34.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:33 smithi107 ceph-mon[30373]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-10T10:52:34.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:33 smithi107 ceph-mon[30373]: Cluster is now healthy 2024-05-10T10:52:34.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:33 smithi107 ceph-mon[30373]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-05-10T10:52:34.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:33 smithi107 ceph-mon[30373]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-10T10:52:34.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:33 smithi107 ceph-mon[30373]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-05-10T10:52:34.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:33 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] up:active 2024-05-10T10:52:34.084 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:33 smithi107 ceph-mon[30373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:52:34.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:33 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/2940227814' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-10T10:52:34.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:33 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] up:active 2024-05-10T10:52:34.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:33 smithi184 ceph-mon[34585]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-10T10:52:34.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:33 smithi184 ceph-mon[34585]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-10T10:52:34.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:33 smithi184 ceph-mon[34585]: Cluster is now healthy 2024-05-10T10:52:34.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:33 smithi184 ceph-mon[34585]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-05-10T10:52:34.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:33 smithi184 ceph-mon[34585]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-10T10:52:34.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:33 smithi184 ceph-mon[34585]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-05-10T10:52:34.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:33 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] up:active 2024-05-10T10:52:34.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:33 smithi184 ceph-mon[34585]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:52:35.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:34 smithi196 ceph-mon[34872]: pgmap v293: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2024-05-10T10:52:35.072 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:34 smithi107 ceph-mon[30373]: pgmap v293: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2024-05-10T10:52:35.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:34 smithi184 ceph-mon[34585]: pgmap v293: 97 pgs: 97 active+clean; 582 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2024-05-10T10:52:35.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.404+0000 7fc362558700 1 -- 172.21.15.107:0/496394555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc35c108890 msgr2=0x7fc35c110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:35.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.404+0000 7fc362558700 1 --2- 172.21.15.107:0/496394555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc35c108890 0x7fc35c110410 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc35400b0d0 tx=0x7fc35400b3e0 comp rx=0 tx=0).stop 2024-05-10T10:52:35.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.404+0000 7fc362558700 1 -- 172.21.15.107:0/496394555 shutdown_connections 2024-05-10T10:52:35.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.404+0000 7fc362558700 1 --2- 172.21.15.107:0/496394555 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc35c101c50 0x7fc35c102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:35.407 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.404+0000 7fc362558700 1 --2- 172.21.15.107:0/496394555 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc35c108890 0x7fc35c110410 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.404+0000 7fc362558700 1 --2- 172.21.15.107:0/496394555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc35c102600 0x7fc35c108160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.404+0000 7fc362558700 1 -- 172.21.15.107:0/496394555 >> 172.21.15.107:0/496394555 conn(0x7fc35c0789a0 msgr2=0x7fc35c0ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.404+0000 7fc362558700 1 -- 172.21.15.107:0/496394555 shutdown_connections 2024-05-10T10:52:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.404+0000 7fc362558700 1 -- 172.21.15.107:0/496394555 wait complete. 2024-05-10T10:52:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.405+0000 7fc362558700 1 Processor -- start 2024-05-10T10:52:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.405+0000 7fc362558700 1 -- start start 2024-05-10T10:52:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.405+0000 7fc362558700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc35c101c50 0x7fc35c19f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.405+0000 7fc362558700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc35c102600 0x7fc35c19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.405+0000 7fc362558700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc35c108890 0x7fc35c1999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.405+0000 7fc362558700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc35c113810 con 0x7fc35c108890 2024-05-10T10:52:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.405+0000 7fc362558700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc35c113690 con 0x7fc35c101c50 2024-05-10T10:52:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.405+0000 7fc362558700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc35c113990 con 0x7fc35c102600 2024-05-10T10:52:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.405+0000 7fc360af5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc35c108890 0x7fc35c1999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.405+0000 7fc360af5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc35c108890 0x7fc35c1999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60606/0 (socket says 172.21.15.107:60606) 2024-05-10T10:52:35.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.405+0000 7fc360af5700 1 -- 172.21.15.107:0/3959457245 learned_addr learned my addr 172.21.15.107:0/3959457245 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:52:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.406+0000 7fc353fff700 1 --2- 172.21.15.107:0/3959457245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc35c102600 0x7fc35c19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.406+0000 7fc35bfff700 1 --2- 172.21.15.107:0/3959457245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc35c101c50 0x7fc35c19f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.406+0000 7fc360af5700 1 -- 172.21.15.107:0/3959457245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc35c102600 msgr2=0x7fc35c19fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.406+0000 7fc360af5700 1 --2- 172.21.15.107:0/3959457245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc35c102600 0x7fc35c19fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.406+0000 7fc360af5700 1 -- 172.21.15.107:0/3959457245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc35c101c50 msgr2=0x7fc35c19f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.406+0000 7fc360af5700 1 --2- 172.21.15.107:0/3959457245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc35c101c50 0x7fc35c19f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.406+0000 7fc360af5700 1 -- 172.21.15.107:0/3959457245 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35c19a130 con 0x7fc35c108890 2024-05-10T10:52:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.406+0000 7fc360af5700 1 --2- 172.21.15.107:0/3959457245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc35c108890 0x7fc35c1999d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc3540079a0 tx=0x7fc3540079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.406+0000 7fc359ffb700 1 -- 172.21.15.107:0/3959457245 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc354021020 con 0x7fc35c108890 2024-05-10T10:52:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.406+0000 7fc359ffb700 1 -- 172.21.15.107:0/3959457245 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc354007e30 con 0x7fc35c108890 2024-05-10T10:52:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.406+0000 7fc362558700 1 -- 172.21.15.107:0/3959457245 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35c19a3c0 con 0x7fc35c108890 2024-05-10T10:52:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.406+0000 7fc359ffb700 1 -- 172.21.15.107:0/3959457245 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3540052b0 con 0x7fc35c108890 2024-05-10T10:52:35.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.406+0000 7fc362558700 1 -- 172.21.15.107:0/3959457245 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc35c1a66e0 con 0x7fc35c108890 2024-05-10T10:52:35.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.407+0000 7fc362558700 1 -- 172.21.15.107:0/3959457245 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc35c06a190 con 0x7fc35c108890 2024-05-10T10:52:35.410 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.408+0000 7fc359ffb700 1 -- 172.21.15.107:0/3959457245 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7fc354024020 con 0x7fc35c108890 2024-05-10T10:52:35.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.409+0000 7fc359ffb700 1 --2- 172.21.15.107:0/3959457245 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc3480b2880 0x7fc3480b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:35.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.410+0000 7fc35bfff700 1 --2- 172.21.15.107:0/3959457245 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc3480b2880 0x7fc3480b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:35.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.410+0000 7fc359ffb700 1 -- 172.21.15.107:0/3959457245 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fc35400f020 con 0x7fc35c108890 2024-05-10T10:52:35.411 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.410+0000 7fc35bfff700 1 --2- 172.21.15.107:0/3959457245 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc3480b2880 0x7fc3480b4d40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc34c006fd0 tx=0x7fc34c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:35.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.414+0000 7fc359ffb700 1 -- 172.21.15.107:0/3959457245 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc3540ab0d0 con 0x7fc35c108890 2024-05-10T10:52:35.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.664+0000 7fc362558700 1 -- 172.21.15.107:0/3959457245 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fc35c02e510 con 0x7fc35c108890 2024-05-10T10:52:35.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.819+0000 7fc359ffb700 1 -- 172.21.15.107:0/3959457245 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7fc3540aa9d0 con 0x7fc35c108890 2024-05-10T10:52:35.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.822+0000 7fc362558700 1 -- 172.21.15.107:0/3959457245 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc3480b2880 msgr2=0x7fc3480b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:35.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.822+0000 7fc362558700 1 --2- 172.21.15.107:0/3959457245 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc3480b2880 0x7fc3480b4d40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc34c006fd0 tx=0x7fc34c008040 comp rx=0 tx=0).stop 2024-05-10T10:52:35.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.822+0000 7fc362558700 1 -- 172.21.15.107:0/3959457245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc35c108890 msgr2=0x7fc35c1999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:35.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.822+0000 7fc362558700 1 --2- 172.21.15.107:0/3959457245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc35c108890 0x7fc35c1999d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc3540079a0 tx=0x7fc3540079d0 comp rx=0 tx=0).stop 2024-05-10T10:52:35.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.823+0000 7fc362558700 1 -- 172.21.15.107:0/3959457245 shutdown_connections 2024-05-10T10:52:35.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.823+0000 7fc362558700 1 --2- 172.21.15.107:0/3959457245 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc3480b2880 0x7fc3480b4d40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:35.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.823+0000 7fc362558700 1 --2- 172.21.15.107:0/3959457245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc35c108890 0x7fc35c1999d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:35.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.823+0000 7fc362558700 1 --2- 172.21.15.107:0/3959457245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc35c101c50 0x7fc35c19f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:35.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.823+0000 7fc362558700 1 --2- 172.21.15.107:0/3959457245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc35c102600 0x7fc35c19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:35.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.823+0000 7fc362558700 1 -- 172.21.15.107:0/3959457245 >> 172.21.15.107:0/3959457245 conn(0x7fc35c0789a0 msgr2=0x7fc35c106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:35.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.823+0000 7fc362558700 1 -- 172.21.15.107:0/3959457245 shutdown_connections 2024-05-10T10:52:35.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:35.823+0000 7fc362558700 1 -- 172.21.15.107:0/3959457245 wait complete. 2024-05-10T10:52:35.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:35 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3959457245' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-10T10:52:36.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:35 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3959457245' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-10T10:52:36.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:35 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3959457245' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-10T10:52:36.497 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-05-10T10:52:36.498 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-05-10T10:52:36.748 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:52:37.072 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:36 smithi107 ceph-mon[30373]: pgmap v294: 97 pgs: 97 active+clean; 584 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.7 KiB/s wr, 13 op/s 2024-05-10T10:52:37.072 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:36 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3959457245' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-10T10:52:37.072 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:36 smithi107 ceph-mon[30373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:52:37.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:36 smithi184 ceph-mon[34585]: pgmap v294: 97 pgs: 97 active+clean; 584 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.7 KiB/s wr, 13 op/s 2024-05-10T10:52:37.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:36 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3959457245' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-10T10:52:37.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:36 smithi184 ceph-mon[34585]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:52:37.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:36 smithi196 ceph-mon[34872]: pgmap v294: 97 pgs: 97 active+clean; 584 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.7 KiB/s wr, 13 op/s 2024-05-10T10:52:37.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:36 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3959457245' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-10T10:52:37.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:36 smithi196 ceph-mon[34872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:52:38.139 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 10:52:37 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-b[64672]: 2024-05-10T10:52:37.661+0000 7f3defcab700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-05-10T10:52:38.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.302+0000 7f8771f02700 1 -- 172.21.15.107:0/715436971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c06c5d0 msgr2=0x7f876c110380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:38.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.302+0000 7f8771f02700 1 --2- 172.21.15.107:0/715436971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c06c5d0 0x7f876c110380 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f876400b0a0 tx=0x7f876400b3b0 comp rx=0 tx=0).stop 2024-05-10T10:52:38.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.302+0000 7f8771f02700 1 -- 172.21.15.107:0/715436971 shutdown_connections 2024-05-10T10:52:38.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.302+0000 7f8771f02700 1 --2- 172.21.15.107:0/715436971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c06c5d0 0x7f876c110380 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:38.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.302+0000 7f8771f02700 1 --2- 172.21.15.107:0/715436971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f876c109540 0x7f876c109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:38.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.302+0000 7f8771f02700 1 --2- 172.21.15.107:0/715436971 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f876c06bc10 0x7f876c06c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:38.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.302+0000 7f8771f02700 1 -- 172.21.15.107:0/715436971 >> 172.21.15.107:0/715436971 conn(0x7f876c078410 msgr2=0x7f876c078820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:38.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.302+0000 7f8771f02700 1 -- 172.21.15.107:0/715436971 shutdown_connections 2024-05-10T10:52:38.303 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.302+0000 7f8771f02700 1 -- 172.21.15.107:0/715436971 wait complete. 2024-05-10T10:52:38.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.302+0000 7f8771f02700 1 Processor -- start 2024-05-10T10:52:38.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.303+0000 7f8771f02700 1 -- start start 2024-05-10T10:52:38.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.303+0000 7f8771f02700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c06bc10 0x7f876c19f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:38.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.303+0000 7f8771f02700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f876c06c5d0 0x7f876c19fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:38.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.303+0000 7f8771f02700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f876c109540 0x7f876c199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:38.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.303+0000 7f8771f02700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f876c1137a0 con 0x7f876c06bc10 2024-05-10T10:52:38.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.303+0000 7f8771f02700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f876c113620 con 0x7f876c109540 2024-05-10T10:52:38.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.303+0000 7f8771f02700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f876c113920 con 0x7f876c06c5d0 2024-05-10T10:52:38.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.303+0000 7f876b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c06bc10 0x7f876c19f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:38.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.303+0000 7f876b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c06bc10 0x7f876c19f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47588/0 (socket says 172.21.15.107:47588) 2024-05-10T10:52:38.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.303+0000 7f876b7fe700 1 -- 172.21.15.107:0/964352680 learned_addr learned my addr 172.21.15.107:0/964352680 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:52:38.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.303+0000 7f876bfff700 1 --2- 172.21.15.107:0/964352680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f876c109540 0x7f876c199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:38.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.303+0000 7f876affd700 1 --2- 172.21.15.107:0/964352680 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f876c06c5d0 0x7f876c19fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:38.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.303+0000 7f876b7fe700 1 -- 172.21.15.107:0/964352680 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f876c06c5d0 msgr2=0x7f876c19fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:38.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.303+0000 7f876b7fe700 1 --2- 172.21.15.107:0/964352680 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f876c06c5d0 0x7f876c19fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:38.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.303+0000 7f876b7fe700 1 -- 172.21.15.107:0/964352680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f876c109540 msgr2=0x7f876c199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:38.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.303+0000 7f876b7fe700 1 --2- 172.21.15.107:0/964352680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f876c109540 0x7f876c199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:38.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.304+0000 7f876b7fe700 1 -- 172.21.15.107:0/964352680 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876c19a1e0 con 0x7f876c06bc10 2024-05-10T10:52:38.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.304+0000 7f876affd700 1 --2- 172.21.15.107:0/964352680 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f876c06c5d0 0x7f876c19fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:52:38.306 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.304+0000 7f876b7fe700 1 --2- 172.21.15.107:0/964352680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c06bc10 0x7f876c19f870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f875c00d980 tx=0x7f875c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:38.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.304+0000 7f8768ff9700 1 -- 172.21.15.107:0/964352680 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c017070 con 0x7f876c06bc10 2024-05-10T10:52:38.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.304+0000 7f8768ff9700 1 -- 172.21.15.107:0/964352680 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f875c005020 con 0x7f876c06bc10 2024-05-10T10:52:38.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.304+0000 7f8771f02700 1 -- 172.21.15.107:0/964352680 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f876c19a4d0 con 0x7f876c06bc10 2024-05-10T10:52:38.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.304+0000 7f8768ff9700 1 -- 172.21.15.107:0/964352680 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c009bf0 con 0x7f876c06bc10 2024-05-10T10:52:38.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.304+0000 7f8771f02700 1 -- 172.21.15.107:0/964352680 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f876c1a6740 con 0x7f876c06bc10 2024-05-10T10:52:38.307 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.305+0000 7f8771f02700 1 -- 172.21.15.107:0/964352680 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f876c104c00 con 0x7f876c06bc10 2024-05-10T10:52:38.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.307+0000 7f8768ff9700 1 -- 172.21.15.107:0/964352680 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 16) ==== 149653+0+0 (secure 0 0 0) 0x7f875c0051d0 con 0x7f876c06bc10 2024-05-10T10:52:38.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.308+0000 7f8768ff9700 1 --2- 172.21.15.107:0/964352680 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87540b2880 0x7f87540b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:38.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.308+0000 7f876affd700 1 --2- 172.21.15.107:0/964352680 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87540b2880 0x7f87540b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:38.308 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.308+0000 7f8768ff9700 1 -- 172.21.15.107:0/964352680 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f875c0e2340 con 0x7f876c06bc10 2024-05-10T10:52:38.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.308+0000 7f876affd700 1 --2- 172.21.15.107:0/964352680 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87540b2880 0x7f87540b4d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f876c078a80 tx=0x7f876000b2c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:38.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.311+0000 7f8768ff9700 1 -- 172.21.15.107:0/964352680 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f875c020020 con 0x7f876c06bc10 2024-05-10T10:52:38.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.548+0000 7f8771f02700 1 -- 172.21.15.107:0/964352680 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f876c0638e0 con 0x7f87540b2880 2024-05-10T10:52:38.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.574+0000 7f8768ff9700 1 -- 172.21.15.107:0/964352680 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f876c0638e0 con 0x7f87540b2880 2024-05-10T10:52:38.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.576+0000 7f8771f02700 1 -- 172.21.15.107:0/964352680 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87540b2880 msgr2=0x7f87540b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:38.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.576+0000 7f8771f02700 1 --2- 172.21.15.107:0/964352680 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87540b2880 0x7f87540b4d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f876c078a80 tx=0x7f876000b2c0 comp rx=0 tx=0).stop 2024-05-10T10:52:38.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.576+0000 7f8771f02700 1 -- 172.21.15.107:0/964352680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c06bc10 msgr2=0x7f876c19f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:38.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.576+0000 7f8771f02700 1 --2- 172.21.15.107:0/964352680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c06bc10 0x7f876c19f870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f875c00d980 tx=0x7f875c00dc90 comp rx=0 tx=0).stop 2024-05-10T10:52:38.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.576+0000 7f8771f02700 1 -- 172.21.15.107:0/964352680 shutdown_connections 2024-05-10T10:52:38.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.576+0000 7f8771f02700 1 --2- 172.21.15.107:0/964352680 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87540b2880 0x7f87540b4d40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:38.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.576+0000 7f8771f02700 1 --2- 172.21.15.107:0/964352680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f876c109540 0x7f876c199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:38.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.576+0000 7f8771f02700 1 --2- 172.21.15.107:0/964352680 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f876c06bc10 0x7f876c19f870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:38.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.576+0000 7f8771f02700 1 --2- 172.21.15.107:0/964352680 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f876c06c5d0 0x7f876c19fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:38.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.576+0000 7f8771f02700 1 -- 172.21.15.107:0/964352680 >> 172.21.15.107:0/964352680 conn(0x7f876c078410 msgr2=0x7f876c101020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:38.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.576+0000 7f8771f02700 1 -- 172.21.15.107:0/964352680 shutdown_connections 2024-05-10T10:52:38.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:38.576+0000 7f8771f02700 1 -- 172.21.15.107:0/964352680 wait complete. 2024-05-10T10:52:38.824 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:52:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:52:38.553+0000 7f6393803700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-10T10:52:38.824 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:52:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:52:38.553+0000 7f6393803700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-10T10:52:38.824 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:52:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:52:38.553+0000 7f6393803700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-10T10:52:38.824 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:52:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:52:38.553+0000 7f6393803700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-10T10:52:38.824 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:52:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:52:38.553+0000 7f6393803700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-10T10:52:39.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:38 smithi184 ceph-mon[34585]: pgmap v295: 97 pgs: 97 active+clean; 584 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-05-10T10:52:39.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:38 smithi107 ceph-mon[30373]: pgmap v295: 97 pgs: 97 active+clean; 584 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-05-10T10:52:39.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:38 smithi196 ceph-mon[34872]: pgmap v295: 97 pgs: 97 active+clean; 584 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-05-10T10:52:39.323 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-10T10:52:39.570 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:52:39.981 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:39 smithi107 ceph-mon[30373]: from='client.14679 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:52:40.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:39 smithi184 ceph-mon[34585]: from='client.14679 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:52:40.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:39 smithi196 ceph-mon[34872]: from='client.14679 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:52:40.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:40 smithi107 ceph-mon[30373]: pgmap v296: 97 pgs: 97 active+clean; 584 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.1 KiB/s wr, 19 op/s 2024-05-10T10:52:40.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:40 smithi107 ceph-mon[30373]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-05-10T10:52:41.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:40 smithi184 ceph-mon[34585]: pgmap v296: 97 pgs: 97 active+clean; 584 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.1 KiB/s wr, 19 op/s 2024-05-10T10:52:41.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:40 smithi184 ceph-mon[34585]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-05-10T10:52:41.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.204+0000 7fd758fa6700 1 -- 172.21.15.107:0/1938215996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd754102d60 msgr2=0x7fd75410f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:41.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.204+0000 7fd758fa6700 1 --2- 172.21.15.107:0/1938215996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd754102d60 0x7fd75410f250 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00b0a0 tx=0x7fd74c00b3b0 comp rx=0 tx=0).stop 2024-05-10T10:52:41.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.204+0000 7fd758fa6700 1 -- 172.21.15.107:0/1938215996 shutdown_connections 2024-05-10T10:52:41.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.204+0000 7fd758fa6700 1 --2- 172.21.15.107:0/1938215996 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd754102d60 0x7fd75410f250 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:41.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.204+0000 7fd758fa6700 1 --2- 172.21.15.107:0/1938215996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd754108410 0x7fd7541087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:41.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.204+0000 7fd758fa6700 1 --2- 172.21.15.107:0/1938215996 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd7541023a0 0x7fd754102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:41.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.204+0000 7fd758fa6700 1 -- 172.21.15.107:0/1938215996 >> 172.21.15.107:0/1938215996 conn(0x7fd754079350 msgr2=0x7fd754079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:41.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.204+0000 7fd758fa6700 1 -- 172.21.15.107:0/1938215996 shutdown_connections 2024-05-10T10:52:41.205 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.204+0000 7fd758fa6700 1 -- 172.21.15.107:0/1938215996 wait complete. 2024-05-10T10:52:41.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.205+0000 7fd758fa6700 1 Processor -- start 2024-05-10T10:52:41.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.205+0000 7fd758fa6700 1 -- start start 2024-05-10T10:52:41.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.205+0000 7fd758fa6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7541023a0 0x7fd75419e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:41.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.205+0000 7fd758fa6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd754102d60 0x7fd75419ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:41.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.205+0000 7fd758fa6700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd754108410 0x7fd754198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:41.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.205+0000 7fd758fa6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd7541126f0 con 0x7fd7541023a0 2024-05-10T10:52:41.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.205+0000 7fd758fa6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd754112570 con 0x7fd754102d60 2024-05-10T10:52:41.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.205+0000 7fd758fa6700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd754112870 con 0x7fd754108410 2024-05-10T10:52:41.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.205+0000 7fd75259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7541023a0 0x7fd75419e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:41.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.205+0000 7fd75259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7541023a0 0x7fd75419e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47636/0 (socket says 172.21.15.107:47636) 2024-05-10T10:52:41.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.205+0000 7fd75259c700 1 -- 172.21.15.107:0/4225443301 learned_addr learned my addr 172.21.15.107:0/4225443301 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:52:41.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.205+0000 7fd75259c700 1 -- 172.21.15.107:0/4225443301 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd754108410 msgr2=0x7fd754198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:41.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.205+0000 7fd75259c700 1 --2- 172.21.15.107:0/4225443301 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd754108410 0x7fd754198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:41.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.205+0000 7fd75259c700 1 -- 172.21.15.107:0/4225443301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd754102d60 msgr2=0x7fd75419ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:41.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.205+0000 7fd75259c700 1 --2- 172.21.15.107:0/4225443301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd754102d60 0x7fd75419ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:41.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.205+0000 7fd75259c700 1 -- 172.21.15.107:0/4225443301 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7541990b0 con 0x7fd7541023a0 2024-05-10T10:52:41.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.206+0000 7fd75259c700 1 --2- 172.21.15.107:0/4225443301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7541023a0 0x7fd75419e790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd74400b530 tx=0x7fd74400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:41.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.206+0000 7fd7437fe700 1 -- 172.21.15.107:0/4225443301 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744015020 con 0x7fd7541023a0 2024-05-10T10:52:41.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.206+0000 7fd758fa6700 1 -- 172.21.15.107:0/4225443301 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7541993a0 con 0x7fd7541023a0 2024-05-10T10:52:41.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.206+0000 7fd7437fe700 1 -- 172.21.15.107:0/4225443301 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd744011d00 con 0x7fd7541023a0 2024-05-10T10:52:41.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.206+0000 7fd7437fe700 1 -- 172.21.15.107:0/4225443301 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744010e60 con 0x7fd7541023a0 2024-05-10T10:52:41.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.206+0000 7fd758fa6700 1 -- 172.21.15.107:0/4225443301 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7541a5660 con 0x7fd7541023a0 2024-05-10T10:52:41.209 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.207+0000 7fd758fa6700 1 -- 172.21.15.107:0/4225443301 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd75406a190 con 0x7fd7541023a0 2024-05-10T10:52:41.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.208+0000 7fd7437fe700 1 -- 172.21.15.107:0/4225443301 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7fd744018020 con 0x7fd7541023a0 2024-05-10T10:52:41.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.209+0000 7fd7437fe700 1 --2- 172.21.15.107:0/4225443301 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd73c0b2910 0x7fd73c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:41.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.209+0000 7fd751d9b700 1 --2- 172.21.15.107:0/4225443301 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd73c0b2910 0x7fd73c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:41.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.209+0000 7fd7437fe700 1 -- 172.21.15.107:0/4225443301 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fd7440e18f0 con 0x7fd7541023a0 2024-05-10T10:52:41.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.209+0000 7fd751d9b700 1 --2- 172.21.15.107:0/4225443301 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd73c0b2910 0x7fd73c0b4dd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd754079870 tx=0x7fd748005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:41.214 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.213+0000 7fd7437fe700 1 -- 172.21.15.107:0/4225443301 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd74401f020 con 0x7fd7541023a0 2024-05-10T10:52:41.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:40 smithi196 ceph-mon[34872]: pgmap v296: 97 pgs: 97 active+clean; 584 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.1 KiB/s wr, 19 op/s 2024-05-10T10:52:41.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:40 smithi196 ceph-mon[34872]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-05-10T10:52:41.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.452+0000 7fd758fa6700 1 -- 172.21.15.107:0/4225443301 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fd7540638e0 con 0x7fd73c0b2910 2024-05-10T10:52:41.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.479+0000 7fd7437fe700 1 -- 172.21.15.107:0/4225443301 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd7540638e0 con 0x7fd73c0b2910 2024-05-10T10:52:41.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.482+0000 7fd758fa6700 1 -- 172.21.15.107:0/4225443301 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd73c0b2910 msgr2=0x7fd73c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:41.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.482+0000 7fd758fa6700 1 --2- 172.21.15.107:0/4225443301 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd73c0b2910 0x7fd73c0b4dd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd754079870 tx=0x7fd748005c80 comp rx=0 tx=0).stop 2024-05-10T10:52:41.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.482+0000 7fd758fa6700 1 -- 172.21.15.107:0/4225443301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7541023a0 msgr2=0x7fd75419e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:41.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.482+0000 7fd758fa6700 1 --2- 172.21.15.107:0/4225443301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7541023a0 0x7fd75419e790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd74400b530 tx=0x7fd74400b8f0 comp rx=0 tx=0).stop 2024-05-10T10:52:41.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.482+0000 7fd758fa6700 1 -- 172.21.15.107:0/4225443301 shutdown_connections 2024-05-10T10:52:41.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.482+0000 7fd758fa6700 1 --2- 172.21.15.107:0/4225443301 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd73c0b2910 0x7fd73c0b4dd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:41.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.482+0000 7fd758fa6700 1 --2- 172.21.15.107:0/4225443301 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd754108410 0x7fd754198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:41.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.482+0000 7fd758fa6700 1 --2- 172.21.15.107:0/4225443301 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7541023a0 0x7fd75419e790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:41.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.482+0000 7fd758fa6700 1 --2- 172.21.15.107:0/4225443301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd754102d60 0x7fd75419ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:41.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.482+0000 7fd758fa6700 1 -- 172.21.15.107:0/4225443301 >> 172.21.15.107:0/4225443301 conn(0x7fd754079350 msgr2=0x7fd754100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:41.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.482+0000 7fd758fa6700 1 -- 172.21.15.107:0/4225443301 shutdown_connections 2024-05-10T10:52:41.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:41.482+0000 7fd758fa6700 1 -- 172.21.15.107:0/4225443301 wait complete. 2024-05-10T10:52:42.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:41 smithi184 ceph-mon[34585]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:52:42.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:41 smithi107 ceph-mon[30373]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:52:42.266 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-10T10:52:42.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:41 smithi196 ceph-mon[34872]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:52:42.510 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:52:42.883 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:42 smithi107 ceph-mon[30373]: pgmap v297: 97 pgs: 97 active+clean; 591 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.9 KiB/s wr, 21 op/s 2024-05-10T10:52:43.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:42 smithi184 ceph-mon[34585]: pgmap v297: 97 pgs: 97 active+clean; 591 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.9 KiB/s wr, 21 op/s 2024-05-10T10:52:43.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:42 smithi196 ceph-mon[34872]: pgmap v297: 97 pgs: 97 active+clean; 591 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.9 KiB/s wr, 21 op/s 2024-05-10T10:52:44.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.178+0000 7f0b53495700 1 -- 172.21.15.107:0/3054352927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b4c102390 msgr2=0x7f0b4c102810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:44.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.178+0000 7f0b53495700 1 --2- 172.21.15.107:0/3054352927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b4c102390 0x7f0b4c102810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0b40009990 tx=0x7f0b40009ca0 comp rx=0 tx=0).stop 2024-05-10T10:52:44.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.178+0000 7f0b53495700 1 -- 172.21.15.107:0/3054352927 shutdown_connections 2024-05-10T10:52:44.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.178+0000 7f0b53495700 1 --2- 172.21.15.107:0/3054352927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b4c108400 0x7f0b4c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:44.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.178+0000 7f0b53495700 1 --2- 172.21.15.107:0/3054352927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b4c102d50 0x7f0b4c10f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:44.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.178+0000 7f0b53495700 1 --2- 172.21.15.107:0/3054352927 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b4c102390 0x7f0b4c102810 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:44.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.178+0000 7f0b53495700 1 -- 172.21.15.107:0/3054352927 >> 172.21.15.107:0/3054352927 conn(0x7f0b4c079310 msgr2=0x7f0b4c079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:44.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.178+0000 7f0b53495700 1 -- 172.21.15.107:0/3054352927 shutdown_connections 2024-05-10T10:52:44.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.178+0000 7f0b53495700 1 -- 172.21.15.107:0/3054352927 wait complete. 2024-05-10T10:52:44.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b53495700 1 Processor -- start 2024-05-10T10:52:44.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b53495700 1 -- start start 2024-05-10T10:52:44.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b53495700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b4c102390 0x7f0b4c19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:44.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b53495700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b4c102d50 0x7f0b4c19afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:44.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b53495700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b4c108400 0x7f0b4c1a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:44.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b53495700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c1126e0 con 0x7f0b4c102390 2024-05-10T10:52:44.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b53495700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c112560 con 0x7f0b4c102d50 2024-05-10T10:52:44.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b53495700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c112860 con 0x7f0b4c108400 2024-05-10T10:52:44.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b51231700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b4c102390 0x7f0b4c19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:44.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b51231700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b4c102390 0x7f0b4c19aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47650/0 (socket says 172.21.15.107:47650) 2024-05-10T10:52:44.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b51231700 1 -- 172.21.15.107:0/2558768133 learned_addr learned my addr 172.21.15.107:0/2558768133 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:52:44.182 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b51a32700 1 --2- 172.21.15.107:0/2558768133 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b4c108400 0x7f0b4c1a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:44.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b50a30700 1 --2- 172.21.15.107:0/2558768133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b4c102d50 0x7f0b4c19afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:44.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b51231700 1 -- 172.21.15.107:0/2558768133 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b4c108400 msgr2=0x7f0b4c1a5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:44.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b51231700 1 --2- 172.21.15.107:0/2558768133 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b4c108400 0x7f0b4c1a5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:44.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b51231700 1 -- 172.21.15.107:0/2558768133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b4c102d50 msgr2=0x7f0b4c19afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:44.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b51231700 1 --2- 172.21.15.107:0/2558768133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b4c102d50 0x7f0b4c19afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:44.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b51231700 1 -- 172.21.15.107:0/2558768133 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4c1a6060 con 0x7f0b4c102390 2024-05-10T10:52:44.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b51a32700 1 --2- 172.21.15.107:0/2558768133 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b4c108400 0x7f0b4c1a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:52:44.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.179+0000 7f0b50a30700 1 --2- 172.21.15.107:0/2558768133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b4c102d50 0x7f0b4c19afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:52:44.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.180+0000 7f0b51231700 1 --2- 172.21.15.107:0/2558768133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b4c102390 0x7f0b4c19aaa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c00ba50 tx=0x7f0b3c00be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:44.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.180+0000 7f0b4a7fc700 1 -- 172.21.15.107:0/2558768133 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c019070 con 0x7f0b4c102390 2024-05-10T10:52:44.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.180+0000 7f0b4a7fc700 1 -- 172.21.15.107:0/2558768133 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0b3c014440 con 0x7f0b4c102390 2024-05-10T10:52:44.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.180+0000 7f0b53495700 1 -- 172.21.15.107:0/2558768133 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4c1a6290 con 0x7f0b4c102390 2024-05-10T10:52:44.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.180+0000 7f0b4a7fc700 1 -- 172.21.15.107:0/2558768133 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c0075d0 con 0x7f0b4c102390 2024-05-10T10:52:44.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.180+0000 7f0b53495700 1 -- 172.21.15.107:0/2558768133 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b4c1a67f0 con 0x7f0b4c102390 2024-05-10T10:52:44.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.181+0000 7f0b53495700 1 -- 172.21.15.107:0/2558768133 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b4c10a970 con 0x7f0b4c102390 2024-05-10T10:52:44.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.182+0000 7f0b4a7fc700 1 -- 172.21.15.107:0/2558768133 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f0b3c01c070 con 0x7f0b4c102390 2024-05-10T10:52:44.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.183+0000 7f0b4a7fc700 1 --2- 172.21.15.107:0/2558768133 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0b340b2990 0x7f0b340b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:44.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.183+0000 7f0b50a30700 1 --2- 172.21.15.107:0/2558768133 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0b340b2990 0x7f0b340b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:44.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.183+0000 7f0b4a7fc700 1 -- 172.21.15.107:0/2558768133 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f0b3c0e1a10 con 0x7f0b4c102390 2024-05-10T10:52:44.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.183+0000 7f0b50a30700 1 --2- 172.21.15.107:0/2558768133 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0b340b2990 0x7f0b340b4e50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0b40006010 tx=0x7f0b4000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:44.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.186+0000 7f0b4a7fc700 1 -- 172.21.15.107:0/2558768133 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0b3c0a9890 con 0x7f0b4c102390 2024-05-10T10:52:44.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.419+0000 7f0b53495700 1 -- 172.21.15.107:0/2558768133 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f0b4c0638e0 con 0x7f0b340b2990 2024-05-10T10:52:44.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.425+0000 7f0b4a7fc700 1 -- 172.21.15.107:0/2558768133 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f0b4c0638e0 con 0x7f0b340b2990 2024-05-10T10:52:44.426 INFO:teuthology.orchestra.run.smithi107.stdout:/volumes/qa/sv_0/c57603d7-61fa-4bf2-a5f4-bd8c1827cc4c 2024-05-10T10:52:44.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.427+0000 7f0b53495700 1 -- 172.21.15.107:0/2558768133 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0b340b2990 msgr2=0x7f0b340b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:44.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.427+0000 7f0b53495700 1 --2- 172.21.15.107:0/2558768133 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0b340b2990 0x7f0b340b4e50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0b40006010 tx=0x7f0b4000b540 comp rx=0 tx=0).stop 2024-05-10T10:52:44.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.428+0000 7f0b53495700 1 -- 172.21.15.107:0/2558768133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b4c102390 msgr2=0x7f0b4c19aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:44.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.428+0000 7f0b53495700 1 --2- 172.21.15.107:0/2558768133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b4c102390 0x7f0b4c19aaa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c00ba50 tx=0x7f0b3c00be10 comp rx=0 tx=0).stop 2024-05-10T10:52:44.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.428+0000 7f0b53495700 1 -- 172.21.15.107:0/2558768133 shutdown_connections 2024-05-10T10:52:44.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.428+0000 7f0b53495700 1 --2- 172.21.15.107:0/2558768133 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0b340b2990 0x7f0b340b4e50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:44.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.428+0000 7f0b53495700 1 --2- 172.21.15.107:0/2558768133 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b4c108400 0x7f0b4c1a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:44.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.428+0000 7f0b53495700 1 --2- 172.21.15.107:0/2558768133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b4c102390 0x7f0b4c19aaa0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:44.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.428+0000 7f0b53495700 1 --2- 172.21.15.107:0/2558768133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b4c102d50 0x7f0b4c19afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:44.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.428+0000 7f0b53495700 1 -- 172.21.15.107:0/2558768133 >> 172.21.15.107:0/2558768133 conn(0x7f0b4c079310 msgr2=0x7f0b4c100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:44.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.428+0000 7f0b53495700 1 -- 172.21.15.107:0/2558768133 shutdown_connections 2024-05-10T10:52:44.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:44.428+0000 7f0b53495700 1 -- 172.21.15.107:0/2558768133 wait complete. 2024-05-10T10:52:45.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:44 smithi184 ceph-mon[34585]: pgmap v298: 97 pgs: 97 active+clean; 591 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.5 KiB/s wr, 21 op/s 2024-05-10T10:52:45.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:44 smithi184 ceph-mon[34585]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:52:45.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:44 smithi107 ceph-mon[30373]: pgmap v298: 97 pgs: 97 active+clean; 591 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.5 KiB/s wr, 21 op/s 2024-05-10T10:52:45.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:44 smithi107 ceph-mon[30373]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:52:45.279 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-10T10:52:45.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:44 smithi196 ceph-mon[34872]: pgmap v298: 97 pgs: 97 active+clean; 591 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.5 KiB/s wr, 21 op/s 2024-05-10T10:52:45.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:44 smithi196 ceph-mon[34872]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:52:45.528 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:52:46.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:46 smithi107 ceph-mon[30373]: pgmap v299: 97 pgs: 97 active+clean; 610 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.7 KiB/s wr, 21 op/s 2024-05-10T10:52:47.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:46 smithi184 ceph-mon[34585]: pgmap v299: 97 pgs: 97 active+clean; 610 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.7 KiB/s wr, 21 op/s 2024-05-10T10:52:47.228 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.228+0000 7f4c749e3700 1 -- 172.21.15.107:0/467188834 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c7006bc70 msgr2=0x7f4c7006c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:47.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.228+0000 7f4c749e3700 1 --2- 172.21.15.107:0/467188834 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c7006bc70 0x7f4c7006c0f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4c580099c0 tx=0x7f4c58009cd0 comp rx=0 tx=0).stop 2024-05-10T10:52:47.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.228+0000 7f4c749e3700 1 -- 172.21.15.107:0/467188834 shutdown_connections 2024-05-10T10:52:47.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.228+0000 7f4c749e3700 1 --2- 172.21.15.107:0/467188834 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c70109590 0x7f4c70109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:47.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.228+0000 7f4c749e3700 1 --2- 172.21.15.107:0/467188834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c7006c630 0x7f4c70110360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:47.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.228+0000 7f4c749e3700 1 --2- 172.21.15.107:0/467188834 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c7006bc70 0x7f4c7006c0f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:47.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.228+0000 7f4c749e3700 1 -- 172.21.15.107:0/467188834 >> 172.21.15.107:0/467188834 conn(0x7f4c70079440 msgr2=0x7f4c70079850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:47.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.228+0000 7f4c749e3700 1 -- 172.21.15.107:0/467188834 shutdown_connections 2024-05-10T10:52:47.229 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.228+0000 7f4c749e3700 1 -- 172.21.15.107:0/467188834 wait complete. 2024-05-10T10:52:47.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.229+0000 7f4c749e3700 1 Processor -- start 2024-05-10T10:52:47.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.229+0000 7f4c749e3700 1 -- start start 2024-05-10T10:52:47.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.229+0000 7f4c749e3700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c7006bc70 0x7f4c7019f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:47.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.229+0000 7f4c749e3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c7006c630 0x7f4c7019fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:47.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.229+0000 7f4c749e3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c70109590 0x7f4c70199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:47.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.229+0000 7f4c749e3700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4c701138b0 con 0x7f4c70109590 2024-05-10T10:52:47.231 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.229+0000 7f4c749e3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4c70113730 con 0x7f4c7006c630 2024-05-10T10:52:47.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.229+0000 7f4c749e3700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4c70113a30 con 0x7f4c7006bc70 2024-05-10T10:52:47.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.229+0000 7f4c6ed9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c70109590 0x7f4c70199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:47.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.229+0000 7f4c6ed9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c70109590 0x7f4c70199b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52740/0 (socket says 172.21.15.107:52740) 2024-05-10T10:52:47.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.229+0000 7f4c6ed9d700 1 -- 172.21.15.107:0/1851168243 learned_addr learned my addr 172.21.15.107:0/1851168243 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:52:47.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.229+0000 7f4c65d9b700 1 --2- 172.21.15.107:0/1851168243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c7006c630 0x7f4c7019fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:47.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.229+0000 7f4c6e59c700 1 --2- 172.21.15.107:0/1851168243 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c7006bc70 0x7f4c7019f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:47.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.229+0000 7f4c6ed9d700 1 -- 172.21.15.107:0/1851168243 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c7006bc70 msgr2=0x7f4c7019f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:47.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.229+0000 7f4c6ed9d700 1 --2- 172.21.15.107:0/1851168243 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c7006bc70 0x7f4c7019f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:47.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.229+0000 7f4c6ed9d700 1 -- 172.21.15.107:0/1851168243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c7006c630 msgr2=0x7f4c7019fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:47.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.229+0000 7f4c6ed9d700 1 --2- 172.21.15.107:0/1851168243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c7006c630 0x7f4c7019fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:47.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.229+0000 7f4c6ed9d700 1 -- 172.21.15.107:0/1851168243 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7019a2b0 con 0x7f4c70109590 2024-05-10T10:52:47.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.230+0000 7f4c6ed9d700 1 --2- 172.21.15.107:0/1851168243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c70109590 0x7f4c70199b50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800b970 tx=0x7f4c6800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:47.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.230+0000 7f4c67fff700 1 -- 172.21.15.107:0/1851168243 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68019070 con 0x7f4c70109590 2024-05-10T10:52:47.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.230+0000 7f4c67fff700 1 -- 172.21.15.107:0/1851168243 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4c6800ce00 con 0x7f4c70109590 2024-05-10T10:52:47.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.230+0000 7f4c67fff700 1 -- 172.21.15.107:0/1851168243 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68007370 con 0x7f4c70109590 2024-05-10T10:52:47.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.230+0000 7f4c749e3700 1 -- 172.21.15.107:0/1851168243 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7019a5a0 con 0x7f4c70109590 2024-05-10T10:52:47.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.230+0000 7f4c749e3700 1 -- 172.21.15.107:0/1851168243 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c701a6810 con 0x7f4c70109590 2024-05-10T10:52:47.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.231+0000 7f4c749e3700 1 -- 172.21.15.107:0/1851168243 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c7006a190 con 0x7f4c70109590 2024-05-10T10:52:47.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.232+0000 7f4c67fff700 1 -- 172.21.15.107:0/1851168243 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f4c6801c070 con 0x7f4c70109590 2024-05-10T10:52:47.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.233+0000 7f4c67fff700 1 --2- 172.21.15.107:0/1851168243 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4c5c0b2910 0x7f4c5c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:47.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.233+0000 7f4c6e59c700 1 --2- 172.21.15.107:0/1851168243 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4c5c0b2910 0x7f4c5c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:47.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.233+0000 7f4c67fff700 1 -- 172.21.15.107:0/1851168243 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f4c680e1920 con 0x7f4c70109590 2024-05-10T10:52:47.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.233+0000 7f4c6e59c700 1 --2- 172.21.15.107:0/1851168243 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4c5c0b2910 0x7f4c5c0b4dd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4c60006fd0 tx=0x7f4c60008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:47.237 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.236+0000 7f4c67fff700 1 -- 172.21.15.107:0/1851168243 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4c680a97a0 con 0x7f4c70109590 2024-05-10T10:52:47.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:46 smithi196 ceph-mon[34872]: pgmap v299: 97 pgs: 97 active+clean; 610 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.7 KiB/s wr, 21 op/s 2024-05-10T10:52:47.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.470+0000 7f4c749e3700 1 -- 172.21.15.107:0/1851168243 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f4c700638e0 con 0x7f4c5c0b2910 2024-05-10T10:52:47.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.500+0000 7f4c67fff700 1 -- 172.21.15.107:0/1851168243 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4c700638e0 con 0x7f4c5c0b2910 2024-05-10T10:52:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.502+0000 7f4c749e3700 1 -- 172.21.15.107:0/1851168243 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4c5c0b2910 msgr2=0x7f4c5c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.502+0000 7f4c749e3700 1 --2- 172.21.15.107:0/1851168243 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4c5c0b2910 0x7f4c5c0b4dd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4c60006fd0 tx=0x7f4c60008040 comp rx=0 tx=0).stop 2024-05-10T10:52:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.502+0000 7f4c749e3700 1 -- 172.21.15.107:0/1851168243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c70109590 msgr2=0x7f4c70199b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.502+0000 7f4c749e3700 1 --2- 172.21.15.107:0/1851168243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c70109590 0x7f4c70199b50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800b970 tx=0x7f4c6800bc80 comp rx=0 tx=0).stop 2024-05-10T10:52:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.502+0000 7f4c749e3700 1 -- 172.21.15.107:0/1851168243 shutdown_connections 2024-05-10T10:52:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.502+0000 7f4c749e3700 1 --2- 172.21.15.107:0/1851168243 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4c5c0b2910 0x7f4c5c0b4dd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.502+0000 7f4c749e3700 1 --2- 172.21.15.107:0/1851168243 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4c7006bc70 0x7f4c7019f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.502+0000 7f4c749e3700 1 --2- 172.21.15.107:0/1851168243 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4c70109590 0x7f4c70199b50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.502+0000 7f4c749e3700 1 --2- 172.21.15.107:0/1851168243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c7006c630 0x7f4c7019fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.502+0000 7f4c749e3700 1 -- 172.21.15.107:0/1851168243 >> 172.21.15.107:0/1851168243 conn(0x7f4c70079440 msgr2=0x7f4c70100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.502+0000 7f4c749e3700 1 -- 172.21.15.107:0/1851168243 shutdown_connections 2024-05-10T10:52:47.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:47.502+0000 7f4c749e3700 1 -- 172.21.15.107:0/1851168243 wait complete. 2024-05-10T10:52:48.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:47 smithi184 ceph-mon[34585]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:52:48.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:47 smithi107 ceph-mon[30373]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:52:48.261 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-10T10:52:48.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:47 smithi196 ceph-mon[34872]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:52:48.505 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:52:48.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:48 smithi107 ceph-mon[30373]: pgmap v300: 97 pgs: 97 active+clean; 610 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.1 KiB/s wr, 14 op/s 2024-05-10T10:52:49.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:48 smithi184 ceph-mon[34585]: pgmap v300: 97 pgs: 97 active+clean; 610 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.1 KiB/s wr, 14 op/s 2024-05-10T10:52:49.214 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:48 smithi196 ceph-mon[34872]: pgmap v300: 97 pgs: 97 active+clean; 610 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.1 KiB/s wr, 14 op/s 2024-05-10T10:52:50.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.271+0000 7fe5cadd6700 1 -- 172.21.15.107:0/110734365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5c4107420 msgr2=0x7fe5c4107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:50.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.271+0000 7fe5cadd6700 1 --2- 172.21.15.107:0/110734365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5c4107420 0x7fe5c4107800 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009990 tx=0x7fe5b8009ca0 comp rx=0 tx=0).stop 2024-05-10T10:52:50.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.271+0000 7fe5cadd6700 1 -- 172.21.15.107:0/110734365 shutdown_connections 2024-05-10T10:52:50.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.271+0000 7fe5cadd6700 1 --2- 172.21.15.107:0/110734365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5c41030b0 0x7fe5c410f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:50.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.271+0000 7fe5cadd6700 1 --2- 172.21.15.107:0/110734365 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5c4107420 0x7fe5c4107800 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:50.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.271+0000 7fe5cadd6700 1 --2- 172.21.15.107:0/110734365 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5c41026f0 0x7fe5c4102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:50.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.271+0000 7fe5cadd6700 1 -- 172.21.15.107:0/110734365 >> 172.21.15.107:0/110734365 conn(0x7fe5c4078210 msgr2=0x7fe5c4078620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:50.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.271+0000 7fe5cadd6700 1 -- 172.21.15.107:0/110734365 shutdown_connections 2024-05-10T10:52:50.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.271+0000 7fe5cadd6700 1 -- 172.21.15.107:0/110734365 wait complete. 2024-05-10T10:52:50.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.271+0000 7fe5cadd6700 1 Processor -- start 2024-05-10T10:52:50.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.271+0000 7fe5cadd6700 1 -- start start 2024-05-10T10:52:50.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5cadd6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5c41026f0 0x7fe5c419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:50.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5cadd6700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5c41030b0 0x7fe5c419afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:50.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5cadd6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5c4107420 0x7fe5c41a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:50.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5cadd6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c4112690 con 0x7fe5c4107420 2024-05-10T10:52:50.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5cadd6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c4112510 con 0x7fe5c41026f0 2024-05-10T10:52:50.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5cadd6700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c4112810 con 0x7fe5c41030b0 2024-05-10T10:52:50.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5c9373700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5c4107420 0x7fe5c41a5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:50.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5c9373700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5c4107420 0x7fe5c41a5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52760/0 (socket says 172.21.15.107:52760) 2024-05-10T10:52:50.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5c9373700 1 -- 172.21.15.107:0/3744007847 learned_addr learned my addr 172.21.15.107:0/3744007847 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:52:50.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5c3fff700 1 --2- 172.21.15.107:0/3744007847 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5c41030b0 0x7fe5c419afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:50.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5c8b72700 1 --2- 172.21.15.107:0/3744007847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5c41026f0 0x7fe5c419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:50.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5c9373700 1 -- 172.21.15.107:0/3744007847 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5c41030b0 msgr2=0x7fe5c419afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:50.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5c9373700 1 --2- 172.21.15.107:0/3744007847 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5c41030b0 0x7fe5c419afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:50.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5c9373700 1 -- 172.21.15.107:0/3744007847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5c41026f0 msgr2=0x7fe5c419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:50.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5c9373700 1 --2- 172.21.15.107:0/3744007847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5c41026f0 0x7fe5c419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:50.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5c9373700 1 -- 172.21.15.107:0/3744007847 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c41a6050 con 0x7fe5c4107420 2024-05-10T10:52:50.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5c3fff700 1 --2- 172.21.15.107:0/3744007847 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5c41030b0 0x7fe5c419afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:52:50.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5c9373700 1 --2- 172.21.15.107:0/3744007847 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5c4107420 0x7fe5c41a5b10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00ada0 tx=0x7fe5bc00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:50.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5c1ffb700 1 -- 172.21.15.107:0/3744007847 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc017020 con 0x7fe5c4107420 2024-05-10T10:52:50.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.272+0000 7fe5cadd6700 1 -- 172.21.15.107:0/3744007847 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c41a6220 con 0x7fe5c4107420 2024-05-10T10:52:50.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.273+0000 7fe5c1ffb700 1 -- 172.21.15.107:0/3744007847 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe5bc00cda0 con 0x7fe5c4107420 2024-05-10T10:52:50.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.273+0000 7fe5c1ffb700 1 -- 172.21.15.107:0/3744007847 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc005310 con 0x7fe5c4107420 2024-05-10T10:52:50.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.273+0000 7fe5cadd6700 1 -- 172.21.15.107:0/3744007847 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c41a6730 con 0x7fe5c4107420 2024-05-10T10:52:50.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.274+0000 7fe5cadd6700 1 -- 172.21.15.107:0/3744007847 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c410a960 con 0x7fe5c4107420 2024-05-10T10:52:50.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.275+0000 7fe5c1ffb700 1 -- 172.21.15.107:0/3744007847 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7fe5bc00c8d0 con 0x7fe5c4107420 2024-05-10T10:52:50.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.276+0000 7fe5c1ffb700 1 --2- 172.21.15.107:0/3744007847 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe5b40b2990 0x7fe5b40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:50.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.276+0000 7fe5c8b72700 1 --2- 172.21.15.107:0/3744007847 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe5b40b2990 0x7fe5b40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:50.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.276+0000 7fe5c1ffb700 1 -- 172.21.15.107:0/3744007847 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fe5bc0e1e70 con 0x7fe5c4107420 2024-05-10T10:52:50.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.276+0000 7fe5c8b72700 1 --2- 172.21.15.107:0/3744007847 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe5b40b2990 0x7fe5b40b4e50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8006010 tx=0x7fe5b8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:50.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.279+0000 7fe5c1ffb700 1 -- 172.21.15.107:0/3744007847 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe5bc021020 con 0x7fe5c4107420 2024-05-10T10:52:50.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.516+0000 7fe5cadd6700 1 -- 172.21.15.107:0/3744007847 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fe5c40638e0 con 0x7fe5b40b2990 2024-05-10T10:52:50.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.521+0000 7fe5c1ffb700 1 -- 172.21.15.107:0/3744007847 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fe5c40638e0 con 0x7fe5b40b2990 2024-05-10T10:52:50.522 INFO:teuthology.orchestra.run.smithi107.stdout:/volumes/qa/sv_1/2fd36ad3-1e0d-47af-93cf-f6f84d4f04b1 2024-05-10T10:52:50.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.523+0000 7fe5cadd6700 1 -- 172.21.15.107:0/3744007847 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe5b40b2990 msgr2=0x7fe5b40b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:50.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.523+0000 7fe5cadd6700 1 --2- 172.21.15.107:0/3744007847 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe5b40b2990 0x7fe5b40b4e50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8006010 tx=0x7fe5b8005960 comp rx=0 tx=0).stop 2024-05-10T10:52:50.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.523+0000 7fe5cadd6700 1 -- 172.21.15.107:0/3744007847 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5c4107420 msgr2=0x7fe5c41a5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:50.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.523+0000 7fe5cadd6700 1 --2- 172.21.15.107:0/3744007847 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5c4107420 0x7fe5c41a5b10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00ada0 tx=0x7fe5bc00c330 comp rx=0 tx=0).stop 2024-05-10T10:52:50.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.524+0000 7fe5cadd6700 1 -- 172.21.15.107:0/3744007847 shutdown_connections 2024-05-10T10:52:50.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.524+0000 7fe5cadd6700 1 --2- 172.21.15.107:0/3744007847 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe5b40b2990 0x7fe5b40b4e50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:50.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.524+0000 7fe5cadd6700 1 --2- 172.21.15.107:0/3744007847 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe5c4107420 0x7fe5c41a5b10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:50.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.524+0000 7fe5cadd6700 1 --2- 172.21.15.107:0/3744007847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5c41026f0 0x7fe5c419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:50.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.524+0000 7fe5cadd6700 1 --2- 172.21.15.107:0/3744007847 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe5c41030b0 0x7fe5c419afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:50.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.524+0000 7fe5cadd6700 1 -- 172.21.15.107:0/3744007847 >> 172.21.15.107:0/3744007847 conn(0x7fe5c4078210 msgr2=0x7fe5c4100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:50.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.524+0000 7fe5cadd6700 1 -- 172.21.15.107:0/3744007847 shutdown_connections 2024-05-10T10:52:50.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:50.524+0000 7fe5cadd6700 1 -- 172.21.15.107:0/3744007847 wait complete. 2024-05-10T10:52:51.109 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:50 smithi107 ceph-mon[30373]: pgmap v301: 97 pgs: 97 active+clean; 610 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-05-10T10:52:51.137 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:52:51.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:50 smithi184 ceph-mon[34585]: pgmap v301: 97 pgs: 97 active+clean; 610 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-05-10T10:52:51.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:50 smithi196 ceph-mon[34872]: pgmap v301: 97 pgs: 97 active+clean; 610 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-05-10T10:52:51.380 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:52:52.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:51 smithi184 ceph-mon[34585]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:52:52.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:51 smithi107 ceph-mon[30373]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:52:52.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:51 smithi196 ceph-mon[34872]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:52:52.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:52 smithi107 ceph-mon[30373]: pgmap v302: 97 pgs: 97 active+clean; 628 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.5 KiB/s wr, 13 op/s 2024-05-10T10:52:53.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:52 smithi184 ceph-mon[34585]: pgmap v302: 97 pgs: 97 active+clean; 628 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.5 KiB/s wr, 13 op/s 2024-05-10T10:52:53.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.188+0000 7fb6cc273700 1 -- 172.21.15.107:0/3817348115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6c4103560 msgr2=0x7fb6c41039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:53.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.188+0000 7fb6cc273700 1 --2- 172.21.15.107:0/3817348115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6c4103560 0x7fb6c41039e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb6c00099c0 tx=0x7fb6c0009cd0 comp rx=0 tx=0).stop 2024-05-10T10:52:53.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.188+0000 7fb6cc273700 1 -- 172.21.15.107:0/3817348115 shutdown_connections 2024-05-10T10:52:53.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.188+0000 7fb6cc273700 1 --2- 172.21.15.107:0/3817348115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6c4103f20 0x7fb6c4110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:53.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.188+0000 7fb6cc273700 1 --2- 172.21.15.107:0/3817348115 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6c4109540 0x7fb6c4109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:53.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.188+0000 7fb6cc273700 1 --2- 172.21.15.107:0/3817348115 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6c4103560 0x7fb6c41039e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:53.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.188+0000 7fb6cc273700 1 -- 172.21.15.107:0/3817348115 >> 172.21.15.107:0/3817348115 conn(0x7fb6c407a660 msgr2=0x7fb6c407aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:53.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.188+0000 7fb6cc273700 1 -- 172.21.15.107:0/3817348115 shutdown_connections 2024-05-10T10:52:53.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.188+0000 7fb6cc273700 1 -- 172.21.15.107:0/3817348115 wait complete. 2024-05-10T10:52:53.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.189+0000 7fb6cc273700 1 Processor -- start 2024-05-10T10:52:53.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.189+0000 7fb6cc273700 1 -- start start 2024-05-10T10:52:53.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.189+0000 7fb6cc273700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6c4103560 0x7fb6c419f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:53.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.189+0000 7fb6cc273700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6c4103f20 0x7fb6c419fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:53.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.189+0000 7fb6cc273700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6c4109540 0x7fb6c4199b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:53.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.189+0000 7fb6cc273700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c41137e0 con 0x7fb6c4109540 2024-05-10T10:52:53.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.189+0000 7fb6cc273700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c4113660 con 0x7fb6c4103560 2024-05-10T10:52:53.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.189+0000 7fb6cc273700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c4113960 con 0x7fb6c4103f20 2024-05-10T10:52:53.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.189+0000 7fb6ca810700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6c4109540 0x7fb6c4199b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:53.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.189+0000 7fb6ca810700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6c4109540 0x7fb6c4199b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52790/0 (socket says 172.21.15.107:52790) 2024-05-10T10:52:53.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.189+0000 7fb6ca810700 1 -- 172.21.15.107:0/114931637 learned_addr learned my addr 172.21.15.107:0/114931637 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:52:53.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.189+0000 7fb6ca00f700 1 --2- 172.21.15.107:0/114931637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6c4103560 0x7fb6c419f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:53.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.190+0000 7fb6c980e700 1 --2- 172.21.15.107:0/114931637 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6c4103f20 0x7fb6c419fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:53.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.190+0000 7fb6ca810700 1 -- 172.21.15.107:0/114931637 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6c4103f20 msgr2=0x7fb6c419fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:53.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.190+0000 7fb6ca810700 1 --2- 172.21.15.107:0/114931637 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6c4103f20 0x7fb6c419fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:53.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.190+0000 7fb6ca810700 1 -- 172.21.15.107:0/114931637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6c4103560 msgr2=0x7fb6c419f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:53.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.190+0000 7fb6ca810700 1 --2- 172.21.15.107:0/114931637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6c4103560 0x7fb6c419f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:53.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.190+0000 7fb6ca810700 1 -- 172.21.15.107:0/114931637 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c419a260 con 0x7fb6c4109540 2024-05-10T10:52:53.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.190+0000 7fb6ca810700 1 --2- 172.21.15.107:0/114931637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6c4109540 0x7fb6c4199b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00b970 tx=0x7fb6bc00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:53.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.190+0000 7fb6bb7fe700 1 -- 172.21.15.107:0/114931637 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc019070 con 0x7fb6c4109540 2024-05-10T10:52:53.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.190+0000 7fb6cc273700 1 -- 172.21.15.107:0/114931637 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c419a550 con 0x7fb6c4109540 2024-05-10T10:52:53.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.190+0000 7fb6bb7fe700 1 -- 172.21.15.107:0/114931637 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb6bc00ce00 con 0x7fb6c4109540 2024-05-10T10:52:53.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.190+0000 7fb6bb7fe700 1 -- 172.21.15.107:0/114931637 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc007370 con 0x7fb6c4109540 2024-05-10T10:52:53.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.190+0000 7fb6cc273700 1 -- 172.21.15.107:0/114931637 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c41a67c0 con 0x7fb6c4109540 2024-05-10T10:52:53.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.191+0000 7fb6cc273700 1 -- 172.21.15.107:0/114931637 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c4104bb0 con 0x7fb6c4109540 2024-05-10T10:52:53.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.192+0000 7fb6bb7fe700 1 -- 172.21.15.107:0/114931637 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7fb6bc01c070 con 0x7fb6c4109540 2024-05-10T10:52:53.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.193+0000 7fb6bb7fe700 1 --2- 172.21.15.107:0/114931637 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb6b00b2910 0x7fb6b00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:53.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.193+0000 7fb6ca00f700 1 --2- 172.21.15.107:0/114931637 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb6b00b2910 0x7fb6b00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:53.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.193+0000 7fb6bb7fe700 1 -- 172.21.15.107:0/114931637 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fb6bc0e14a0 con 0x7fb6c4109540 2024-05-10T10:52:53.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.193+0000 7fb6ca00f700 1 --2- 172.21.15.107:0/114931637 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb6b00b2910 0x7fb6b00b4dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4005950 tx=0x7fb6b400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:53.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.197+0000 7fb6bb7fe700 1 -- 172.21.15.107:0/114931637 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb6bc0a9320 con 0x7fb6c4109540 2024-05-10T10:52:53.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:52 smithi196 ceph-mon[34872]: pgmap v302: 97 pgs: 97 active+clean; 628 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.5 KiB/s wr, 13 op/s 2024-05-10T10:52:53.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.450+0000 7fb6cc273700 1 -- 172.21.15.107:0/114931637 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6c419b010 con 0x7fb6c4109540 2024-05-10T10:52:53.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.450+0000 7fb6bb7fe700 1 -- 172.21.15.107:0/114931637 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11951 (secure 0 0 0) 0x7fb6c419b010 con 0x7fb6c4109540 2024-05-10T10:52:53.451 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:52:53.451 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T10:52:17.367732+0000","modified":"2024-05-10T10:52:35.666052+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24482,"mds_1":24449,"mds_2":24442,"mds_3":24431,"mds_4":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/2332963094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":2332963094},{"type":"v1","addr":"172.21.15.107:6841","nonce":2332963094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.184:6839/16501252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":16501252},{"type":"v1","addr":"172.21.15.184:6839","nonce":16501252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24449,24442,24482,24431,24430]},"id":1}]} 2024-05-10T10:52:53.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.452+0000 7fb6cc273700 1 -- 172.21.15.107:0/114931637 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb6b00b2910 msgr2=0x7fb6b00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:53.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.453+0000 7fb6cc273700 1 --2- 172.21.15.107:0/114931637 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb6b00b2910 0x7fb6b00b4dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4005950 tx=0x7fb6b400a300 comp rx=0 tx=0).stop 2024-05-10T10:52:53.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.453+0000 7fb6cc273700 1 -- 172.21.15.107:0/114931637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6c4109540 msgr2=0x7fb6c4199b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:53.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.453+0000 7fb6cc273700 1 --2- 172.21.15.107:0/114931637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6c4109540 0x7fb6c4199b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00b970 tx=0x7fb6bc00bc80 comp rx=0 tx=0).stop 2024-05-10T10:52:53.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.453+0000 7fb6cc273700 1 -- 172.21.15.107:0/114931637 shutdown_connections 2024-05-10T10:52:53.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.453+0000 7fb6cc273700 1 --2- 172.21.15.107:0/114931637 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb6b00b2910 0x7fb6b00b4dd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:53.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.453+0000 7fb6cc273700 1 --2- 172.21.15.107:0/114931637 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6c4109540 0x7fb6c4199b00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:53.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.453+0000 7fb6cc273700 1 --2- 172.21.15.107:0/114931637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6c4103560 0x7fb6c419f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:53.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.453+0000 7fb6cc273700 1 --2- 172.21.15.107:0/114931637 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb6c4103f20 0x7fb6c419fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:53.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.453+0000 7fb6cc273700 1 -- 172.21.15.107:0/114931637 >> 172.21.15.107:0/114931637 conn(0x7fb6c407a660 msgr2=0x7fb6c4102170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:53.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.453+0000 7fb6cc273700 1 -- 172.21.15.107:0/114931637 shutdown_connections 2024-05-10T10:52:53.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:53.453+0000 7fb6cc273700 1 -- 172.21.15.107:0/114931637 wait complete. 2024-05-10T10:52:53.455 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 26 2024-05-10T10:52:54.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:53 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/114931637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:52:54.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:53 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/114931637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:52:54.220 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-10T10:52:54.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:53 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/114931637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:52:54.465 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:52:55.131 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:54 smithi107 ceph-mon[30373]: pgmap v303: 97 pgs: 97 active+clean; 628 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.7 KiB/s wr, 11 op/s 2024-05-10T10:52:55.145 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:54 smithi184 ceph-mon[34585]: pgmap v303: 97 pgs: 97 active+clean; 628 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.7 KiB/s wr, 11 op/s 2024-05-10T10:52:55.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:54 smithi196 ceph-mon[34872]: pgmap v303: 97 pgs: 97 active+clean; 628 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.7 KiB/s wr, 11 op/s 2024-05-10T10:52:56.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.244+0000 7f4e4818c700 1 -- 172.21.15.107:0/1008976076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e40103f20 msgr2=0x7f4e40110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:56.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.244+0000 7f4e4818c700 1 --2- 172.21.15.107:0/1008976076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e40103f20 0x7f4e40110310 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800b0d0 tx=0x7f4e3800b3e0 comp rx=0 tx=0).stop 2024-05-10T10:52:56.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.244+0000 7f4e4818c700 1 -- 172.21.15.107:0/1008976076 shutdown_connections 2024-05-10T10:52:56.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.244+0000 7f4e4818c700 1 --2- 172.21.15.107:0/1008976076 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e40109540 0x7f4e40109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:56.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.244+0000 7f4e4818c700 1 --2- 172.21.15.107:0/1008976076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e40103f20 0x7f4e40110310 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:56.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.244+0000 7f4e4818c700 1 --2- 172.21.15.107:0/1008976076 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e40103560 0x7f4e401039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:56.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.244+0000 7f4e4818c700 1 -- 172.21.15.107:0/1008976076 >> 172.21.15.107:0/1008976076 conn(0x7f4e4007a660 msgr2=0x7f4e4007aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:56.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.244+0000 7f4e4818c700 1 -- 172.21.15.107:0/1008976076 shutdown_connections 2024-05-10T10:52:56.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.244+0000 7f4e4818c700 1 -- 172.21.15.107:0/1008976076 wait complete. 2024-05-10T10:52:56.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e4818c700 1 Processor -- start 2024-05-10T10:52:56.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e4818c700 1 -- start start 2024-05-10T10:52:56.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e4818c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e40103560 0x7f4e40199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:56.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e4818c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e40103f20 0x7f4e4019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:56.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e4818c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e40109540 0x7f4e4019e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:56.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e4818c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4e40113860 con 0x7f4e40103f20 2024-05-10T10:52:56.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e4818c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4e401136e0 con 0x7f4e40109540 2024-05-10T10:52:56.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e4818c700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4e401139e0 con 0x7f4e40103560 2024-05-10T10:52:56.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e45727700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e40103f20 0x7f4e4019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:56.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e45727700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e40103f20 0x7f4e4019a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:52794/0 (socket says 172.21.15.107:52794) 2024-05-10T10:52:56.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e45727700 1 -- 172.21.15.107:0/2561115706 learned_addr learned my addr 172.21.15.107:0/2561115706 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:52:56.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e46729700 1 --2- 172.21.15.107:0/2561115706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e40109540 0x7f4e4019e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:56.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e45f28700 1 --2- 172.21.15.107:0/2561115706 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e40103560 0x7f4e40199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:56.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e45727700 1 -- 172.21.15.107:0/2561115706 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e40103560 msgr2=0x7f4e40199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:56.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e45727700 1 --2- 172.21.15.107:0/2561115706 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e40103560 0x7f4e40199db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:56.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e45727700 1 -- 172.21.15.107:0/2561115706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e40109540 msgr2=0x7f4e4019e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:56.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e45727700 1 --2- 172.21.15.107:0/2561115706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e40109540 0x7f4e4019e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:56.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e45727700 1 -- 172.21.15.107:0/2561115706 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4019edc0 con 0x7f4e40103f20 2024-05-10T10:52:56.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e45f28700 1 --2- 172.21.15.107:0/2561115706 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e40103560 0x7f4e40199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:52:56.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.245+0000 7f4e45727700 1 --2- 172.21.15.107:0/2561115706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e40103f20 0x7f4e4019a2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000b530 tx=0x7f4e3000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:56.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.246+0000 7f4e36ffd700 1 -- 172.21.15.107:0/2561115706 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e30015020 con 0x7f4e40103f20 2024-05-10T10:52:56.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.246+0000 7f4e36ffd700 1 -- 172.21.15.107:0/2561115706 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4e30011d00 con 0x7f4e40103f20 2024-05-10T10:52:56.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.246+0000 7f4e36ffd700 1 -- 172.21.15.107:0/2561115706 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e30010e60 con 0x7f4e40103f20 2024-05-10T10:52:56.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.246+0000 7f4e4818c700 1 -- 172.21.15.107:0/2561115706 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e4019f0b0 con 0x7f4e40103f20 2024-05-10T10:52:56.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.246+0000 7f4e4818c700 1 -- 172.21.15.107:0/2561115706 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e401a6930 con 0x7f4e40103f20 2024-05-10T10:52:56.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.247+0000 7f4e4818c700 1 -- 172.21.15.107:0/2561115706 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e4006a190 con 0x7f4e40103f20 2024-05-10T10:52:56.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.248+0000 7f4e36ffd700 1 -- 172.21.15.107:0/2561115706 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f4e30018020 con 0x7f4e40103f20 2024-05-10T10:52:56.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.249+0000 7f4e36ffd700 1 --2- 172.21.15.107:0/2561115706 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4e2c0b2990 0x7f4e2c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:56.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.249+0000 7f4e45f28700 1 --2- 172.21.15.107:0/2561115706 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4e2c0b2990 0x7f4e2c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:56.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.249+0000 7f4e36ffd700 1 -- 172.21.15.107:0/2561115706 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f4e300e1890 con 0x7f4e40103f20 2024-05-10T10:52:56.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.249+0000 7f4e45f28700 1 --2- 172.21.15.107:0/2561115706 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4e2c0b2990 0x7f4e2c0b4e50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c007900 tx=0x7f4e3c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:56.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.253+0000 7f4e36ffd700 1 -- 172.21.15.107:0/2561115706 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4e3001f020 con 0x7f4e40103f20 2024-05-10T10:52:56.458 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.457+0000 7f4e4818c700 1 -- 172.21.15.107:0/2561115706 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e4010b9d0 con 0x7f4e40103f20 2024-05-10T10:52:56.459 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.458+0000 7f4e36ffd700 1 -- 172.21.15.107:0/2561115706 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22277 (secure 0 0 0) 0x7f4e300a9710 con 0x7f4e40103f20 2024-05-10T10:52:56.459 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:52:56.460 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":80,"fsid":"0ba8a8e4-0eba-11ef-bc98-c7b262605968","created":"2024-05-10T10:44:13.064379+0000","modified":"2024-05-10T10:52:17.367774+0000","last_up_change":"2024-05-10T10:51:12.979718+0000","last_in_change":"2024-05-10T10:50:53.297651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T10:47:31.600062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T10:52:10.705022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T10:52:14.377732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"503f960c-a74b-4979-9bf9-42c90a2885a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6803","nonce":4213004004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6805","nonce":4213004004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6809","nonce":4213004004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6807","nonce":4213004004}]},"public_addr":"172.21.15.107:6803/4213004004","cluster_addr":"172.21.15.107:6805/4213004004","heartbeat_back_addr":"172.21.15.107:6809/4213004004","heartbeat_front_addr":"172.21.15.107:6807/4213004004","state":["exists","up"]},{"osd":1,"uuid":"f0f89167-1aa1-40a1-b122-c7f203c587d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6801","nonce":3242825160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6803","nonce":3242825160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6807","nonce":3242825160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6805","nonce":3242825160}]},"public_addr":"172.21.15.184:6801/3242825160","cluster_addr":"172.21.15.184:6803/3242825160","heartbeat_back_addr":"172.21.15.184:6807/3242825160","heartbeat_front_addr":"172.21.15.184:6805/3242825160","state":["exists","up"]},{"osd":2,"uuid":"7588b9be-b935-450a-944f-3feca69c029c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6801","nonce":137473043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6803","nonce":137473043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6807","nonce":137473043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6805","nonce":137473043}]},"public_addr":"172.21.15.196:6801/137473043","cluster_addr":"172.21.15.196:6803/137473043","heartbeat_back_addr":"172.21.15.196:6807/137473043","heartbeat_front_addr":"172.21.15.196:6805/137473043","state":["exists","up"]},{"osd":3,"uuid":"589ec3bb-884a-4441-a9d2-1f34ab372cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6811","nonce":1995642021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6813","nonce":1995642021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6817","nonce":1995642021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6815","nonce":1995642021}]},"public_addr":"172.21.15.107:6811/1995642021","cluster_addr":"172.21.15.107:6813/1995642021","heartbeat_back_addr":"172.21.15.107:6817/1995642021","heartbeat_front_addr":"172.21.15.107:6815/1995642021","state":["exists","up"]},{"osd":4,"uuid":"b72cdb50-492b-4406-8f21-37e4b2cf5a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6809","nonce":271550329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6811","nonce":271550329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6815","nonce":271550329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6813","nonce":271550329}]},"public_addr":"172.21.15.184:6809/271550329","cluster_addr":"172.21.15.184:6811/271550329","heartbeat_back_addr":"172.21.15.184:6815/271550329","heartbeat_front_addr":"172.21.15.184:6813/271550329","state":["exists","up"]},{"osd":5,"uuid":"05b6ad82-9153-44df-ae64-50c82d304429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6809","nonce":3681130435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6811","nonce":3681130435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6815","nonce":3681130435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6813","nonce":3681130435}]},"public_addr":"172.21.15.196:6809/3681130435","cluster_addr":"172.21.15.196:6811/3681130435","heartbeat_back_addr":"172.21.15.196:6815/3681130435","heartbeat_front_addr":"172.21.15.196:6813/3681130435","state":["exists","up"]},{"osd":6,"uuid":"bceadd7a-20bf-4482-aaab-46a2539cf37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6819","nonce":4223253757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6821","nonce":4223253757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6825","nonce":4223253757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6823","nonce":4223253757}]},"public_addr":"172.21.15.107:6819/4223253757","cluster_addr":"172.21.15.107:6821/4223253757","heartbeat_back_addr":"172.21.15.107:6825/4223253757","heartbeat_front_addr":"172.21.15.107:6823/4223253757","state":["exists","up"]},{"osd":7,"uuid":"0d9243a6-0e16-4677-a0b0-010be4162148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6817","nonce":2850715284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6819","nonce":2850715284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6823","nonce":2850715284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6821","nonce":2850715284}]},"public_addr":"172.21.15.184:6817/2850715284","cluster_addr":"172.21.15.184:6819/2850715284","heartbeat_back_addr":"172.21.15.184:6823/2850715284","heartbeat_front_addr":"172.21.15.184:6821/2850715284","state":["exists","up"]},{"osd":8,"uuid":"24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6817","nonce":504426486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6819","nonce":504426486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6823","nonce":504426486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6821","nonce":504426486}]},"public_addr":"172.21.15.196:6817/504426486","cluster_addr":"172.21.15.196:6819/504426486","heartbeat_back_addr":"172.21.15.196:6823/504426486","heartbeat_front_addr":"172.21.15.196:6821/504426486","state":["exists","up"]},{"osd":9,"uuid":"8bcb03ec-1342-4679-9343-fcefd28dd69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6827","nonce":1533051760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6829","nonce":1533051760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6833","nonce":1533051760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6831","nonce":1533051760}]},"public_addr":"172.21.15.107:6827/1533051760","cluster_addr":"172.21.15.107:6829/1533051760","heartbeat_back_addr":"172.21.15.107:6833/1533051760","heartbeat_front_addr":"172.21.15.107:6831/1533051760","state":["exists","up"]},{"osd":10,"uuid":"78374015-aa7f-4288-b5ae-be64a5182bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6825","nonce":1387541139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6827","nonce":1387541139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6831","nonce":1387541139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6829","nonce":1387541139}]},"public_addr":"172.21.15.184:6825/1387541139","cluster_addr":"172.21.15.184:6827/1387541139","heartbeat_back_addr":"172.21.15.184:6831/1387541139","heartbeat_front_addr":"172.21.15.184:6829/1387541139","state":["exists","up"]},{"osd":11,"uuid":"4aeb2b1a-f35e-44ea-be64-f60c31a096e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6825","nonce":3861964533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6827","nonce":3861964533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6831","nonce":3861964533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6829","nonce":3861964533}]},"public_addr":"172.21.15.196:6825/3861964533","cluster_addr":"172.21.15.196:6827/3861964533","heartbeat_back_addr":"172.21.15.196:6831/3861964533","heartbeat_front_addr":"172.21.15.196:6829/3861964533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:46:42.110232+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:06.232727+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:29.623425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:53.466546+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:17.927564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:41.913454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:06.610629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:31.048807+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:54.922097+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:20.727547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:46.072303+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:51:11.022775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:0/3518338734":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/4092342993":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6800/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:6800/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3761740075":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/2215024983":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/2124974715":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3361930986":"2024-05-11T10:44:40.339608+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T10:52:56.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.461+0000 7f4e4818c700 1 -- 172.21.15.107:0/2561115706 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4e2c0b2990 msgr2=0x7f4e2c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:56.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.461+0000 7f4e4818c700 1 --2- 172.21.15.107:0/2561115706 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4e2c0b2990 0x7f4e2c0b4e50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c007900 tx=0x7f4e3c008040 comp rx=0 tx=0).stop 2024-05-10T10:52:56.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.461+0000 7f4e4818c700 1 -- 172.21.15.107:0/2561115706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e40103f20 msgr2=0x7f4e4019a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:56.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.461+0000 7f4e4818c700 1 --2- 172.21.15.107:0/2561115706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e40103f20 0x7f4e4019a2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000b530 tx=0x7f4e3000b8f0 comp rx=0 tx=0).stop 2024-05-10T10:52:56.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.461+0000 7f4e4818c700 1 -- 172.21.15.107:0/2561115706 shutdown_connections 2024-05-10T10:52:56.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.461+0000 7f4e4818c700 1 --2- 172.21.15.107:0/2561115706 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4e2c0b2990 0x7f4e2c0b4e50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:56.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.461+0000 7f4e4818c700 1 --2- 172.21.15.107:0/2561115706 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e40103560 0x7f4e40199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:56.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.461+0000 7f4e4818c700 1 --2- 172.21.15.107:0/2561115706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e40109540 0x7f4e4019e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:56.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.461+0000 7f4e4818c700 1 --2- 172.21.15.107:0/2561115706 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4e40103f20 0x7f4e4019a2f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:56.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.461+0000 7f4e4818c700 1 -- 172.21.15.107:0/2561115706 >> 172.21.15.107:0/2561115706 conn(0x7f4e4007a660 msgr2=0x7f4e40102170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:56.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.461+0000 7f4e4818c700 1 -- 172.21.15.107:0/2561115706 shutdown_connections 2024-05-10T10:52:56.462 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:56.461+0000 7f4e4818c700 1 -- 172.21.15.107:0/2561115706 wait complete. 2024-05-10T10:52:57.059 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:56 smithi107 ceph-mon[30373]: pgmap v304: 97 pgs: 97 active+clean; 637 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.5 KiB/s wr, 14 op/s 2024-05-10T10:52:57.059 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:56 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2561115706' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:52:57.061 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-10T10:52:57.061 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-10T10:52:57.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:56 smithi184 ceph-mon[34585]: pgmap v304: 97 pgs: 97 active+clean; 637 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.5 KiB/s wr, 14 op/s 2024-05-10T10:52:57.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:56 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/2561115706' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:52:57.308 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:52:57.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:56 smithi196 ceph-mon[34872]: pgmap v304: 97 pgs: 97 active+clean; 637 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.5 KiB/s wr, 14 op/s 2024-05-10T10:52:57.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:56 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/2561115706' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:52:59.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.997+0000 7f161454e700 1 -- 172.21.15.107:0/2344499569 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f160c102230 msgr2=0x7f160c109280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:59.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.997+0000 7f161454e700 1 --2- 172.21.15.107:0/2344499569 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f160c102230 0x7f160c109280 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f15fc0099c0 tx=0x7f15fc009cd0 comp rx=0 tx=0).stop 2024-05-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.998+0000 7f161454e700 1 -- 172.21.15.107:0/2344499569 shutdown_connections 2024-05-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.998+0000 7f161454e700 1 --2- 172.21.15.107:0/2344499569 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f160c109960 0x7f160c110390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.998+0000 7f161454e700 1 --2- 172.21.15.107:0/2344499569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f160c101880 0x7f160c101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.998+0000 7f161454e700 1 --2- 172.21.15.107:0/2344499569 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f160c102230 0x7f160c109280 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.998+0000 7f161454e700 1 -- 172.21.15.107:0/2344499569 >> 172.21.15.107:0/2344499569 conn(0x7f160c0785a0 msgr2=0x7f160c0ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.998+0000 7f161454e700 1 -- 172.21.15.107:0/2344499569 shutdown_connections 2024-05-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.998+0000 7f161454e700 1 -- 172.21.15.107:0/2344499569 wait complete. 2024-05-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.998+0000 7f161454e700 1 Processor -- start 2024-05-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.998+0000 7f161454e700 1 -- start start 2024-05-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.998+0000 7f161454e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f160c101880 0x7f160c199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.998+0000 7f161454e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f160c102230 0x7f160c19a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.998+0000 7f161454e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f160c109960 0x7f160c19e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:59.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.998+0000 7f161454e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f160c113870 con 0x7f160c101880 2024-05-10T10:52:59.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.998+0000 7f161454e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f160c1136f0 con 0x7f160c102230 2024-05-10T10:52:59.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.998+0000 7f161454e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f160c1139f0 con 0x7f160c109960 2024-05-10T10:52:59.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.999+0000 7f16122ea700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f160c101880 0x7f160c199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:59.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.999+0000 7f16122ea700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f160c101880 0x7f160c199da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56090/0 (socket says 172.21.15.107:56090) 2024-05-10T10:52:59.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.999+0000 7f16122ea700 1 -- 172.21.15.107:0/4147057815 learned_addr learned my addr 172.21.15.107:0/4147057815 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:52:59.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.999+0000 7f1612aeb700 1 --2- 172.21.15.107:0/4147057815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f160c109960 0x7f160c19e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:59.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.999+0000 7f1611ae9700 1 --2- 172.21.15.107:0/4147057815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f160c102230 0x7f160c19a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:59.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.999+0000 7f16122ea700 1 -- 172.21.15.107:0/4147057815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f160c109960 msgr2=0x7f160c19e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:59.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.999+0000 7f16122ea700 1 --2- 172.21.15.107:0/4147057815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f160c109960 0x7f160c19e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:59.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.999+0000 7f16122ea700 1 -- 172.21.15.107:0/4147057815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f160c102230 msgr2=0x7f160c19a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:59.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.999+0000 7f16122ea700 1 --2- 172.21.15.107:0/4147057815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f160c102230 0x7f160c19a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:59.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.999+0000 7f16122ea700 1 -- 172.21.15.107:0/4147057815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160c19ed60 con 0x7f160c101880 2024-05-10T10:52:59.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.999+0000 7f16122ea700 1 --2- 172.21.15.107:0/4147057815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f160c101880 0x7f160c199da0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f160800b530 tx=0x7f160800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:59.002 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.999+0000 7f16037fe700 1 -- 172.21.15.107:0/4147057815 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1608015020 con 0x7f160c101880 2024-05-10T10:52:59.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.999+0000 7f16037fe700 1 -- 172.21.15.107:0/4147057815 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1608011d00 con 0x7f160c101880 2024-05-10T10:52:59.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.999+0000 7f161454e700 1 -- 172.21.15.107:0/4147057815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f160c19f050 con 0x7f160c101880 2024-05-10T10:52:59.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.999+0000 7f16037fe700 1 -- 172.21.15.107:0/4147057815 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1608010e60 con 0x7f160c101880 2024-05-10T10:52:59.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:58.999+0000 7f161454e700 1 -- 172.21.15.107:0/4147057815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f160c1a68d0 con 0x7f160c101880 2024-05-10T10:52:59.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.000+0000 7f161454e700 1 -- 172.21.15.107:0/4147057815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f160c1029b0 con 0x7f160c101880 2024-05-10T10:52:59.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.002+0000 7f16037fe700 1 -- 172.21.15.107:0/4147057815 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f1608018020 con 0x7f160c101880 2024-05-10T10:52:59.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.002+0000 7f16037fe700 1 --2- 172.21.15.107:0/4147057815 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f15f80b2990 0x7f15f80b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:52:59.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.002+0000 7f1611ae9700 1 --2- 172.21.15.107:0/4147057815 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f15f80b2990 0x7f15f80b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:52:59.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.002+0000 7f16037fe700 1 -- 172.21.15.107:0/4147057815 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f16080e1e70 con 0x7f160c101880 2024-05-10T10:52:59.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.003+0000 7f1611ae9700 1 --2- 172.21.15.107:0/4147057815 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f15f80b2990 0x7f15f80b4e50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f15fc000c00 tx=0x7f15fc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:52:59.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.006+0000 7f16037fe700 1 -- 172.21.15.107:0/4147057815 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f160801f020 con 0x7f160c101880 2024-05-10T10:52:59.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:58 smithi184 ceph-mon[34585]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-05-10T10:52:59.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:58 smithi107 ceph-mon[30373]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-05-10T10:52:59.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.211+0000 7f161454e700 1 -- 172.21.15.107:0/4147057815 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f160c19b0b0 con 0x7f15f80b2990 2024-05-10T10:52:59.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.225+0000 7f16037fe700 1 -- 172.21.15.107:0/4147057815 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258741 (secure 0 0 0) 0x7f160c19b0b0 con 0x7f15f80b2990 2024-05-10T10:52:59.230 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:52:59.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.228+0000 7f161454e700 1 -- 172.21.15.107:0/4147057815 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f15f80b2990 msgr2=0x7f15f80b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:59.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.228+0000 7f161454e700 1 --2- 172.21.15.107:0/4147057815 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f15f80b2990 0x7f15f80b4e50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f15fc000c00 tx=0x7f15fc005fb0 comp rx=0 tx=0).stop 2024-05-10T10:52:59.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.228+0000 7f161454e700 1 -- 172.21.15.107:0/4147057815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f160c101880 msgr2=0x7f160c199da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:52:59.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.228+0000 7f161454e700 1 --2- 172.21.15.107:0/4147057815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f160c101880 0x7f160c199da0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f160800b530 tx=0x7f160800b8f0 comp rx=0 tx=0).stop 2024-05-10T10:52:59.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.228+0000 7f161454e700 1 -- 172.21.15.107:0/4147057815 shutdown_connections 2024-05-10T10:52:59.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.228+0000 7f161454e700 1 --2- 172.21.15.107:0/4147057815 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f15f80b2990 0x7f15f80b4e50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:59.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.228+0000 7f161454e700 1 --2- 172.21.15.107:0/4147057815 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f160c109960 0x7f160c19e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:59.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.228+0000 7f161454e700 1 --2- 172.21.15.107:0/4147057815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f160c101880 0x7f160c199da0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:59.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.228+0000 7f161454e700 1 --2- 172.21.15.107:0/4147057815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f160c102230 0x7f160c19a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:52:59.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.228+0000 7f161454e700 1 -- 172.21.15.107:0/4147057815 >> 172.21.15.107:0/4147057815 conn(0x7f160c0785a0 msgr2=0x7f160c1002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:52:59.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.228+0000 7f161454e700 1 -- 172.21.15.107:0/4147057815 shutdown_connections 2024-05-10T10:52:59.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:52:59.228+0000 7f161454e700 1 -- 172.21.15.107:0/4147057815 wait complete. 2024-05-10T10:52:59.233 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-05-10T10:52:59.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:58 smithi196 ceph-mon[34872]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-05-10T10:52:59.899 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2024-05-10T10:52:57.612371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651782,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":334,"num_read_kb":259,"num_write":363,"num_write_kb":2277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":298,"ondisk_log_size":298,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369856,"kb_used_data":12384,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571968,"statfs":{"total":1151940427776,"available":1151561695232,"internally_reserved":0,"allocated":12681216,"data_stored":6978486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27539,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":112,"num_read_kb":78,"num_write":18,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002959"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691313+0000","last_change":"2024-05-10T10:52:15.686294+0000","last_active":"2024-05-10T10:52:17.691313+0000","last_peered":"2024-05-10T10:52:17.691313+0000","last_clean":"2024-05-10T10:52:17.691313+0000","last_became_active":"2024-05-10T10:52:15.685324+0000","last_became_peered":"2024-05-10T10:52:15.685324+0000","last_unstale":"2024-05-10T10:52:17.691313+0000","last_undegraded":"2024-05-10T10:52:17.691313+0000","last_fullsized":"2024-05-10T10:52:17.691313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:20.777432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691414+0000","last_change":"2024-05-10T10:52:15.687542+0000","last_active":"2024-05-10T10:52:17.691414+0000","last_peered":"2024-05-10T10:52:17.691414+0000","last_clean":"2024-05-10T10:52:17.691414+0000","last_became_active":"2024-05-10T10:52:15.687258+0000","last_became_peered":"2024-05-10T10:52:15.687258+0000","last_unstale":"2024-05-10T10:52:17.691414+0000","last_undegraded":"2024-05-10T10:52:17.691414+0000","last_fullsized":"2024-05-10T10:52:17.691414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:08.522392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691139+0000","last_change":"2024-05-10T10:52:15.682314+0000","last_active":"2024-05-10T10:52:17.691139+0000","last_peered":"2024-05-10T10:52:17.691139+0000","last_clean":"2024-05-10T10:52:17.691139+0000","last_became_active":"2024-05-10T10:52:15.681939+0000","last_became_peered":"2024-05-10T10:52:15.681939+0000","last_unstale":"2024-05-10T10:52:17.691139+0000","last_undegraded":"2024-05-10T10:52:17.691139+0000","last_fullsized":"2024-05-10T10:52:17.691139+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:04.857969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.679717+0000","last_change":"2024-05-10T10:52:15.693451+0000","last_active":"2024-05-10T10:52:17.679717+0000","last_peered":"2024-05-10T10:52:17.679717+0000","last_clean":"2024-05-10T10:52:17.679717+0000","last_became_active":"2024-05-10T10:52:15.693041+0000","last_became_peered":"2024-05-10T10:52:15.693041+0000","last_unstale":"2024-05-10T10:52:17.679717+0000","last_undegraded":"2024-05-10T10:52:17.679717+0000","last_fullsized":"2024-05-10T10:52:17.679717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:57:14.959699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678856+0000","last_change":"2024-05-10T10:52:15.679527+0000","last_active":"2024-05-10T10:52:17.678856+0000","last_peered":"2024-05-10T10:52:17.678856+0000","last_clean":"2024-05-10T10:52:17.678856+0000","last_became_active":"2024-05-10T10:52:15.679153+0000","last_became_peered":"2024-05-10T10:52:15.679153+0000","last_unstale":"2024-05-10T10:52:17.678856+0000","last_undegraded":"2024-05-10T10:52:17.678856+0000","last_fullsized":"2024-05-10T10:52:17.678856+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:58.738486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690410+0000","last_change":"2024-05-10T10:52:15.685905+0000","last_active":"2024-05-10T10:52:17.690410+0000","last_peered":"2024-05-10T10:52:17.690410+0000","last_clean":"2024-05-10T10:52:17.690410+0000","last_became_active":"2024-05-10T10:52:15.685628+0000","last_became_peered":"2024-05-10T10:52:15.685628+0000","last_unstale":"2024-05-10T10:52:17.690410+0000","last_undegraded":"2024-05-10T10:52:17.690410+0000","last_fullsized":"2024-05-10T10:52:17.690410+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:16.776307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.692063+0000","last_change":"2024-05-10T10:52:15.692951+0000","last_active":"2024-05-10T10:52:17.692063+0000","last_peered":"2024-05-10T10:52:17.692063+0000","last_clean":"2024-05-10T10:52:17.692063+0000","last_became_active":"2024-05-10T10:52:15.692594+0000","last_became_peered":"2024-05-10T10:52:15.692594+0000","last_unstale":"2024-05-10T10:52:17.692063+0000","last_undegraded":"2024-05-10T10:52:17.692063+0000","last_fullsized":"2024-05-10T10:52:17.692063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:04.105565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.677953+0000","last_change":"2024-05-10T10:52:15.692349+0000","last_active":"2024-05-10T10:52:17.677953+0000","last_peered":"2024-05-10T10:52:17.677953+0000","last_clean":"2024-05-10T10:52:17.677953+0000","last_became_active":"2024-05-10T10:52:15.691840+0000","last_became_peered":"2024-05-10T10:52:15.691840+0000","last_unstale":"2024-05-10T10:52:17.677953+0000","last_undegraded":"2024-05-10T10:52:17.677953+0000","last_fullsized":"2024-05-10T10:52:17.677953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:32:25.011085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691729+0000","last_change":"2024-05-10T10:52:15.686531+0000","last_active":"2024-05-10T10:52:17.691729+0000","last_peered":"2024-05-10T10:52:17.691729+0000","last_clean":"2024-05-10T10:52:17.691729+0000","last_became_active":"2024-05-10T10:52:15.686029+0000","last_became_peered":"2024-05-10T10:52:15.686029+0000","last_unstale":"2024-05-10T10:52:17.691729+0000","last_undegraded":"2024-05-10T10:52:17.691729+0000","last_fullsized":"2024-05-10T10:52:17.691729+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:30.836606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690784+0000","last_change":"2024-05-10T10:52:15.697314+0000","last_active":"2024-05-10T10:52:17.690784+0000","last_peered":"2024-05-10T10:52:17.690784+0000","last_clean":"2024-05-10T10:52:17.690784+0000","last_became_active":"2024-05-10T10:52:15.696944+0000","last_became_peered":"2024-05-10T10:52:15.696944+0000","last_unstale":"2024-05-10T10:52:17.690784+0000","last_undegraded":"2024-05-10T10:52:17.690784+0000","last_fullsized":"2024-05-10T10:52:17.690784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:10.098904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.692430+0000","last_change":"2024-05-10T10:52:15.690866+0000","last_active":"2024-05-10T10:52:17.692430+0000","last_peered":"2024-05-10T10:52:17.692430+0000","last_clean":"2024-05-10T10:52:17.692430+0000","last_became_active":"2024-05-10T10:52:15.690533+0000","last_became_peered":"2024-05-10T10:52:15.690533+0000","last_unstale":"2024-05-10T10:52:17.692430+0000","last_undegraded":"2024-05-10T10:52:17.692430+0000","last_fullsized":"2024-05-10T10:52:17.692430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:48.290897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.679647+0000","last_change":"2024-05-10T10:52:15.696386+0000","last_active":"2024-05-10T10:52:17.679647+0000","last_peered":"2024-05-10T10:52:17.679647+0000","last_clean":"2024-05-10T10:52:17.679647+0000","last_became_active":"2024-05-10T10:52:15.696044+0000","last_became_peered":"2024-05-10T10:52:15.696044+0000","last_unstale":"2024-05-10T10:52:17.679647+0000","last_undegraded":"2024-05-10T10:52:17.679647+0000","last_fullsized":"2024-05-10T10:52:17.679647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:48.259860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.689831+0000","last_change":"2024-05-10T10:52:15.691796+0000","last_active":"2024-05-10T10:52:17.689831+0000","last_peered":"2024-05-10T10:52:17.689831+0000","last_clean":"2024-05-10T10:52:17.689831+0000","last_became_active":"2024-05-10T10:52:15.690952+0000","last_became_peered":"2024-05-10T10:52:15.690952+0000","last_unstale":"2024-05-10T10:52:17.689831+0000","last_undegraded":"2024-05-10T10:52:17.689831+0000","last_fullsized":"2024-05-10T10:52:17.689831+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:10.645645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691248+0000","last_change":"2024-05-10T10:52:15.683303+0000","last_active":"2024-05-10T10:52:17.691248+0000","last_peered":"2024-05-10T10:52:17.691248+0000","last_clean":"2024-05-10T10:52:17.691248+0000","last_became_active":"2024-05-10T10:52:15.682753+0000","last_became_peered":"2024-05-10T10:52:15.682753+0000","last_unstale":"2024-05-10T10:52:17.691248+0000","last_undegraded":"2024-05-10T10:52:17.691248+0000","last_fullsized":"2024-05-10T10:52:17.691248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:00.167463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690936+0000","last_change":"2024-05-10T10:52:15.691668+0000","last_active":"2024-05-10T10:52:17.690936+0000","last_peered":"2024-05-10T10:52:17.690936+0000","last_clean":"2024-05-10T10:52:17.690936+0000","last_became_active":"2024-05-10T10:52:15.691323+0000","last_became_peered":"2024-05-10T10:52:15.691323+0000","last_unstale":"2024-05-10T10:52:17.690936+0000","last_undegraded":"2024-05-10T10:52:17.690936+0000","last_fullsized":"2024-05-10T10:52:17.690936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:09.235092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690810+0000","last_change":"2024-05-10T10:52:15.689859+0000","last_active":"2024-05-10T10:52:17.690810+0000","last_peered":"2024-05-10T10:52:17.690810+0000","last_clean":"2024-05-10T10:52:17.690810+0000","last_became_active":"2024-05-10T10:52:15.689060+0000","last_became_peered":"2024-05-10T10:52:15.689060+0000","last_unstale":"2024-05-10T10:52:17.690810+0000","last_undegraded":"2024-05-10T10:52:17.690810+0000","last_fullsized":"2024-05-10T10:52:17.690810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:42.029942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691501+0000","last_change":"2024-05-10T10:52:15.686711+0000","last_active":"2024-05-10T10:52:17.691501+0000","last_peered":"2024-05-10T10:52:17.691501+0000","last_clean":"2024-05-10T10:52:17.691501+0000","last_became_active":"2024-05-10T10:52:15.685817+0000","last_became_peered":"2024-05-10T10:52:15.685817+0000","last_unstale":"2024-05-10T10:52:17.691501+0000","last_undegraded":"2024-05-10T10:52:17.691501+0000","last_fullsized":"2024-05-10T10:52:17.691501+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:50:25.703341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690140+0000","last_change":"2024-05-10T10:52:15.681702+0000","last_active":"2024-05-10T10:52:17.690140+0000","last_peered":"2024-05-10T10:52:17.690140+0000","last_clean":"2024-05-10T10:52:17.690140+0000","last_became_active":"2024-05-10T10:52:15.681400+0000","last_became_peered":"2024-05-10T10:52:15.681400+0000","last_unstale":"2024-05-10T10:52:17.690140+0000","last_undegraded":"2024-05-10T10:52:17.690140+0000","last_fullsized":"2024-05-10T10:52:17.690140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:07.520500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691301+0000","last_change":"2024-05-10T10:52:15.684321+0000","last_active":"2024-05-10T10:52:17.691301+0000","last_peered":"2024-05-10T10:52:17.691301+0000","last_clean":"2024-05-10T10:52:17.691301+0000","last_became_active":"2024-05-10T10:52:15.683099+0000","last_became_peered":"2024-05-10T10:52:15.683099+0000","last_unstale":"2024-05-10T10:52:17.691301+0000","last_undegraded":"2024-05-10T10:52:17.691301+0000","last_fullsized":"2024-05-10T10:52:17.691301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:09.310292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":57,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:52.699042+0000","last_change":"2024-05-10T10:52:12.530258+0000","last_active":"2024-05-10T10:52:52.699042+0000","last_peered":"2024-05-10T10:52:52.699042+0000","last_clean":"2024-05-10T10:52:52.699042+0000","last_became_active":"2024-05-10T10:52:12.529842+0000","last_became_peered":"2024-05-10T10:52:12.529842+0000","last_unstale":"2024-05-10T10:52:52.699042+0000","last_undegraded":"2024-05-10T10:52:52.699042+0000","last_fullsized":"2024-05-10T10:52:52.699042+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:13.525038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678444+0000","last_change":"2024-05-10T10:52:15.693217+0000","last_active":"2024-05-10T10:52:17.678444+0000","last_peered":"2024-05-10T10:52:17.678444+0000","last_clean":"2024-05-10T10:52:17.678444+0000","last_became_active":"2024-05-10T10:52:15.692933+0000","last_became_peered":"2024-05-10T10:52:15.692933+0000","last_unstale":"2024-05-10T10:52:17.678444+0000","last_undegraded":"2024-05-10T10:52:17.678444+0000","last_fullsized":"2024-05-10T10:52:17.678444+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:38:15.821098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.693813+0000","last_change":"2024-05-10T10:52:12.630918+0000","last_active":"2024-05-10T10:52:17.693813+0000","last_peered":"2024-05-10T10:52:17.693813+0000","last_clean":"2024-05-10T10:52:17.693813+0000","last_became_active":"2024-05-10T10:52:12.630563+0000","last_became_peered":"2024-05-10T10:52:12.630563+0000","last_unstale":"2024-05-10T10:52:17.693813+0000","last_undegraded":"2024-05-10T10:52:17.693813+0000","last_fullsized":"2024-05-10T10:52:17.693813+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:58:03.341362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.692604+0000","last_change":"2024-05-10T10:52:15.676831+0000","last_active":"2024-05-10T10:52:17.692604+0000","last_peered":"2024-05-10T10:52:17.692604+0000","last_clean":"2024-05-10T10:52:17.692604+0000","last_became_active":"2024-05-10T10:52:15.676506+0000","last_became_peered":"2024-05-10T10:52:15.676506+0000","last_unstale":"2024-05-10T10:52:17.692604+0000","last_undegraded":"2024-05-10T10:52:17.692604+0000","last_fullsized":"2024-05-10T10:52:17.692604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:43.498800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:33.669733+0000","last_change":"2024-05-10T10:52:12.532092+0000","last_active":"2024-05-10T10:52:33.669733+0000","last_peered":"2024-05-10T10:52:33.669733+0000","last_clean":"2024-05-10T10:52:33.669733+0000","last_became_active":"2024-05-10T10:52:12.531649+0000","last_became_peered":"2024-05-10T10:52:12.531649+0000","last_unstale":"2024-05-10T10:52:33.669733+0000","last_undegraded":"2024-05-10T10:52:33.669733+0000","last_fullsized":"2024-05-10T10:52:33.669733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.709935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691201+0000","last_change":"2024-05-10T10:52:15.683024+0000","last_active":"2024-05-10T10:52:17.691201+0000","last_peered":"2024-05-10T10:52:17.691201+0000","last_clean":"2024-05-10T10:52:17.691201+0000","last_became_active":"2024-05-10T10:52:15.682655+0000","last_became_peered":"2024-05-10T10:52:15.682655+0000","last_unstale":"2024-05-10T10:52:17.691201+0000","last_undegraded":"2024-05-10T10:52:17.691201+0000","last_fullsized":"2024-05-10T10:52:17.691201+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:27.922746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.815376+0000","last_change":"2024-05-10T10:52:12.534000+0000","last_active":"2024-05-10T10:52:32.815376+0000","last_peered":"2024-05-10T10:52:32.815376+0000","last_clean":"2024-05-10T10:52:32.815376+0000","last_became_active":"2024-05-10T10:52:12.533609+0000","last_became_peered":"2024-05-10T10:52:12.533609+0000","last_unstale":"2024-05-10T10:52:32.815376+0000","last_undegraded":"2024-05-10T10:52:32.815376+0000","last_fullsized":"2024-05-10T10:52:32.815376+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:38:18.115926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.694878+0000","last_change":"2024-05-10T10:52:15.695263+0000","last_active":"2024-05-10T10:52:17.694878+0000","last_peered":"2024-05-10T10:52:17.694878+0000","last_clean":"2024-05-10T10:52:17.694878+0000","last_became_active":"2024-05-10T10:52:15.694890+0000","last_became_peered":"2024-05-10T10:52:15.694890+0000","last_unstale":"2024-05-10T10:52:17.694878+0000","last_undegraded":"2024-05-10T10:52:17.694878+0000","last_fullsized":"2024-05-10T10:52:17.694878+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:50:32.361110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:53.701676+0000","last_change":"2024-05-10T10:52:12.534673+0000","last_active":"2024-05-10T10:52:53.701676+0000","last_peered":"2024-05-10T10:52:53.701676+0000","last_clean":"2024-05-10T10:52:53.701676+0000","last_became_active":"2024-05-10T10:52:12.534031+0000","last_became_peered":"2024-05-10T10:52:12.534031+0000","last_unstale":"2024-05-10T10:52:53.701676+0000","last_undegraded":"2024-05-10T10:52:53.701676+0000","last_fullsized":"2024-05-10T10:52:53.701676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:32.030866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678615+0000","last_change":"2024-05-10T10:52:15.683282+0000","last_active":"2024-05-10T10:52:17.678615+0000","last_peered":"2024-05-10T10:52:17.678615+0000","last_clean":"2024-05-10T10:52:17.678615+0000","last_became_active":"2024-05-10T10:52:15.682421+0000","last_became_peered":"2024-05-10T10:52:15.682421+0000","last_unstale":"2024-05-10T10:52:17.678615+0000","last_undegraded":"2024-05-10T10:52:17.678615+0000","last_fullsized":"2024-05-10T10:52:17.678615+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:12.014145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:31.805723+0000","last_change":"2024-05-10T10:52:12.532161+0000","last_active":"2024-05-10T10:52:31.805723+0000","last_peered":"2024-05-10T10:52:31.805723+0000","last_clean":"2024-05-10T10:52:31.805723+0000","last_became_active":"2024-05-10T10:52:12.531780+0000","last_became_peered":"2024-05-10T10:52:12.531780+0000","last_unstale":"2024-05-10T10:52:31.805723+0000","last_undegraded":"2024-05-10T10:52:31.805723+0000","last_fullsized":"2024-05-10T10:52:31.805723+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:08.724945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.694259+0000","last_change":"2024-05-10T10:52:15.694602+0000","last_active":"2024-05-10T10:52:17.694259+0000","last_peered":"2024-05-10T10:52:17.694259+0000","last_clean":"2024-05-10T10:52:17.694259+0000","last_became_active":"2024-05-10T10:52:15.694279+0000","last_became_peered":"2024-05-10T10:52:15.694279+0000","last_unstale":"2024-05-10T10:52:17.694259+0000","last_undegraded":"2024-05-10T10:52:17.694259+0000","last_fullsized":"2024-05-10T10:52:17.694259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:12:16.286092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:30.799114+0000","last_change":"2024-05-10T10:52:12.526817+0000","last_active":"2024-05-10T10:52:30.799114+0000","last_peered":"2024-05-10T10:52:30.799114+0000","last_clean":"2024-05-10T10:52:30.799114+0000","last_became_active":"2024-05-10T10:52:12.526315+0000","last_became_peered":"2024-05-10T10:52:12.526315+0000","last_unstale":"2024-05-10T10:52:30.799114+0000","last_undegraded":"2024-05-10T10:52:30.799114+0000","last_fullsized":"2024-05-10T10:52:30.799114+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:49.968299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678020+0000","last_change":"2024-05-10T10:52:15.683201+0000","last_active":"2024-05-10T10:52:17.678020+0000","last_peered":"2024-05-10T10:52:17.678020+0000","last_clean":"2024-05-10T10:52:17.678020+0000","last_became_active":"2024-05-10T10:52:15.682412+0000","last_became_peered":"2024-05-10T10:52:15.682412+0000","last_unstale":"2024-05-10T10:52:17.678020+0000","last_undegraded":"2024-05-10T10:52:17.678020+0000","last_fullsized":"2024-05-10T10:52:17.678020+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:22.001179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.813287+0000","last_change":"2024-05-10T10:52:12.531058+0000","last_active":"2024-05-10T10:52:32.813287+0000","last_peered":"2024-05-10T10:52:32.813287+0000","last_clean":"2024-05-10T10:52:32.813287+0000","last_became_active":"2024-05-10T10:52:12.530655+0000","last_became_peered":"2024-05-10T10:52:12.530655+0000","last_unstale":"2024-05-10T10:52:32.813287+0000","last_undegraded":"2024-05-10T10:52:32.813287+0000","last_fullsized":"2024-05-10T10:52:32.813287+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:36:52.300420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.689483+0000","last_change":"2024-05-10T10:52:15.681697+0000","last_active":"2024-05-10T10:52:17.689483+0000","last_peered":"2024-05-10T10:52:17.689483+0000","last_clean":"2024-05-10T10:52:17.689483+0000","last_became_active":"2024-05-10T10:52:15.681396+0000","last_became_peered":"2024-05-10T10:52:15.681396+0000","last_unstale":"2024-05-10T10:52:17.689483+0000","last_undegraded":"2024-05-10T10:52:17.689483+0000","last_fullsized":"2024-05-10T10:52:17.689483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:35.390837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:54.702409+0000","last_change":"2024-05-10T10:52:12.532089+0000","last_active":"2024-05-10T10:52:54.702409+0000","last_peered":"2024-05-10T10:52:54.702409+0000","last_clean":"2024-05-10T10:52:54.702409+0000","last_became_active":"2024-05-10T10:52:12.531641+0000","last_became_peered":"2024-05-10T10:52:12.531641+0000","last_unstale":"2024-05-10T10:52:54.702409+0000","last_undegraded":"2024-05-10T10:52:54.702409+0000","last_fullsized":"2024-05-10T10:52:54.702409+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:34.517079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691339+0000","last_change":"2024-05-10T10:52:15.685566+0000","last_active":"2024-05-10T10:52:17.691339+0000","last_peered":"2024-05-10T10:52:17.691339+0000","last_clean":"2024-05-10T10:52:17.691339+0000","last_became_active":"2024-05-10T10:52:15.685220+0000","last_became_peered":"2024-05-10T10:52:15.685220+0000","last_unstale":"2024-05-10T10:52:17.691339+0000","last_undegraded":"2024-05-10T10:52:17.691339+0000","last_fullsized":"2024-05-10T10:52:17.691339+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:06.140961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.811737+0000","last_change":"2024-05-10T10:52:12.533182+0000","last_active":"2024-05-10T10:52:32.811737+0000","last_peered":"2024-05-10T10:52:32.811737+0000","last_clean":"2024-05-10T10:52:32.811737+0000","last_became_active":"2024-05-10T10:52:12.532821+0000","last_became_peered":"2024-05-10T10:52:12.532821+0000","last_unstale":"2024-05-10T10:52:32.811737+0000","last_undegraded":"2024-05-10T10:52:32.811737+0000","last_fullsized":"2024-05-10T10:52:32.811737+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:54:15.930093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.692377+0000","last_change":"2024-05-10T10:52:15.690491+0000","last_active":"2024-05-10T10:52:17.692377+0000","last_peered":"2024-05-10T10:52:17.692377+0000","last_clean":"2024-05-10T10:52:17.692377+0000","last_became_active":"2024-05-10T10:52:15.690200+0000","last_became_peered":"2024-05-10T10:52:15.690200+0000","last_unstale":"2024-05-10T10:52:17.692377+0000","last_undegraded":"2024-05-10T10:52:17.692377+0000","last_fullsized":"2024-05-10T10:52:17.692377+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:28.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:31.805227+0000","last_change":"2024-05-10T10:52:12.631966+0000","last_active":"2024-05-10T10:52:31.805227+0000","last_peered":"2024-05-10T10:52:31.805227+0000","last_clean":"2024-05-10T10:52:31.805227+0000","last_became_active":"2024-05-10T10:52:12.631539+0000","last_became_peered":"2024-05-10T10:52:12.631539+0000","last_unstale":"2024-05-10T10:52:31.805227+0000","last_undegraded":"2024-05-10T10:52:31.805227+0000","last_fullsized":"2024-05-10T10:52:31.805227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:32:52.392307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691579+0000","last_change":"2024-05-10T10:52:15.692893+0000","last_active":"2024-05-10T10:52:17.691579+0000","last_peered":"2024-05-10T10:52:17.691579+0000","last_clean":"2024-05-10T10:52:17.691579+0000","last_became_active":"2024-05-10T10:52:15.692528+0000","last_became_peered":"2024-05-10T10:52:15.692528+0000","last_unstale":"2024-05-10T10:52:17.691579+0000","last_undegraded":"2024-05-10T10:52:17.691579+0000","last_fullsized":"2024-05-10T10:52:17.691579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:51.452294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'27","reported_seq":100,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:54.713434+0000","last_change":"2024-05-10T10:52:12.532094+0000","last_active":"2024-05-10T10:52:54.713434+0000","last_peered":"2024-05-10T10:52:54.713434+0000","last_clean":"2024-05-10T10:52:54.713434+0000","last_became_active":"2024-05-10T10:52:12.531719+0000","last_became_peered":"2024-05-10T10:52:12.531719+0000","last_unstale":"2024-05-10T10:52:54.713434+0000","last_undegraded":"2024-05-10T10:52:54.713434+0000","last_fullsized":"2024-05-10T10:52:54.713434+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:43:52.697528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54367,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":51,"num_read_kb":78,"num_write":29,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678914+0000","last_change":"2024-05-10T10:52:15.688187+0000","last_active":"2024-05-10T10:52:17.678914+0000","last_peered":"2024-05-10T10:52:17.678914+0000","last_clean":"2024-05-10T10:52:17.678914+0000","last_became_active":"2024-05-10T10:52:15.687821+0000","last_became_peered":"2024-05-10T10:52:15.687821+0000","last_unstale":"2024-05-10T10:52:17.678914+0000","last_undegraded":"2024-05-10T10:52:17.678914+0000","last_fullsized":"2024-05-10T10:52:17.678914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:54.425892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:33.669916+0000","last_change":"2024-05-10T10:52:12.532185+0000","last_active":"2024-05-10T10:52:33.669916+0000","last_peered":"2024-05-10T10:52:33.669916+0000","last_clean":"2024-05-10T10:52:33.669916+0000","last_became_active":"2024-05-10T10:52:12.531795+0000","last_became_peered":"2024-05-10T10:52:12.531795+0000","last_unstale":"2024-05-10T10:52:33.669916+0000","last_undegraded":"2024-05-10T10:52:33.669916+0000","last_fullsized":"2024-05-10T10:52:33.669916+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:51.704767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.689369+0000","last_change":"2024-05-10T10:52:15.684388+0000","last_active":"2024-05-10T10:52:17.689369+0000","last_peered":"2024-05-10T10:52:17.689369+0000","last_clean":"2024-05-10T10:52:17.689369+0000","last_became_active":"2024-05-10T10:52:15.684061+0000","last_became_peered":"2024-05-10T10:52:15.684061+0000","last_unstale":"2024-05-10T10:52:17.689369+0000","last_undegraded":"2024-05-10T10:52:17.689369+0000","last_fullsized":"2024-05-10T10:52:17.689369+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:19.462083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.813114+0000","last_change":"2024-05-10T10:52:12.531912+0000","last_active":"2024-05-10T10:52:32.813114+0000","last_peered":"2024-05-10T10:52:32.813114+0000","last_clean":"2024-05-10T10:52:32.813114+0000","last_became_active":"2024-05-10T10:52:12.531501+0000","last_became_peered":"2024-05-10T10:52:12.531501+0000","last_unstale":"2024-05-10T10:52:32.813114+0000","last_undegraded":"2024-05-10T10:52:32.813114+0000","last_fullsized":"2024-05-10T10:52:32.813114+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:15.086519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.693407+0000","last_change":"2024-05-10T10:52:15.686521+0000","last_active":"2024-05-10T10:52:17.693407+0000","last_peered":"2024-05-10T10:52:17.693407+0000","last_clean":"2024-05-10T10:52:17.693407+0000","last_became_active":"2024-05-10T10:52:15.686142+0000","last_became_peered":"2024-05-10T10:52:15.686142+0000","last_unstale":"2024-05-10T10:52:17.693407+0000","last_undegraded":"2024-05-10T10:52:17.693407+0000","last_fullsized":"2024-05-10T10:52:17.693407+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:40.315401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":52,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:54.709020+0000","last_change":"2024-05-10T10:52:12.527774+0000","last_active":"2024-05-10T10:52:54.709020+0000","last_peered":"2024-05-10T10:52:54.709020+0000","last_clean":"2024-05-10T10:52:54.709020+0000","last_became_active":"2024-05-10T10:52:12.527412+0000","last_became_peered":"2024-05-10T10:52:12.527412+0000","last_unstale":"2024-05-10T10:52:54.709020+0000","last_undegraded":"2024-05-10T10:52:54.709020+0000","last_fullsized":"2024-05-10T10:52:54.709020+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:51:21.334653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.692406+0000","last_change":"2024-05-10T10:52:15.693427+0000","last_active":"2024-05-10T10:52:17.692406+0000","last_peered":"2024-05-10T10:52:17.692406+0000","last_clean":"2024-05-10T10:52:17.692406+0000","last_became_active":"2024-05-10T10:52:15.693114+0000","last_became_peered":"2024-05-10T10:52:15.693114+0000","last_unstale":"2024-05-10T10:52:17.692406+0000","last_undegraded":"2024-05-10T10:52:17.692406+0000","last_fullsized":"2024-05-10T10:52:17.692406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:25:36.423413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.814488+0000","last_change":"2024-05-10T10:52:12.631475+0000","last_active":"2024-05-10T10:52:32.814488+0000","last_peered":"2024-05-10T10:52:32.814488+0000","last_clean":"2024-05-10T10:52:32.814488+0000","last_became_active":"2024-05-10T10:52:12.631079+0000","last_became_peered":"2024-05-10T10:52:12.631079+0000","last_unstale":"2024-05-10T10:52:32.814488+0000","last_undegraded":"2024-05-10T10:52:32.814488+0000","last_fullsized":"2024-05-10T10:52:32.814488+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:52.975413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.694922+0000","last_change":"2024-05-10T10:52:15.692741+0000","last_active":"2024-05-10T10:52:17.694922+0000","last_peered":"2024-05-10T10:52:17.694922+0000","last_clean":"2024-05-10T10:52:17.694922+0000","last_became_active":"2024-05-10T10:52:15.692411+0000","last_became_peered":"2024-05-10T10:52:15.692411+0000","last_unstale":"2024-05-10T10:52:17.694922+0000","last_undegraded":"2024-05-10T10:52:17.694922+0000","last_fullsized":"2024-05-10T10:52:17.694922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:34.604303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.795103+0000","last_change":"2024-05-10T10:52:12.533071+0000","last_active":"2024-05-10T10:52:32.795103+0000","last_peered":"2024-05-10T10:52:32.795103+0000","last_clean":"2024-05-10T10:52:32.795103+0000","last_became_active":"2024-05-10T10:52:12.532655+0000","last_became_peered":"2024-05-10T10:52:12.532655+0000","last_unstale":"2024-05-10T10:52:32.795103+0000","last_undegraded":"2024-05-10T10:52:32.795103+0000","last_fullsized":"2024-05-10T10:52:32.795103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:30.723701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691496+0000","last_change":"2024-05-10T10:52:15.697362+0000","last_active":"2024-05-10T10:52:17.691496+0000","last_peered":"2024-05-10T10:52:17.691496+0000","last_clean":"2024-05-10T10:52:17.691496+0000","last_became_active":"2024-05-10T10:52:15.696915+0000","last_became_peered":"2024-05-10T10:52:15.696915+0000","last_unstale":"2024-05-10T10:52:17.691496+0000","last_undegraded":"2024-05-10T10:52:17.691496+0000","last_fullsized":"2024-05-10T10:52:17.691496+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:29:03.365667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.689833+0000","last_change":"2024-05-10T10:52:12.631088+0000","last_active":"2024-05-10T10:52:17.689833+0000","last_peered":"2024-05-10T10:52:17.689833+0000","last_clean":"2024-05-10T10:52:17.689833+0000","last_became_active":"2024-05-10T10:52:12.630557+0000","last_became_peered":"2024-05-10T10:52:12.630557+0000","last_unstale":"2024-05-10T10:52:17.689833+0000","last_undegraded":"2024-05-10T10:52:17.689833+0000","last_fullsized":"2024-05-10T10:52:17.689833+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:44:21.599055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690460+0000","last_change":"2024-05-10T10:52:15.675837+0000","last_active":"2024-05-10T10:52:17.690460+0000","last_peered":"2024-05-10T10:52:17.690460+0000","last_clean":"2024-05-10T10:52:17.690460+0000","last_became_active":"2024-05-10T10:52:15.675438+0000","last_became_peered":"2024-05-10T10:52:15.675438+0000","last_unstale":"2024-05-10T10:52:17.690460+0000","last_undegraded":"2024-05-10T10:52:17.690460+0000","last_fullsized":"2024-05-10T10:52:17.690460+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:23.142008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:52.699583+0000","last_change":"2024-05-10T10:52:12.530141+0000","last_active":"2024-05-10T10:52:52.699583+0000","last_peered":"2024-05-10T10:52:52.699583+0000","last_clean":"2024-05-10T10:52:52.699583+0000","last_became_active":"2024-05-10T10:52:12.529771+0000","last_became_peered":"2024-05-10T10:52:12.529771+0000","last_unstale":"2024-05-10T10:52:52.699583+0000","last_undegraded":"2024-05-10T10:52:52.699583+0000","last_fullsized":"2024-05-10T10:52:52.699583+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:42.803789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690174+0000","last_change":"2024-05-10T10:52:15.686934+0000","last_active":"2024-05-10T10:52:17.690174+0000","last_peered":"2024-05-10T10:52:17.690174+0000","last_clean":"2024-05-10T10:52:17.690174+0000","last_became_active":"2024-05-10T10:52:15.686494+0000","last_became_peered":"2024-05-10T10:52:15.686494+0000","last_unstale":"2024-05-10T10:52:17.690174+0000","last_undegraded":"2024-05-10T10:52:17.690174+0000","last_fullsized":"2024-05-10T10:52:17.690174+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:18.049088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.694792+0000","last_change":"2024-05-10T10:52:15.693243+0000","last_active":"2024-05-10T10:52:17.694792+0000","last_peered":"2024-05-10T10:52:17.694792+0000","last_clean":"2024-05-10T10:52:17.694792+0000","last_became_active":"2024-05-10T10:52:15.692868+0000","last_became_peered":"2024-05-10T10:52:15.692868+0000","last_unstale":"2024-05-10T10:52:17.694792+0000","last_undegraded":"2024-05-10T10:52:17.694792+0000","last_fullsized":"2024-05-10T10:52:17.694792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:25.316500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:52.704953+0000","last_change":"2024-05-10T10:52:12.630916+0000","last_active":"2024-05-10T10:52:52.704953+0000","last_peered":"2024-05-10T10:52:52.704953+0000","last_clean":"2024-05-10T10:52:52.704953+0000","last_became_active":"2024-05-10T10:52:12.630564+0000","last_became_peered":"2024-05-10T10:52:12.630564+0000","last_unstale":"2024-05-10T10:52:52.704953+0000","last_undegraded":"2024-05-10T10:52:52.704953+0000","last_fullsized":"2024-05-10T10:52:52.704953+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:09:46.434409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678229+0000","last_change":"2024-05-10T10:52:15.691017+0000","last_active":"2024-05-10T10:52:17.678229+0000","last_peered":"2024-05-10T10:52:17.678229+0000","last_clean":"2024-05-10T10:52:17.678229+0000","last_became_active":"2024-05-10T10:52:15.690705+0000","last_became_peered":"2024-05-10T10:52:15.690705+0000","last_unstale":"2024-05-10T10:52:17.678229+0000","last_undegraded":"2024-05-10T10:52:17.678229+0000","last_fullsized":"2024-05-10T10:52:17.678229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:50:43.517455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:33.669905+0000","last_change":"2024-05-10T10:52:12.529180+0000","last_active":"2024-05-10T10:52:33.669905+0000","last_peered":"2024-05-10T10:52:33.669905+0000","last_clean":"2024-05-10T10:52:33.669905+0000","last_became_active":"2024-05-10T10:52:12.528570+0000","last_became_peered":"2024-05-10T10:52:12.528570+0000","last_unstale":"2024-05-10T10:52:33.669905+0000","last_undegraded":"2024-05-10T10:52:33.669905+0000","last_fullsized":"2024-05-10T10:52:33.669905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:31:53.254302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":97,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.692176+0000","last_change":"2024-05-10T10:50:51.113120+0000","last_active":"2024-05-10T10:52:17.692176+0000","last_peered":"2024-05-10T10:52:17.692176+0000","last_clean":"2024-05-10T10:52:17.692176+0000","last_became_active":"2024-05-10T10:50:51.107803+0000","last_became_peered":"2024-05-10T10:50:51.107803+0000","last_unstale":"2024-05-10T10:52:17.692176+0000","last_undegraded":"2024-05-10T10:52:17.692176+0000","last_fullsized":"2024-05-10T10:52:17.692176+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:47:32.190034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:47:32.190034+0000","last_clean_scrub_stamp":"2024-05-10T10:47:32.190034+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:53.599839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.688897+0000","last_change":"2024-05-10T10:52:15.689856+0000","last_active":"2024-05-10T10:52:17.688897+0000","last_peered":"2024-05-10T10:52:17.688897+0000","last_clean":"2024-05-10T10:52:17.688897+0000","last_became_active":"2024-05-10T10:52:15.689544+0000","last_became_peered":"2024-05-10T10:52:15.689544+0000","last_unstale":"2024-05-10T10:52:17.688897+0000","last_undegraded":"2024-05-10T10:52:17.688897+0000","last_fullsized":"2024-05-10T10:52:17.688897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:39.374857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:30.798981+0000","last_change":"2024-05-10T10:52:12.532217+0000","last_active":"2024-05-10T10:52:30.798981+0000","last_peered":"2024-05-10T10:52:30.798981+0000","last_clean":"2024-05-10T10:52:30.798981+0000","last_became_active":"2024-05-10T10:52:12.531575+0000","last_became_peered":"2024-05-10T10:52:12.531575+0000","last_unstale":"2024-05-10T10:52:30.798981+0000","last_undegraded":"2024-05-10T10:52:30.798981+0000","last_fullsized":"2024-05-10T10:52:30.798981+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:15:59.493728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.813476+0000","last_change":"2024-05-10T10:52:12.631990+0000","last_active":"2024-05-10T10:52:32.813476+0000","last_peered":"2024-05-10T10:52:32.813476+0000","last_clean":"2024-05-10T10:52:32.813476+0000","last_became_active":"2024-05-10T10:52:12.631061+0000","last_became_peered":"2024-05-10T10:52:12.631061+0000","last_unstale":"2024-05-10T10:52:32.813476+0000","last_undegraded":"2024-05-10T10:52:32.813476+0000","last_fullsized":"2024-05-10T10:52:32.813476+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:30.298079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.689741+0000","last_change":"2024-05-10T10:52:15.678797+0000","last_active":"2024-05-10T10:52:17.689741+0000","last_peered":"2024-05-10T10:52:17.689741+0000","last_clean":"2024-05-10T10:52:17.689741+0000","last_became_active":"2024-05-10T10:52:15.678388+0000","last_became_peered":"2024-05-10T10:52:15.678388+0000","last_unstale":"2024-05-10T10:52:17.689741+0000","last_undegraded":"2024-05-10T10:52:17.689741+0000","last_fullsized":"2024-05-10T10:52:17.689741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:15.314479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'14","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:49.692663+0000","last_change":"2024-05-10T10:52:12.529461+0000","last_active":"2024-05-10T10:52:49.692663+0000","last_peered":"2024-05-10T10:52:49.692663+0000","last_clean":"2024-05-10T10:52:49.692663+0000","last_became_active":"2024-05-10T10:52:12.529095+0000","last_became_peered":"2024-05-10T10:52:12.529095+0000","last_unstale":"2024-05-10T10:52:49.692663+0000","last_undegraded":"2024-05-10T10:52:49.692663+0000","last_fullsized":"2024-05-10T10:52:49.692663+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:26:39.331856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678612+0000","last_change":"2024-05-10T10:52:15.688313+0000","last_active":"2024-05-10T10:52:17.678612+0000","last_peered":"2024-05-10T10:52:17.678612+0000","last_clean":"2024-05-10T10:52:17.678612+0000","last_became_active":"2024-05-10T10:52:15.688028+0000","last_became_peered":"2024-05-10T10:52:15.688028+0000","last_unstale":"2024-05-10T10:52:17.678612+0000","last_undegraded":"2024-05-10T10:52:17.678612+0000","last_fullsized":"2024-05-10T10:52:17.678612+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:03.815985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.814296+0000","last_change":"2024-05-10T10:52:12.529409+0000","last_active":"2024-05-10T10:52:32.814296+0000","last_peered":"2024-05-10T10:52:32.814296+0000","last_clean":"2024-05-10T10:52:32.814296+0000","last_became_active":"2024-05-10T10:52:12.528837+0000","last_became_peered":"2024-05-10T10:52:12.528837+0000","last_unstale":"2024-05-10T10:52:32.814296+0000","last_undegraded":"2024-05-10T10:52:32.814296+0000","last_fullsized":"2024-05-10T10:52:32.814296+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:28.280292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691687+0000","last_change":"2024-05-10T10:52:15.689755+0000","last_active":"2024-05-10T10:52:17.691687+0000","last_peered":"2024-05-10T10:52:17.691687+0000","last_clean":"2024-05-10T10:52:17.691687+0000","last_became_active":"2024-05-10T10:52:15.689344+0000","last_became_peered":"2024-05-10T10:52:15.689344+0000","last_unstale":"2024-05-10T10:52:17.691687+0000","last_undegraded":"2024-05-10T10:52:17.691687+0000","last_fullsized":"2024-05-10T10:52:17.691687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:01:20.965017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:29.790331+0000","last_change":"2024-05-10T10:52:12.631048+0000","last_active":"2024-05-10T10:52:29.790331+0000","last_peered":"2024-05-10T10:52:29.790331+0000","last_clean":"2024-05-10T10:52:29.790331+0000","last_became_active":"2024-05-10T10:52:12.630754+0000","last_became_peered":"2024-05-10T10:52:12.630754+0000","last_unstale":"2024-05-10T10:52:29.790331+0000","last_undegraded":"2024-05-10T10:52:29.790331+0000","last_fullsized":"2024-05-10T10:52:29.790331+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:57.755423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678635+0000","last_change":"2024-05-10T10:52:15.684552+0000","last_active":"2024-05-10T10:52:17.678635+0000","last_peered":"2024-05-10T10:52:17.678635+0000","last_clean":"2024-05-10T10:52:17.678635+0000","last_became_active":"2024-05-10T10:52:15.684174+0000","last_became_peered":"2024-05-10T10:52:15.684174+0000","last_unstale":"2024-05-10T10:52:17.678635+0000","last_undegraded":"2024-05-10T10:52:17.678635+0000","last_fullsized":"2024-05-10T10:52:17.678635+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:21:51.633525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.812520+0000","last_change":"2024-05-10T10:52:12.525692+0000","last_active":"2024-05-10T10:52:32.812520+0000","last_peered":"2024-05-10T10:52:32.812520+0000","last_clean":"2024-05-10T10:52:32.812520+0000","last_became_active":"2024-05-10T10:52:12.525436+0000","last_became_peered":"2024-05-10T10:52:12.525436+0000","last_unstale":"2024-05-10T10:52:32.812520+0000","last_undegraded":"2024-05-10T10:52:32.812520+0000","last_fullsized":"2024-05-10T10:52:32.812520+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:34:40.801973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690617+0000","last_change":"2024-05-10T10:52:15.689838+0000","last_active":"2024-05-10T10:52:17.690617+0000","last_peered":"2024-05-10T10:52:17.690617+0000","last_clean":"2024-05-10T10:52:17.690617+0000","last_became_active":"2024-05-10T10:52:15.689481+0000","last_became_peered":"2024-05-10T10:52:15.689481+0000","last_unstale":"2024-05-10T10:52:17.690617+0000","last_undegraded":"2024-05-10T10:52:17.690617+0000","last_fullsized":"2024-05-10T10:52:17.690617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:02:27.382859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:31.805841+0000","last_change":"2024-05-10T10:52:12.533782+0000","last_active":"2024-05-10T10:52:31.805841+0000","last_peered":"2024-05-10T10:52:31.805841+0000","last_clean":"2024-05-10T10:52:31.805841+0000","last_became_active":"2024-05-10T10:52:12.533457+0000","last_became_peered":"2024-05-10T10:52:12.533457+0000","last_unstale":"2024-05-10T10:52:31.805841+0000","last_undegraded":"2024-05-10T10:52:31.805841+0000","last_fullsized":"2024-05-10T10:52:31.805841+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:17.372672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678258+0000","last_change":"2024-05-10T10:52:15.691594+0000","last_active":"2024-05-10T10:52:17.678258+0000","last_peered":"2024-05-10T10:52:17.678258+0000","last_clean":"2024-05-10T10:52:17.678258+0000","last_became_active":"2024-05-10T10:52:15.690300+0000","last_became_peered":"2024-05-10T10:52:15.690300+0000","last_unstale":"2024-05-10T10:52:17.678258+0000","last_undegraded":"2024-05-10T10:52:17.678258+0000","last_fullsized":"2024-05-10T10:52:17.678258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:05.228834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:29.790568+0000","last_change":"2024-05-10T10:52:12.530693+0000","last_active":"2024-05-10T10:52:29.790568+0000","last_peered":"2024-05-10T10:52:29.790568+0000","last_clean":"2024-05-10T10:52:29.790568+0000","last_became_active":"2024-05-10T10:52:12.530310+0000","last_became_peered":"2024-05-10T10:52:12.530310+0000","last_unstale":"2024-05-10T10:52:29.790568+0000","last_undegraded":"2024-05-10T10:52:29.790568+0000","last_fullsized":"2024-05-10T10:52:29.790568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:42:46.967318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.692950+0000","last_change":"2024-05-10T10:52:15.695473+0000","last_active":"2024-05-10T10:52:17.692950+0000","last_peered":"2024-05-10T10:52:17.692950+0000","last_clean":"2024-05-10T10:52:17.692950+0000","last_became_active":"2024-05-10T10:52:15.695121+0000","last_became_peered":"2024-05-10T10:52:15.695121+0000","last_unstale":"2024-05-10T10:52:17.692950+0000","last_undegraded":"2024-05-10T10:52:17.692950+0000","last_fullsized":"2024-05-10T10:52:17.692950+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:48:08.019465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:55.704355+0000","last_change":"2024-05-10T10:52:12.630799+0000","last_active":"2024-05-10T10:52:55.704355+0000","last_peered":"2024-05-10T10:52:55.704355+0000","last_clean":"2024-05-10T10:52:55.704355+0000","last_became_active":"2024-05-10T10:52:12.630448+0000","last_became_peered":"2024-05-10T10:52:12.630448+0000","last_unstale":"2024-05-10T10:52:55.704355+0000","last_undegraded":"2024-05-10T10:52:55.704355+0000","last_fullsized":"2024-05-10T10:52:55.704355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:27.335062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.693013+0000","last_change":"2024-05-10T10:52:15.686691+0000","last_active":"2024-05-10T10:52:17.693013+0000","last_peered":"2024-05-10T10:52:17.693013+0000","last_clean":"2024-05-10T10:52:17.693013+0000","last_became_active":"2024-05-10T10:52:15.685886+0000","last_became_peered":"2024-05-10T10:52:15.685886+0000","last_unstale":"2024-05-10T10:52:17.693013+0000","last_undegraded":"2024-05-10T10:52:17.693013+0000","last_fullsized":"2024-05-10T10:52:17.693013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:45.199414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.812495+0000","last_change":"2024-05-10T10:52:12.533535+0000","last_active":"2024-05-10T10:52:32.812495+0000","last_peered":"2024-05-10T10:52:32.812495+0000","last_clean":"2024-05-10T10:52:32.812495+0000","last_became_active":"2024-05-10T10:52:12.533146+0000","last_became_peered":"2024-05-10T10:52:12.533146+0000","last_unstale":"2024-05-10T10:52:32.812495+0000","last_undegraded":"2024-05-10T10:52:32.812495+0000","last_fullsized":"2024-05-10T10:52:32.812495+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:07:16.138240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:18.936008+0000","last_change":"2024-05-10T10:52:15.692013+0000","last_active":"2024-05-10T10:52:18.936008+0000","last_peered":"2024-05-10T10:52:18.936008+0000","last_clean":"2024-05-10T10:52:18.936008+0000","last_became_active":"2024-05-10T10:52:15.691660+0000","last_became_peered":"2024-05-10T10:52:15.691660+0000","last_unstale":"2024-05-10T10:52:18.936008+0000","last_undegraded":"2024-05-10T10:52:18.936008+0000","last_fullsized":"2024-05-10T10:52:18.936008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:58.780961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.812775+0000","last_change":"2024-05-10T10:52:12.530962+0000","last_active":"2024-05-10T10:52:32.812775+0000","last_peered":"2024-05-10T10:52:32.812775+0000","last_clean":"2024-05-10T10:52:32.812775+0000","last_became_active":"2024-05-10T10:52:12.530610+0000","last_became_peered":"2024-05-10T10:52:12.530610+0000","last_unstale":"2024-05-10T10:52:32.812775+0000","last_undegraded":"2024-05-10T10:52:32.812775+0000","last_fullsized":"2024-05-10T10:52:32.812775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:04:13.484713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.693214+0000","last_change":"2024-05-10T10:52:15.687218+0000","last_active":"2024-05-10T10:52:17.693214+0000","last_peered":"2024-05-10T10:52:17.693214+0000","last_clean":"2024-05-10T10:52:17.693214+0000","last_became_active":"2024-05-10T10:52:15.686888+0000","last_became_peered":"2024-05-10T10:52:15.686888+0000","last_unstale":"2024-05-10T10:52:17.693214+0000","last_undegraded":"2024-05-10T10:52:17.693214+0000","last_fullsized":"2024-05-10T10:52:17.693214+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:53:53.420063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690801+0000","last_change":"2024-05-10T10:52:15.691196+0000","last_active":"2024-05-10T10:52:17.690801+0000","last_peered":"2024-05-10T10:52:17.690801+0000","last_clean":"2024-05-10T10:52:17.690801+0000","last_became_active":"2024-05-10T10:52:15.690865+0000","last_became_peered":"2024-05-10T10:52:15.690865+0000","last_unstale":"2024-05-10T10:52:17.690801+0000","last_undegraded":"2024-05-10T10:52:17.690801+0000","last_fullsized":"2024-05-10T10:52:17.690801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:02:04.666193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691175+0000","last_change":"2024-05-10T10:52:15.691239+0000","last_active":"2024-05-10T10:52:17.691175+0000","last_peered":"2024-05-10T10:52:17.691175+0000","last_clean":"2024-05-10T10:52:17.691175+0000","last_became_active":"2024-05-10T10:52:15.690877+0000","last_became_peered":"2024-05-10T10:52:15.690877+0000","last_unstale":"2024-05-10T10:52:17.691175+0000","last_undegraded":"2024-05-10T10:52:17.691175+0000","last_fullsized":"2024-05-10T10:52:17.691175+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:16.564872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690798+0000","last_change":"2024-05-10T10:52:15.681784+0000","last_active":"2024-05-10T10:52:17.690798+0000","last_peered":"2024-05-10T10:52:17.690798+0000","last_clean":"2024-05-10T10:52:17.690798+0000","last_became_active":"2024-05-10T10:52:15.680900+0000","last_became_peered":"2024-05-10T10:52:15.680900+0000","last_unstale":"2024-05-10T10:52:17.690798+0000","last_undegraded":"2024-05-10T10:52:17.690798+0000","last_fullsized":"2024-05-10T10:52:17.690798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:56.393338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691822+0000","last_change":"2024-05-10T10:52:15.690659+0000","last_active":"2024-05-10T10:52:17.691822+0000","last_peered":"2024-05-10T10:52:17.691822+0000","last_clean":"2024-05-10T10:52:17.691822+0000","last_became_active":"2024-05-10T10:52:15.689723+0000","last_became_peered":"2024-05-10T10:52:15.689723+0000","last_unstale":"2024-05-10T10:52:17.691822+0000","last_undegraded":"2024-05-10T10:52:17.691822+0000","last_fullsized":"2024-05-10T10:52:17.691822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:53:35.212066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690242+0000","last_change":"2024-05-10T10:52:15.691359+0000","last_active":"2024-05-10T10:52:17.690242+0000","last_peered":"2024-05-10T10:52:17.690242+0000","last_clean":"2024-05-10T10:52:17.690242+0000","last_became_active":"2024-05-10T10:52:15.691067+0000","last_became_peered":"2024-05-10T10:52:15.691067+0000","last_unstale":"2024-05-10T10:52:17.690242+0000","last_undegraded":"2024-05-10T10:52:17.690242+0000","last_fullsized":"2024-05-10T10:52:17.690242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:41:38.244971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691030+0000","last_change":"2024-05-10T10:52:15.690573+0000","last_active":"2024-05-10T10:52:17.691030+0000","last_peered":"2024-05-10T10:52:17.691030+0000","last_clean":"2024-05-10T10:52:17.691030+0000","last_became_active":"2024-05-10T10:52:15.690257+0000","last_became_peered":"2024-05-10T10:52:15.690257+0000","last_unstale":"2024-05-10T10:52:17.691030+0000","last_undegraded":"2024-05-10T10:52:17.691030+0000","last_fullsized":"2024-05-10T10:52:17.691030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:37:27.128718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690925+0000","last_change":"2024-05-10T10:52:15.684914+0000","last_active":"2024-05-10T10:52:17.690925+0000","last_peered":"2024-05-10T10:52:17.690925+0000","last_clean":"2024-05-10T10:52:17.690925+0000","last_became_active":"2024-05-10T10:52:15.684557+0000","last_became_peered":"2024-05-10T10:52:15.684557+0000","last_unstale":"2024-05-10T10:52:17.690925+0000","last_undegraded":"2024-05-10T10:52:17.690925+0000","last_fullsized":"2024-05-10T10:52:17.690925+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:17.444305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678448+0000","last_change":"2024-05-10T10:52:15.697047+0000","last_active":"2024-05-10T10:52:17.678448+0000","last_peered":"2024-05-10T10:52:17.678448+0000","last_clean":"2024-05-10T10:52:17.678448+0000","last_became_active":"2024-05-10T10:52:15.696726+0000","last_became_peered":"2024-05-10T10:52:15.696726+0000","last_unstale":"2024-05-10T10:52:17.678448+0000","last_undegraded":"2024-05-10T10:52:17.678448+0000","last_fullsized":"2024-05-10T10:52:17.678448+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:14:30.777403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.694424+0000","last_change":"2024-05-10T10:52:15.695613+0000","last_active":"2024-05-10T10:52:17.694424+0000","last_peered":"2024-05-10T10:52:17.694424+0000","last_clean":"2024-05-10T10:52:17.694424+0000","last_became_active":"2024-05-10T10:52:15.695147+0000","last_became_peered":"2024-05-10T10:52:15.695147+0000","last_unstale":"2024-05-10T10:52:17.694424+0000","last_undegraded":"2024-05-10T10:52:17.694424+0000","last_fullsized":"2024-05-10T10:52:17.694424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:14.175158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678011+0000","last_change":"2024-05-10T10:52:15.683914+0000","last_active":"2024-05-10T10:52:17.678011+0000","last_peered":"2024-05-10T10:52:17.678011+0000","last_clean":"2024-05-10T10:52:17.678011+0000","last_became_active":"2024-05-10T10:52:15.682359+0000","last_became_peered":"2024-05-10T10:52:15.682359+0000","last_unstale":"2024-05-10T10:52:17.678011+0000","last_undegraded":"2024-05-10T10:52:17.678011+0000","last_fullsized":"2024-05-10T10:52:17.678011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:23:41.018064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691825+0000","last_change":"2024-05-10T10:52:15.690862+0000","last_active":"2024-05-10T10:52:17.691825+0000","last_peered":"2024-05-10T10:52:17.691825+0000","last_clean":"2024-05-10T10:52:17.691825+0000","last_became_active":"2024-05-10T10:52:15.690520+0000","last_became_peered":"2024-05-10T10:52:15.690520+0000","last_unstale":"2024-05-10T10:52:17.691825+0000","last_undegraded":"2024-05-10T10:52:17.691825+0000","last_fullsized":"2024-05-10T10:52:17.691825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:39.819473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.689969+0000","last_change":"2024-05-10T10:52:15.684605+0000","last_active":"2024-05-10T10:52:17.689969+0000","last_peered":"2024-05-10T10:52:17.689969+0000","last_clean":"2024-05-10T10:52:17.689969+0000","last_became_active":"2024-05-10T10:52:15.683863+0000","last_became_peered":"2024-05-10T10:52:15.683863+0000","last_unstale":"2024-05-10T10:52:17.689969+0000","last_undegraded":"2024-05-10T10:52:17.689969+0000","last_fullsized":"2024-05-10T10:52:17.689969+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:49:35.187932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690355+0000","last_change":"2024-05-10T10:52:15.698014+0000","last_active":"2024-05-10T10:52:17.690355+0000","last_peered":"2024-05-10T10:52:17.690355+0000","last_clean":"2024-05-10T10:52:17.690355+0000","last_became_active":"2024-05-10T10:52:15.697583+0000","last_became_peered":"2024-05-10T10:52:15.697583+0000","last_unstale":"2024-05-10T10:52:17.690355+0000","last_undegraded":"2024-05-10T10:52:17.690355+0000","last_fullsized":"2024-05-10T10:52:17.690355+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:30.792127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61180,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":258,"num_read_kb":195,"num_write":238,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":183540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645333,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":872448,"data_stored":419787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841565,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36868,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708284,"statfs":{"total":95995035648,"available":95957282816,"internally_reserved":0,"allocated":1568768,"data_stored":1065183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037794,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":897024,"data_stored":419717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234022,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":892928,"data_stored":420095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430251,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28472,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716680,"statfs":{"total":95995035648,"available":95965880320,"internally_reserved":0,"allocated":1490944,"data_stored":1012613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593776,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":419434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":474714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":901120,"data_stored":420773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":475325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182462,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":897024,"data_stored":419259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986235,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":880640,"data_stored":419295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790004,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36804,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708348,"statfs":{"total":95995035648,"available":95957348352,"internally_reserved":0,"allocated":1503232,"data_stored":1012291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":56119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":56103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T10:52:59.904 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-10T10:53:00.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:52:59 smithi184 ceph-mon[34585]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:53:00.161 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:00.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:52:59 smithi107 ceph-mon[30373]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:53:00.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:52:59 smithi196 ceph-mon[34872]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:53:01.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:00 smithi184 ceph-mon[34585]: pgmap v306: 97 pgs: 97 active+clean; 637 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-10T10:53:01.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:00 smithi107 ceph-mon[30373]: pgmap v306: 97 pgs: 97 active+clean; 637 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-10T10:53:01.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:00 smithi196 ceph-mon[34872]: pgmap v306: 97 pgs: 97 active+clean; 637 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-10T10:53:01.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.781+0000 7f9fe472a700 1 -- 172.21.15.107:0/2752992161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc1087c0 msgr2=0x7f9fdc1103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:01.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.781+0000 7f9fe472a700 1 --2- 172.21.15.107:0/2752992161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc1087c0 0x7f9fdc1103d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400b0d0 tx=0x7f9fd400b3e0 comp rx=0 tx=0).stop 2024-05-10T10:53:01.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.781+0000 7f9fe472a700 1 -- 172.21.15.107:0/2752992161 shutdown_connections 2024-05-10T10:53:01.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.781+0000 7f9fe472a700 1 --2- 172.21.15.107:0/2752992161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc1087c0 0x7f9fdc1103d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:01.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.781+0000 7f9fe472a700 1 --2- 172.21.15.107:0/2752992161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc06be70 0x7f9fdc06c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:01.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.781+0000 7f9fe472a700 1 --2- 172.21.15.107:0/2752992161 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9fdc06c820 0x7f9fdc1080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:01.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.781+0000 7f9fe472a700 1 -- 172.21.15.107:0/2752992161 >> 172.21.15.107:0/2752992161 conn(0x7f9fdc0783f0 msgr2=0x7f9fdc078800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:01.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.781+0000 7f9fe472a700 1 -- 172.21.15.107:0/2752992161 shutdown_connections 2024-05-10T10:53:01.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.781+0000 7f9fe472a700 1 -- 172.21.15.107:0/2752992161 wait complete. 2024-05-10T10:53:01.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.782+0000 7f9fe472a700 1 Processor -- start 2024-05-10T10:53:01.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.782+0000 7f9fe472a700 1 -- start start 2024-05-10T10:53:01.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.782+0000 7f9fe472a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc06be70 0x7f9fdc199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:01.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.782+0000 7f9fe472a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc06c820 0x7f9fdc19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:01.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.782+0000 7f9fe472a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9fdc1087c0 0x7f9fdc19e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:01.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.782+0000 7f9fe472a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc1138d0 con 0x7f9fdc06c820 2024-05-10T10:53:01.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.782+0000 7f9fe472a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc113750 con 0x7f9fdc06be70 2024-05-10T10:53:01.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.782+0000 7f9fe472a700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9fdc113a50 con 0x7f9fdc1087c0 2024-05-10T10:53:01.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.782+0000 7f9fe1cc5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc06c820 0x7f9fdc19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:01.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.782+0000 7f9fe1cc5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc06c820 0x7f9fdc19a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56108/0 (socket says 172.21.15.107:56108) 2024-05-10T10:53:01.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.782+0000 7f9fe1cc5700 1 -- 172.21.15.107:0/647670643 learned_addr learned my addr 172.21.15.107:0/647670643 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:01.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.782+0000 7f9fe24c6700 1 --2- 172.21.15.107:0/647670643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc06be70 0x7f9fdc199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:01.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.782+0000 7f9fe1cc5700 1 -- 172.21.15.107:0/647670643 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9fdc1087c0 msgr2=0x7f9fdc19e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:01.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.782+0000 7f9fe1cc5700 1 --2- 172.21.15.107:0/647670643 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9fdc1087c0 0x7f9fdc19e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:01.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.782+0000 7f9fe1cc5700 1 -- 172.21.15.107:0/647670643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc06be70 msgr2=0x7f9fdc199d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:01.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.782+0000 7f9fe1cc5700 1 --2- 172.21.15.107:0/647670643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc06be70 0x7f9fdc199d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:01.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.782+0000 7f9fe1cc5700 1 -- 172.21.15.107:0/647670643 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fdc19ed50 con 0x7f9fdc06c820 2024-05-10T10:53:01.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.783+0000 7f9fe1cc5700 1 --2- 172.21.15.107:0/647670643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc06c820 0x7f9fdc19a280 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00b500 tx=0x7f9fcc00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:01.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.783+0000 7f9fd37fe700 1 -- 172.21.15.107:0/647670643 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc015020 con 0x7f9fdc06c820 2024-05-10T10:53:01.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.783+0000 7f9fd37fe700 1 -- 172.21.15.107:0/647670643 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9fcc011d00 con 0x7f9fdc06c820 2024-05-10T10:53:01.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.783+0000 7f9fe472a700 1 -- 172.21.15.107:0/647670643 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fdc19f040 con 0x7f9fdc06c820 2024-05-10T10:53:01.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.783+0000 7f9fd37fe700 1 -- 172.21.15.107:0/647670643 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc010e40 con 0x7f9fdc06c820 2024-05-10T10:53:01.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.783+0000 7f9fe472a700 1 -- 172.21.15.107:0/647670643 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fdc1a68c0 con 0x7f9fdc06c820 2024-05-10T10:53:01.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.784+0000 7f9fe472a700 1 -- 172.21.15.107:0/647670643 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fdc06a190 con 0x7f9fdc06c820 2024-05-10T10:53:01.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.785+0000 7f9fd37fe700 1 -- 172.21.15.107:0/647670643 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f9fcc018020 con 0x7f9fdc06c820 2024-05-10T10:53:01.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.786+0000 7f9fd37fe700 1 --2- 172.21.15.107:0/647670643 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f9fc80b2910 0x7f9fc80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:01.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.786+0000 7f9fe24c6700 1 --2- 172.21.15.107:0/647670643 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f9fc80b2910 0x7f9fc80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:01.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.787+0000 7f9fd37fe700 1 -- 172.21.15.107:0/647670643 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f9fcc0e1fb0 con 0x7f9fdc06c820 2024-05-10T10:53:01.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.787+0000 7f9fe24c6700 1 --2- 172.21.15.107:0/647670643 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f9fc80b2910 0x7f9fc80b4dd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8006fd0 tx=0x7f9fd8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:01.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.790+0000 7f9fd37fe700 1 -- 172.21.15.107:0/647670643 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f9fcc01f020 con 0x7f9fdc06c820 2024-05-10T10:53:01.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:01.994+0000 7f9fe472a700 1 -- 172.21.15.107:0/647670643 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9fdc02e580 con 0x7f9fc80b2910 2024-05-10T10:53:02.001 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:02.001+0000 7f9fd37fe700 1 -- 172.21.15.107:0/647670643 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258742 (secure 0 0 0) 0x7f9fdc02e580 con 0x7f9fc80b2910 2024-05-10T10:53:02.005 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:53:02.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:02.004+0000 7f9fe472a700 1 -- 172.21.15.107:0/647670643 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f9fc80b2910 msgr2=0x7f9fc80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:02.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:02.004+0000 7f9fe472a700 1 --2- 172.21.15.107:0/647670643 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f9fc80b2910 0x7f9fc80b4dd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8006fd0 tx=0x7f9fd8008040 comp rx=0 tx=0).stop 2024-05-10T10:53:02.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:02.004+0000 7f9fe472a700 1 -- 172.21.15.107:0/647670643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc06c820 msgr2=0x7f9fdc19a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:02.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:02.004+0000 7f9fe472a700 1 --2- 172.21.15.107:0/647670643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc06c820 0x7f9fdc19a280 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00b500 tx=0x7f9fcc00b8c0 comp rx=0 tx=0).stop 2024-05-10T10:53:02.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:02.004+0000 7f9fe472a700 1 -- 172.21.15.107:0/647670643 shutdown_connections 2024-05-10T10:53:02.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:02.004+0000 7f9fe472a700 1 --2- 172.21.15.107:0/647670643 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f9fc80b2910 0x7f9fc80b4dd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:02.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:02.004+0000 7f9fe472a700 1 --2- 172.21.15.107:0/647670643 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9fdc1087c0 0x7f9fdc19e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:02.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:02.004+0000 7f9fe472a700 1 --2- 172.21.15.107:0/647670643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc06be70 0x7f9fdc199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:02.008 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:02.004+0000 7f9fe472a700 1 --2- 172.21.15.107:0/647670643 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9fdc06c820 0x7f9fdc19a280 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:02.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:02.004+0000 7f9fe472a700 1 -- 172.21.15.107:0/647670643 >> 172.21.15.107:0/647670643 conn(0x7f9fdc0783f0 msgr2=0x7f9fdc1073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:02.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:02.004+0000 7f9fe472a700 1 -- 172.21.15.107:0/647670643 shutdown_connections 2024-05-10T10:53:02.009 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:02.004+0000 7f9fe472a700 1 -- 172.21.15.107:0/647670643 wait complete. 2024-05-10T10:53:02.009 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-05-10T10:53:02.635 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-05-10T10:53:01.613313+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660487,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":375,"num_read_kb":293,"num_write":370,"num_write_kb":2289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369872,"kb_used_data":12400,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571952,"statfs":{"total":1151940427776,"available":1151561678848,"internally_reserved":0,"allocated":12697600,"data_stored":6995896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":36127,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":102,"num_write":20,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002814"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691313+0000","last_change":"2024-05-10T10:52:15.686294+0000","last_active":"2024-05-10T10:52:17.691313+0000","last_peered":"2024-05-10T10:52:17.691313+0000","last_clean":"2024-05-10T10:52:17.691313+0000","last_became_active":"2024-05-10T10:52:15.685324+0000","last_became_peered":"2024-05-10T10:52:15.685324+0000","last_unstale":"2024-05-10T10:52:17.691313+0000","last_undegraded":"2024-05-10T10:52:17.691313+0000","last_fullsized":"2024-05-10T10:52:17.691313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:20.777432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691414+0000","last_change":"2024-05-10T10:52:15.687542+0000","last_active":"2024-05-10T10:52:17.691414+0000","last_peered":"2024-05-10T10:52:17.691414+0000","last_clean":"2024-05-10T10:52:17.691414+0000","last_became_active":"2024-05-10T10:52:15.687258+0000","last_became_peered":"2024-05-10T10:52:15.687258+0000","last_unstale":"2024-05-10T10:52:17.691414+0000","last_undegraded":"2024-05-10T10:52:17.691414+0000","last_fullsized":"2024-05-10T10:52:17.691414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:08.522392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691139+0000","last_change":"2024-05-10T10:52:15.682314+0000","last_active":"2024-05-10T10:52:17.691139+0000","last_peered":"2024-05-10T10:52:17.691139+0000","last_clean":"2024-05-10T10:52:17.691139+0000","last_became_active":"2024-05-10T10:52:15.681939+0000","last_became_peered":"2024-05-10T10:52:15.681939+0000","last_unstale":"2024-05-10T10:52:17.691139+0000","last_undegraded":"2024-05-10T10:52:17.691139+0000","last_fullsized":"2024-05-10T10:52:17.691139+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:04.857969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.679717+0000","last_change":"2024-05-10T10:52:15.693451+0000","last_active":"2024-05-10T10:52:17.679717+0000","last_peered":"2024-05-10T10:52:17.679717+0000","last_clean":"2024-05-10T10:52:17.679717+0000","last_became_active":"2024-05-10T10:52:15.693041+0000","last_became_peered":"2024-05-10T10:52:15.693041+0000","last_unstale":"2024-05-10T10:52:17.679717+0000","last_undegraded":"2024-05-10T10:52:17.679717+0000","last_fullsized":"2024-05-10T10:52:17.679717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:57:14.959699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678856+0000","last_change":"2024-05-10T10:52:15.679527+0000","last_active":"2024-05-10T10:52:17.678856+0000","last_peered":"2024-05-10T10:52:17.678856+0000","last_clean":"2024-05-10T10:52:17.678856+0000","last_became_active":"2024-05-10T10:52:15.679153+0000","last_became_peered":"2024-05-10T10:52:15.679153+0000","last_unstale":"2024-05-10T10:52:17.678856+0000","last_undegraded":"2024-05-10T10:52:17.678856+0000","last_fullsized":"2024-05-10T10:52:17.678856+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:58.738486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690410+0000","last_change":"2024-05-10T10:52:15.685905+0000","last_active":"2024-05-10T10:52:17.690410+0000","last_peered":"2024-05-10T10:52:17.690410+0000","last_clean":"2024-05-10T10:52:17.690410+0000","last_became_active":"2024-05-10T10:52:15.685628+0000","last_became_peered":"2024-05-10T10:52:15.685628+0000","last_unstale":"2024-05-10T10:52:17.690410+0000","last_undegraded":"2024-05-10T10:52:17.690410+0000","last_fullsized":"2024-05-10T10:52:17.690410+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:16.776307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.692063+0000","last_change":"2024-05-10T10:52:15.692951+0000","last_active":"2024-05-10T10:52:17.692063+0000","last_peered":"2024-05-10T10:52:17.692063+0000","last_clean":"2024-05-10T10:52:17.692063+0000","last_became_active":"2024-05-10T10:52:15.692594+0000","last_became_peered":"2024-05-10T10:52:15.692594+0000","last_unstale":"2024-05-10T10:52:17.692063+0000","last_undegraded":"2024-05-10T10:52:17.692063+0000","last_fullsized":"2024-05-10T10:52:17.692063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:04.105565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.677953+0000","last_change":"2024-05-10T10:52:15.692349+0000","last_active":"2024-05-10T10:52:17.677953+0000","last_peered":"2024-05-10T10:52:17.677953+0000","last_clean":"2024-05-10T10:52:17.677953+0000","last_became_active":"2024-05-10T10:52:15.691840+0000","last_became_peered":"2024-05-10T10:52:15.691840+0000","last_unstale":"2024-05-10T10:52:17.677953+0000","last_undegraded":"2024-05-10T10:52:17.677953+0000","last_fullsized":"2024-05-10T10:52:17.677953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:32:25.011085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691729+0000","last_change":"2024-05-10T10:52:15.686531+0000","last_active":"2024-05-10T10:52:17.691729+0000","last_peered":"2024-05-10T10:52:17.691729+0000","last_clean":"2024-05-10T10:52:17.691729+0000","last_became_active":"2024-05-10T10:52:15.686029+0000","last_became_peered":"2024-05-10T10:52:15.686029+0000","last_unstale":"2024-05-10T10:52:17.691729+0000","last_undegraded":"2024-05-10T10:52:17.691729+0000","last_fullsized":"2024-05-10T10:52:17.691729+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:30.836606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690784+0000","last_change":"2024-05-10T10:52:15.697314+0000","last_active":"2024-05-10T10:52:17.690784+0000","last_peered":"2024-05-10T10:52:17.690784+0000","last_clean":"2024-05-10T10:52:17.690784+0000","last_became_active":"2024-05-10T10:52:15.696944+0000","last_became_peered":"2024-05-10T10:52:15.696944+0000","last_unstale":"2024-05-10T10:52:17.690784+0000","last_undegraded":"2024-05-10T10:52:17.690784+0000","last_fullsized":"2024-05-10T10:52:17.690784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:10.098904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.692430+0000","last_change":"2024-05-10T10:52:15.690866+0000","last_active":"2024-05-10T10:52:17.692430+0000","last_peered":"2024-05-10T10:52:17.692430+0000","last_clean":"2024-05-10T10:52:17.692430+0000","last_became_active":"2024-05-10T10:52:15.690533+0000","last_became_peered":"2024-05-10T10:52:15.690533+0000","last_unstale":"2024-05-10T10:52:17.692430+0000","last_undegraded":"2024-05-10T10:52:17.692430+0000","last_fullsized":"2024-05-10T10:52:17.692430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:48.290897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.679647+0000","last_change":"2024-05-10T10:52:15.696386+0000","last_active":"2024-05-10T10:52:17.679647+0000","last_peered":"2024-05-10T10:52:17.679647+0000","last_clean":"2024-05-10T10:52:17.679647+0000","last_became_active":"2024-05-10T10:52:15.696044+0000","last_became_peered":"2024-05-10T10:52:15.696044+0000","last_unstale":"2024-05-10T10:52:17.679647+0000","last_undegraded":"2024-05-10T10:52:17.679647+0000","last_fullsized":"2024-05-10T10:52:17.679647+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:48.259860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.689831+0000","last_change":"2024-05-10T10:52:15.691796+0000","last_active":"2024-05-10T10:52:17.689831+0000","last_peered":"2024-05-10T10:52:17.689831+0000","last_clean":"2024-05-10T10:52:17.689831+0000","last_became_active":"2024-05-10T10:52:15.690952+0000","last_became_peered":"2024-05-10T10:52:15.690952+0000","last_unstale":"2024-05-10T10:52:17.689831+0000","last_undegraded":"2024-05-10T10:52:17.689831+0000","last_fullsized":"2024-05-10T10:52:17.689831+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:10.645645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691248+0000","last_change":"2024-05-10T10:52:15.683303+0000","last_active":"2024-05-10T10:52:17.691248+0000","last_peered":"2024-05-10T10:52:17.691248+0000","last_clean":"2024-05-10T10:52:17.691248+0000","last_became_active":"2024-05-10T10:52:15.682753+0000","last_became_peered":"2024-05-10T10:52:15.682753+0000","last_unstale":"2024-05-10T10:52:17.691248+0000","last_undegraded":"2024-05-10T10:52:17.691248+0000","last_fullsized":"2024-05-10T10:52:17.691248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:00.167463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690936+0000","last_change":"2024-05-10T10:52:15.691668+0000","last_active":"2024-05-10T10:52:17.690936+0000","last_peered":"2024-05-10T10:52:17.690936+0000","last_clean":"2024-05-10T10:52:17.690936+0000","last_became_active":"2024-05-10T10:52:15.691323+0000","last_became_peered":"2024-05-10T10:52:15.691323+0000","last_unstale":"2024-05-10T10:52:17.690936+0000","last_undegraded":"2024-05-10T10:52:17.690936+0000","last_fullsized":"2024-05-10T10:52:17.690936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:09.235092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690810+0000","last_change":"2024-05-10T10:52:15.689859+0000","last_active":"2024-05-10T10:52:17.690810+0000","last_peered":"2024-05-10T10:52:17.690810+0000","last_clean":"2024-05-10T10:52:17.690810+0000","last_became_active":"2024-05-10T10:52:15.689060+0000","last_became_peered":"2024-05-10T10:52:15.689060+0000","last_unstale":"2024-05-10T10:52:17.690810+0000","last_undegraded":"2024-05-10T10:52:17.690810+0000","last_fullsized":"2024-05-10T10:52:17.690810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:42.029942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691501+0000","last_change":"2024-05-10T10:52:15.686711+0000","last_active":"2024-05-10T10:52:17.691501+0000","last_peered":"2024-05-10T10:52:17.691501+0000","last_clean":"2024-05-10T10:52:17.691501+0000","last_became_active":"2024-05-10T10:52:15.685817+0000","last_became_peered":"2024-05-10T10:52:15.685817+0000","last_unstale":"2024-05-10T10:52:17.691501+0000","last_undegraded":"2024-05-10T10:52:17.691501+0000","last_fullsized":"2024-05-10T10:52:17.691501+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:50:25.703341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690140+0000","last_change":"2024-05-10T10:52:15.681702+0000","last_active":"2024-05-10T10:52:17.690140+0000","last_peered":"2024-05-10T10:52:17.690140+0000","last_clean":"2024-05-10T10:52:17.690140+0000","last_became_active":"2024-05-10T10:52:15.681400+0000","last_became_peered":"2024-05-10T10:52:15.681400+0000","last_unstale":"2024-05-10T10:52:17.690140+0000","last_undegraded":"2024-05-10T10:52:17.690140+0000","last_fullsized":"2024-05-10T10:52:17.690140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:07.520500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691301+0000","last_change":"2024-05-10T10:52:15.684321+0000","last_active":"2024-05-10T10:52:17.691301+0000","last_peered":"2024-05-10T10:52:17.691301+0000","last_clean":"2024-05-10T10:52:17.691301+0000","last_became_active":"2024-05-10T10:52:15.683099+0000","last_became_peered":"2024-05-10T10:52:15.683099+0000","last_unstale":"2024-05-10T10:52:17.691301+0000","last_undegraded":"2024-05-10T10:52:17.691301+0000","last_fullsized":"2024-05-10T10:52:17.691301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:09.310292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":62,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:57.705947+0000","last_change":"2024-05-10T10:52:12.530258+0000","last_active":"2024-05-10T10:52:57.705947+0000","last_peered":"2024-05-10T10:52:57.705947+0000","last_clean":"2024-05-10T10:52:57.705947+0000","last_became_active":"2024-05-10T10:52:12.529842+0000","last_became_peered":"2024-05-10T10:52:12.529842+0000","last_unstale":"2024-05-10T10:52:57.705947+0000","last_undegraded":"2024-05-10T10:52:57.705947+0000","last_fullsized":"2024-05-10T10:52:57.705947+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:13.525038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678444+0000","last_change":"2024-05-10T10:52:15.693217+0000","last_active":"2024-05-10T10:52:17.678444+0000","last_peered":"2024-05-10T10:52:17.678444+0000","last_clean":"2024-05-10T10:52:17.678444+0000","last_became_active":"2024-05-10T10:52:15.692933+0000","last_became_peered":"2024-05-10T10:52:15.692933+0000","last_unstale":"2024-05-10T10:52:17.678444+0000","last_undegraded":"2024-05-10T10:52:17.678444+0000","last_fullsized":"2024-05-10T10:52:17.678444+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:38:15.821098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.693813+0000","last_change":"2024-05-10T10:52:12.630918+0000","last_active":"2024-05-10T10:52:17.693813+0000","last_peered":"2024-05-10T10:52:17.693813+0000","last_clean":"2024-05-10T10:52:17.693813+0000","last_became_active":"2024-05-10T10:52:12.630563+0000","last_became_peered":"2024-05-10T10:52:12.630563+0000","last_unstale":"2024-05-10T10:52:17.693813+0000","last_undegraded":"2024-05-10T10:52:17.693813+0000","last_fullsized":"2024-05-10T10:52:17.693813+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:58:03.341362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.692604+0000","last_change":"2024-05-10T10:52:15.676831+0000","last_active":"2024-05-10T10:52:17.692604+0000","last_peered":"2024-05-10T10:52:17.692604+0000","last_clean":"2024-05-10T10:52:17.692604+0000","last_became_active":"2024-05-10T10:52:15.676506+0000","last_became_peered":"2024-05-10T10:52:15.676506+0000","last_unstale":"2024-05-10T10:52:17.692604+0000","last_undegraded":"2024-05-10T10:52:17.692604+0000","last_fullsized":"2024-05-10T10:52:17.692604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:43.498800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:33.669733+0000","last_change":"2024-05-10T10:52:12.532092+0000","last_active":"2024-05-10T10:52:33.669733+0000","last_peered":"2024-05-10T10:52:33.669733+0000","last_clean":"2024-05-10T10:52:33.669733+0000","last_became_active":"2024-05-10T10:52:12.531649+0000","last_became_peered":"2024-05-10T10:52:12.531649+0000","last_unstale":"2024-05-10T10:52:33.669733+0000","last_undegraded":"2024-05-10T10:52:33.669733+0000","last_fullsized":"2024-05-10T10:52:33.669733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.709935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691201+0000","last_change":"2024-05-10T10:52:15.683024+0000","last_active":"2024-05-10T10:52:17.691201+0000","last_peered":"2024-05-10T10:52:17.691201+0000","last_clean":"2024-05-10T10:52:17.691201+0000","last_became_active":"2024-05-10T10:52:15.682655+0000","last_became_peered":"2024-05-10T10:52:15.682655+0000","last_unstale":"2024-05-10T10:52:17.691201+0000","last_undegraded":"2024-05-10T10:52:17.691201+0000","last_fullsized":"2024-05-10T10:52:17.691201+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:27.922746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.815376+0000","last_change":"2024-05-10T10:52:12.534000+0000","last_active":"2024-05-10T10:52:32.815376+0000","last_peered":"2024-05-10T10:52:32.815376+0000","last_clean":"2024-05-10T10:52:32.815376+0000","last_became_active":"2024-05-10T10:52:12.533609+0000","last_became_peered":"2024-05-10T10:52:12.533609+0000","last_unstale":"2024-05-10T10:52:32.815376+0000","last_undegraded":"2024-05-10T10:52:32.815376+0000","last_fullsized":"2024-05-10T10:52:32.815376+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:38:18.115926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.694878+0000","last_change":"2024-05-10T10:52:15.695263+0000","last_active":"2024-05-10T10:52:17.694878+0000","last_peered":"2024-05-10T10:52:17.694878+0000","last_clean":"2024-05-10T10:52:17.694878+0000","last_became_active":"2024-05-10T10:52:15.694890+0000","last_became_peered":"2024-05-10T10:52:15.694890+0000","last_unstale":"2024-05-10T10:52:17.694878+0000","last_undegraded":"2024-05-10T10:52:17.694878+0000","last_fullsized":"2024-05-10T10:52:17.694878+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:50:32.361110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":58,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:58.709185+0000","last_change":"2024-05-10T10:52:12.534673+0000","last_active":"2024-05-10T10:52:58.709185+0000","last_peered":"2024-05-10T10:52:58.709185+0000","last_clean":"2024-05-10T10:52:58.709185+0000","last_became_active":"2024-05-10T10:52:12.534031+0000","last_became_peered":"2024-05-10T10:52:12.534031+0000","last_unstale":"2024-05-10T10:52:58.709185+0000","last_undegraded":"2024-05-10T10:52:58.709185+0000","last_fullsized":"2024-05-10T10:52:58.709185+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:32.030866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678615+0000","last_change":"2024-05-10T10:52:15.683282+0000","last_active":"2024-05-10T10:52:17.678615+0000","last_peered":"2024-05-10T10:52:17.678615+0000","last_clean":"2024-05-10T10:52:17.678615+0000","last_became_active":"2024-05-10T10:52:15.682421+0000","last_became_peered":"2024-05-10T10:52:15.682421+0000","last_unstale":"2024-05-10T10:52:17.678615+0000","last_undegraded":"2024-05-10T10:52:17.678615+0000","last_fullsized":"2024-05-10T10:52:17.678615+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:12.014145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:31.805723+0000","last_change":"2024-05-10T10:52:12.532161+0000","last_active":"2024-05-10T10:52:31.805723+0000","last_peered":"2024-05-10T10:52:31.805723+0000","last_clean":"2024-05-10T10:52:31.805723+0000","last_became_active":"2024-05-10T10:52:12.531780+0000","last_became_peered":"2024-05-10T10:52:12.531780+0000","last_unstale":"2024-05-10T10:52:31.805723+0000","last_undegraded":"2024-05-10T10:52:31.805723+0000","last_fullsized":"2024-05-10T10:52:31.805723+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:08.724945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.694259+0000","last_change":"2024-05-10T10:52:15.694602+0000","last_active":"2024-05-10T10:52:17.694259+0000","last_peered":"2024-05-10T10:52:17.694259+0000","last_clean":"2024-05-10T10:52:17.694259+0000","last_became_active":"2024-05-10T10:52:15.694279+0000","last_became_peered":"2024-05-10T10:52:15.694279+0000","last_unstale":"2024-05-10T10:52:17.694259+0000","last_undegraded":"2024-05-10T10:52:17.694259+0000","last_fullsized":"2024-05-10T10:52:17.694259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:12:16.286092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:30.799114+0000","last_change":"2024-05-10T10:52:12.526817+0000","last_active":"2024-05-10T10:52:30.799114+0000","last_peered":"2024-05-10T10:52:30.799114+0000","last_clean":"2024-05-10T10:52:30.799114+0000","last_became_active":"2024-05-10T10:52:12.526315+0000","last_became_peered":"2024-05-10T10:52:12.526315+0000","last_unstale":"2024-05-10T10:52:30.799114+0000","last_undegraded":"2024-05-10T10:52:30.799114+0000","last_fullsized":"2024-05-10T10:52:30.799114+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:49.968299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678020+0000","last_change":"2024-05-10T10:52:15.683201+0000","last_active":"2024-05-10T10:52:17.678020+0000","last_peered":"2024-05-10T10:52:17.678020+0000","last_clean":"2024-05-10T10:52:17.678020+0000","last_became_active":"2024-05-10T10:52:15.682412+0000","last_became_peered":"2024-05-10T10:52:15.682412+0000","last_unstale":"2024-05-10T10:52:17.678020+0000","last_undegraded":"2024-05-10T10:52:17.678020+0000","last_fullsized":"2024-05-10T10:52:17.678020+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:22.001179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.813287+0000","last_change":"2024-05-10T10:52:12.531058+0000","last_active":"2024-05-10T10:52:32.813287+0000","last_peered":"2024-05-10T10:52:32.813287+0000","last_clean":"2024-05-10T10:52:32.813287+0000","last_became_active":"2024-05-10T10:52:12.530655+0000","last_became_peered":"2024-05-10T10:52:12.530655+0000","last_unstale":"2024-05-10T10:52:32.813287+0000","last_undegraded":"2024-05-10T10:52:32.813287+0000","last_fullsized":"2024-05-10T10:52:32.813287+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:36:52.300420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.689483+0000","last_change":"2024-05-10T10:52:15.681697+0000","last_active":"2024-05-10T10:52:17.689483+0000","last_peered":"2024-05-10T10:52:17.689483+0000","last_clean":"2024-05-10T10:52:17.689483+0000","last_became_active":"2024-05-10T10:52:15.681396+0000","last_became_peered":"2024-05-10T10:52:15.681396+0000","last_unstale":"2024-05-10T10:52:17.689483+0000","last_undegraded":"2024-05-10T10:52:17.689483+0000","last_fullsized":"2024-05-10T10:52:17.689483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:35.390837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:59.709829+0000","last_change":"2024-05-10T10:52:12.532089+0000","last_active":"2024-05-10T10:52:59.709829+0000","last_peered":"2024-05-10T10:52:59.709829+0000","last_clean":"2024-05-10T10:52:59.709829+0000","last_became_active":"2024-05-10T10:52:12.531641+0000","last_became_peered":"2024-05-10T10:52:12.531641+0000","last_unstale":"2024-05-10T10:52:59.709829+0000","last_undegraded":"2024-05-10T10:52:59.709829+0000","last_fullsized":"2024-05-10T10:52:59.709829+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:34.517079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691339+0000","last_change":"2024-05-10T10:52:15.685566+0000","last_active":"2024-05-10T10:52:17.691339+0000","last_peered":"2024-05-10T10:52:17.691339+0000","last_clean":"2024-05-10T10:52:17.691339+0000","last_became_active":"2024-05-10T10:52:15.685220+0000","last_became_peered":"2024-05-10T10:52:15.685220+0000","last_unstale":"2024-05-10T10:52:17.691339+0000","last_undegraded":"2024-05-10T10:52:17.691339+0000","last_fullsized":"2024-05-10T10:52:17.691339+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:06.140961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.811737+0000","last_change":"2024-05-10T10:52:12.533182+0000","last_active":"2024-05-10T10:52:32.811737+0000","last_peered":"2024-05-10T10:52:32.811737+0000","last_clean":"2024-05-10T10:52:32.811737+0000","last_became_active":"2024-05-10T10:52:12.532821+0000","last_became_peered":"2024-05-10T10:52:12.532821+0000","last_unstale":"2024-05-10T10:52:32.811737+0000","last_undegraded":"2024-05-10T10:52:32.811737+0000","last_fullsized":"2024-05-10T10:52:32.811737+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:54:15.930093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.692377+0000","last_change":"2024-05-10T10:52:15.690491+0000","last_active":"2024-05-10T10:52:17.692377+0000","last_peered":"2024-05-10T10:52:17.692377+0000","last_clean":"2024-05-10T10:52:17.692377+0000","last_became_active":"2024-05-10T10:52:15.690200+0000","last_became_peered":"2024-05-10T10:52:15.690200+0000","last_unstale":"2024-05-10T10:52:17.692377+0000","last_undegraded":"2024-05-10T10:52:17.692377+0000","last_fullsized":"2024-05-10T10:52:17.692377+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:28.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:31.805227+0000","last_change":"2024-05-10T10:52:12.631966+0000","last_active":"2024-05-10T10:52:31.805227+0000","last_peered":"2024-05-10T10:52:31.805227+0000","last_clean":"2024-05-10T10:52:31.805227+0000","last_became_active":"2024-05-10T10:52:12.631539+0000","last_became_peered":"2024-05-10T10:52:12.631539+0000","last_unstale":"2024-05-10T10:52:31.805227+0000","last_undegraded":"2024-05-10T10:52:31.805227+0000","last_fullsized":"2024-05-10T10:52:31.805227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:32:52.392307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691579+0000","last_change":"2024-05-10T10:52:15.692893+0000","last_active":"2024-05-10T10:52:17.691579+0000","last_peered":"2024-05-10T10:52:17.691579+0000","last_clean":"2024-05-10T10:52:17.691579+0000","last_became_active":"2024-05-10T10:52:15.692528+0000","last_became_peered":"2024-05-10T10:52:15.692528+0000","last_unstale":"2024-05-10T10:52:17.691579+0000","last_undegraded":"2024-05-10T10:52:17.691579+0000","last_fullsized":"2024-05-10T10:52:17.691579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:51.452294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'32","reported_seq":116,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:59.721059+0000","last_change":"2024-05-10T10:52:12.532094+0000","last_active":"2024-05-10T10:52:59.721059+0000","last_peered":"2024-05-10T10:52:59.721059+0000","last_clean":"2024-05-10T10:52:59.721059+0000","last_became_active":"2024-05-10T10:52:12.531719+0000","last_became_peered":"2024-05-10T10:52:12.531719+0000","last_unstale":"2024-05-10T10:52:59.721059+0000","last_undegraded":"2024-05-10T10:52:59.721059+0000","last_fullsized":"2024-05-10T10:52:59.721059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:43:52.697528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63072,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":62,"num_read_kb":92,"num_write":34,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678914+0000","last_change":"2024-05-10T10:52:15.688187+0000","last_active":"2024-05-10T10:52:17.678914+0000","last_peered":"2024-05-10T10:52:17.678914+0000","last_clean":"2024-05-10T10:52:17.678914+0000","last_became_active":"2024-05-10T10:52:15.687821+0000","last_became_peered":"2024-05-10T10:52:15.687821+0000","last_unstale":"2024-05-10T10:52:17.678914+0000","last_undegraded":"2024-05-10T10:52:17.678914+0000","last_fullsized":"2024-05-10T10:52:17.678914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:54.425892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:33.669916+0000","last_change":"2024-05-10T10:52:12.532185+0000","last_active":"2024-05-10T10:52:33.669916+0000","last_peered":"2024-05-10T10:52:33.669916+0000","last_clean":"2024-05-10T10:52:33.669916+0000","last_became_active":"2024-05-10T10:52:12.531795+0000","last_became_peered":"2024-05-10T10:52:12.531795+0000","last_unstale":"2024-05-10T10:52:33.669916+0000","last_undegraded":"2024-05-10T10:52:33.669916+0000","last_fullsized":"2024-05-10T10:52:33.669916+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:51.704767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.689369+0000","last_change":"2024-05-10T10:52:15.684388+0000","last_active":"2024-05-10T10:52:17.689369+0000","last_peered":"2024-05-10T10:52:17.689369+0000","last_clean":"2024-05-10T10:52:17.689369+0000","last_became_active":"2024-05-10T10:52:15.684061+0000","last_became_peered":"2024-05-10T10:52:15.684061+0000","last_unstale":"2024-05-10T10:52:17.689369+0000","last_undegraded":"2024-05-10T10:52:17.689369+0000","last_fullsized":"2024-05-10T10:52:17.689369+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:19.462083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.813114+0000","last_change":"2024-05-10T10:52:12.531912+0000","last_active":"2024-05-10T10:52:32.813114+0000","last_peered":"2024-05-10T10:52:32.813114+0000","last_clean":"2024-05-10T10:52:32.813114+0000","last_became_active":"2024-05-10T10:52:12.531501+0000","last_became_peered":"2024-05-10T10:52:12.531501+0000","last_unstale":"2024-05-10T10:52:32.813114+0000","last_undegraded":"2024-05-10T10:52:32.813114+0000","last_fullsized":"2024-05-10T10:52:32.813114+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:15.086519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.693407+0000","last_change":"2024-05-10T10:52:15.686521+0000","last_active":"2024-05-10T10:52:17.693407+0000","last_peered":"2024-05-10T10:52:17.693407+0000","last_clean":"2024-05-10T10:52:17.693407+0000","last_became_active":"2024-05-10T10:52:15.686142+0000","last_became_peered":"2024-05-10T10:52:15.686142+0000","last_unstale":"2024-05-10T10:52:17.693407+0000","last_undegraded":"2024-05-10T10:52:17.693407+0000","last_fullsized":"2024-05-10T10:52:17.693407+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:40.315401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":52,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:54.709020+0000","last_change":"2024-05-10T10:52:12.527774+0000","last_active":"2024-05-10T10:52:54.709020+0000","last_peered":"2024-05-10T10:52:54.709020+0000","last_clean":"2024-05-10T10:52:54.709020+0000","last_became_active":"2024-05-10T10:52:12.527412+0000","last_became_peered":"2024-05-10T10:52:12.527412+0000","last_unstale":"2024-05-10T10:52:54.709020+0000","last_undegraded":"2024-05-10T10:52:54.709020+0000","last_fullsized":"2024-05-10T10:52:54.709020+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:51:21.334653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.692406+0000","last_change":"2024-05-10T10:52:15.693427+0000","last_active":"2024-05-10T10:52:17.692406+0000","last_peered":"2024-05-10T10:52:17.692406+0000","last_clean":"2024-05-10T10:52:17.692406+0000","last_became_active":"2024-05-10T10:52:15.693114+0000","last_became_peered":"2024-05-10T10:52:15.693114+0000","last_unstale":"2024-05-10T10:52:17.692406+0000","last_undegraded":"2024-05-10T10:52:17.692406+0000","last_fullsized":"2024-05-10T10:52:17.692406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:25:36.423413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.814488+0000","last_change":"2024-05-10T10:52:12.631475+0000","last_active":"2024-05-10T10:52:32.814488+0000","last_peered":"2024-05-10T10:52:32.814488+0000","last_clean":"2024-05-10T10:52:32.814488+0000","last_became_active":"2024-05-10T10:52:12.631079+0000","last_became_peered":"2024-05-10T10:52:12.631079+0000","last_unstale":"2024-05-10T10:52:32.814488+0000","last_undegraded":"2024-05-10T10:52:32.814488+0000","last_fullsized":"2024-05-10T10:52:32.814488+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:52.975413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.694922+0000","last_change":"2024-05-10T10:52:15.692741+0000","last_active":"2024-05-10T10:52:17.694922+0000","last_peered":"2024-05-10T10:52:17.694922+0000","last_clean":"2024-05-10T10:52:17.694922+0000","last_became_active":"2024-05-10T10:52:15.692411+0000","last_became_peered":"2024-05-10T10:52:15.692411+0000","last_unstale":"2024-05-10T10:52:17.694922+0000","last_undegraded":"2024-05-10T10:52:17.694922+0000","last_fullsized":"2024-05-10T10:52:17.694922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:34.604303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.795103+0000","last_change":"2024-05-10T10:52:12.533071+0000","last_active":"2024-05-10T10:52:32.795103+0000","last_peered":"2024-05-10T10:52:32.795103+0000","last_clean":"2024-05-10T10:52:32.795103+0000","last_became_active":"2024-05-10T10:52:12.532655+0000","last_became_peered":"2024-05-10T10:52:12.532655+0000","last_unstale":"2024-05-10T10:52:32.795103+0000","last_undegraded":"2024-05-10T10:52:32.795103+0000","last_fullsized":"2024-05-10T10:52:32.795103+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:30.723701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691496+0000","last_change":"2024-05-10T10:52:15.697362+0000","last_active":"2024-05-10T10:52:17.691496+0000","last_peered":"2024-05-10T10:52:17.691496+0000","last_clean":"2024-05-10T10:52:17.691496+0000","last_became_active":"2024-05-10T10:52:15.696915+0000","last_became_peered":"2024-05-10T10:52:15.696915+0000","last_unstale":"2024-05-10T10:52:17.691496+0000","last_undegraded":"2024-05-10T10:52:17.691496+0000","last_fullsized":"2024-05-10T10:52:17.691496+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:29:03.365667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.689833+0000","last_change":"2024-05-10T10:52:12.631088+0000","last_active":"2024-05-10T10:52:17.689833+0000","last_peered":"2024-05-10T10:52:17.689833+0000","last_clean":"2024-05-10T10:52:17.689833+0000","last_became_active":"2024-05-10T10:52:12.630557+0000","last_became_peered":"2024-05-10T10:52:12.630557+0000","last_unstale":"2024-05-10T10:52:17.689833+0000","last_undegraded":"2024-05-10T10:52:17.689833+0000","last_fullsized":"2024-05-10T10:52:17.689833+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:44:21.599055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690460+0000","last_change":"2024-05-10T10:52:15.675837+0000","last_active":"2024-05-10T10:52:17.690460+0000","last_peered":"2024-05-10T10:52:17.690460+0000","last_clean":"2024-05-10T10:52:17.690460+0000","last_became_active":"2024-05-10T10:52:15.675438+0000","last_became_peered":"2024-05-10T10:52:15.675438+0000","last_unstale":"2024-05-10T10:52:17.690460+0000","last_undegraded":"2024-05-10T10:52:17.690460+0000","last_fullsized":"2024-05-10T10:52:17.690460+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:23.142008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:57.706652+0000","last_change":"2024-05-10T10:52:12.530141+0000","last_active":"2024-05-10T10:52:57.706652+0000","last_peered":"2024-05-10T10:52:57.706652+0000","last_clean":"2024-05-10T10:52:57.706652+0000","last_became_active":"2024-05-10T10:52:12.529771+0000","last_became_peered":"2024-05-10T10:52:12.529771+0000","last_unstale":"2024-05-10T10:52:57.706652+0000","last_undegraded":"2024-05-10T10:52:57.706652+0000","last_fullsized":"2024-05-10T10:52:57.706652+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:42.803789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690174+0000","last_change":"2024-05-10T10:52:15.686934+0000","last_active":"2024-05-10T10:52:17.690174+0000","last_peered":"2024-05-10T10:52:17.690174+0000","last_clean":"2024-05-10T10:52:17.690174+0000","last_became_active":"2024-05-10T10:52:15.686494+0000","last_became_peered":"2024-05-10T10:52:15.686494+0000","last_unstale":"2024-05-10T10:52:17.690174+0000","last_undegraded":"2024-05-10T10:52:17.690174+0000","last_fullsized":"2024-05-10T10:52:17.690174+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:18.049088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.694792+0000","last_change":"2024-05-10T10:52:15.693243+0000","last_active":"2024-05-10T10:52:17.694792+0000","last_peered":"2024-05-10T10:52:17.694792+0000","last_clean":"2024-05-10T10:52:17.694792+0000","last_became_active":"2024-05-10T10:52:15.692868+0000","last_became_peered":"2024-05-10T10:52:15.692868+0000","last_unstale":"2024-05-10T10:52:17.694792+0000","last_undegraded":"2024-05-10T10:52:17.694792+0000","last_fullsized":"2024-05-10T10:52:17.694792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:25.316500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:57.713708+0000","last_change":"2024-05-10T10:52:12.630916+0000","last_active":"2024-05-10T10:52:57.713708+0000","last_peered":"2024-05-10T10:52:57.713708+0000","last_clean":"2024-05-10T10:52:57.713708+0000","last_became_active":"2024-05-10T10:52:12.630564+0000","last_became_peered":"2024-05-10T10:52:12.630564+0000","last_unstale":"2024-05-10T10:52:57.713708+0000","last_undegraded":"2024-05-10T10:52:57.713708+0000","last_fullsized":"2024-05-10T10:52:57.713708+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:09:46.434409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678229+0000","last_change":"2024-05-10T10:52:15.691017+0000","last_active":"2024-05-10T10:52:17.678229+0000","last_peered":"2024-05-10T10:52:17.678229+0000","last_clean":"2024-05-10T10:52:17.678229+0000","last_became_active":"2024-05-10T10:52:15.690705+0000","last_became_peered":"2024-05-10T10:52:15.690705+0000","last_unstale":"2024-05-10T10:52:17.678229+0000","last_undegraded":"2024-05-10T10:52:17.678229+0000","last_fullsized":"2024-05-10T10:52:17.678229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:50:43.517455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:33.669905+0000","last_change":"2024-05-10T10:52:12.529180+0000","last_active":"2024-05-10T10:52:33.669905+0000","last_peered":"2024-05-10T10:52:33.669905+0000","last_clean":"2024-05-10T10:52:33.669905+0000","last_became_active":"2024-05-10T10:52:12.528570+0000","last_became_peered":"2024-05-10T10:52:12.528570+0000","last_unstale":"2024-05-10T10:52:33.669905+0000","last_undegraded":"2024-05-10T10:52:33.669905+0000","last_fullsized":"2024-05-10T10:52:33.669905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:31:53.254302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":97,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.692176+0000","last_change":"2024-05-10T10:50:51.113120+0000","last_active":"2024-05-10T10:52:17.692176+0000","last_peered":"2024-05-10T10:52:17.692176+0000","last_clean":"2024-05-10T10:52:17.692176+0000","last_became_active":"2024-05-10T10:50:51.107803+0000","last_became_peered":"2024-05-10T10:50:51.107803+0000","last_unstale":"2024-05-10T10:52:17.692176+0000","last_undegraded":"2024-05-10T10:52:17.692176+0000","last_fullsized":"2024-05-10T10:52:17.692176+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:47:32.190034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:47:32.190034+0000","last_clean_scrub_stamp":"2024-05-10T10:47:32.190034+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:53.599839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.688897+0000","last_change":"2024-05-10T10:52:15.689856+0000","last_active":"2024-05-10T10:52:17.688897+0000","last_peered":"2024-05-10T10:52:17.688897+0000","last_clean":"2024-05-10T10:52:17.688897+0000","last_became_active":"2024-05-10T10:52:15.689544+0000","last_became_peered":"2024-05-10T10:52:15.689544+0000","last_unstale":"2024-05-10T10:52:17.688897+0000","last_undegraded":"2024-05-10T10:52:17.688897+0000","last_fullsized":"2024-05-10T10:52:17.688897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:39.374857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:30.798981+0000","last_change":"2024-05-10T10:52:12.532217+0000","last_active":"2024-05-10T10:52:30.798981+0000","last_peered":"2024-05-10T10:52:30.798981+0000","last_clean":"2024-05-10T10:52:30.798981+0000","last_became_active":"2024-05-10T10:52:12.531575+0000","last_became_peered":"2024-05-10T10:52:12.531575+0000","last_unstale":"2024-05-10T10:52:30.798981+0000","last_undegraded":"2024-05-10T10:52:30.798981+0000","last_fullsized":"2024-05-10T10:52:30.798981+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:15:59.493728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.813476+0000","last_change":"2024-05-10T10:52:12.631990+0000","last_active":"2024-05-10T10:52:32.813476+0000","last_peered":"2024-05-10T10:52:32.813476+0000","last_clean":"2024-05-10T10:52:32.813476+0000","last_became_active":"2024-05-10T10:52:12.631061+0000","last_became_peered":"2024-05-10T10:52:12.631061+0000","last_unstale":"2024-05-10T10:52:32.813476+0000","last_undegraded":"2024-05-10T10:52:32.813476+0000","last_fullsized":"2024-05-10T10:52:32.813476+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:30.298079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.689741+0000","last_change":"2024-05-10T10:52:15.678797+0000","last_active":"2024-05-10T10:52:17.689741+0000","last_peered":"2024-05-10T10:52:17.689741+0000","last_clean":"2024-05-10T10:52:17.689741+0000","last_became_active":"2024-05-10T10:52:15.678388+0000","last_became_peered":"2024-05-10T10:52:15.678388+0000","last_unstale":"2024-05-10T10:52:17.689741+0000","last_undegraded":"2024-05-10T10:52:17.689741+0000","last_fullsized":"2024-05-10T10:52:17.689741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:15.314479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'15","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:52.693308+0000","last_change":"2024-05-10T10:52:12.529461+0000","last_active":"2024-05-10T10:52:52.693308+0000","last_peered":"2024-05-10T10:52:52.693308+0000","last_clean":"2024-05-10T10:52:52.693308+0000","last_became_active":"2024-05-10T10:52:12.529095+0000","last_became_peered":"2024-05-10T10:52:12.529095+0000","last_unstale":"2024-05-10T10:52:52.693308+0000","last_undegraded":"2024-05-10T10:52:52.693308+0000","last_fullsized":"2024-05-10T10:52:52.693308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:26:39.331856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678612+0000","last_change":"2024-05-10T10:52:15.688313+0000","last_active":"2024-05-10T10:52:17.678612+0000","last_peered":"2024-05-10T10:52:17.678612+0000","last_clean":"2024-05-10T10:52:17.678612+0000","last_became_active":"2024-05-10T10:52:15.688028+0000","last_became_peered":"2024-05-10T10:52:15.688028+0000","last_unstale":"2024-05-10T10:52:17.678612+0000","last_undegraded":"2024-05-10T10:52:17.678612+0000","last_fullsized":"2024-05-10T10:52:17.678612+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:03.815985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.814296+0000","last_change":"2024-05-10T10:52:12.529409+0000","last_active":"2024-05-10T10:52:32.814296+0000","last_peered":"2024-05-10T10:52:32.814296+0000","last_clean":"2024-05-10T10:52:32.814296+0000","last_became_active":"2024-05-10T10:52:12.528837+0000","last_became_peered":"2024-05-10T10:52:12.528837+0000","last_unstale":"2024-05-10T10:52:32.814296+0000","last_undegraded":"2024-05-10T10:52:32.814296+0000","last_fullsized":"2024-05-10T10:52:32.814296+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:28.280292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691687+0000","last_change":"2024-05-10T10:52:15.689755+0000","last_active":"2024-05-10T10:52:17.691687+0000","last_peered":"2024-05-10T10:52:17.691687+0000","last_clean":"2024-05-10T10:52:17.691687+0000","last_became_active":"2024-05-10T10:52:15.689344+0000","last_became_peered":"2024-05-10T10:52:15.689344+0000","last_unstale":"2024-05-10T10:52:17.691687+0000","last_undegraded":"2024-05-10T10:52:17.691687+0000","last_fullsized":"2024-05-10T10:52:17.691687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:01:20.965017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:29.790331+0000","last_change":"2024-05-10T10:52:12.631048+0000","last_active":"2024-05-10T10:52:29.790331+0000","last_peered":"2024-05-10T10:52:29.790331+0000","last_clean":"2024-05-10T10:52:29.790331+0000","last_became_active":"2024-05-10T10:52:12.630754+0000","last_became_peered":"2024-05-10T10:52:12.630754+0000","last_unstale":"2024-05-10T10:52:29.790331+0000","last_undegraded":"2024-05-10T10:52:29.790331+0000","last_fullsized":"2024-05-10T10:52:29.790331+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:57.755423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678635+0000","last_change":"2024-05-10T10:52:15.684552+0000","last_active":"2024-05-10T10:52:17.678635+0000","last_peered":"2024-05-10T10:52:17.678635+0000","last_clean":"2024-05-10T10:52:17.678635+0000","last_became_active":"2024-05-10T10:52:15.684174+0000","last_became_peered":"2024-05-10T10:52:15.684174+0000","last_unstale":"2024-05-10T10:52:17.678635+0000","last_undegraded":"2024-05-10T10:52:17.678635+0000","last_fullsized":"2024-05-10T10:52:17.678635+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:21:51.633525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.812520+0000","last_change":"2024-05-10T10:52:12.525692+0000","last_active":"2024-05-10T10:52:32.812520+0000","last_peered":"2024-05-10T10:52:32.812520+0000","last_clean":"2024-05-10T10:52:32.812520+0000","last_became_active":"2024-05-10T10:52:12.525436+0000","last_became_peered":"2024-05-10T10:52:12.525436+0000","last_unstale":"2024-05-10T10:52:32.812520+0000","last_undegraded":"2024-05-10T10:52:32.812520+0000","last_fullsized":"2024-05-10T10:52:32.812520+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:34:40.801973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690617+0000","last_change":"2024-05-10T10:52:15.689838+0000","last_active":"2024-05-10T10:52:17.690617+0000","last_peered":"2024-05-10T10:52:17.690617+0000","last_clean":"2024-05-10T10:52:17.690617+0000","last_became_active":"2024-05-10T10:52:15.689481+0000","last_became_peered":"2024-05-10T10:52:15.689481+0000","last_unstale":"2024-05-10T10:52:17.690617+0000","last_undegraded":"2024-05-10T10:52:17.690617+0000","last_fullsized":"2024-05-10T10:52:17.690617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:02:27.382859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:31.805841+0000","last_change":"2024-05-10T10:52:12.533782+0000","last_active":"2024-05-10T10:52:31.805841+0000","last_peered":"2024-05-10T10:52:31.805841+0000","last_clean":"2024-05-10T10:52:31.805841+0000","last_became_active":"2024-05-10T10:52:12.533457+0000","last_became_peered":"2024-05-10T10:52:12.533457+0000","last_unstale":"2024-05-10T10:52:31.805841+0000","last_undegraded":"2024-05-10T10:52:31.805841+0000","last_fullsized":"2024-05-10T10:52:31.805841+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:17.372672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678258+0000","last_change":"2024-05-10T10:52:15.691594+0000","last_active":"2024-05-10T10:52:17.678258+0000","last_peered":"2024-05-10T10:52:17.678258+0000","last_clean":"2024-05-10T10:52:17.678258+0000","last_became_active":"2024-05-10T10:52:15.690300+0000","last_became_peered":"2024-05-10T10:52:15.690300+0000","last_unstale":"2024-05-10T10:52:17.678258+0000","last_undegraded":"2024-05-10T10:52:17.678258+0000","last_fullsized":"2024-05-10T10:52:17.678258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:05.228834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:29.790568+0000","last_change":"2024-05-10T10:52:12.530693+0000","last_active":"2024-05-10T10:52:29.790568+0000","last_peered":"2024-05-10T10:52:29.790568+0000","last_clean":"2024-05-10T10:52:29.790568+0000","last_became_active":"2024-05-10T10:52:12.530310+0000","last_became_peered":"2024-05-10T10:52:12.530310+0000","last_unstale":"2024-05-10T10:52:29.790568+0000","last_undegraded":"2024-05-10T10:52:29.790568+0000","last_fullsized":"2024-05-10T10:52:29.790568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:42:46.967318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.692950+0000","last_change":"2024-05-10T10:52:15.695473+0000","last_active":"2024-05-10T10:52:17.692950+0000","last_peered":"2024-05-10T10:52:17.692950+0000","last_clean":"2024-05-10T10:52:17.692950+0000","last_became_active":"2024-05-10T10:52:15.695121+0000","last_became_peered":"2024-05-10T10:52:15.695121+0000","last_unstale":"2024-05-10T10:52:17.692950+0000","last_undegraded":"2024-05-10T10:52:17.692950+0000","last_fullsized":"2024-05-10T10:52:17.692950+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:48:08.019465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:55.704355+0000","last_change":"2024-05-10T10:52:12.630799+0000","last_active":"2024-05-10T10:52:55.704355+0000","last_peered":"2024-05-10T10:52:55.704355+0000","last_clean":"2024-05-10T10:52:55.704355+0000","last_became_active":"2024-05-10T10:52:12.630448+0000","last_became_peered":"2024-05-10T10:52:12.630448+0000","last_unstale":"2024-05-10T10:52:55.704355+0000","last_undegraded":"2024-05-10T10:52:55.704355+0000","last_fullsized":"2024-05-10T10:52:55.704355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:27.335062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.693013+0000","last_change":"2024-05-10T10:52:15.686691+0000","last_active":"2024-05-10T10:52:17.693013+0000","last_peered":"2024-05-10T10:52:17.693013+0000","last_clean":"2024-05-10T10:52:17.693013+0000","last_became_active":"2024-05-10T10:52:15.685886+0000","last_became_peered":"2024-05-10T10:52:15.685886+0000","last_unstale":"2024-05-10T10:52:17.693013+0000","last_undegraded":"2024-05-10T10:52:17.693013+0000","last_fullsized":"2024-05-10T10:52:17.693013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:45.199414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.812495+0000","last_change":"2024-05-10T10:52:12.533535+0000","last_active":"2024-05-10T10:52:32.812495+0000","last_peered":"2024-05-10T10:52:32.812495+0000","last_clean":"2024-05-10T10:52:32.812495+0000","last_became_active":"2024-05-10T10:52:12.533146+0000","last_became_peered":"2024-05-10T10:52:12.533146+0000","last_unstale":"2024-05-10T10:52:32.812495+0000","last_undegraded":"2024-05-10T10:52:32.812495+0000","last_fullsized":"2024-05-10T10:52:32.812495+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:07:16.138240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:18.936008+0000","last_change":"2024-05-10T10:52:15.692013+0000","last_active":"2024-05-10T10:52:18.936008+0000","last_peered":"2024-05-10T10:52:18.936008+0000","last_clean":"2024-05-10T10:52:18.936008+0000","last_became_active":"2024-05-10T10:52:15.691660+0000","last_became_peered":"2024-05-10T10:52:15.691660+0000","last_unstale":"2024-05-10T10:52:18.936008+0000","last_undegraded":"2024-05-10T10:52:18.936008+0000","last_fullsized":"2024-05-10T10:52:18.936008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:58.780961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:32.812775+0000","last_change":"2024-05-10T10:52:12.530962+0000","last_active":"2024-05-10T10:52:32.812775+0000","last_peered":"2024-05-10T10:52:32.812775+0000","last_clean":"2024-05-10T10:52:32.812775+0000","last_became_active":"2024-05-10T10:52:12.530610+0000","last_became_peered":"2024-05-10T10:52:12.530610+0000","last_unstale":"2024-05-10T10:52:32.812775+0000","last_undegraded":"2024-05-10T10:52:32.812775+0000","last_fullsized":"2024-05-10T10:52:32.812775+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:04:13.484713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.693214+0000","last_change":"2024-05-10T10:52:15.687218+0000","last_active":"2024-05-10T10:52:17.693214+0000","last_peered":"2024-05-10T10:52:17.693214+0000","last_clean":"2024-05-10T10:52:17.693214+0000","last_became_active":"2024-05-10T10:52:15.686888+0000","last_became_peered":"2024-05-10T10:52:15.686888+0000","last_unstale":"2024-05-10T10:52:17.693214+0000","last_undegraded":"2024-05-10T10:52:17.693214+0000","last_fullsized":"2024-05-10T10:52:17.693214+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:53:53.420063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690801+0000","last_change":"2024-05-10T10:52:15.691196+0000","last_active":"2024-05-10T10:52:17.690801+0000","last_peered":"2024-05-10T10:52:17.690801+0000","last_clean":"2024-05-10T10:52:17.690801+0000","last_became_active":"2024-05-10T10:52:15.690865+0000","last_became_peered":"2024-05-10T10:52:15.690865+0000","last_unstale":"2024-05-10T10:52:17.690801+0000","last_undegraded":"2024-05-10T10:52:17.690801+0000","last_fullsized":"2024-05-10T10:52:17.690801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:02:04.666193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691175+0000","last_change":"2024-05-10T10:52:15.691239+0000","last_active":"2024-05-10T10:52:17.691175+0000","last_peered":"2024-05-10T10:52:17.691175+0000","last_clean":"2024-05-10T10:52:17.691175+0000","last_became_active":"2024-05-10T10:52:15.690877+0000","last_became_peered":"2024-05-10T10:52:15.690877+0000","last_unstale":"2024-05-10T10:52:17.691175+0000","last_undegraded":"2024-05-10T10:52:17.691175+0000","last_fullsized":"2024-05-10T10:52:17.691175+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:16.564872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690798+0000","last_change":"2024-05-10T10:52:15.681784+0000","last_active":"2024-05-10T10:52:17.690798+0000","last_peered":"2024-05-10T10:52:17.690798+0000","last_clean":"2024-05-10T10:52:17.690798+0000","last_became_active":"2024-05-10T10:52:15.680900+0000","last_became_peered":"2024-05-10T10:52:15.680900+0000","last_unstale":"2024-05-10T10:52:17.690798+0000","last_undegraded":"2024-05-10T10:52:17.690798+0000","last_fullsized":"2024-05-10T10:52:17.690798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:56.393338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691822+0000","last_change":"2024-05-10T10:52:15.690659+0000","last_active":"2024-05-10T10:52:17.691822+0000","last_peered":"2024-05-10T10:52:17.691822+0000","last_clean":"2024-05-10T10:52:17.691822+0000","last_became_active":"2024-05-10T10:52:15.689723+0000","last_became_peered":"2024-05-10T10:52:15.689723+0000","last_unstale":"2024-05-10T10:52:17.691822+0000","last_undegraded":"2024-05-10T10:52:17.691822+0000","last_fullsized":"2024-05-10T10:52:17.691822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:53:35.212066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690242+0000","last_change":"2024-05-10T10:52:15.691359+0000","last_active":"2024-05-10T10:52:17.690242+0000","last_peered":"2024-05-10T10:52:17.690242+0000","last_clean":"2024-05-10T10:52:17.690242+0000","last_became_active":"2024-05-10T10:52:15.691067+0000","last_became_peered":"2024-05-10T10:52:15.691067+0000","last_unstale":"2024-05-10T10:52:17.690242+0000","last_undegraded":"2024-05-10T10:52:17.690242+0000","last_fullsized":"2024-05-10T10:52:17.690242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:41:38.244971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691030+0000","last_change":"2024-05-10T10:52:15.690573+0000","last_active":"2024-05-10T10:52:17.691030+0000","last_peered":"2024-05-10T10:52:17.691030+0000","last_clean":"2024-05-10T10:52:17.691030+0000","last_became_active":"2024-05-10T10:52:15.690257+0000","last_became_peered":"2024-05-10T10:52:15.690257+0000","last_unstale":"2024-05-10T10:52:17.691030+0000","last_undegraded":"2024-05-10T10:52:17.691030+0000","last_fullsized":"2024-05-10T10:52:17.691030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:37:27.128718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690925+0000","last_change":"2024-05-10T10:52:15.684914+0000","last_active":"2024-05-10T10:52:17.690925+0000","last_peered":"2024-05-10T10:52:17.690925+0000","last_clean":"2024-05-10T10:52:17.690925+0000","last_became_active":"2024-05-10T10:52:15.684557+0000","last_became_peered":"2024-05-10T10:52:15.684557+0000","last_unstale":"2024-05-10T10:52:17.690925+0000","last_undegraded":"2024-05-10T10:52:17.690925+0000","last_fullsized":"2024-05-10T10:52:17.690925+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:17.444305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678448+0000","last_change":"2024-05-10T10:52:15.697047+0000","last_active":"2024-05-10T10:52:17.678448+0000","last_peered":"2024-05-10T10:52:17.678448+0000","last_clean":"2024-05-10T10:52:17.678448+0000","last_became_active":"2024-05-10T10:52:15.696726+0000","last_became_peered":"2024-05-10T10:52:15.696726+0000","last_unstale":"2024-05-10T10:52:17.678448+0000","last_undegraded":"2024-05-10T10:52:17.678448+0000","last_fullsized":"2024-05-10T10:52:17.678448+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:14:30.777403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.694424+0000","last_change":"2024-05-10T10:52:15.695613+0000","last_active":"2024-05-10T10:52:17.694424+0000","last_peered":"2024-05-10T10:52:17.694424+0000","last_clean":"2024-05-10T10:52:17.694424+0000","last_became_active":"2024-05-10T10:52:15.695147+0000","last_became_peered":"2024-05-10T10:52:15.695147+0000","last_unstale":"2024-05-10T10:52:17.694424+0000","last_undegraded":"2024-05-10T10:52:17.694424+0000","last_fullsized":"2024-05-10T10:52:17.694424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:14.175158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.678011+0000","last_change":"2024-05-10T10:52:15.683914+0000","last_active":"2024-05-10T10:52:17.678011+0000","last_peered":"2024-05-10T10:52:17.678011+0000","last_clean":"2024-05-10T10:52:17.678011+0000","last_became_active":"2024-05-10T10:52:15.682359+0000","last_became_peered":"2024-05-10T10:52:15.682359+0000","last_unstale":"2024-05-10T10:52:17.678011+0000","last_undegraded":"2024-05-10T10:52:17.678011+0000","last_fullsized":"2024-05-10T10:52:17.678011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:23:41.018064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.691825+0000","last_change":"2024-05-10T10:52:15.690862+0000","last_active":"2024-05-10T10:52:17.691825+0000","last_peered":"2024-05-10T10:52:17.691825+0000","last_clean":"2024-05-10T10:52:17.691825+0000","last_became_active":"2024-05-10T10:52:15.690520+0000","last_became_peered":"2024-05-10T10:52:15.690520+0000","last_unstale":"2024-05-10T10:52:17.691825+0000","last_undegraded":"2024-05-10T10:52:17.691825+0000","last_fullsized":"2024-05-10T10:52:17.691825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:39.819473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.689969+0000","last_change":"2024-05-10T10:52:15.684605+0000","last_active":"2024-05-10T10:52:17.689969+0000","last_peered":"2024-05-10T10:52:17.689969+0000","last_clean":"2024-05-10T10:52:17.689969+0000","last_became_active":"2024-05-10T10:52:15.683863+0000","last_became_peered":"2024-05-10T10:52:15.683863+0000","last_unstale":"2024-05-10T10:52:17.689969+0000","last_undegraded":"2024-05-10T10:52:17.689969+0000","last_fullsized":"2024-05-10T10:52:17.689969+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:49:35.187932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-10T10:52:17.690355+0000","last_change":"2024-05-10T10:52:15.698014+0000","last_active":"2024-05-10T10:52:17.690355+0000","last_peered":"2024-05-10T10:52:17.690355+0000","last_clean":"2024-05-10T10:52:17.690355+0000","last_became_active":"2024-05-10T10:52:15.697583+0000","last_became_peered":"2024-05-10T10:52:15.697583+0000","last_unstale":"2024-05-10T10:52:17.690355+0000","last_undegraded":"2024-05-10T10:52:17.690355+0000","last_fullsized":"2024-05-10T10:52:17.690355+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:30.792127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69885,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":299,"num_read_kb":229,"num_write":245,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":200950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645334,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":872448,"data_stored":419787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841566,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36876,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708276,"statfs":{"total":95995035648,"available":95957274624,"internally_reserved":0,"allocated":1576960,"data_stored":1073888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037795,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":897024,"data_stored":419717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234022,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":892928,"data_stored":420095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430252,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28472,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716680,"statfs":{"total":95995035648,"available":95965880320,"internally_reserved":0,"allocated":1490944,"data_stored":1012613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593777,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":419434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":483419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":901120,"data_stored":420773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":475325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182463,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":897024,"data_stored":419259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986235,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36196,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708956,"statfs":{"total":95995035648,"available":95957970944,"internally_reserved":0,"allocated":880640,"data_stored":419295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790005,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36804,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708348,"statfs":{"total":95995035648,"available":95957348352,"internally_reserved":0,"allocated":1503232,"data_stored":1012291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T10:53:02.641 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-10T10:53:02.642 INFO:tasks.cephadm:Setting up client nodes... 2024-05-10T10:53:02.642 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-10T10:53:02.888 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:03.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:02 smithi184 ceph-mon[34585]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2024-05-10T10:53:03.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:02 smithi184 ceph-mon[34585]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:53:03.149 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:02 smithi107 ceph-mon[30373]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2024-05-10T10:53:03.149 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:02 smithi107 ceph-mon[30373]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:53:03.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:02 smithi196 ceph-mon[34872]: pgmap v307: 97 pgs: 97 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2024-05-10T10:53:03.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:02 smithi196 ceph-mon[34872]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:53:04.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.561+0000 7fcfbade3700 1 -- 172.21.15.107:0/705483883 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfb4103520 msgr2=0x7fcfb4103940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:04.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.561+0000 7fcfbade3700 1 --2- 172.21.15.107:0/705483883 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfb4103520 0x7fcfb4103940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80099c0 tx=0x7fcfa8009cd0 comp rx=0 tx=0).stop 2024-05-10T10:53:04.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.562+0000 7fcfbade3700 1 -- 172.21.15.107:0/705483883 shutdown_connections 2024-05-10T10:53:04.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.562+0000 7fcfbade3700 1 --2- 172.21.15.107:0/705483883 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfb41050c0 0x7fcfb410b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:04.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.562+0000 7fcfbade3700 1 --2- 172.21.15.107:0/705483883 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfb4103520 0x7fcfb4103940 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:04.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.562+0000 7fcfbade3700 1 --2- 172.21.15.107:0/705483883 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfb4104720 0x7fcfb4104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:04.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.562+0000 7fcfbade3700 1 -- 172.21.15.107:0/705483883 >> 172.21.15.107:0/705483883 conn(0x7fcfb40feac0 msgr2=0x7fcfb4100f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:04.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.562+0000 7fcfbade3700 1 -- 172.21.15.107:0/705483883 shutdown_connections 2024-05-10T10:53:04.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.562+0000 7fcfbade3700 1 -- 172.21.15.107:0/705483883 wait complete. 2024-05-10T10:53:04.563 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.562+0000 7fcfbade3700 1 Processor -- start 2024-05-10T10:53:04.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.562+0000 7fcfbade3700 1 -- start start 2024-05-10T10:53:04.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.563+0000 7fcfbade3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfb4103520 0x7fcfb4199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:04.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.563+0000 7fcfbade3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfb4104720 0x7fcfb4199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:04.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.563+0000 7fcfbade3700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfb41050c0 0x7fcfb41a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:04.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.563+0000 7fcfbade3700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb410f220 con 0x7fcfb4104720 2024-05-10T10:53:04.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.563+0000 7fcfbade3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb410f0a0 con 0x7fcfb4103520 2024-05-10T10:53:04.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.563+0000 7fcfbade3700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb410f3a0 con 0x7fcfb41050c0 2024-05-10T10:53:04.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.563+0000 7fcfb3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfb4104720 0x7fcfb4199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:04.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.563+0000 7fcfb3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfb4104720 0x7fcfb4199d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56128/0 (socket says 172.21.15.107:56128) 2024-05-10T10:53:04.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.563+0000 7fcfb3fff700 1 -- 172.21.15.107:0/3019275222 learned_addr learned my addr 172.21.15.107:0/3019275222 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:04.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.563+0000 7fcfb8b7f700 1 --2- 172.21.15.107:0/3019275222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfb4103520 0x7fcfb4199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:04.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.563+0000 7fcfb9380700 1 --2- 172.21.15.107:0/3019275222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfb41050c0 0x7fcfb41a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:04.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.563+0000 7fcfb3fff700 1 -- 172.21.15.107:0/3019275222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfb41050c0 msgr2=0x7fcfb41a0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:04.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.563+0000 7fcfb3fff700 1 --2- 172.21.15.107:0/3019275222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfb41050c0 0x7fcfb41a0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:04.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.563+0000 7fcfb3fff700 1 -- 172.21.15.107:0/3019275222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfb4103520 msgr2=0x7fcfb4199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:04.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.563+0000 7fcfb3fff700 1 --2- 172.21.15.107:0/3019275222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfb4103520 0x7fcfb4199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:04.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.563+0000 7fcfb3fff700 1 -- 172.21.15.107:0/3019275222 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb41a1480 con 0x7fcfb4104720 2024-05-10T10:53:04.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.563+0000 7fcfb3fff700 1 --2- 172.21.15.107:0/3019275222 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfb4104720 0x7fcfb4199d60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000b560 tx=0x7fcfa000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:04.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.563+0000 7fcfb1ffb700 1 -- 172.21.15.107:0/3019275222 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0015020 con 0x7fcfb4104720 2024-05-10T10:53:04.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.564+0000 7fcfb1ffb700 1 -- 172.21.15.107:0/3019275222 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcfa0011d00 con 0x7fcfb4104720 2024-05-10T10:53:04.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.564+0000 7fcfbade3700 1 -- 172.21.15.107:0/3019275222 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb41a1770 con 0x7fcfb4104720 2024-05-10T10:53:04.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.564+0000 7fcfb1ffb700 1 -- 172.21.15.107:0/3019275222 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0010e60 con 0x7fcfb4104720 2024-05-10T10:53:04.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.564+0000 7fcfbade3700 1 -- 172.21.15.107:0/3019275222 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb41a1c60 con 0x7fcfb4104720 2024-05-10T10:53:04.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.565+0000 7fcfbade3700 1 -- 172.21.15.107:0/3019275222 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfb40519e0 con 0x7fcfb4104720 2024-05-10T10:53:04.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.566+0000 7fcfb1ffb700 1 -- 172.21.15.107:0/3019275222 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7fcfa0018020 con 0x7fcfb4104720 2024-05-10T10:53:04.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.567+0000 7fcfb1ffb700 1 --2- 172.21.15.107:0/3019275222 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcfa40b29b0 0x7fcfa40b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:04.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.567+0000 7fcfb8b7f700 1 --2- 172.21.15.107:0/3019275222 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcfa40b29b0 0x7fcfa40b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:04.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.567+0000 7fcfb1ffb700 1 -- 172.21.15.107:0/3019275222 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fcfa00e17f0 con 0x7fcfb4104720 2024-05-10T10:53:04.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.568+0000 7fcfb8b7f700 1 --2- 172.21.15.107:0/3019275222 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcfa40b29b0 0x7fcfa40b4e70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8003910 tx=0x7fcfa8009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:04.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.572+0000 7fcfb1ffb700 1 -- 172.21.15.107:0/3019275222 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fcfa001f020 con 0x7fcfb4104720 2024-05-10T10:53:04.859 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.858+0000 7fcfbade3700 1 -- 172.21.15.107:0/3019275222 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fcfb402e510 con 0x7fcfb4104720 2024-05-10T10:53:04.861 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.860+0000 7fcfb1ffb700 1 -- 172.21.15.107:0/3019275222 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fcfa00a9670 con 0x7fcfb4104720 2024-05-10T10:53:04.861 INFO:teuthology.orchestra.run.smithi107.stdout:[client.0] 2024-05-10T10:53:04.861 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCQ/D1mveo/MxAA/UE++QCt/HDY1oTaw39Fig== 2024-05-10T10:53:04.863 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.862+0000 7fcfbade3700 1 -- 172.21.15.107:0/3019275222 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcfa40b29b0 msgr2=0x7fcfa40b4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:04.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.862+0000 7fcfbade3700 1 --2- 172.21.15.107:0/3019275222 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcfa40b29b0 0x7fcfa40b4e70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8003910 tx=0x7fcfa8009f10 comp rx=0 tx=0).stop 2024-05-10T10:53:04.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.862+0000 7fcfbade3700 1 -- 172.21.15.107:0/3019275222 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfb4104720 msgr2=0x7fcfb4199d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:04.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.862+0000 7fcfbade3700 1 --2- 172.21.15.107:0/3019275222 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfb4104720 0x7fcfb4199d60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000b560 tx=0x7fcfa000b870 comp rx=0 tx=0).stop 2024-05-10T10:53:04.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.863+0000 7fcfbade3700 1 -- 172.21.15.107:0/3019275222 shutdown_connections 2024-05-10T10:53:04.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.863+0000 7fcfbade3700 1 --2- 172.21.15.107:0/3019275222 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcfa40b29b0 0x7fcfa40b4e70 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:04.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.863+0000 7fcfbade3700 1 --2- 172.21.15.107:0/3019275222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfb41050c0 0x7fcfb41a0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:04.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.863+0000 7fcfbade3700 1 --2- 172.21.15.107:0/3019275222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfb4103520 0x7fcfb4199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:04.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.863+0000 7fcfbade3700 1 --2- 172.21.15.107:0/3019275222 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfb4104720 0x7fcfb4199d60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:04.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.863+0000 7fcfbade3700 1 -- 172.21.15.107:0/3019275222 >> 172.21.15.107:0/3019275222 conn(0x7fcfb40feac0 msgr2=0x7fcfb4107950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:04.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.863+0000 7fcfbade3700 1 -- 172.21.15.107:0/3019275222 shutdown_connections 2024-05-10T10:53:04.864 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:04.863+0000 7fcfbade3700 1 -- 172.21.15.107:0/3019275222 wait complete. 2024-05-10T10:53:05.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:04 smithi107 ceph-mon[30373]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-05-10T10:53:05.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:04 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3019275222' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-10T10:53:05.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:04 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3019275222' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-10T10:53:05.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:04 smithi196 ceph-mon[34872]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-05-10T10:53:05.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:04 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3019275222' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-10T10:53:05.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:04 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3019275222' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-10T10:53:05.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:04 smithi184 ceph-mon[34585]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-05-10T10:53:05.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:04 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3019275222' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-10T10:53:05.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:04 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3019275222' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-10T10:53:05.534 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T10:53:05.534 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-10T10:53:05.534 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-10T10:53:05.573 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-10T10:53:05.573 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-10T10:53:05.573 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph mgr dump --format=json 2024-05-10T10:53:05.856 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:07.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:06 smithi107 ceph-mon[30373]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-05-10T10:53:07.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:06 smithi196 ceph-mon[34872]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-05-10T10:53:07.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:06 smithi184 ceph-mon[34585]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-05-10T10:53:07.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.423+0000 7fbbb5fc2700 1 -- 172.21.15.107:0/1387592907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbb00756d0 msgr2=0x7fbbb0075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:07.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.423+0000 7fbbb5fc2700 1 --2- 172.21.15.107:0/1387592907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbb00756d0 0x7fbbb0075ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009990 tx=0x7fbba0009ca0 comp rx=0 tx=0).stop 2024-05-10T10:53:07.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.423+0000 7fbbb5fc2700 1 -- 172.21.15.107:0/1387592907 shutdown_connections 2024-05-10T10:53:07.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.423+0000 7fbbb5fc2700 1 --2- 172.21.15.107:0/1387592907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbb010ff10 0x7fbbb0112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:07.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.423+0000 7fbbb5fc2700 1 --2- 172.21.15.107:0/1387592907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbb00756d0 0x7fbbb0075ab0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:07.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.423+0000 7fbbb5fc2700 1 --2- 172.21.15.107:0/1387592907 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbbb0075ff0 0x7fbbb010f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:07.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.423+0000 7fbbb5fc2700 1 -- 172.21.15.107:0/1387592907 >> 172.21.15.107:0/1387592907 conn(0x7fbbb007a660 msgr2=0x7fbbb007aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:07.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.423+0000 7fbbb5fc2700 1 -- 172.21.15.107:0/1387592907 shutdown_connections 2024-05-10T10:53:07.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.423+0000 7fbbb5fc2700 1 -- 172.21.15.107:0/1387592907 wait complete. 2024-05-10T10:53:07.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.424+0000 7fbbb5fc2700 1 Processor -- start 2024-05-10T10:53:07.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.424+0000 7fbbb5fc2700 1 -- start start 2024-05-10T10:53:07.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.424+0000 7fbbb5fc2700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbb00756d0 0x7fbbb019beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:07.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.424+0000 7fbbb5fc2700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbb0075ff0 0x7fbbb019c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:07.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.424+0000 7fbbb5fc2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbbb010ff10 0x7fbbb01a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:07.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.424+0000 7fbbb5fc2700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb01159e0 con 0x7fbbb00756d0 2024-05-10T10:53:07.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.424+0000 7fbbb5fc2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb0115860 con 0x7fbbb010ff10 2024-05-10T10:53:07.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.424+0000 7fbbb5fc2700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb0115b60 con 0x7fbbb0075ff0 2024-05-10T10:53:07.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.424+0000 7fbbaf7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbb00756d0 0x7fbbb019beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:07.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.424+0000 7fbbaf7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbb00756d0 0x7fbbb019beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33252/0 (socket says 172.21.15.107:33252) 2024-05-10T10:53:07.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.424+0000 7fbbaf7fe700 1 -- 172.21.15.107:0/2748866101 learned_addr learned my addr 172.21.15.107:0/2748866101 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:07.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.424+0000 7fbbaffff700 1 --2- 172.21.15.107:0/2748866101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbbb010ff10 0x7fbbb01a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:07.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.425+0000 7fbbaeffd700 1 --2- 172.21.15.107:0/2748866101 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbb0075ff0 0x7fbbb019c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:07.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.425+0000 7fbbaf7fe700 1 -- 172.21.15.107:0/2748866101 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbb0075ff0 msgr2=0x7fbbb019c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:07.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.425+0000 7fbbaf7fe700 1 --2- 172.21.15.107:0/2748866101 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbb0075ff0 0x7fbbb019c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:07.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.425+0000 7fbbaf7fe700 1 -- 172.21.15.107:0/2748866101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbbb010ff10 msgr2=0x7fbbb01a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:07.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.425+0000 7fbbaf7fe700 1 --2- 172.21.15.107:0/2748866101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbbb010ff10 0x7fbbb01a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:07.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.425+0000 7fbbaf7fe700 1 -- 172.21.15.107:0/2748866101 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb01a0ec0 con 0x7fbbb00756d0 2024-05-10T10:53:07.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.425+0000 7fbbaeffd700 1 --2- 172.21.15.107:0/2748866101 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbb0075ff0 0x7fbbb019c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:53:07.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.425+0000 7fbbaf7fe700 1 --2- 172.21.15.107:0/2748866101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbb00756d0 0x7fbbb019beb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbba0000c00 tx=0x7fbba0009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:07.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.425+0000 7fbbacff9700 1 -- 172.21.15.107:0/2748866101 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0027070 con 0x7fbbb00756d0 2024-05-10T10:53:07.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.425+0000 7fbbb5fc2700 1 -- 172.21.15.107:0/2748866101 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbb01a1150 con 0x7fbbb00756d0 2024-05-10T10:53:07.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.425+0000 7fbbacff9700 1 -- 172.21.15.107:0/2748866101 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbba0003fb0 con 0x7fbbb00756d0 2024-05-10T10:53:07.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.425+0000 7fbbacff9700 1 -- 172.21.15.107:0/2748866101 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0022e10 con 0x7fbbb00756d0 2024-05-10T10:53:07.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.425+0000 7fbbb5fc2700 1 -- 172.21.15.107:0/2748866101 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbb01a8a30 con 0x7fbbb00756d0 2024-05-10T10:53:07.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.426+0000 7fbbb5fc2700 1 -- 172.21.15.107:0/2748866101 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbb006a190 con 0x7fbbb00756d0 2024-05-10T10:53:07.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.427+0000 7fbbacff9700 1 -- 172.21.15.107:0/2748866101 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7fbba002a070 con 0x7fbbb00756d0 2024-05-10T10:53:07.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.428+0000 7fbbacff9700 1 --2- 172.21.15.107:0/2748866101 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbb980b2910 0x7fbb980b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:07.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.428+0000 7fbbaeffd700 1 --2- 172.21.15.107:0/2748866101 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbb980b2910 0x7fbb980b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:07.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.428+0000 7fbbacff9700 1 -- 172.21.15.107:0/2748866101 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fbba00e2f80 con 0x7fbbb00756d0 2024-05-10T10:53:07.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.428+0000 7fbbaeffd700 1 --2- 172.21.15.107:0/2748866101 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbb980b2910 0x7fbb980b4dd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbba4005fd0 tx=0x7fbba4005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:07.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.433+0000 7fbbacff9700 1 -- 172.21.15.107:0/2748866101 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fbba005fd70 con 0x7fbbb00756d0 2024-05-10T10:53:07.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.697+0000 7fbbb5fc2700 1 -- 172.21.15.107:0/2748866101 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fbbb002e510 con 0x7fbbb00756d0 2024-05-10T10:53:07.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.703+0000 7fbbacff9700 1 -- 172.21.15.107:0/2748866101 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+288654 (secure 0 0 0) 0x7fbba0013070 con 0x7fbbb00756d0 2024-05-10T10:53:07.708 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:53:07.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.706+0000 7fbbb5fc2700 1 -- 172.21.15.107:0/2748866101 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbb980b2910 msgr2=0x7fbb980b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:07.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.706+0000 7fbbb5fc2700 1 --2- 172.21.15.107:0/2748866101 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbb980b2910 0x7fbb980b4dd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbba4005fd0 tx=0x7fbba4005ee0 comp rx=0 tx=0).stop 2024-05-10T10:53:07.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.706+0000 7fbbb5fc2700 1 -- 172.21.15.107:0/2748866101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbb00756d0 msgr2=0x7fbbb019beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:07.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.706+0000 7fbbb5fc2700 1 --2- 172.21.15.107:0/2748866101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbb00756d0 0x7fbbb019beb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbba0000c00 tx=0x7fbba0009f50 comp rx=0 tx=0).stop 2024-05-10T10:53:07.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.706+0000 7fbbb5fc2700 1 -- 172.21.15.107:0/2748866101 shutdown_connections 2024-05-10T10:53:07.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.706+0000 7fbbb5fc2700 1 --2- 172.21.15.107:0/2748866101 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbb980b2910 0x7fbb980b4dd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:07.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.706+0000 7fbbb5fc2700 1 --2- 172.21.15.107:0/2748866101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbbb010ff10 0x7fbbb01a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:07.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.706+0000 7fbbb5fc2700 1 --2- 172.21.15.107:0/2748866101 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbb00756d0 0x7fbbb019beb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:07.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.706+0000 7fbbb5fc2700 1 --2- 172.21.15.107:0/2748866101 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbbb0075ff0 0x7fbbb019c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:07.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.706+0000 7fbbb5fc2700 1 -- 172.21.15.107:0/2748866101 >> 172.21.15.107:0/2748866101 conn(0x7fbbb007a660 msgr2=0x7fbbb01006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:07.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.706+0000 7fbbb5fc2700 1 -- 172.21.15.107:0/2748866101 shutdown_connections 2024-05-10T10:53:07.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:07.706+0000 7fbbb5fc2700 1 -- 172.21.15.107:0/2748866101 wait complete. 2024-05-10T10:53:08.026 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-05-10T10:53:08.026 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-05-10T10:53:08.026 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-05-10T10:53:08.026 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-05-10T10:53:08.027 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-05-10T10:53:08.027 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:07 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-05-10T10:53:08.027 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:07 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2748866101' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-10T10:53:08.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:07 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-05-10T10:53:08.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:07 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-05-10T10:53:08.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:07 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-05-10T10:53:08.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:07 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-05-10T10:53:08.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:07 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-05-10T10:53:08.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:07 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-05-10T10:53:08.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:07 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/2748866101' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-10T10:53:08.336 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2062256859},{"type":"v1","addr":"172.21.15.107:6801","nonce":2062256859}]},"active_addr":"172.21.15.107:6801/2062256859","active_change":"2024-05-10T10:45:07.518869+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.107:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":352827006}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":1206403814}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":1174205013}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":343213747}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":2684864345}]}]} 2024-05-10T10:53:08.343 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-10T10:53:08.343 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-10T10:53:08.344 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-10T10:53:08.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:07 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-05-10T10:53:08.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:07 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-05-10T10:53:08.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:07 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-05-10T10:53:08.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:07 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-05-10T10:53:08.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:07 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-05-10T10:53:08.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:07 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-05-10T10:53:08.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:07 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/2748866101' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-10T10:53:08.587 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:09.031 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:08 smithi107 ceph-mon[30373]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 9 op/s 2024-05-10T10:53:09.031 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-05-10T10:53:09.031 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-05-10T10:53:09.031 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-05-10T10:53:09.031 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-05-10T10:53:09.031 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-05-10T10:53:09.031 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:08 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-05-10T10:53:09.031 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:08 smithi107 ceph-mon[30373]: osdmap e81: 12 total, 12 up, 12 in 2024-05-10T10:53:09.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:08 smithi196 ceph-mon[34872]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 9 op/s 2024-05-10T10:53:09.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-05-10T10:53:09.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-05-10T10:53:09.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-05-10T10:53:09.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-05-10T10:53:09.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-05-10T10:53:09.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:08 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-05-10T10:53:09.314 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:08 smithi196 ceph-mon[34872]: osdmap e81: 12 total, 12 up, 12 in 2024-05-10T10:53:09.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:08 smithi184 ceph-mon[34585]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 9 op/s 2024-05-10T10:53:09.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-05-10T10:53:09.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-05-10T10:53:09.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-05-10T10:53:09.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-05-10T10:53:09.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-05-10T10:53:09.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:08 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-05-10T10:53:09.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:08 smithi184 ceph-mon[34585]: osdmap e81: 12 total, 12 up, 12 in 2024-05-10T10:53:10.055 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:09 smithi107 ceph-mon[30373]: osdmap e82: 12 total, 12 up, 12 in 2024-05-10T10:53:10.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.270+0000 7f4cedbf2700 1 -- 172.21.15.107:0/605515685 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ce8103eb0 msgr2=0x7f4ce8110390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:10.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.270+0000 7f4cedbf2700 1 --2- 172.21.15.107:0/605515685 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ce8103eb0 0x7f4ce8110390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009990 tx=0x7f4ce0009ca0 comp rx=0 tx=0).stop 2024-05-10T10:53:10.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.270+0000 7f4cedbf2700 1 -- 172.21.15.107:0/605515685 shutdown_connections 2024-05-10T10:53:10.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.270+0000 7f4cedbf2700 1 --2- 172.21.15.107:0/605515685 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ce8103eb0 0x7f4ce8110390 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:10.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.270+0000 7f4cedbf2700 1 --2- 172.21.15.107:0/605515685 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ce8109600 0x7f4ce81099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:10.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.270+0000 7f4cedbf2700 1 --2- 172.21.15.107:0/605515685 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ce81034f0 0x7f4ce8103970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:10.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.270+0000 7f4cedbf2700 1 -- 172.21.15.107:0/605515685 >> 172.21.15.107:0/605515685 conn(0x7f4ce807a650 msgr2=0x7f4ce807aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:10.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.270+0000 7f4cedbf2700 1 -- 172.21.15.107:0/605515685 shutdown_connections 2024-05-10T10:53:10.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.270+0000 7f4cedbf2700 1 -- 172.21.15.107:0/605515685 wait complete. 2024-05-10T10:53:10.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.271+0000 7f4cedbf2700 1 Processor -- start 2024-05-10T10:53:10.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.271+0000 7f4cedbf2700 1 -- start start 2024-05-10T10:53:10.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.271+0000 7f4cedbf2700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ce81034f0 0x7f4ce8199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:10.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.271+0000 7f4cedbf2700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ce8103eb0 0x7f4ce8199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:10.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.271+0000 7f4cedbf2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ce8109600 0x7f4ce819e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:10.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.271+0000 7f4cedbf2700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81137a0 con 0x7f4ce8103eb0 2024-05-10T10:53:10.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.271+0000 7f4cedbf2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce8113620 con 0x7f4ce8109600 2024-05-10T10:53:10.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.271+0000 7f4cedbf2700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce8113920 con 0x7f4ce81034f0 2024-05-10T10:53:10.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.271+0000 7f4ce6ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ce8103eb0 0x7f4ce8199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:10.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.271+0000 7f4ce6ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ce8103eb0 0x7f4ce8199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33266/0 (socket says 172.21.15.107:33266) 2024-05-10T10:53:10.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.271+0000 7f4ce6ffd700 1 -- 172.21.15.107:0/1508645976 learned_addr learned my addr 172.21.15.107:0/1508645976 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:10.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.271+0000 7f4ce77fe700 1 --2- 172.21.15.107:0/1508645976 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ce81034f0 0x7f4ce8199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:10.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.272+0000 7f4ce6ffd700 1 -- 172.21.15.107:0/1508645976 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ce81034f0 msgr2=0x7f4ce8199a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:10.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.272+0000 7f4ce7fff700 1 --2- 172.21.15.107:0/1508645976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ce8109600 0x7f4ce819e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:10.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.272+0000 7f4ce6ffd700 1 --2- 172.21.15.107:0/1508645976 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ce81034f0 0x7f4ce8199a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:10.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.272+0000 7f4ce6ffd700 1 -- 172.21.15.107:0/1508645976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ce8109600 msgr2=0x7f4ce819e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:10.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.272+0000 7f4ce6ffd700 1 --2- 172.21.15.107:0/1508645976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ce8109600 0x7f4ce819e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:10.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.272+0000 7f4ce6ffd700 1 -- 172.21.15.107:0/1508645976 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce819ea50 con 0x7f4ce8103eb0 2024-05-10T10:53:10.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.272+0000 7f4ce77fe700 1 --2- 172.21.15.107:0/1508645976 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ce81034f0 0x7f4ce8199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:53:10.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.272+0000 7f4ce7fff700 1 --2- 172.21.15.107:0/1508645976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ce8109600 0x7f4ce819e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:53:10.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.272+0000 7f4ce6ffd700 1 --2- 172.21.15.107:0/1508645976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ce8103eb0 0x7f4ce8199f90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4cd000c9b0 tx=0x7f4cd000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:10.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.272+0000 7f4ce4ff9700 1 -- 172.21.15.107:0/1508645976 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0007b00 con 0x7f4ce8103eb0 2024-05-10T10:53:10.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.272+0000 7f4ce4ff9700 1 -- 172.21.15.107:0/1508645976 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4cd0007ca0 con 0x7f4ce8103eb0 2024-05-10T10:53:10.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.272+0000 7f4cedbf2700 1 -- 172.21.15.107:0/1508645976 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce819ed40 con 0x7f4ce8103eb0 2024-05-10T10:53:10.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.272+0000 7f4ce4ff9700 1 -- 172.21.15.107:0/1508645976 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd00187c0 con 0x7f4ce8103eb0 2024-05-10T10:53:10.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.272+0000 7f4cedbf2700 1 -- 172.21.15.107:0/1508645976 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce81a6600 con 0x7f4ce8103eb0 2024-05-10T10:53:10.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.273+0000 7f4cedbf2700 1 -- 172.21.15.107:0/1508645976 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ce806a190 con 0x7f4ce8103eb0 2024-05-10T10:53:10.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.274+0000 7f4ce4ff9700 1 -- 172.21.15.107:0/1508645976 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f4cd000f450 con 0x7f4ce8103eb0 2024-05-10T10:53:10.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.275+0000 7f4ce4ff9700 1 --2- 172.21.15.107:0/1508645976 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4cd40b2910 0x7f4cd40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:10.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.275+0000 7f4ce77fe700 1 --2- 172.21.15.107:0/1508645976 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4cd40b2910 0x7f4cd40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:10.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.275+0000 7f4ce4ff9700 1 -- 172.21.15.107:0/1508645976 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f4cd00e2670 con 0x7f4ce8103eb0 2024-05-10T10:53:10.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.275+0000 7f4ce77fe700 1 --2- 172.21.15.107:0/1508645976 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4cd40b2910 0x7f4cd40b4dd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800e350 tx=0x7f4cd8009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:10.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.278+0000 7f4ce4ff9700 1 -- 172.21.15.107:0/1508645976 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4cd0014030 con 0x7f4ce8103eb0 2024-05-10T10:53:10.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:09 smithi196 ceph-mon[34872]: osdmap e82: 12 total, 12 up, 12 in 2024-05-10T10:53:10.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:09 smithi184 ceph-mon[34585]: osdmap e82: 12 total, 12 up, 12 in 2024-05-10T10:53:10.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.501+0000 7f4cedbf2700 1 -- 172.21.15.107:0/1508645976 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ce81a6890 con 0x7f4ce8103eb0 2024-05-10T10:53:10.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.503+0000 7f4ce4ff9700 1 -- 172.21.15.107:0/1508645976 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22560 (secure 0 0 0) 0x7f4cd00aa3c0 con 0x7f4ce8103eb0 2024-05-10T10:53:10.504 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:53:10.504 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":82,"fsid":"0ba8a8e4-0eba-11ef-bc98-c7b262605968","created":"2024-05-10T10:44:13.064379+0000","modified":"2024-05-10T10:53:08.899432+0000","last_up_change":"2024-05-10T10:51:12.979718+0000","last_in_change":"2024-05-10T10:50:53.297651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T10:47:31.600062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T10:52:10.705022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T10:52:14.377732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"503f960c-a74b-4979-9bf9-42c90a2885a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6803","nonce":4213004004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6805","nonce":4213004004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6809","nonce":4213004004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6807","nonce":4213004004}]},"public_addr":"172.21.15.107:6803/4213004004","cluster_addr":"172.21.15.107:6805/4213004004","heartbeat_back_addr":"172.21.15.107:6809/4213004004","heartbeat_front_addr":"172.21.15.107:6807/4213004004","state":["exists","up"]},{"osd":1,"uuid":"f0f89167-1aa1-40a1-b122-c7f203c587d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6801","nonce":3242825160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6803","nonce":3242825160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6807","nonce":3242825160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6805","nonce":3242825160}]},"public_addr":"172.21.15.184:6801/3242825160","cluster_addr":"172.21.15.184:6803/3242825160","heartbeat_back_addr":"172.21.15.184:6807/3242825160","heartbeat_front_addr":"172.21.15.184:6805/3242825160","state":["exists","up"]},{"osd":2,"uuid":"7588b9be-b935-450a-944f-3feca69c029c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6801","nonce":137473043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6803","nonce":137473043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6807","nonce":137473043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6805","nonce":137473043}]},"public_addr":"172.21.15.196:6801/137473043","cluster_addr":"172.21.15.196:6803/137473043","heartbeat_back_addr":"172.21.15.196:6807/137473043","heartbeat_front_addr":"172.21.15.196:6805/137473043","state":["exists","up"]},{"osd":3,"uuid":"589ec3bb-884a-4441-a9d2-1f34ab372cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6811","nonce":1995642021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6813","nonce":1995642021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6817","nonce":1995642021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6815","nonce":1995642021}]},"public_addr":"172.21.15.107:6811/1995642021","cluster_addr":"172.21.15.107:6813/1995642021","heartbeat_back_addr":"172.21.15.107:6817/1995642021","heartbeat_front_addr":"172.21.15.107:6815/1995642021","state":["exists","up"]},{"osd":4,"uuid":"b72cdb50-492b-4406-8f21-37e4b2cf5a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6809","nonce":271550329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6811","nonce":271550329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6815","nonce":271550329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6813","nonce":271550329}]},"public_addr":"172.21.15.184:6809/271550329","cluster_addr":"172.21.15.184:6811/271550329","heartbeat_back_addr":"172.21.15.184:6815/271550329","heartbeat_front_addr":"172.21.15.184:6813/271550329","state":["exists","up"]},{"osd":5,"uuid":"05b6ad82-9153-44df-ae64-50c82d304429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6809","nonce":3681130435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6811","nonce":3681130435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6815","nonce":3681130435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6813","nonce":3681130435}]},"public_addr":"172.21.15.196:6809/3681130435","cluster_addr":"172.21.15.196:6811/3681130435","heartbeat_back_addr":"172.21.15.196:6815/3681130435","heartbeat_front_addr":"172.21.15.196:6813/3681130435","state":["exists","up"]},{"osd":6,"uuid":"bceadd7a-20bf-4482-aaab-46a2539cf37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6819","nonce":4223253757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6821","nonce":4223253757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6825","nonce":4223253757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6823","nonce":4223253757}]},"public_addr":"172.21.15.107:6819/4223253757","cluster_addr":"172.21.15.107:6821/4223253757","heartbeat_back_addr":"172.21.15.107:6825/4223253757","heartbeat_front_addr":"172.21.15.107:6823/4223253757","state":["exists","up"]},{"osd":7,"uuid":"0d9243a6-0e16-4677-a0b0-010be4162148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6817","nonce":2850715284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6819","nonce":2850715284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6823","nonce":2850715284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6821","nonce":2850715284}]},"public_addr":"172.21.15.184:6817/2850715284","cluster_addr":"172.21.15.184:6819/2850715284","heartbeat_back_addr":"172.21.15.184:6823/2850715284","heartbeat_front_addr":"172.21.15.184:6821/2850715284","state":["exists","up"]},{"osd":8,"uuid":"24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6817","nonce":504426486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6819","nonce":504426486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6823","nonce":504426486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6821","nonce":504426486}]},"public_addr":"172.21.15.196:6817/504426486","cluster_addr":"172.21.15.196:6819/504426486","heartbeat_back_addr":"172.21.15.196:6823/504426486","heartbeat_front_addr":"172.21.15.196:6821/504426486","state":["exists","up"]},{"osd":9,"uuid":"8bcb03ec-1342-4679-9343-fcefd28dd69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6827","nonce":1533051760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6829","nonce":1533051760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6833","nonce":1533051760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6831","nonce":1533051760}]},"public_addr":"172.21.15.107:6827/1533051760","cluster_addr":"172.21.15.107:6829/1533051760","heartbeat_back_addr":"172.21.15.107:6833/1533051760","heartbeat_front_addr":"172.21.15.107:6831/1533051760","state":["exists","up"]},{"osd":10,"uuid":"78374015-aa7f-4288-b5ae-be64a5182bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6825","nonce":1387541139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6827","nonce":1387541139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6831","nonce":1387541139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6829","nonce":1387541139}]},"public_addr":"172.21.15.184:6825/1387541139","cluster_addr":"172.21.15.184:6827/1387541139","heartbeat_back_addr":"172.21.15.184:6831/1387541139","heartbeat_front_addr":"172.21.15.184:6829/1387541139","state":["exists","up"]},{"osd":11,"uuid":"4aeb2b1a-f35e-44ea-be64-f60c31a096e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6825","nonce":3861964533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6827","nonce":3861964533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6831","nonce":3861964533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6829","nonce":3861964533}]},"public_addr":"172.21.15.196:6825/3861964533","cluster_addr":"172.21.15.196:6827/3861964533","heartbeat_back_addr":"172.21.15.196:6831/3861964533","heartbeat_front_addr":"172.21.15.196:6829/3861964533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:46:42.110232+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:06.232727+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:29.623425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:53.466546+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:17.927564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:41.913454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:06.610629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:31.048807+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:54.922097+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:20.727547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:46.072303+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:51:11.022775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:0/3518338734":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/4092342993":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6800/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:6800/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3761740075":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/2215024983":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/2124974715":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3361930986":"2024-05-11T10:44:40.339608+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T10:53:10.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.505+0000 7f4cedbf2700 1 -- 172.21.15.107:0/1508645976 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4cd40b2910 msgr2=0x7f4cd40b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:10.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.505+0000 7f4cedbf2700 1 --2- 172.21.15.107:0/1508645976 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4cd40b2910 0x7f4cd40b4dd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800e350 tx=0x7f4cd8009040 comp rx=0 tx=0).stop 2024-05-10T10:53:10.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.505+0000 7f4cedbf2700 1 -- 172.21.15.107:0/1508645976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ce8103eb0 msgr2=0x7f4ce8199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:10.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.505+0000 7f4cedbf2700 1 --2- 172.21.15.107:0/1508645976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ce8103eb0 0x7f4ce8199f90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4cd000c9b0 tx=0x7f4cd000cd70 comp rx=0 tx=0).stop 2024-05-10T10:53:10.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.505+0000 7f4cedbf2700 1 -- 172.21.15.107:0/1508645976 shutdown_connections 2024-05-10T10:53:10.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.505+0000 7f4cedbf2700 1 --2- 172.21.15.107:0/1508645976 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4cd40b2910 0x7f4cd40b4dd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:10.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.505+0000 7f4cedbf2700 1 --2- 172.21.15.107:0/1508645976 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ce81034f0 0x7f4ce8199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:10.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.505+0000 7f4cedbf2700 1 --2- 172.21.15.107:0/1508645976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ce8109600 0x7f4ce819e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:10.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.505+0000 7f4cedbf2700 1 --2- 172.21.15.107:0/1508645976 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ce8103eb0 0x7f4ce8199f90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:10.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.505+0000 7f4cedbf2700 1 -- 172.21.15.107:0/1508645976 >> 172.21.15.107:0/1508645976 conn(0x7f4ce807a650 msgr2=0x7f4ce8101ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:10.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.506+0000 7f4cedbf2700 1 -- 172.21.15.107:0/1508645976 shutdown_connections 2024-05-10T10:53:10.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:10.506+0000 7f4cedbf2700 1 -- 172.21.15.107:0/1508645976 wait complete. 2024-05-10T10:53:11.165 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:10 smithi107 ceph-mon[30373]: pgmap v313: 97 pgs: 1 activating, 96 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-10T10:53:11.165 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:10 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1508645976' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:53:11.195 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-10T10:53:11.195 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-10T10:53:11.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:10 smithi196 ceph-mon[34872]: pgmap v313: 97 pgs: 1 activating, 96 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-10T10:53:11.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:10 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1508645976' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:53:11.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:10 smithi184 ceph-mon[34585]: pgmap v313: 97 pgs: 1 activating, 96 active+clean; 645 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-10T10:53:11.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:10 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1508645976' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:53:11.461 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:12.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:11 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:53:12.211 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:11 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:53:12.237 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:11 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:53:13.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.102+0000 7f9c1a00d700 1 -- 172.21.15.107:0/2457711002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c14108510 msgr2=0x7f9c141088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:13.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.102+0000 7f9c1a00d700 1 --2- 172.21.15.107:0/2457711002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c14108510 0x7f9c141088f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9c04009990 tx=0x7f9c04009ca0 comp rx=0 tx=0).stop 2024-05-10T10:53:13.104 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:12 smithi107 ceph-mon[30373]: pgmap v314: 97 pgs: 1 activating, 96 active+clean; 647 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-10T10:53:13.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.102+0000 7f9c1a00d700 1 -- 172.21.15.107:0/2457711002 shutdown_connections 2024-05-10T10:53:13.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.102+0000 7f9c1a00d700 1 --2- 172.21.15.107:0/2457711002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c14103080 0x7f9c1410f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:13.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.102+0000 7f9c1a00d700 1 --2- 172.21.15.107:0/2457711002 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c14108510 0x7f9c141088f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:13.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.102+0000 7f9c1a00d700 1 --2- 172.21.15.107:0/2457711002 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c141026c0 0x7f9c14102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:13.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.102+0000 7f9c1a00d700 1 -- 172.21.15.107:0/2457711002 >> 172.21.15.107:0/2457711002 conn(0x7f9c14079100 msgr2=0x7f9c14079510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:13.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.102+0000 7f9c1a00d700 1 -- 172.21.15.107:0/2457711002 shutdown_connections 2024-05-10T10:53:13.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.103+0000 7f9c1a00d700 1 -- 172.21.15.107:0/2457711002 wait complete. 2024-05-10T10:53:13.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.103+0000 7f9c1a00d700 1 Processor -- start 2024-05-10T10:53:13.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.103+0000 7f9c1a00d700 1 -- start start 2024-05-10T10:53:13.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c1a00d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c141026c0 0x7f9c1419e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:13.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c1a00d700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c14103080 0x7f9c1419ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:13.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c1a00d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c14108510 0x7f9c141988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:13.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c1a00d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9c14112710 con 0x7f9c14108510 2024-05-10T10:53:13.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c1a00d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9c14112590 con 0x7f9c141026c0 2024-05-10T10:53:13.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c1a00d700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f9c14112890 con 0x7f9c14103080 2024-05-10T10:53:13.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c13fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c14108510 0x7f9c141988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:13.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c13fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c14108510 0x7f9c141988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33286/0 (socket says 172.21.15.107:33286) 2024-05-10T10:53:13.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c13fff700 1 -- 172.21.15.107:0/69996570 learned_addr learned my addr 172.21.15.107:0/69996570 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:13.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c12ffd700 1 --2- 172.21.15.107:0/69996570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c14103080 0x7f9c1419ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:13.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c137fe700 1 --2- 172.21.15.107:0/69996570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c141026c0 0x7f9c1419e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:13.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c13fff700 1 -- 172.21.15.107:0/69996570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c14103080 msgr2=0x7f9c1419ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:13.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c13fff700 1 --2- 172.21.15.107:0/69996570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c14103080 0x7f9c1419ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:13.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c13fff700 1 -- 172.21.15.107:0/69996570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c141026c0 msgr2=0x7f9c1419e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:13.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c13fff700 1 --2- 172.21.15.107:0/69996570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c141026c0 0x7f9c1419e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:13.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c13fff700 1 -- 172.21.15.107:0/69996570 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c14199010 con 0x7f9c14108510 2024-05-10T10:53:13.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c13fff700 1 --2- 172.21.15.107:0/69996570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c14108510 0x7f9c141988b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c007f10 tx=0x7f9c0c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:13.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c10ff9700 1 -- 172.21.15.107:0/69996570 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c004bb0 con 0x7f9c14108510 2024-05-10T10:53:13.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c10ff9700 1 -- 172.21.15.107:0/69996570 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9c0c004d50 con 0x7f9c14108510 2024-05-10T10:53:13.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c1a00d700 1 -- 172.21.15.107:0/69996570 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c14199300 con 0x7f9c14108510 2024-05-10T10:53:13.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.104+0000 7f9c10ff9700 1 -- 172.21.15.107:0/69996570 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c0059e0 con 0x7f9c14108510 2024-05-10T10:53:13.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.105+0000 7f9c1a00d700 1 -- 172.21.15.107:0/69996570 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c1406bbb0 con 0x7f9c14108510 2024-05-10T10:53:13.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.105+0000 7f9c1a00d700 1 -- 172.21.15.107:0/69996570 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c1406a190 con 0x7f9c14108510 2024-05-10T10:53:13.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.107+0000 7f9c10ff9700 1 -- 172.21.15.107:0/69996570 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f9c0c01a020 con 0x7f9c14108510 2024-05-10T10:53:13.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.107+0000 7f9c10ff9700 1 --2- 172.21.15.107:0/69996570 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f9bfc0b2910 0x7f9bfc0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:13.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.108+0000 7f9c137fe700 1 --2- 172.21.15.107:0/69996570 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f9bfc0b2910 0x7f9bfc0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:13.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.108+0000 7f9c10ff9700 1 -- 172.21.15.107:0/69996570 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f9c0c0e2010 con 0x7f9c14108510 2024-05-10T10:53:13.109 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.108+0000 7f9c137fe700 1 --2- 172.21.15.107:0/69996570 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f9bfc0b2910 0x7f9bfc0b4dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9c141999f0 tx=0x7f9c04005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:13.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.111+0000 7f9c10ff9700 1 -- 172.21.15.107:0/69996570 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f9c0c010070 con 0x7f9c14108510 2024-05-10T10:53:13.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:12 smithi196 ceph-mon[34872]: pgmap v314: 97 pgs: 1 activating, 96 active+clean; 647 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-10T10:53:13.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.327+0000 7f9c1a00d700 1 -- 172.21.15.107:0/69996570 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c1410a2b0 con 0x7f9c14108510 2024-05-10T10:53:13.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.328+0000 7f9c10ff9700 1 -- 172.21.15.107:0/69996570 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22560 (secure 0 0 0) 0x7f9c0c0a9cd0 con 0x7f9c14108510 2024-05-10T10:53:13.329 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:53:13.330 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":82,"fsid":"0ba8a8e4-0eba-11ef-bc98-c7b262605968","created":"2024-05-10T10:44:13.064379+0000","modified":"2024-05-10T10:53:08.899432+0000","last_up_change":"2024-05-10T10:51:12.979718+0000","last_in_change":"2024-05-10T10:50:53.297651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T10:47:31.600062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T10:52:10.705022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T10:52:14.377732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"503f960c-a74b-4979-9bf9-42c90a2885a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6803","nonce":4213004004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6805","nonce":4213004004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6809","nonce":4213004004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6807","nonce":4213004004}]},"public_addr":"172.21.15.107:6803/4213004004","cluster_addr":"172.21.15.107:6805/4213004004","heartbeat_back_addr":"172.21.15.107:6809/4213004004","heartbeat_front_addr":"172.21.15.107:6807/4213004004","state":["exists","up"]},{"osd":1,"uuid":"f0f89167-1aa1-40a1-b122-c7f203c587d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6801","nonce":3242825160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6803","nonce":3242825160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6807","nonce":3242825160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6805","nonce":3242825160}]},"public_addr":"172.21.15.184:6801/3242825160","cluster_addr":"172.21.15.184:6803/3242825160","heartbeat_back_addr":"172.21.15.184:6807/3242825160","heartbeat_front_addr":"172.21.15.184:6805/3242825160","state":["exists","up"]},{"osd":2,"uuid":"7588b9be-b935-450a-944f-3feca69c029c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6801","nonce":137473043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6803","nonce":137473043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6807","nonce":137473043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6805","nonce":137473043}]},"public_addr":"172.21.15.196:6801/137473043","cluster_addr":"172.21.15.196:6803/137473043","heartbeat_back_addr":"172.21.15.196:6807/137473043","heartbeat_front_addr":"172.21.15.196:6805/137473043","state":["exists","up"]},{"osd":3,"uuid":"589ec3bb-884a-4441-a9d2-1f34ab372cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6811","nonce":1995642021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6813","nonce":1995642021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6817","nonce":1995642021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6815","nonce":1995642021}]},"public_addr":"172.21.15.107:6811/1995642021","cluster_addr":"172.21.15.107:6813/1995642021","heartbeat_back_addr":"172.21.15.107:6817/1995642021","heartbeat_front_addr":"172.21.15.107:6815/1995642021","state":["exists","up"]},{"osd":4,"uuid":"b72cdb50-492b-4406-8f21-37e4b2cf5a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6809","nonce":271550329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6811","nonce":271550329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6815","nonce":271550329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6813","nonce":271550329}]},"public_addr":"172.21.15.184:6809/271550329","cluster_addr":"172.21.15.184:6811/271550329","heartbeat_back_addr":"172.21.15.184:6815/271550329","heartbeat_front_addr":"172.21.15.184:6813/271550329","state":["exists","up"]},{"osd":5,"uuid":"05b6ad82-9153-44df-ae64-50c82d304429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6809","nonce":3681130435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6811","nonce":3681130435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6815","nonce":3681130435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6813","nonce":3681130435}]},"public_addr":"172.21.15.196:6809/3681130435","cluster_addr":"172.21.15.196:6811/3681130435","heartbeat_back_addr":"172.21.15.196:6815/3681130435","heartbeat_front_addr":"172.21.15.196:6813/3681130435","state":["exists","up"]},{"osd":6,"uuid":"bceadd7a-20bf-4482-aaab-46a2539cf37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6819","nonce":4223253757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6821","nonce":4223253757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6825","nonce":4223253757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6823","nonce":4223253757}]},"public_addr":"172.21.15.107:6819/4223253757","cluster_addr":"172.21.15.107:6821/4223253757","heartbeat_back_addr":"172.21.15.107:6825/4223253757","heartbeat_front_addr":"172.21.15.107:6823/4223253757","state":["exists","up"]},{"osd":7,"uuid":"0d9243a6-0e16-4677-a0b0-010be4162148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6817","nonce":2850715284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6819","nonce":2850715284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6823","nonce":2850715284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6821","nonce":2850715284}]},"public_addr":"172.21.15.184:6817/2850715284","cluster_addr":"172.21.15.184:6819/2850715284","heartbeat_back_addr":"172.21.15.184:6823/2850715284","heartbeat_front_addr":"172.21.15.184:6821/2850715284","state":["exists","up"]},{"osd":8,"uuid":"24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6817","nonce":504426486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6819","nonce":504426486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6823","nonce":504426486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6821","nonce":504426486}]},"public_addr":"172.21.15.196:6817/504426486","cluster_addr":"172.21.15.196:6819/504426486","heartbeat_back_addr":"172.21.15.196:6823/504426486","heartbeat_front_addr":"172.21.15.196:6821/504426486","state":["exists","up"]},{"osd":9,"uuid":"8bcb03ec-1342-4679-9343-fcefd28dd69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6827","nonce":1533051760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6829","nonce":1533051760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6833","nonce":1533051760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6831","nonce":1533051760}]},"public_addr":"172.21.15.107:6827/1533051760","cluster_addr":"172.21.15.107:6829/1533051760","heartbeat_back_addr":"172.21.15.107:6833/1533051760","heartbeat_front_addr":"172.21.15.107:6831/1533051760","state":["exists","up"]},{"osd":10,"uuid":"78374015-aa7f-4288-b5ae-be64a5182bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6825","nonce":1387541139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6827","nonce":1387541139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6831","nonce":1387541139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6829","nonce":1387541139}]},"public_addr":"172.21.15.184:6825/1387541139","cluster_addr":"172.21.15.184:6827/1387541139","heartbeat_back_addr":"172.21.15.184:6831/1387541139","heartbeat_front_addr":"172.21.15.184:6829/1387541139","state":["exists","up"]},{"osd":11,"uuid":"4aeb2b1a-f35e-44ea-be64-f60c31a096e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6825","nonce":3861964533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6827","nonce":3861964533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6831","nonce":3861964533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6829","nonce":3861964533}]},"public_addr":"172.21.15.196:6825/3861964533","cluster_addr":"172.21.15.196:6827/3861964533","heartbeat_back_addr":"172.21.15.196:6831/3861964533","heartbeat_front_addr":"172.21.15.196:6829/3861964533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:46:42.110232+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:06.232727+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:29.623425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:53.466546+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:17.927564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:41.913454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:06.610629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:31.048807+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:54.922097+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:20.727547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:46.072303+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:51:11.022775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:0/3518338734":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/4092342993":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6800/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:6800/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3761740075":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/2215024983":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/2124974715":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3361930986":"2024-05-11T10:44:40.339608+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T10:53:13.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.331+0000 7f9c1a00d700 1 -- 172.21.15.107:0/69996570 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f9bfc0b2910 msgr2=0x7f9bfc0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:13.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.331+0000 7f9c1a00d700 1 --2- 172.21.15.107:0/69996570 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f9bfc0b2910 0x7f9bfc0b4dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9c141999f0 tx=0x7f9c04005960 comp rx=0 tx=0).stop 2024-05-10T10:53:13.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.331+0000 7f9c1a00d700 1 -- 172.21.15.107:0/69996570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c14108510 msgr2=0x7f9c141988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:13.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.331+0000 7f9c1a00d700 1 --2- 172.21.15.107:0/69996570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c14108510 0x7f9c141988b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c007f10 tx=0x7f9c0c00d3b0 comp rx=0 tx=0).stop 2024-05-10T10:53:13.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.331+0000 7f9c1a00d700 1 -- 172.21.15.107:0/69996570 shutdown_connections 2024-05-10T10:53:13.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.331+0000 7f9c1a00d700 1 --2- 172.21.15.107:0/69996570 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f9bfc0b2910 0x7f9bfc0b4dd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:13.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.331+0000 7f9c1a00d700 1 --2- 172.21.15.107:0/69996570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c14108510 0x7f9c141988b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:13.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.331+0000 7f9c1a00d700 1 --2- 172.21.15.107:0/69996570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c141026c0 0x7f9c1419e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:13.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.331+0000 7f9c1a00d700 1 --2- 172.21.15.107:0/69996570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9c14103080 0x7f9c1419ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:13.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.331+0000 7f9c1a00d700 1 -- 172.21.15.107:0/69996570 >> 172.21.15.107:0/69996570 conn(0x7f9c14079100 msgr2=0x7f9c141011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:13.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.331+0000 7f9c1a00d700 1 -- 172.21.15.107:0/69996570 shutdown_connections 2024-05-10T10:53:13.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:13.331+0000 7f9c1a00d700 1 -- 172.21.15.107:0/69996570 wait complete. 2024-05-10T10:53:13.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:12 smithi184 ceph-mon[34585]: pgmap v314: 97 pgs: 1 activating, 96 active+clean; 647 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-10T10:53:14.106 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:13 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:14.107 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:13 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:14.107 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:13 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:14.107 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:13 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:14.107 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:13 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/69996570' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:53:14.133 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-10T10:53:14.133 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-10T10:53:14.134 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-10T10:53:14.134 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-10T10:53:14.134 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-10T10:53:14.135 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-10T10:53:14.135 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-10T10:53:14.135 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-10T10:53:14.136 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-10T10:53:14.136 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-10T10:53:14.137 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-10T10:53:14.137 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-10T10:53:14.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:13 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:14.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:13 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:14.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:13 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:14.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:13 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:14.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:13 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/69996570' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:53:14.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:13 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:14.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:13 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:14.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:13 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:14.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:13 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:14.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:13 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/69996570' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:53:14.810 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:15.196 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:15.226 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:15.226 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:15.226 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:15.227 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:15.227 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:15.227 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:15.228 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:15.228 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:15.228 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:15.228 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:14 smithi107 ceph-mon[30373]: pgmap v315: 97 pgs: 1 activating, 96 active+clean; 647 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-10T10:53:15.234 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:15.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:14 smithi196 ceph-mon[34872]: pgmap v315: 97 pgs: 1 activating, 96 active+clean; 647 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-10T10:53:15.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:14 smithi184 ceph-mon[34585]: pgmap v315: 97 pgs: 1 activating, 96 active+clean; 647 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-10T10:53:17.063 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:16 smithi107 ceph-mon[30373]: pgmap v316: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-10T10:53:17.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:16 smithi196 ceph-mon[34872]: pgmap v316: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-10T10:53:17.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:16 smithi184 ceph-mon[34585]: pgmap v316: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 11 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-10T10:53:19.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:18 smithi196 ceph-mon[34872]: pgmap v317: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 210 B/s wr, 10 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-10T10:53:19.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:18 smithi184 ceph-mon[34585]: pgmap v317: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 210 B/s wr, 10 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-10T10:53:19.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:18 smithi107 ceph-mon[30373]: pgmap v317: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 210 B/s wr, 10 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-10T10:53:20.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.718+0000 7faafd1a7700 1 -- 172.21.15.107:0/669847325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf8109510 msgr2=0x7faaf81098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:20.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.718+0000 7faafd1a7700 1 --2- 172.21.15.107:0/669847325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf8109510 0x7faaf81098f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7faae8009990 tx=0x7faae8009ca0 comp rx=0 tx=0).stop 2024-05-10T10:53:20.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.718+0000 7faafd1a7700 1 -- 172.21.15.107:0/669847325 shutdown_connections 2024-05-10T10:53:20.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.718+0000 7faafd1a7700 1 --2- 172.21.15.107:0/669847325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faaf806bb40 0x7faaf8110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:20.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.718+0000 7faafd1a7700 1 --2- 172.21.15.107:0/669847325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf8109510 0x7faaf81098f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:20.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.718+0000 7faafd1a7700 1 --2- 172.21.15.107:0/669847325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaf806b180 0x7faaf806b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:20.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.718+0000 7faafd1a7700 1 -- 172.21.15.107:0/669847325 >> 172.21.15.107:0/669847325 conn(0x7faaf8079350 msgr2=0x7faaf8079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:20.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.718+0000 7faafd1a7700 1 -- 172.21.15.107:0/669847325 shutdown_connections 2024-05-10T10:53:20.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.718+0000 7faafd1a7700 1 -- 172.21.15.107:0/669847325 wait complete. 2024-05-10T10:53:20.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.718+0000 7faafd1a7700 1 Processor -- start 2024-05-10T10:53:20.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.719+0000 7faafd1a7700 1 -- start start 2024-05-10T10:53:20.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.719+0000 7faafd1a7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaf806b180 0x7faaf8102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:20.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.719+0000 7faafd1a7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf806bb40 0x7faaf81029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:20.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.719+0000 7faafd1a7700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faaf8109510 0x7faaf8102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:20.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.719+0000 7faafd1a7700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faaf8113860 con 0x7faaf806bb40 2024-05-10T10:53:20.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.719+0000 7faafd1a7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7faaf81136e0 con 0x7faaf806b180 2024-05-10T10:53:20.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.719+0000 7faafd1a7700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faaf81139e0 con 0x7faaf8109510 2024-05-10T10:53:20.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.719+0000 7faaee59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf806bb40 0x7faaf81029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:20.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.719+0000 7faaee59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf806bb40 0x7faaf81029b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44174/0 (socket says 172.21.15.107:44174) 2024-05-10T10:53:20.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.719+0000 7faaee59c700 1 -- 172.21.15.107:0/1109062766 learned_addr learned my addr 172.21.15.107:0/1109062766 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:20.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.719+0000 7faaee59c700 1 -- 172.21.15.107:0/1109062766 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faaf8109510 msgr2=0x7faaf8102ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:20.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.719+0000 7faaee59c700 1 --2- 172.21.15.107:0/1109062766 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faaf8109510 0x7faaf8102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:20.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.719+0000 7faaee59c700 1 -- 172.21.15.107:0/1109062766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaf806b180 msgr2=0x7faaf8102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:20.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.719+0000 7faaf6d9d700 1 --2- 172.21.15.107:0/1109062766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaf806b180 0x7faaf8102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:20.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.719+0000 7faaee59c700 1 --2- 172.21.15.107:0/1109062766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaf806b180 0x7faaf8102470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:20.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.719+0000 7faaee59c700 1 -- 172.21.15.107:0/1109062766 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf81a82e0 con 0x7faaf806bb40 2024-05-10T10:53:20.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.719+0000 7faaee59c700 1 --2- 172.21.15.107:0/1109062766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf806bb40 0x7faaf81029b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faae000b530 tx=0x7faae000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:20.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.720+0000 7faaf4d99700 1 -- 172.21.15.107:0/1109062766 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae0015020 con 0x7faaf806bb40 2024-05-10T10:53:20.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.720+0000 7faafd1a7700 1 -- 172.21.15.107:0/1109062766 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf81a85d0 con 0x7faaf806bb40 2024-05-10T10:53:20.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.720+0000 7faaf4d99700 1 -- 172.21.15.107:0/1109062766 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faae0011d00 con 0x7faaf806bb40 2024-05-10T10:53:20.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.720+0000 7faaf4d99700 1 -- 172.21.15.107:0/1109062766 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae0010e60 con 0x7faaf806bb40 2024-05-10T10:53:20.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.720+0000 7faafd1a7700 1 -- 172.21.15.107:0/1109062766 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf81a8b10 con 0x7faaf806bb40 2024-05-10T10:53:20.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.720+0000 7faafd1a7700 1 -- 172.21.15.107:0/1109062766 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faaf8063bb0 con 0x7faaf806bb40 2024-05-10T10:53:20.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.722+0000 7faaf4d99700 1 -- 172.21.15.107:0/1109062766 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7faae0018020 con 0x7faaf806bb40 2024-05-10T10:53:20.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.723+0000 7faaf4d99700 1 --2- 172.21.15.107:0/1109062766 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7faae40b2910 0x7faae40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:20.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.723+0000 7faaf6d9d700 1 --2- 172.21.15.107:0/1109062766 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7faae40b2910 0x7faae40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:20.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.723+0000 7faaf4d99700 1 -- 172.21.15.107:0/1109062766 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7faae00e2140 con 0x7faaf806bb40 2024-05-10T10:53:20.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.723+0000 7faaf4d99700 1 --2- 172.21.15.107:0/1109062766 >> [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757] conn(0x7faae40bc350 0x7faae40be7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:20.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.723+0000 7faaf4d99700 1 -- 172.21.15.107:0/1109062766 --> [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faae001be50 con 0x7faae40bc350 2024-05-10T10:53:20.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.723+0000 7faaf4d99700 1 -- 172.21.15.107:0/1109062766 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7faae00e2620 con 0x7faaf806bb40 2024-05-10T10:53:20.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.723+0000 7faaf759e700 1 --2- 172.21.15.107:0/1109062766 >> [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757] conn(0x7faae40bc350 0x7faae40be7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:20.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.723+0000 7faaf6d9d700 1 --2- 172.21.15.107:0/1109062766 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7faae40b2910 0x7faae40b4dd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faae800b5c0 tx=0x7faae8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:20.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.723+0000 7faaf759e700 1 --2- 172.21.15.107:0/1109062766 >> [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757] conn(0x7faae40bc350 0x7faae40be7f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:20.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.724+0000 7faaf4d99700 1 -- 172.21.15.107:0/1109062766 <== osd.6 v2:172.21.15.107:6818/4223253757 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faae001be50 con 0x7faae40bc350 2024-05-10T10:53:20.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.741+0000 7faafd1a7700 1 -- 172.21.15.107:0/1109062766 --> [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faaf8063fb0 con 0x7faae40bc350 2024-05-10T10:53:20.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.741+0000 7faaf4d99700 1 -- 172.21.15.107:0/1109062766 <== osd.6 v2:172.21.15.107:6818/4223253757 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faaf8063fb0 con 0x7faae40bc350 2024-05-10T10:53:20.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.741+0000 7faafd1a7700 1 -- 172.21.15.107:0/1109062766 >> [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757] conn(0x7faae40bc350 msgr2=0x7faae40be7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:20.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.741+0000 7faafd1a7700 1 --2- 172.21.15.107:0/1109062766 >> [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757] conn(0x7faae40bc350 0x7faae40be7f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:20.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.741+0000 7faafd1a7700 1 -- 172.21.15.107:0/1109062766 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7faae40b2910 msgr2=0x7faae40b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:20.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.741+0000 7faafd1a7700 1 --2- 172.21.15.107:0/1109062766 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7faae40b2910 0x7faae40b4dd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faae800b5c0 tx=0x7faae8005fd0 comp rx=0 tx=0).stop 2024-05-10T10:53:20.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.741+0000 7faafd1a7700 1 -- 172.21.15.107:0/1109062766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf806bb40 msgr2=0x7faaf81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:20.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.741+0000 7faafd1a7700 1 --2- 172.21.15.107:0/1109062766 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf806bb40 0x7faaf81029b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faae000b530 tx=0x7faae000b8f0 comp rx=0 tx=0).stop 2024-05-10T10:53:20.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.742+0000 7faaf759e700 1 -- 172.21.15.107:0/1109062766 reap_dead start 2024-05-10T10:53:20.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.742+0000 7faafd1a7700 1 -- 172.21.15.107:0/1109062766 shutdown_connections 2024-05-10T10:53:20.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.742+0000 7faafd1a7700 1 -- 172.21.15.107:0/1109062766 >> 172.21.15.107:0/1109062766 conn(0x7faaf8079350 msgr2=0x7faaf81010d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:20.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.742+0000 7faafd1a7700 1 -- 172.21.15.107:0/1109062766 shutdown_connections 2024-05-10T10:53:20.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:20.742+0000 7faafd1a7700 1 -- 172.21.15.107:0/1109062766 wait complete. 2024-05-10T10:53:21.275 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:20 smithi107 ceph-mon[30373]: pgmap v318: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 191 B/s wr, 10 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-10T10:53:21.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:20 smithi196 ceph-mon[34872]: pgmap v318: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 191 B/s wr, 10 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-10T10:53:21.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:20 smithi184 ceph-mon[34585]: pgmap v318: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 191 B/s wr, 10 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-05-10T10:53:23.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:22 smithi196 ceph-mon[34872]: pgmap v319: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-10T10:53:23.316 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:22 smithi107 ceph-mon[30373]: pgmap v319: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-10T10:53:23.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:22 smithi184 ceph-mon[34585]: pgmap v319: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-10T10:53:23.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.959+0000 7f2743f5e700 1 -- 172.21.15.107:0/3886537636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f273c102d50 msgr2=0x7f273c10f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:23.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.960+0000 7f2743f5e700 1 --2- 172.21.15.107:0/3886537636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f273c102d50 0x7f273c10f240 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f273400b0a0 tx=0x7f273400b3b0 comp rx=0 tx=0).stop 2024-05-10T10:53:23.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.960+0000 7f2743f5e700 1 -- 172.21.15.107:0/3886537636 shutdown_connections 2024-05-10T10:53:23.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.960+0000 7f2743f5e700 1 --2- 172.21.15.107:0/3886537636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f273c102d50 0x7f273c10f240 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:23.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.960+0000 7f2743f5e700 1 --2- 172.21.15.107:0/3886537636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f273c108400 0x7f273c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:23.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.960+0000 7f2743f5e700 1 --2- 172.21.15.107:0/3886537636 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f273c102390 0x7f273c102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:23.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.960+0000 7f2743f5e700 1 -- 172.21.15.107:0/3886537636 >> 172.21.15.107:0/3886537636 conn(0x7f273c079310 msgr2=0x7f273c079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:23.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.960+0000 7f2743f5e700 1 -- 172.21.15.107:0/3886537636 shutdown_connections 2024-05-10T10:53:23.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.960+0000 7f2743f5e700 1 -- 172.21.15.107:0/3886537636 wait complete. 2024-05-10T10:53:23.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.960+0000 7f2743f5e700 1 Processor -- start 2024-05-10T10:53:23.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.960+0000 7f2743f5e700 1 -- start start 2024-05-10T10:53:23.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2743f5e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f273c102390 0x7f273c104070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:23.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2743f5e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f273c102d50 0x7f273c1045b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:23.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2743f5e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f273c108400 0x7f273c104af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:23.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2743f5e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f273c112760 con 0x7f273c102390 2024-05-10T10:53:23.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2743f5e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f273c1125e0 con 0x7f273c102d50 2024-05-10T10:53:23.964 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2743f5e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f273c1128e0 con 0x7f273c108400 2024-05-10T10:53:23.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2741cfa700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f273c102390 0x7f273c104070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:23.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2741cfa700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f273c102390 0x7f273c104070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44196/0 (socket says 172.21.15.107:44196) 2024-05-10T10:53:23.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2741cfa700 1 -- 172.21.15.107:0/727616730 learned_addr learned my addr 172.21.15.107:0/727616730 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:23.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f27424fb700 1 --2- 172.21.15.107:0/727616730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f273c108400 0x7f273c104af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:23.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f27414f9700 1 --2- 172.21.15.107:0/727616730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f273c102d50 0x7f273c1045b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:23.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2741cfa700 1 -- 172.21.15.107:0/727616730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f273c108400 msgr2=0x7f273c104af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:23.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2741cfa700 1 --2- 172.21.15.107:0/727616730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f273c108400 0x7f273c104af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:23.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2741cfa700 1 -- 172.21.15.107:0/727616730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f273c102d50 msgr2=0x7f273c1045b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:23.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2741cfa700 1 --2- 172.21.15.107:0/727616730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f273c102d50 0x7f273c1045b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:23.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2741cfa700 1 -- 172.21.15.107:0/727616730 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273c1a8270 con 0x7f273c102390 2024-05-10T10:53:23.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2741cfa700 1 --2- 172.21.15.107:0/727616730 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f273c102390 0x7f273c104070 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f273800b530 tx=0x7f273800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:23.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2732ffd700 1 -- 172.21.15.107:0/727616730 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738015020 con 0x7f273c102390 2024-05-10T10:53:23.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2732ffd700 1 -- 172.21.15.107:0/727616730 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2738011d00 con 0x7f273c102390 2024-05-10T10:53:23.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2743f5e700 1 -- 172.21.15.107:0/727616730 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f273c1a8560 con 0x7f273c102390 2024-05-10T10:53:23.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2732ffd700 1 -- 172.21.15.107:0/727616730 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738010e60 con 0x7f273c102390 2024-05-10T10:53:23.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.961+0000 7f2743f5e700 1 -- 172.21.15.107:0/727616730 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f273c1a8af0 con 0x7f273c102390 2024-05-10T10:53:23.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.962+0000 7f2743f5e700 1 -- 172.21.15.107:0/727616730 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f273c106480 con 0x7f273c102390 2024-05-10T10:53:23.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.964+0000 7f2732ffd700 1 -- 172.21.15.107:0/727616730 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f2738018020 con 0x7f273c102390 2024-05-10T10:53:23.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.964+0000 7f2732ffd700 1 --2- 172.21.15.107:0/727616730 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f27280b2990 0x7f27280b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:23.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.965+0000 7f27414f9700 1 --2- 172.21.15.107:0/727616730 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f27280b2990 0x7f27280b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:23.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.965+0000 7f2732ffd700 1 -- 172.21.15.107:0/727616730 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f27380e20c0 con 0x7f273c102390 2024-05-10T10:53:23.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.965+0000 7f2732ffd700 1 --2- 172.21.15.107:0/727616730 >> [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160] conn(0x7f27280bc3d0 0x7f27280be870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:23.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.965+0000 7f2732ffd700 1 -- 172.21.15.107:0/727616730 --> [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f273801be50 con 0x7f27280bc3d0 2024-05-10T10:53:23.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.965+0000 7f2732ffd700 1 -- 172.21.15.107:0/727616730 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f27380e25a0 con 0x7f273c102390 2024-05-10T10:53:23.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.965+0000 7f27414f9700 1 --2- 172.21.15.107:0/727616730 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f27280b2990 0x7f27280b4e50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f272c006fd0 tx=0x7f272c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:23.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.965+0000 7f27424fb700 1 --2- 172.21.15.107:0/727616730 >> [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160] conn(0x7f27280bc3d0 0x7f27280be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:23.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.966+0000 7f27424fb700 1 --2- 172.21.15.107:0/727616730 >> [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160] conn(0x7f27280bc3d0 0x7f27280be870 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:23.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.967+0000 7f2732ffd700 1 -- 172.21.15.107:0/727616730 <== osd.1 v2:172.21.15.184:6800/3242825160 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f273801be50 con 0x7f27280bc3d0 2024-05-10T10:53:23.985 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.983+0000 7f2743f5e700 1 -- 172.21.15.107:0/727616730 --> [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f273c103ab0 con 0x7f27280bc3d0 2024-05-10T10:53:23.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.983+0000 7f2732ffd700 1 -- 172.21.15.107:0/727616730 <== osd.1 v2:172.21.15.184:6800/3242825160 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f273c103ab0 con 0x7f27280bc3d0 2024-05-10T10:53:23.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.984+0000 7f2743f5e700 1 -- 172.21.15.107:0/727616730 >> [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160] conn(0x7f27280bc3d0 msgr2=0x7f27280be870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:23.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.984+0000 7f2743f5e700 1 --2- 172.21.15.107:0/727616730 >> [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160] conn(0x7f27280bc3d0 0x7f27280be870 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:23.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.984+0000 7f2743f5e700 1 -- 172.21.15.107:0/727616730 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f27280b2990 msgr2=0x7f27280b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:23.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.984+0000 7f2743f5e700 1 --2- 172.21.15.107:0/727616730 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f27280b2990 0x7f27280b4e50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f272c006fd0 tx=0x7f272c008040 comp rx=0 tx=0).stop 2024-05-10T10:53:23.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.984+0000 7f2743f5e700 1 -- 172.21.15.107:0/727616730 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f273c102390 msgr2=0x7f273c104070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:23.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.984+0000 7f2743f5e700 1 --2- 172.21.15.107:0/727616730 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f273c102390 0x7f273c104070 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f273800b530 tx=0x7f273800b8f0 comp rx=0 tx=0).stop 2024-05-10T10:53:23.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.984+0000 7f27424fb700 1 -- 172.21.15.107:0/727616730 reap_dead start 2024-05-10T10:53:23.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.984+0000 7f2743f5e700 1 -- 172.21.15.107:0/727616730 shutdown_connections 2024-05-10T10:53:23.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.984+0000 7f2743f5e700 1 -- 172.21.15.107:0/727616730 >> 172.21.15.107:0/727616730 conn(0x7f273c079310 msgr2=0x7f273c06bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:23.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.984+0000 7f2743f5e700 1 -- 172.21.15.107:0/727616730 shutdown_connections 2024-05-10T10:53:23.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:23.984+0000 7f2743f5e700 1 -- 172.21.15.107:0/727616730 wait complete. 2024-05-10T10:53:24.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:24.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:24.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:24 smithi184 ceph-mon[34585]: pgmap v320: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:53:24.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:53:24.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:53:24.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:24.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:24.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:24.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:24 smithi107 ceph-mon[30373]: pgmap v320: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:53:24.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:53:24.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:53:24.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:25.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:25.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:25.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:24 smithi196 ceph-mon[34872]: pgmap v320: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:53:25.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:53:25.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:53:25.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:53:25.311 INFO:teuthology.orchestra.run.smithi107.stdout:55834574926 2024-05-10T10:53:25.311 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-10T10:53:26.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.332+0000 7f78d87c4700 1 -- 172.21.15.107:0/2081806202 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78d0108410 msgr2=0x7f78d01087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:26.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.332+0000 7f78d87c4700 1 --2- 172.21.15.107:0/2081806202 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78d0108410 0x7f78d01087f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f78cc009990 tx=0x7f78cc009ca0 comp rx=0 tx=0).stop 2024-05-10T10:53:26.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.332+0000 7f78d87c4700 1 -- 172.21.15.107:0/2081806202 shutdown_connections 2024-05-10T10:53:26.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.333+0000 7f78d87c4700 1 --2- 172.21.15.107:0/2081806202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78d0102d60 0x7f78d010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:26.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.333+0000 7f78d87c4700 1 --2- 172.21.15.107:0/2081806202 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78d0108410 0x7f78d01087f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:26.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.333+0000 7f78d87c4700 1 --2- 172.21.15.107:0/2081806202 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d01023a0 0x7f78d0102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:26.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.333+0000 7f78d87c4700 1 -- 172.21.15.107:0/2081806202 >> 172.21.15.107:0/2081806202 conn(0x7f78d0079350 msgr2=0x7f78d0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:26.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.333+0000 7f78d87c4700 1 -- 172.21.15.107:0/2081806202 shutdown_connections 2024-05-10T10:53:26.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.333+0000 7f78d87c4700 1 -- 172.21.15.107:0/2081806202 wait complete. 2024-05-10T10:53:26.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.333+0000 7f78d87c4700 1 Processor -- start 2024-05-10T10:53:26.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.333+0000 7f78d87c4700 1 -- start start 2024-05-10T10:53:26.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.333+0000 7f78d87c4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78d01023a0 0x7f78d0199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:26.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.333+0000 7f78d87c4700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d0102d60 0x7f78d019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:26.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.333+0000 7f78d87c4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78d0108410 0x7f78d019e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:26.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.333+0000 7f78d87c4700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f78d0112770 con 0x7f78d01023a0 2024-05-10T10:53:26.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.333+0000 7f78d87c4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f78d01125f0 con 0x7f78d0108410 2024-05-10T10:53:26.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.333+0000 7f78d87c4700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f78d01128f0 con 0x7f78d0102d60 2024-05-10T10:53:26.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.333+0000 7f78d6560700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78d01023a0 0x7f78d0199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:26.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.333+0000 7f78d6560700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78d01023a0 0x7f78d0199db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44224/0 (socket says 172.21.15.107:44224) 2024-05-10T10:53:26.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.334+0000 7f78d6560700 1 -- 172.21.15.107:0/1022624196 learned_addr learned my addr 172.21.15.107:0/1022624196 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:26.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.334+0000 7f78d5d5f700 1 --2- 172.21.15.107:0/1022624196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d0102d60 0x7f78d019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:26.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.334+0000 7f78d6560700 1 -- 172.21.15.107:0/1022624196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d0102d60 msgr2=0x7f78d019a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:26.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.334+0000 7f78d6560700 1 --2- 172.21.15.107:0/1022624196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d0102d60 0x7f78d019a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:26.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.334+0000 7f78d6560700 1 -- 172.21.15.107:0/1022624196 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78d0108410 msgr2=0x7f78d019e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:26.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.334+0000 7f78d6560700 1 --2- 172.21.15.107:0/1022624196 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78d0108410 0x7f78d019e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:26.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.334+0000 7f78d6560700 1 -- 172.21.15.107:0/1022624196 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d019edc0 con 0x7f78d01023a0 2024-05-10T10:53:26.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.334+0000 7f78d5d5f700 1 --2- 172.21.15.107:0/1022624196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d0102d60 0x7f78d019a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:53:26.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.334+0000 7f78d6560700 1 --2- 172.21.15.107:0/1022624196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78d01023a0 0x7f78d0199db0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f78cc000c00 tx=0x7f78cc0037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:26.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.334+0000 7f78c77fe700 1 -- 172.21.15.107:0/1022624196 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc027070 con 0x7f78d01023a0 2024-05-10T10:53:26.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.334+0000 7f78c77fe700 1 -- 172.21.15.107:0/1022624196 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f78cc0041e0 con 0x7f78d01023a0 2024-05-10T10:53:26.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.334+0000 7f78d87c4700 1 -- 172.21.15.107:0/1022624196 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d019f050 con 0x7f78d01023a0 2024-05-10T10:53:26.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.334+0000 7f78c77fe700 1 -- 172.21.15.107:0/1022624196 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc00f460 con 0x7f78d01023a0 2024-05-10T10:53:26.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.334+0000 7f78d87c4700 1 -- 172.21.15.107:0/1022624196 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d01a6930 con 0x7f78d01023a0 2024-05-10T10:53:26.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.335+0000 7f78d87c4700 1 -- 172.21.15.107:0/1022624196 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f78d006b510 con 0x7f78d01023a0 2024-05-10T10:53:26.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.336+0000 7f78c77fe700 1 -- 172.21.15.107:0/1022624196 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f78cc02a070 con 0x7f78d01023a0 2024-05-10T10:53:26.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.337+0000 7f78c77fe700 1 --2- 172.21.15.107:0/1022624196 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f78bc0b2910 0x7f78bc0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:26.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.337+0000 7f78d5d5f700 1 --2- 172.21.15.107:0/1022624196 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f78bc0b2910 0x7f78bc0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:26.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.337+0000 7f78c77fe700 1 -- 172.21.15.107:0/1022624196 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f78cc0e3600 con 0x7f78d01023a0 2024-05-10T10:53:26.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.337+0000 7f78c77fe700 1 --2- 172.21.15.107:0/1022624196 >> [v2:172.21.15.196:6808/3681130435,v1:172.21.15.196:6809/3681130435] conn(0x7f78bc0bc3b0 0x7f78bc0be850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:26.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.337+0000 7f78c77fe700 1 -- 172.21.15.107:0/1022624196 --> [v2:172.21.15.196:6808/3681130435,v1:172.21.15.196:6809/3681130435] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f78cc00b0b0 con 0x7f78bc0bc3b0 2024-05-10T10:53:26.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.337+0000 7f78c77fe700 1 -- 172.21.15.107:0/1022624196 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f78cc0e3ae0 con 0x7f78d01023a0 2024-05-10T10:53:26.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.337+0000 7f78d5d5f700 1 --2- 172.21.15.107:0/1022624196 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f78bc0b2910 0x7f78bc0b4dd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f78d0107210 tx=0x7f78c0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:26.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.338+0000 7f78d6d61700 1 --2- 172.21.15.107:0/1022624196 >> [v2:172.21.15.196:6808/3681130435,v1:172.21.15.196:6809/3681130435] conn(0x7f78bc0bc3b0 0x7f78bc0be850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:26.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.338+0000 7f78d6d61700 1 --2- 172.21.15.107:0/1022624196 >> [v2:172.21.15.196:6808/3681130435,v1:172.21.15.196:6809/3681130435] conn(0x7f78bc0bc3b0 0x7f78bc0be850 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:26.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.339+0000 7f78c77fe700 1 -- 172.21.15.107:0/1022624196 <== osd.5 v2:172.21.15.196:6808/3681130435 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f78cc00b0b0 con 0x7f78bc0bc3b0 2024-05-10T10:53:26.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.356+0000 7f78d87c4700 1 -- 172.21.15.107:0/1022624196 --> [v2:172.21.15.196:6808/3681130435,v1:172.21.15.196:6809/3681130435] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f78d0103ac0 con 0x7f78bc0bc3b0 2024-05-10T10:53:26.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.356+0000 7f78c77fe700 1 -- 172.21.15.107:0/1022624196 <== osd.5 v2:172.21.15.196:6808/3681130435 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f78d0103ac0 con 0x7f78bc0bc3b0 2024-05-10T10:53:26.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.357+0000 7f78d87c4700 1 -- 172.21.15.107:0/1022624196 >> [v2:172.21.15.196:6808/3681130435,v1:172.21.15.196:6809/3681130435] conn(0x7f78bc0bc3b0 msgr2=0x7f78bc0be850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:26.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.357+0000 7f78d87c4700 1 --2- 172.21.15.107:0/1022624196 >> [v2:172.21.15.196:6808/3681130435,v1:172.21.15.196:6809/3681130435] conn(0x7f78bc0bc3b0 0x7f78bc0be850 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:26.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.357+0000 7f78d87c4700 1 -- 172.21.15.107:0/1022624196 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f78bc0b2910 msgr2=0x7f78bc0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:26.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.357+0000 7f78d87c4700 1 --2- 172.21.15.107:0/1022624196 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f78bc0b2910 0x7f78bc0b4dd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f78d0107210 tx=0x7f78c0008040 comp rx=0 tx=0).stop 2024-05-10T10:53:26.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.357+0000 7f78d87c4700 1 -- 172.21.15.107:0/1022624196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78d01023a0 msgr2=0x7f78d0199db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:26.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.357+0000 7f78d87c4700 1 --2- 172.21.15.107:0/1022624196 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f78d01023a0 0x7f78d0199db0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f78cc000c00 tx=0x7f78cc0037a0 comp rx=0 tx=0).stop 2024-05-10T10:53:26.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.357+0000 7f78d6d61700 1 -- 172.21.15.107:0/1022624196 reap_dead start 2024-05-10T10:53:26.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.357+0000 7f78d87c4700 1 -- 172.21.15.107:0/1022624196 shutdown_connections 2024-05-10T10:53:26.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.357+0000 7f78d87c4700 1 -- 172.21.15.107:0/1022624196 >> 172.21.15.107:0/1022624196 conn(0x7f78d0079350 msgr2=0x7f78d0101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:26.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.357+0000 7f78d87c4700 1 -- 172.21.15.107:0/1022624196 shutdown_connections 2024-05-10T10:53:26.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.357+0000 7f78d87c4700 1 -- 172.21.15.107:0/1022624196 wait complete. 2024-05-10T10:53:26.890 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:26 smithi107 ceph-mon[30373]: pgmap v321: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:53:27.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:26 smithi196 ceph-mon[34872]: pgmap v321: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:53:27.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:26 smithi184 ceph-mon[34585]: pgmap v321: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:53:27.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.855+0000 7feaa796b700 1 -- 172.21.15.107:0/1073843679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaa0104160 msgr2=0x7feaa0108150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:27.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.855+0000 7feaa796b700 1 --2- 172.21.15.107:0/1073843679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaa0104160 0x7feaa0108150 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0099c0 tx=0x7fea9c009cd0 comp rx=0 tx=0).stop 2024-05-10T10:53:27.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.855+0000 7feaa796b700 1 -- 172.21.15.107:0/1073843679 shutdown_connections 2024-05-10T10:53:27.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.855+0000 7feaa796b700 1 --2- 172.21.15.107:0/1073843679 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaa0108880 0x7feaa0110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:27.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.855+0000 7feaa796b700 1 --2- 172.21.15.107:0/1073843679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaa01037b0 0x7feaa0103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:27.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.855+0000 7feaa796b700 1 --2- 172.21.15.107:0/1073843679 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaa0104160 0x7feaa0108150 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:27.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.855+0000 7feaa796b700 1 -- 172.21.15.107:0/1073843679 >> 172.21.15.107:0/1073843679 conn(0x7feaa007a580 msgr2=0x7feaa007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:27.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.855+0000 7feaa796b700 1 -- 172.21.15.107:0/1073843679 shutdown_connections 2024-05-10T10:53:27.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.855+0000 7feaa796b700 1 -- 172.21.15.107:0/1073843679 wait complete. 2024-05-10T10:53:27.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.856+0000 7feaa796b700 1 Processor -- start 2024-05-10T10:53:27.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.856+0000 7feaa796b700 1 -- start start 2024-05-10T10:53:27.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.856+0000 7feaa796b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaa01037b0 0x7feaa019f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:27.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.856+0000 7feaa796b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaa0104160 0x7feaa019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:27.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.856+0000 7feaa796b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaa0108880 0x7feaa0199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:27.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.856+0000 7feaa796b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7feaa0113790 con 0x7feaa0104160 2024-05-10T10:53:27.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.856+0000 7feaa796b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7feaa0113610 con 0x7feaa0108880 2024-05-10T10:53:27.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.856+0000 7feaa796b700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7feaa0113910 con 0x7feaa01037b0 2024-05-10T10:53:27.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.856+0000 7feaa4f06700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaa0104160 0x7feaa019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:27.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.856+0000 7feaa4f06700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaa0104160 0x7feaa019fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37044/0 (socket says 172.21.15.107:37044) 2024-05-10T10:53:27.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.856+0000 7feaa4f06700 1 -- 172.21.15.107:0/3896842970 learned_addr learned my addr 172.21.15.107:0/3896842970 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:27.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.856+0000 7feaa5f08700 1 --2- 172.21.15.107:0/3896842970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaa0108880 0x7feaa0199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:27.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.856+0000 7feaa5707700 1 --2- 172.21.15.107:0/3896842970 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaa01037b0 0x7feaa019f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:27.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.856+0000 7feaa4f06700 1 -- 172.21.15.107:0/3896842970 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaa01037b0 msgr2=0x7feaa019f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:27.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.856+0000 7feaa4f06700 1 --2- 172.21.15.107:0/3896842970 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaa01037b0 0x7feaa019f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:27.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.856+0000 7feaa4f06700 1 -- 172.21.15.107:0/3896842970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaa0108880 msgr2=0x7feaa0199a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:27.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.856+0000 7feaa4f06700 1 --2- 172.21.15.107:0/3896842970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaa0108880 0x7feaa0199a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:27.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.856+0000 7feaa4f06700 1 -- 172.21.15.107:0/3896842970 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa019a1b0 con 0x7feaa0104160 2024-05-10T10:53:27.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.856+0000 7feaa4f06700 1 --2- 172.21.15.107:0/3896842970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaa0104160 0x7feaa019fdd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fea9c00b580 tx=0x7fea9c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:27.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.857+0000 7fea967fc700 1 -- 172.21.15.107:0/3896842970 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c027070 con 0x7feaa0104160 2024-05-10T10:53:27.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.857+0000 7feaa796b700 1 -- 172.21.15.107:0/3896842970 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa019a440 con 0x7feaa0104160 2024-05-10T10:53:27.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.857+0000 7fea967fc700 1 -- 172.21.15.107:0/3896842970 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fea9c003fb0 con 0x7feaa0104160 2024-05-10T10:53:27.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.857+0000 7fea967fc700 1 -- 172.21.15.107:0/3896842970 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00f460 con 0x7feaa0104160 2024-05-10T10:53:27.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.857+0000 7feaa796b700 1 -- 172.21.15.107:0/3896842970 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa01a6760 con 0x7feaa0104160 2024-05-10T10:53:27.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.858+0000 7feaa796b700 1 -- 172.21.15.107:0/3896842970 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feaa0063c30 con 0x7feaa0104160 2024-05-10T10:53:27.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.860+0000 7fea967fc700 1 -- 172.21.15.107:0/3896842970 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7fea9c022620 con 0x7feaa0104160 2024-05-10T10:53:27.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.860+0000 7fea967fc700 1 --2- 172.21.15.107:0/3896842970 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fea8c0b2910 0x7fea8c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:27.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.861+0000 7feaa5707700 1 --2- 172.21.15.107:0/3896842970 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fea8c0b2910 0x7fea8c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:27.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.861+0000 7fea967fc700 1 -- 172.21.15.107:0/3896842970 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fea9c0e3790 con 0x7feaa0104160 2024-05-10T10:53:27.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.861+0000 7fea967fc700 1 --2- 172.21.15.107:0/3896842970 >> [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760] conn(0x7fea8c0bc220 0x7fea8c0be6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:27.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.861+0000 7fea967fc700 1 -- 172.21.15.107:0/3896842970 --> [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fea8c0bed90 con 0x7fea8c0bc220 2024-05-10T10:53:27.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.861+0000 7fea967fc700 1 -- 172.21.15.107:0/3896842970 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fea9c0e3c70 con 0x7feaa0104160 2024-05-10T10:53:27.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.861+0000 7feaa5f08700 1 --2- 172.21.15.107:0/3896842970 >> [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760] conn(0x7fea8c0bc220 0x7fea8c0be6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:27.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.861+0000 7feaa5707700 1 --2- 172.21.15.107:0/3896842970 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fea8c0b2910 0x7fea8c0b4dd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feaa019ab90 tx=0x7fea9000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:27.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.861+0000 7feaa5f08700 1 --2- 172.21.15.107:0/3896842970 >> [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760] conn(0x7fea8c0bc220 0x7fea8c0be6c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:27.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.862+0000 7fea967fc700 1 -- 172.21.15.107:0/3896842970 <== osd.9 v2:172.21.15.107:6826/1533051760 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fea8c0bed90 con 0x7fea8c0bc220 2024-05-10T10:53:27.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.879+0000 7feaa796b700 1 -- 172.21.15.107:0/3896842970 --> [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feaa0064030 con 0x7fea8c0bc220 2024-05-10T10:53:27.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.879+0000 7fea967fc700 1 -- 172.21.15.107:0/3896842970 <== osd.9 v2:172.21.15.107:6826/1533051760 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7feaa0064030 con 0x7fea8c0bc220 2024-05-10T10:53:27.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.879+0000 7feaa796b700 1 -- 172.21.15.107:0/3896842970 >> [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760] conn(0x7fea8c0bc220 msgr2=0x7fea8c0be6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:27.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.879+0000 7feaa796b700 1 --2- 172.21.15.107:0/3896842970 >> [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760] conn(0x7fea8c0bc220 0x7fea8c0be6c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:27.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.879+0000 7feaa796b700 1 -- 172.21.15.107:0/3896842970 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fea8c0b2910 msgr2=0x7fea8c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:27.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.879+0000 7feaa796b700 1 --2- 172.21.15.107:0/3896842970 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fea8c0b2910 0x7fea8c0b4dd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feaa019ab90 tx=0x7fea9000b410 comp rx=0 tx=0).stop 2024-05-10T10:53:27.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.879+0000 7feaa796b700 1 -- 172.21.15.107:0/3896842970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaa0104160 msgr2=0x7feaa019fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:27.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.879+0000 7feaa796b700 1 --2- 172.21.15.107:0/3896842970 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaa0104160 0x7feaa019fdd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fea9c00b580 tx=0x7fea9c005e80 comp rx=0 tx=0).stop 2024-05-10T10:53:27.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.879+0000 7feaa5f08700 1 -- 172.21.15.107:0/3896842970 reap_dead start 2024-05-10T10:53:27.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.879+0000 7feaa796b700 1 -- 172.21.15.107:0/3896842970 shutdown_connections 2024-05-10T10:53:27.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.879+0000 7feaa796b700 1 -- 172.21.15.107:0/3896842970 >> 172.21.15.107:0/3896842970 conn(0x7feaa007a580 msgr2=0x7feaa0101620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:27.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.879+0000 7feaa796b700 1 -- 172.21.15.107:0/3896842970 shutdown_connections 2024-05-10T10:53:27.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.880+0000 7feaa796b700 1 -- 172.21.15.107:0/3896842970 wait complete. 2024-05-10T10:53:27.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.744+0000 7f785b851700 1 -- 172.21.15.107:0/3248235822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7854103f20 msgr2=0x7f7854110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:27.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.744+0000 7f785b851700 1 --2- 172.21.15.107:0/3248235822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7854103f20 0x7f7854110310 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f784c00b0d0 tx=0x7f784c00b3e0 comp rx=0 tx=0).stop 2024-05-10T10:53:27.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.744+0000 7f785b851700 1 -- 172.21.15.107:0/3248235822 shutdown_connections 2024-05-10T10:53:27.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.744+0000 7f785b851700 1 --2- 172.21.15.107:0/3248235822 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7854103f20 0x7f7854110310 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:27.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.744+0000 7f785b851700 1 --2- 172.21.15.107:0/3248235822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7854109540 0x7f7854109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:27.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.744+0000 7f785b851700 1 --2- 172.21.15.107:0/3248235822 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7854103560 0x7f78541039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:27.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.744+0000 7f785b851700 1 -- 172.21.15.107:0/3248235822 >> 172.21.15.107:0/3248235822 conn(0x7f785407a660 msgr2=0x7f785407aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:27.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.744+0000 7f785b851700 1 -- 172.21.15.107:0/3248235822 shutdown_connections 2024-05-10T10:53:27.655 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.744+0000 7f785b851700 1 -- 172.21.15.107:0/3248235822 wait complete. 2024-05-10T10:53:27.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.744+0000 7f785b851700 1 Processor -- start 2024-05-10T10:53:27.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.744+0000 7f785b851700 1 -- start start 2024-05-10T10:53:27.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f785b851700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7854103560 0x7f78540757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:27.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f785b851700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7854103f20 0x7f7854075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:27.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f785b851700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7854109540 0x7f7854076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:27.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f785b851700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7854113830 con 0x7f7854109540 2024-05-10T10:53:27.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f785b851700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f78541136b0 con 0x7f7854103560 2024-05-10T10:53:27.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f785b851700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f78541139b0 con 0x7f7854103f20 2024-05-10T10:53:27.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f7859dee700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7854109540 0x7f7854076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:27.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f7859dee700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7854109540 0x7f7854076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37024/0 (socket says 172.21.15.107:37024) 2024-05-10T10:53:27.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f7859dee700 1 -- 172.21.15.107:0/3298749755 learned_addr learned my addr 172.21.15.107:0/3298749755 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:27.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f78595ed700 1 --2- 172.21.15.107:0/3298749755 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7854103560 0x7f78540757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:27.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f7858dec700 1 --2- 172.21.15.107:0/3298749755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7854103f20 0x7f7854075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:27.656 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f7859dee700 1 -- 172.21.15.107:0/3298749755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7854103f20 msgr2=0x7f7854075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:27.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f7859dee700 1 --2- 172.21.15.107:0/3298749755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7854103f20 0x7f7854075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:27.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f7859dee700 1 -- 172.21.15.107:0/3298749755 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7854103560 msgr2=0x7f78540757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:27.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f7859dee700 1 --2- 172.21.15.107:0/3298749755 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7854103560 0x7f78540757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:27.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f7859dee700 1 -- 172.21.15.107:0/3298749755 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78541a8250 con 0x7f7854109540 2024-05-10T10:53:27.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f7858dec700 1 --2- 172.21.15.107:0/3298749755 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7854103f20 0x7f7854075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:53:27.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f7859dee700 1 --2- 172.21.15.107:0/3298749755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7854109540 0x7f7854076220 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f784c007980 tx=0x7f784c0079b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:27.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f784a7fc700 1 -- 172.21.15.107:0/3298749755 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c01f070 con 0x7f7854109540 2024-05-10T10:53:27.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f784a7fc700 1 -- 172.21.15.107:0/3298749755 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f784c003c00 con 0x7f7854109540 2024-05-10T10:53:27.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f785b851700 1 -- 172.21.15.107:0/3298749755 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78541a84e0 con 0x7f7854109540 2024-05-10T10:53:27.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f784a7fc700 1 -- 172.21.15.107:0/3298749755 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c01b6a0 con 0x7f7854109540 2024-05-10T10:53:27.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.745+0000 7f785b851700 1 -- 172.21.15.107:0/3298749755 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78541a88e0 con 0x7f7854109540 2024-05-10T10:53:27.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.746+0000 7f785b851700 1 -- 172.21.15.107:0/3298749755 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7854063bb0 con 0x7f7854109540 2024-05-10T10:53:27.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.748+0000 7f784a7fc700 1 -- 172.21.15.107:0/3298749755 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f784c022070 con 0x7f7854109540 2024-05-10T10:53:27.657 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.748+0000 7f784a7fc700 1 --2- 172.21.15.107:0/3298749755 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f78400b2910 0x7f78400b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:27.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.749+0000 7f78595ed700 1 --2- 172.21.15.107:0/3298749755 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f78400b2910 0x7f78400b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:27.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.749+0000 7f784a7fc700 1 -- 172.21.15.107:0/3298749755 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f784c0e3500 con 0x7f7854109540 2024-05-10T10:53:27.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.749+0000 7f784a7fc700 1 --2- 172.21.15.107:0/3298749755 >> [v2:172.21.15.196:6824/3861964533,v1:172.21.15.196:6825/3861964533] conn(0x7f78400bc350 0x7f78400be7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:27.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.749+0000 7f784a7fc700 1 -- 172.21.15.107:0/3298749755 --> [v2:172.21.15.196:6824/3861964533,v1:172.21.15.196:6825/3861964533] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f784c00fec0 con 0x7f78400bc350 2024-05-10T10:53:27.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.749+0000 7f784a7fc700 1 -- 172.21.15.107:0/3298749755 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f784c0e39e0 con 0x7f7854109540 2024-05-10T10:53:27.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.749+0000 7f7858dec700 1 --2- 172.21.15.107:0/3298749755 >> [v2:172.21.15.196:6824/3861964533,v1:172.21.15.196:6825/3861964533] conn(0x7f78400bc350 0x7f78400be7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:27.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.749+0000 7f78595ed700 1 --2- 172.21.15.107:0/3298749755 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f78400b2910 0x7f78400b4dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7850005950 tx=0x7f785000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:27.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.749+0000 7f7858dec700 1 --2- 172.21.15.107:0/3298749755 >> [v2:172.21.15.196:6824/3861964533,v1:172.21.15.196:6825/3861964533] conn(0x7f78400bc350 0x7f78400be7f0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:27.658 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.750+0000 7f784a7fc700 1 -- 172.21.15.107:0/3298749755 <== osd.11 v2:172.21.15.196:6824/3861964533 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f784c00fec0 con 0x7f78400bc350 2024-05-10T10:53:27.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.768+0000 7f785b851700 1 -- 172.21.15.107:0/3298749755 --> [v2:172.21.15.196:6824/3861964533,v1:172.21.15.196:6825/3861964533] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7854063fb0 con 0x7f78400bc350 2024-05-10T10:53:27.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.768+0000 7f784a7fc700 1 -- 172.21.15.107:0/3298749755 <== osd.11 v2:172.21.15.196:6824/3861964533 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7854063fb0 con 0x7f78400bc350 2024-05-10T10:53:27.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.769+0000 7f785b851700 1 -- 172.21.15.107:0/3298749755 >> [v2:172.21.15.196:6824/3861964533,v1:172.21.15.196:6825/3861964533] conn(0x7f78400bc350 msgr2=0x7f78400be7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:27.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.769+0000 7f785b851700 1 --2- 172.21.15.107:0/3298749755 >> [v2:172.21.15.196:6824/3861964533,v1:172.21.15.196:6825/3861964533] conn(0x7f78400bc350 0x7f78400be7f0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:27.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.769+0000 7f785b851700 1 -- 172.21.15.107:0/3298749755 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f78400b2910 msgr2=0x7f78400b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:27.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.769+0000 7f785b851700 1 --2- 172.21.15.107:0/3298749755 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f78400b2910 0x7f78400b4dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7850005950 tx=0x7f785000b410 comp rx=0 tx=0).stop 2024-05-10T10:53:27.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.769+0000 7f785b851700 1 -- 172.21.15.107:0/3298749755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7854109540 msgr2=0x7f7854076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:27.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.769+0000 7f785b851700 1 --2- 172.21.15.107:0/3298749755 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7854109540 0x7f7854076220 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f784c007980 tx=0x7f784c0079b0 comp rx=0 tx=0).stop 2024-05-10T10:53:27.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.769+0000 7f7859dee700 1 -- 172.21.15.107:0/3298749755 reap_dead start 2024-05-10T10:53:27.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.769+0000 7f785b851700 1 -- 172.21.15.107:0/3298749755 shutdown_connections 2024-05-10T10:53:27.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.769+0000 7f785b851700 1 -- 172.21.15.107:0/3298749755 >> 172.21.15.107:0/3298749755 conn(0x7f785407a660 msgr2=0x7f78541021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:27.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.769+0000 7f785b851700 1 -- 172.21.15.107:0/3298749755 shutdown_connections 2024-05-10T10:53:27.659 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:26.769+0000 7f785b851700 1 -- 172.21.15.107:0/3298749755 wait complete. 2024-05-10T10:53:28.244 INFO:teuthology.orchestra.run.smithi107.stdout:309237645340 2024-05-10T10:53:28.244 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-10T10:53:28.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:28 smithi107 ceph-mon[30373]: pgmap v322: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-10T10:53:29.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:28 smithi196 ceph-mon[34872]: pgmap v322: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-10T10:53:29.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:28 smithi184 ceph-mon[34585]: pgmap v322: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-10T10:53:29.637 INFO:teuthology.orchestra.run.smithi107.stdout:184683593782 2024-05-10T10:53:29.637 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-10T10:53:30.999 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:30 smithi107 ceph-mon[30373]: pgmap v323: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:53:31.026 INFO:teuthology.orchestra.run.smithi107.stdout:158913790011 2024-05-10T10:53:31.026 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-10T10:53:31.062 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:30 smithi196 ceph-mon[34872]: pgmap v323: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:53:31.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:30 smithi184 ceph-mon[34585]: pgmap v323: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:53:32.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.087+0000 7f2ae4361700 1 -- 172.21.15.107:0/691288252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2adc06b180 msgr2=0x7f2adc06b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:32.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.087+0000 7f2ae4361700 1 --2- 172.21.15.107:0/691288252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2adc06b180 0x7f2adc06b600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009990 tx=0x7f2acc009ca0 comp rx=0 tx=0).stop 2024-05-10T10:53:32.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.087+0000 7f2ae4361700 1 -- 172.21.15.107:0/691288252 shutdown_connections 2024-05-10T10:53:32.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.087+0000 7f2ae4361700 1 --2- 172.21.15.107:0/691288252 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2adc109510 0x7f2adc1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:32.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.087+0000 7f2ae4361700 1 --2- 172.21.15.107:0/691288252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2adc06bb40 0x7f2adc110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:32.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.087+0000 7f2ae4361700 1 --2- 172.21.15.107:0/691288252 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2adc06b180 0x7f2adc06b600 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:32.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.087+0000 7f2ae4361700 1 -- 172.21.15.107:0/691288252 >> 172.21.15.107:0/691288252 conn(0x7f2adc079350 msgr2=0x7f2adc079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:32.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.087+0000 7f2ae4361700 1 -- 172.21.15.107:0/691288252 shutdown_connections 2024-05-10T10:53:32.088 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.087+0000 7f2ae4361700 1 -- 172.21.15.107:0/691288252 wait complete. 2024-05-10T10:53:32.090 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.088+0000 7f2ae4361700 1 Processor -- start 2024-05-10T10:53:32.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.088+0000 7f2ae4361700 1 -- start start 2024-05-10T10:53:32.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.088+0000 7f2ae4361700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2adc06b180 0x7f2adc19f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:32.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.088+0000 7f2ae4361700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2adc06bb40 0x7f2adc19fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:32.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.088+0000 7f2ae4361700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2adc109510 0x7f2adc199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:32.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.088+0000 7f2ae4361700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc1137e0 con 0x7f2adc06b180 2024-05-10T10:53:32.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.088+0000 7f2ae4361700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc113660 con 0x7f2adc06bb40 2024-05-10T10:53:32.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.088+0000 7f2ae4361700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f2adc113960 con 0x7f2adc109510 2024-05-10T10:53:32.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.088+0000 7f2ae20fd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2adc06b180 0x7f2adc19f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:32.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.088+0000 7f2ae20fd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2adc06b180 0x7f2adc19f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37062/0 (socket says 172.21.15.107:37062) 2024-05-10T10:53:32.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.088+0000 7f2ae20fd700 1 -- 172.21.15.107:0/1249091224 learned_addr learned my addr 172.21.15.107:0/1249091224 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:32.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.088+0000 7f2ae18fc700 1 --2- 172.21.15.107:0/1249091224 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2adc06bb40 0x7f2adc19fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:32.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.088+0000 7f2ae28fe700 1 --2- 172.21.15.107:0/1249091224 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2adc109510 0x7f2adc199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:32.091 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.088+0000 7f2ae20fd700 1 -- 172.21.15.107:0/1249091224 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2adc109510 msgr2=0x7f2adc199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:32.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.088+0000 7f2ae20fd700 1 --2- 172.21.15.107:0/1249091224 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2adc109510 0x7f2adc199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:32.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.088+0000 7f2ae20fd700 1 -- 172.21.15.107:0/1249091224 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2adc06bb40 msgr2=0x7f2adc19fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:32.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.088+0000 7f2ae20fd700 1 --2- 172.21.15.107:0/1249091224 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2adc06bb40 0x7f2adc19fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:32.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.088+0000 7f2ae20fd700 1 -- 172.21.15.107:0/1249091224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2adc19a220 con 0x7f2adc06b180 2024-05-10T10:53:32.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.088+0000 7f2ae18fc700 1 --2- 172.21.15.107:0/1249091224 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2adc06bb40 0x7f2adc19fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:53:32.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.089+0000 7f2ae20fd700 1 --2- 172.21.15.107:0/1249091224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2adc06b180 0x7f2adc19f8b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2ad800ba50 tx=0x7f2ad800be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:32.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.089+0000 7f2ad37fe700 1 -- 172.21.15.107:0/1249091224 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8019070 con 0x7f2adc06b180 2024-05-10T10:53:32.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.089+0000 7f2ad37fe700 1 -- 172.21.15.107:0/1249091224 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2ad8014440 con 0x7f2adc06b180 2024-05-10T10:53:32.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.089+0000 7f2ae4361700 1 -- 172.21.15.107:0/1249091224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2adc19a510 con 0x7f2adc06b180 2024-05-10T10:53:32.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.089+0000 7f2ad37fe700 1 -- 172.21.15.107:0/1249091224 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad80075d0 con 0x7f2adc06b180 2024-05-10T10:53:32.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.089+0000 7f2ae4361700 1 -- 172.21.15.107:0/1249091224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2adc1a6780 con 0x7f2adc06b180 2024-05-10T10:53:32.092 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.089+0000 7f2ae4361700 1 -- 172.21.15.107:0/1249091224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2adc063bf0 con 0x7f2adc06b180 2024-05-10T10:53:32.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.091+0000 7f2ad37fe700 1 -- 172.21.15.107:0/1249091224 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f2ad801c070 con 0x7f2adc06b180 2024-05-10T10:53:32.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.092+0000 7f2ad37fe700 1 --2- 172.21.15.107:0/1249091224 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f2ac80b2910 0x7f2ac80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:32.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.092+0000 7f2ae18fc700 1 --2- 172.21.15.107:0/1249091224 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f2ac80b2910 0x7f2ac80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:32.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.092+0000 7f2ad37fe700 1 -- 172.21.15.107:0/1249091224 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f2ad80e25c0 con 0x7f2adc06b180 2024-05-10T10:53:32.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.092+0000 7f2ad37fe700 1 --2- 172.21.15.107:0/1249091224 >> [v2:172.21.15.184:6824/1387541139,v1:172.21.15.184:6825/1387541139] conn(0x7f2ac80bc350 0x7f2ac80be7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:32.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.092+0000 7f2ad37fe700 1 -- 172.21.15.107:0/1249091224 --> [v2:172.21.15.184:6824/1387541139,v1:172.21.15.184:6825/1387541139] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ad800aea0 con 0x7f2ac80bc350 2024-05-10T10:53:32.094 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.092+0000 7f2ad37fe700 1 -- 172.21.15.107:0/1249091224 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f2ad80e2aa0 con 0x7f2adc06b180 2024-05-10T10:53:32.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.092+0000 7f2ae18fc700 1 --2- 172.21.15.107:0/1249091224 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f2ac80b2910 0x7f2ac80b4dd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2acc006010 tx=0x7f2acc00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:32.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.092+0000 7f2ae28fe700 1 --2- 172.21.15.107:0/1249091224 >> [v2:172.21.15.184:6824/1387541139,v1:172.21.15.184:6825/1387541139] conn(0x7f2ac80bc350 0x7f2ac80be7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:32.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.093+0000 7f2ae28fe700 1 --2- 172.21.15.107:0/1249091224 >> [v2:172.21.15.184:6824/1387541139,v1:172.21.15.184:6825/1387541139] conn(0x7f2ac80bc350 0x7f2ac80be7f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:32.095 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.094+0000 7f2ad37fe700 1 -- 172.21.15.107:0/1249091224 <== osd.10 v2:172.21.15.184:6824/1387541139 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2ad800aea0 con 0x7f2ac80bc350 2024-05-10T10:53:32.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.110+0000 7f2ae4361700 1 -- 172.21.15.107:0/1249091224 --> [v2:172.21.15.184:6824/1387541139,v1:172.21.15.184:6825/1387541139] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2adc064070 con 0x7f2ac80bc350 2024-05-10T10:53:32.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.111+0000 7f2ad37fe700 1 -- 172.21.15.107:0/1249091224 <== osd.10 v2:172.21.15.184:6824/1387541139 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2adc064070 con 0x7f2ac80bc350 2024-05-10T10:53:32.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.111+0000 7f2ae4361700 1 -- 172.21.15.107:0/1249091224 >> [v2:172.21.15.184:6824/1387541139,v1:172.21.15.184:6825/1387541139] conn(0x7f2ac80bc350 msgr2=0x7f2ac80be7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:32.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.111+0000 7f2ae4361700 1 --2- 172.21.15.107:0/1249091224 >> [v2:172.21.15.184:6824/1387541139,v1:172.21.15.184:6825/1387541139] conn(0x7f2ac80bc350 0x7f2ac80be7f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:32.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.111+0000 7f2ae4361700 1 -- 172.21.15.107:0/1249091224 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f2ac80b2910 msgr2=0x7f2ac80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:32.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.111+0000 7f2ae4361700 1 --2- 172.21.15.107:0/1249091224 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f2ac80b2910 0x7f2ac80b4dd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2acc006010 tx=0x7f2acc00b540 comp rx=0 tx=0).stop 2024-05-10T10:53:32.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.111+0000 7f2ae4361700 1 -- 172.21.15.107:0/1249091224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2adc06b180 msgr2=0x7f2adc19f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:32.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.111+0000 7f2ae4361700 1 --2- 172.21.15.107:0/1249091224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2adc06b180 0x7f2adc19f8b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2ad800ba50 tx=0x7f2ad800be10 comp rx=0 tx=0).stop 2024-05-10T10:53:32.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.111+0000 7f2ae28fe700 1 -- 172.21.15.107:0/1249091224 reap_dead start 2024-05-10T10:53:32.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.111+0000 7f2ae4361700 1 -- 172.21.15.107:0/1249091224 shutdown_connections 2024-05-10T10:53:32.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.111+0000 7f2ae4361700 1 -- 172.21.15.107:0/1249091224 >> 172.21.15.107:0/1249091224 conn(0x7f2adc079350 msgr2=0x7f2adc100f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:32.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.111+0000 7f2ae4361700 1 -- 172.21.15.107:0/1249091224 shutdown_connections 2024-05-10T10:53:32.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:32.111+0000 7f2ae4361700 1 -- 172.21.15.107:0/1249091224 wait complete. 2024-05-10T10:53:32.881 INFO:teuthology.orchestra.run.smithi107.stdout:283467841573 2024-05-10T10:53:32.881 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-10T10:53:32.989 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:32 smithi107 ceph-mon[30373]: pgmap v324: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:53:33.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:32 smithi196 ceph-mon[34872]: pgmap v324: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:53:33.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.094+0000 7fad1ea4c700 1 -- 172.21.15.107:0/3385554577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad18103f20 msgr2=0x7fad18110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:33.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.094+0000 7fad1ea4c700 1 --2- 172.21.15.107:0/3385554577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad18103f20 0x7fad18110310 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fad1000b0d0 tx=0x7fad1000b3e0 comp rx=0 tx=0).stop 2024-05-10T10:53:33.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.094+0000 7fad1ea4c700 1 -- 172.21.15.107:0/3385554577 shutdown_connections 2024-05-10T10:53:33.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.094+0000 7fad1ea4c700 1 --2- 172.21.15.107:0/3385554577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad18103f20 0x7fad18110310 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:33.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.094+0000 7fad1ea4c700 1 --2- 172.21.15.107:0/3385554577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad18109540 0x7fad18109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:33.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.094+0000 7fad1ea4c700 1 --2- 172.21.15.107:0/3385554577 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fad18103560 0x7fad181039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:33.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.094+0000 7fad1ea4c700 1 -- 172.21.15.107:0/3385554577 >> 172.21.15.107:0/3385554577 conn(0x7fad1807a660 msgr2=0x7fad1807aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:33.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.094+0000 7fad1ea4c700 1 -- 172.21.15.107:0/3385554577 shutdown_connections 2024-05-10T10:53:33.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.094+0000 7fad1ea4c700 1 -- 172.21.15.107:0/3385554577 wait complete. 2024-05-10T10:53:33.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.094+0000 7fad1ea4c700 1 Processor -- start 2024-05-10T10:53:33.096 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.095+0000 7fad1ea4c700 1 -- start start 2024-05-10T10:53:33.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.095+0000 7fad1ea4c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad18103560 0x7fad1819f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:33.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.095+0000 7fad1ea4c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fad18103f20 0x7fad1819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:33.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.095+0000 7fad1ea4c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad18109540 0x7fad18199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:33.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.095+0000 7fad1ea4c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fad18113770 con 0x7fad18109540 2024-05-10T10:53:33.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.095+0000 7fad1ea4c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fad181135f0 con 0x7fad18103560 2024-05-10T10:53:33.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.095+0000 7fad1ea4c700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fad181138f0 con 0x7fad18103f20 2024-05-10T10:53:33.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.095+0000 7fad1cfe9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad18109540 0x7fad18199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:33.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.095+0000 7fad17fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad18103560 0x7fad1819f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:33.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.095+0000 7fad1cfe9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad18109540 0x7fad18199970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37070/0 (socket says 172.21.15.107:37070) 2024-05-10T10:53:33.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.095+0000 7fad1cfe9700 1 -- 172.21.15.107:0/4070964498 learned_addr learned my addr 172.21.15.107:0/4070964498 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:33.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.095+0000 7fad0ffff700 1 --2- 172.21.15.107:0/4070964498 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fad18103f20 0x7fad1819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:33.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.095+0000 7fad1cfe9700 1 -- 172.21.15.107:0/4070964498 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fad18103f20 msgr2=0x7fad1819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:33.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.095+0000 7fad1cfe9700 1 --2- 172.21.15.107:0/4070964498 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fad18103f20 0x7fad1819fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:33.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.095+0000 7fad1cfe9700 1 -- 172.21.15.107:0/4070964498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad18103560 msgr2=0x7fad1819f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:33.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.095+0000 7fad1cfe9700 1 --2- 172.21.15.107:0/4070964498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad18103560 0x7fad1819f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:33.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.095+0000 7fad1cfe9700 1 -- 172.21.15.107:0/4070964498 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1819a0d0 con 0x7fad18109540 2024-05-10T10:53:33.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.095+0000 7fad17fff700 1 --2- 172.21.15.107:0/4070964498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad18103560 0x7fad1819f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:53:33.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.095+0000 7fad1cfe9700 1 --2- 172.21.15.107:0/4070964498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad18109540 0x7fad18199970 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fad10007a20 tx=0x7fad10007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:33.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.096+0000 7fad15ffb700 1 -- 172.21.15.107:0/4070964498 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1001f070 con 0x7fad18109540 2024-05-10T10:53:33.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.096+0000 7fad15ffb700 1 -- 172.21.15.107:0/4070964498 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fad10004c50 con 0x7fad18109540 2024-05-10T10:53:33.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.096+0000 7fad15ffb700 1 -- 172.21.15.107:0/4070964498 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1001b680 con 0x7fad18109540 2024-05-10T10:53:33.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.096+0000 7fad1ea4c700 1 -- 172.21.15.107:0/4070964498 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1819a360 con 0x7fad18109540 2024-05-10T10:53:33.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.096+0000 7fad1ea4c700 1 -- 172.21.15.107:0/4070964498 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad180756d0 con 0x7fad18109540 2024-05-10T10:53:33.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.097+0000 7fad1ea4c700 1 -- 172.21.15.107:0/4070964498 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad18063bf0 con 0x7fad18109540 2024-05-10T10:53:33.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.098+0000 7fad15ffb700 1 -- 172.21.15.107:0/4070964498 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7fad10022070 con 0x7fad18109540 2024-05-10T10:53:33.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.099+0000 7fad15ffb700 1 --2- 172.21.15.107:0/4070964498 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fad040b2990 0x7fad040b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:33.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.099+0000 7fad17fff700 1 --2- 172.21.15.107:0/4070964498 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fad040b2990 0x7fad040b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:33.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.099+0000 7fad15ffb700 1 -- 172.21.15.107:0/4070964498 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fad1000f020 con 0x7fad18109540 2024-05-10T10:53:33.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.099+0000 7fad15ffb700 1 --2- 172.21.15.107:0/4070964498 >> [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021] conn(0x7fad040bc3d0 0x7fad040be870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:33.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.099+0000 7fad15ffb700 1 -- 172.21.15.107:0/4070964498 --> [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad10026e50 con 0x7fad040bc3d0 2024-05-10T10:53:33.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.099+0000 7fad15ffb700 1 -- 172.21.15.107:0/4070964498 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fad100e3ae0 con 0x7fad18109540 2024-05-10T10:53:33.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.100+0000 7fad0ffff700 1 --2- 172.21.15.107:0/4070964498 >> [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021] conn(0x7fad040bc3d0 0x7fad040be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:33.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.100+0000 7fad17fff700 1 --2- 172.21.15.107:0/4070964498 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fad040b2990 0x7fad040b4e50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fad18108c30 tx=0x7fad0800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:33.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.100+0000 7fad0ffff700 1 --2- 172.21.15.107:0/4070964498 >> [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021] conn(0x7fad040bc3d0 0x7fad040be870 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:33.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.101+0000 7fad15ffb700 1 -- 172.21.15.107:0/4070964498 <== osd.3 v2:172.21.15.107:6810/1995642021 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad10026e50 con 0x7fad040bc3d0 2024-05-10T10:53:33.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.126+0000 7fad1ea4c700 1 -- 172.21.15.107:0/4070964498 --> [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fad180640c0 con 0x7fad040bc3d0 2024-05-10T10:53:33.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.127+0000 7fad15ffb700 1 -- 172.21.15.107:0/4070964498 <== osd.3 v2:172.21.15.107:6810/1995642021 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fad180640c0 con 0x7fad040bc3d0 2024-05-10T10:53:33.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.127+0000 7fad1ea4c700 1 -- 172.21.15.107:0/4070964498 >> [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021] conn(0x7fad040bc3d0 msgr2=0x7fad040be870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:33.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.127+0000 7fad1ea4c700 1 --2- 172.21.15.107:0/4070964498 >> [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021] conn(0x7fad040bc3d0 0x7fad040be870 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:33.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.127+0000 7fad1ea4c700 1 -- 172.21.15.107:0/4070964498 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fad040b2990 msgr2=0x7fad040b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:33.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.127+0000 7fad1ea4c700 1 --2- 172.21.15.107:0/4070964498 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fad040b2990 0x7fad040b4e50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fad18108c30 tx=0x7fad0800b410 comp rx=0 tx=0).stop 2024-05-10T10:53:33.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.127+0000 7fad1ea4c700 1 -- 172.21.15.107:0/4070964498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad18109540 msgr2=0x7fad18199970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:33.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.127+0000 7fad1ea4c700 1 --2- 172.21.15.107:0/4070964498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad18109540 0x7fad18199970 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fad10007a20 tx=0x7fad10007a50 comp rx=0 tx=0).stop 2024-05-10T10:53:33.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.127+0000 7fad1cfe9700 1 -- 172.21.15.107:0/4070964498 reap_dead start 2024-05-10T10:53:33.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.127+0000 7fad1ea4c700 1 -- 172.21.15.107:0/4070964498 shutdown_connections 2024-05-10T10:53:33.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.127+0000 7fad1ea4c700 1 -- 172.21.15.107:0/4070964498 >> 172.21.15.107:0/4070964498 conn(0x7fad1807a660 msgr2=0x7fad181020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:33.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.127+0000 7fad1ea4c700 1 -- 172.21.15.107:0/4070964498 shutdown_connections 2024-05-10T10:53:33.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:33.127+0000 7fad1ea4c700 1 -- 172.21.15.107:0/4070964498 wait complete. 2024-05-10T10:53:33.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:32 smithi184 ceph-mon[34585]: pgmap v324: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:53:34.223 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.222+0000 7fcfc6d0e700 1 -- 172.21.15.107:0/3138775564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfc0109540 msgr2=0x7fcfc0109920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:34.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.222+0000 7fcfc6d0e700 1 --2- 172.21.15.107:0/3138775564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfc0109540 0x7fcfc0109920 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009990 tx=0x7fcfb4009ca0 comp rx=0 tx=0).stop 2024-05-10T10:53:34.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.222+0000 7fcfc6d0e700 1 -- 172.21.15.107:0/3138775564 shutdown_connections 2024-05-10T10:53:34.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.222+0000 7fcfc6d0e700 1 --2- 172.21.15.107:0/3138775564 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfc006c530 0x7fcfc0110360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:34.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.222+0000 7fcfc6d0e700 1 --2- 172.21.15.107:0/3138775564 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfc0109540 0x7fcfc0109920 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:34.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.222+0000 7fcfc6d0e700 1 --2- 172.21.15.107:0/3138775564 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfc006bb70 0x7fcfc006bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:34.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.222+0000 7fcfc6d0e700 1 -- 172.21.15.107:0/3138775564 >> 172.21.15.107:0/3138775564 conn(0x7fcfc00793e0 msgr2=0x7fcfc00797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:34.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.222+0000 7fcfc6d0e700 1 -- 172.21.15.107:0/3138775564 shutdown_connections 2024-05-10T10:53:34.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.222+0000 7fcfc6d0e700 1 -- 172.21.15.107:0/3138775564 wait complete. 2024-05-10T10:53:34.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.223+0000 7fcfc6d0e700 1 Processor -- start 2024-05-10T10:53:34.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.223+0000 7fcfc6d0e700 1 -- start start 2024-05-10T10:53:34.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.223+0000 7fcfc6d0e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfc006bb70 0x7fcfc0199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:34.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.223+0000 7fcfc6d0e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfc006c530 0x7fcfc019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:34.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.223+0000 7fcfc6d0e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfc0109540 0x7fcfc019e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:34.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.223+0000 7fcfc6d0e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc0113890 con 0x7fcfc0109540 2024-05-10T10:53:34.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.223+0000 7fcfc6d0e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc0113710 con 0x7fcfc006c530 2024-05-10T10:53:34.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.223+0000 7fcfc6d0e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc0113a10 con 0x7fcfc006bb70 2024-05-10T10:53:34.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.223+0000 7fcfc52ab700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfc0109540 0x7fcfc019e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:34.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.223+0000 7fcfc52ab700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfc0109540 0x7fcfc019e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37086/0 (socket says 172.21.15.107:37086) 2024-05-10T10:53:34.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.223+0000 7fcfc52ab700 1 -- 172.21.15.107:0/2672397335 learned_addr learned my addr 172.21.15.107:0/2672397335 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:34.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.223+0000 7fcfc4aaa700 1 --2- 172.21.15.107:0/2672397335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfc006bb70 0x7fcfc0199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:34.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.223+0000 7fcfbffff700 1 --2- 172.21.15.107:0/2672397335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfc006c530 0x7fcfc019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:34.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.223+0000 7fcfc52ab700 1 -- 172.21.15.107:0/2672397335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfc006bb70 msgr2=0x7fcfc0199e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:34.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.223+0000 7fcfc52ab700 1 --2- 172.21.15.107:0/2672397335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfc006bb70 0x7fcfc0199e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:34.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.223+0000 7fcfc52ab700 1 -- 172.21.15.107:0/2672397335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfc006c530 msgr2=0x7fcfc019a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:34.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.223+0000 7fcfc52ab700 1 --2- 172.21.15.107:0/2672397335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfc006c530 0x7fcfc019a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:34.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.223+0000 7fcfc52ab700 1 -- 172.21.15.107:0/2672397335 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc019ee30 con 0x7fcfc0109540 2024-05-10T10:53:34.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.223+0000 7fcfc4aaa700 1 --2- 172.21.15.107:0/2672397335 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfc006bb70 0x7fcfc0199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:53:34.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.224+0000 7fcfc52ab700 1 --2- 172.21.15.107:0/2672397335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfc0109540 0x7fcfc019e6f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800b970 tx=0x7fcfb800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:34.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.224+0000 7fcfbdffb700 1 -- 172.21.15.107:0/2672397335 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8019070 con 0x7fcfc0109540 2024-05-10T10:53:34.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.224+0000 7fcfbdffb700 1 -- 172.21.15.107:0/2672397335 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcfb8014440 con 0x7fcfc0109540 2024-05-10T10:53:34.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.224+0000 7fcfc6d0e700 1 -- 172.21.15.107:0/2672397335 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc019f120 con 0x7fcfc0109540 2024-05-10T10:53:34.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.224+0000 7fcfbdffb700 1 -- 172.21.15.107:0/2672397335 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80075d0 con 0x7fcfc0109540 2024-05-10T10:53:34.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.224+0000 7fcfc6d0e700 1 -- 172.21.15.107:0/2672397335 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc01a69a0 con 0x7fcfc0109540 2024-05-10T10:53:34.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.225+0000 7fcfc6d0e700 1 -- 172.21.15.107:0/2672397335 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcfc0063bb0 con 0x7fcfc0109540 2024-05-10T10:53:34.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.226+0000 7fcfbdffb700 1 -- 172.21.15.107:0/2672397335 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7fcfb801c070 con 0x7fcfc0109540 2024-05-10T10:53:34.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.227+0000 7fcfbdffb700 1 --2- 172.21.15.107:0/2672397335 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcfb00b2910 0x7fcfb00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:34.250 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.227+0000 7fcfc4aaa700 1 --2- 172.21.15.107:0/2672397335 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcfb00b2910 0x7fcfb00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:34.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.227+0000 7fcfbdffb700 1 -- 172.21.15.107:0/2672397335 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fcfb80e1e10 con 0x7fcfc0109540 2024-05-10T10:53:34.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.227+0000 7fcfbdffb700 1 --2- 172.21.15.107:0/2672397335 >> [v2:172.21.15.184:6816/2850715284,v1:172.21.15.184:6817/2850715284] conn(0x7fcfb00bc350 0x7fcfb00be7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:34.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.227+0000 7fcfbdffb700 1 -- 172.21.15.107:0/2672397335 --> [v2:172.21.15.184:6816/2850715284,v1:172.21.15.184:6817/2850715284] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcfb8020e50 con 0x7fcfb00bc350 2024-05-10T10:53:34.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.227+0000 7fcfbdffb700 1 -- 172.21.15.107:0/2672397335 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fcfb80e22f0 con 0x7fcfc0109540 2024-05-10T10:53:34.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.227+0000 7fcfc4aaa700 1 --2- 172.21.15.107:0/2672397335 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcfb00b2910 0x7fcfb00b4dd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4006010 tx=0x7fcfb400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:34.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.228+0000 7fcfbffff700 1 --2- 172.21.15.107:0/2672397335 >> [v2:172.21.15.184:6816/2850715284,v1:172.21.15.184:6817/2850715284] conn(0x7fcfb00bc350 0x7fcfb00be7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:34.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.228+0000 7fcfbffff700 1 --2- 172.21.15.107:0/2672397335 >> [v2:172.21.15.184:6816/2850715284,v1:172.21.15.184:6817/2850715284] conn(0x7fcfb00bc350 0x7fcfb00be7f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:34.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.229+0000 7fcfbdffb700 1 -- 172.21.15.107:0/2672397335 <== osd.7 v2:172.21.15.184:6816/2850715284 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcfb8020e50 con 0x7fcfb00bc350 2024-05-10T10:53:34.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.245+0000 7fcfc6d0e700 1 -- 172.21.15.107:0/2672397335 --> [v2:172.21.15.184:6816/2850715284,v1:172.21.15.184:6817/2850715284] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcfc0064030 con 0x7fcfb00bc350 2024-05-10T10:53:34.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.246+0000 7fcfbdffb700 1 -- 172.21.15.107:0/2672397335 <== osd.7 v2:172.21.15.184:6816/2850715284 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcfc0064030 con 0x7fcfb00bc350 2024-05-10T10:53:34.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.246+0000 7fcfc6d0e700 1 -- 172.21.15.107:0/2672397335 >> [v2:172.21.15.184:6816/2850715284,v1:172.21.15.184:6817/2850715284] conn(0x7fcfb00bc350 msgr2=0x7fcfb00be7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:34.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.246+0000 7fcfc6d0e700 1 --2- 172.21.15.107:0/2672397335 >> [v2:172.21.15.184:6816/2850715284,v1:172.21.15.184:6817/2850715284] conn(0x7fcfb00bc350 0x7fcfb00be7f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:34.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.246+0000 7fcfc6d0e700 1 -- 172.21.15.107:0/2672397335 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcfb00b2910 msgr2=0x7fcfb00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:34.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.246+0000 7fcfc6d0e700 1 --2- 172.21.15.107:0/2672397335 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcfb00b2910 0x7fcfb00b4dd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4006010 tx=0x7fcfb400b540 comp rx=0 tx=0).stop 2024-05-10T10:53:34.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.246+0000 7fcfc6d0e700 1 -- 172.21.15.107:0/2672397335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfc0109540 msgr2=0x7fcfc019e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:34.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.246+0000 7fcfc6d0e700 1 --2- 172.21.15.107:0/2672397335 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfc0109540 0x7fcfc019e6f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcfb800b970 tx=0x7fcfb800bd30 comp rx=0 tx=0).stop 2024-05-10T10:53:34.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.246+0000 7fcfc52ab700 1 -- 172.21.15.107:0/2672397335 reap_dead start 2024-05-10T10:53:34.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.246+0000 7fcfc6d0e700 1 -- 172.21.15.107:0/2672397335 shutdown_connections 2024-05-10T10:53:34.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.246+0000 7fcfc6d0e700 1 -- 172.21.15.107:0/2672397335 >> 172.21.15.107:0/2672397335 conn(0x7fcfc00793e0 msgr2=0x7fcfc01012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:34.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.246+0000 7fcfc6d0e700 1 -- 172.21.15.107:0/2672397335 shutdown_connections 2024-05-10T10:53:34.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:34.246+0000 7fcfc6d0e700 1 -- 172.21.15.107:0/2672397335 wait complete. 2024-05-10T10:53:34.879 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:34 smithi107 ceph-mon[30373]: pgmap v325: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T10:53:35.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:34 smithi196 ceph-mon[34872]: pgmap v325: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T10:53:35.143 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:34 smithi184 ceph-mon[34585]: pgmap v325: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-10T10:53:35.201 INFO:teuthology.orchestra.run.smithi107.stdout:107374182470 2024-05-10T10:53:35.202 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-10T10:53:36.431 INFO:teuthology.orchestra.run.smithi107.stdout:206158430260 2024-05-10T10:53:36.432 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-10T10:53:36.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.762+0000 7f53a573c700 1 -- 172.21.15.107:0/125874032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53a0103530 msgr2=0x7f53a01039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:36.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.762+0000 7f53a573c700 1 --2- 172.21.15.107:0/125874032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53a0103530 0x7f53a01039b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f53940099c0 tx=0x7f5394009cd0 comp rx=0 tx=0).stop 2024-05-10T10:53:36.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.762+0000 7f53a573c700 1 -- 172.21.15.107:0/125874032 shutdown_connections 2024-05-10T10:53:36.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.762+0000 7f53a573c700 1 --2- 172.21.15.107:0/125874032 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53a0103ef0 0x7f53a01103a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:36.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.762+0000 7f53a573c700 1 --2- 172.21.15.107:0/125874032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53a01095d0 0x7f53a01099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:36.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.762+0000 7f53a573c700 1 --2- 172.21.15.107:0/125874032 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53a0103530 0x7f53a01039b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:36.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.762+0000 7f53a573c700 1 -- 172.21.15.107:0/125874032 >> 172.21.15.107:0/125874032 conn(0x7f53a007a690 msgr2=0x7f53a007aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:36.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.762+0000 7f53a573c700 1 -- 172.21.15.107:0/125874032 shutdown_connections 2024-05-10T10:53:36.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.762+0000 7f53a573c700 1 -- 172.21.15.107:0/125874032 wait complete. 2024-05-10T10:53:36.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.762+0000 7f53a573c700 1 Processor -- start 2024-05-10T10:53:36.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.763+0000 7f53a573c700 1 -- start start 2024-05-10T10:53:36.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.763+0000 7f53a573c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53a0103530 0x7f53a019fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:36.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.763+0000 7f53a573c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53a0103ef0 0x7f53a019ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:36.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.763+0000 7f53a573c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53a01095d0 0x7f53a0199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:36.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.763+0000 7f53a573c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f53a0113870 con 0x7f53a01095d0 2024-05-10T10:53:36.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.763+0000 7f53a573c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f53a01136f0 con 0x7f53a0103530 2024-05-10T10:53:36.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.763+0000 7f53a573c700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f53a01139f0 con 0x7f53a0103ef0 2024-05-10T10:53:36.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.763+0000 7f539f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53a01095d0 0x7f53a0199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:36.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.763+0000 7f539f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53a01095d0 0x7f53a0199b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43448/0 (socket says 172.21.15.107:43448) 2024-05-10T10:53:36.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.763+0000 7f539f7fe700 1 -- 172.21.15.107:0/1990445497 learned_addr learned my addr 172.21.15.107:0/1990445497 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:36.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.763+0000 7f539effd700 1 --2- 172.21.15.107:0/1990445497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53a0103530 0x7f53a019fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:36.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.763+0000 7f539e7fc700 1 --2- 172.21.15.107:0/1990445497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53a0103ef0 0x7f53a019ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:36.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.763+0000 7f539f7fe700 1 -- 172.21.15.107:0/1990445497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53a0103ef0 msgr2=0x7f53a019ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:36.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.763+0000 7f539f7fe700 1 --2- 172.21.15.107:0/1990445497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f53a0103ef0 0x7f53a019ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:36.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.763+0000 7f539f7fe700 1 -- 172.21.15.107:0/1990445497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53a0103530 msgr2=0x7f53a019fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:36.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.763+0000 7f539f7fe700 1 --2- 172.21.15.107:0/1990445497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53a0103530 0x7f53a019fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:36.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.763+0000 7f539f7fe700 1 -- 172.21.15.107:0/1990445497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a019a410 con 0x7f53a01095d0 2024-05-10T10:53:36.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.763+0000 7f539effd700 1 --2- 172.21.15.107:0/1990445497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53a0103530 0x7f53a019fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:53:36.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.763+0000 7f539f7fe700 1 --2- 172.21.15.107:0/1990445497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53a01095d0 0x7f53a0199b30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f539800b970 tx=0x7f539800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:36.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.764+0000 7f5387fff700 1 -- 172.21.15.107:0/1990445497 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5398019070 con 0x7f53a01095d0 2024-05-10T10:53:36.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.764+0000 7f53a573c700 1 -- 172.21.15.107:0/1990445497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a019a700 con 0x7f53a01095d0 2024-05-10T10:53:36.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.764+0000 7f5387fff700 1 -- 172.21.15.107:0/1990445497 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5398014440 con 0x7f53a01095d0 2024-05-10T10:53:36.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.764+0000 7f53a573c700 1 -- 172.21.15.107:0/1990445497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a01a69e0 con 0x7f53a01095d0 2024-05-10T10:53:36.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.764+0000 7f5387fff700 1 -- 172.21.15.107:0/1990445497 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53980075d0 con 0x7f53a01095d0 2024-05-10T10:53:36.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.765+0000 7f53a573c700 1 -- 172.21.15.107:0/1990445497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f53a0063b70 con 0x7f53a01095d0 2024-05-10T10:53:36.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.766+0000 7f5387fff700 1 -- 172.21.15.107:0/1990445497 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f539801c070 con 0x7f53a01095d0 2024-05-10T10:53:36.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.767+0000 7f5387fff700 1 --2- 172.21.15.107:0/1990445497 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f53880b2910 0x7f53880b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:36.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.767+0000 7f539effd700 1 --2- 172.21.15.107:0/1990445497 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f53880b2910 0x7f53880b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:36.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.767+0000 7f5387fff700 1 -- 172.21.15.107:0/1990445497 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f53980e1e10 con 0x7f53a01095d0 2024-05-10T10:53:36.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.767+0000 7f5387fff700 1 --2- 172.21.15.107:0/1990445497 >> [v2:172.21.15.196:6816/504426486,v1:172.21.15.196:6817/504426486] conn(0x7f53880bc350 0x7f53880be7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:36.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.767+0000 7f5387fff700 1 -- 172.21.15.107:0/1990445497 --> [v2:172.21.15.196:6816/504426486,v1:172.21.15.196:6817/504426486] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5398020e50 con 0x7f53880bc350 2024-05-10T10:53:36.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.767+0000 7f5387fff700 1 -- 172.21.15.107:0/1990445497 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f53980e22f0 con 0x7f53a01095d0 2024-05-10T10:53:36.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.767+0000 7f539effd700 1 --2- 172.21.15.107:0/1990445497 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f53880b2910 0x7f53880b4dd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5390009cb0 tx=0x7f5390009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:36.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.768+0000 7f539e7fc700 1 --2- 172.21.15.107:0/1990445497 >> [v2:172.21.15.196:6816/504426486,v1:172.21.15.196:6817/504426486] conn(0x7f53880bc350 0x7f53880be7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:36.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.768+0000 7f539e7fc700 1 --2- 172.21.15.107:0/1990445497 >> [v2:172.21.15.196:6816/504426486,v1:172.21.15.196:6817/504426486] conn(0x7f53880bc350 0x7f53880be7f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:36.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.769+0000 7f5387fff700 1 -- 172.21.15.107:0/1990445497 <== osd.8 v2:172.21.15.196:6816/504426486 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5398020e50 con 0x7f53880bc350 2024-05-10T10:53:36.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.785+0000 7f53a573c700 1 -- 172.21.15.107:0/1990445497 --> [v2:172.21.15.196:6816/504426486,v1:172.21.15.196:6817/504426486] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f53a0063ff0 con 0x7f53880bc350 2024-05-10T10:53:36.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.786+0000 7f5387fff700 1 -- 172.21.15.107:0/1990445497 <== osd.8 v2:172.21.15.196:6816/504426486 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f53a0063ff0 con 0x7f53880bc350 2024-05-10T10:53:36.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.786+0000 7f53a573c700 1 -- 172.21.15.107:0/1990445497 >> [v2:172.21.15.196:6816/504426486,v1:172.21.15.196:6817/504426486] conn(0x7f53880bc350 msgr2=0x7f53880be7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:36.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.786+0000 7f53a573c700 1 --2- 172.21.15.107:0/1990445497 >> [v2:172.21.15.196:6816/504426486,v1:172.21.15.196:6817/504426486] conn(0x7f53880bc350 0x7f53880be7f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:36.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.786+0000 7f53a573c700 1 -- 172.21.15.107:0/1990445497 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f53880b2910 msgr2=0x7f53880b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:36.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.786+0000 7f53a573c700 1 --2- 172.21.15.107:0/1990445497 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f53880b2910 0x7f53880b4dd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5390009cb0 tx=0x7f5390009260 comp rx=0 tx=0).stop 2024-05-10T10:53:36.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.786+0000 7f53a573c700 1 -- 172.21.15.107:0/1990445497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53a01095d0 msgr2=0x7f53a0199b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:36.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.786+0000 7f53a573c700 1 --2- 172.21.15.107:0/1990445497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f53a01095d0 0x7f53a0199b30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f539800b970 tx=0x7f539800bd30 comp rx=0 tx=0).stop 2024-05-10T10:53:36.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.786+0000 7f539f7fe700 1 -- 172.21.15.107:0/1990445497 reap_dead start 2024-05-10T10:53:36.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.786+0000 7f53a573c700 1 -- 172.21.15.107:0/1990445497 shutdown_connections 2024-05-10T10:53:36.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.786+0000 7f53a573c700 1 -- 172.21.15.107:0/1990445497 >> 172.21.15.107:0/1990445497 conn(0x7f53a007a690 msgr2=0x7f53a01022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:36.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.786+0000 7f53a573c700 1 -- 172.21.15.107:0/1990445497 shutdown_connections 2024-05-10T10:53:36.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.786+0000 7f53a573c700 1 -- 172.21.15.107:0/1990445497 wait complete. 2024-05-10T10:53:36.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:36 smithi107 ceph-mon[30373]: pgmap v326: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:53:37.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:36 smithi196 ceph-mon[34872]: pgmap v326: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:53:37.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:36 smithi184 ceph-mon[34585]: pgmap v326: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:53:37.185 INFO:teuthology.orchestra.run.smithi107.stdout:257698037801 2024-05-10T10:53:37.185 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-10T10:53:37.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.652+0000 7f86eba64700 1 -- 172.21.15.107:0/442677482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86e4109510 msgr2=0x7f86e41098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:37.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.652+0000 7f86eba64700 1 --2- 172.21.15.107:0/442677482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86e4109510 0x7f86e41098f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009990 tx=0x7f86e0009ca0 comp rx=0 tx=0).stop 2024-05-10T10:53:37.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.652+0000 7f86eba64700 1 -- 172.21.15.107:0/442677482 shutdown_connections 2024-05-10T10:53:37.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.652+0000 7f86eba64700 1 --2- 172.21.15.107:0/442677482 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86e406c5b0 0x7f86e4110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:37.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.652+0000 7f86eba64700 1 --2- 172.21.15.107:0/442677482 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86e4109510 0x7f86e41098f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:37.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.652+0000 7f86eba64700 1 --2- 172.21.15.107:0/442677482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86e406bbf0 0x7f86e406c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:37.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.652+0000 7f86eba64700 1 -- 172.21.15.107:0/442677482 >> 172.21.15.107:0/442677482 conn(0x7f86e4079370 msgr2=0x7f86e4079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:37.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.652+0000 7f86eba64700 1 -- 172.21.15.107:0/442677482 shutdown_connections 2024-05-10T10:53:37.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.652+0000 7f86eba64700 1 -- 172.21.15.107:0/442677482 wait complete. 2024-05-10T10:53:37.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.653+0000 7f86eba64700 1 Processor -- start 2024-05-10T10:53:37.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.653+0000 7f86eba64700 1 -- start start 2024-05-10T10:53:37.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.653+0000 7f86eba64700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86e406bbf0 0x7f86e419f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:37.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.653+0000 7f86eba64700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86e406c5b0 0x7f86e419fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:37.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.653+0000 7f86eba64700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86e4109510 0x7f86e4199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:37.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.653+0000 7f86eba64700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f86e41137e0 con 0x7f86e4109510 2024-05-10T10:53:37.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.653+0000 7f86eba64700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f86e4113660 con 0x7f86e406bbf0 2024-05-10T10:53:37.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.653+0000 7f86eba64700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f86e4113960 con 0x7f86e406c5b0 2024-05-10T10:53:37.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.653+0000 7f86ea001700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86e4109510 0x7f86e4199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:37.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.653+0000 7f86ea001700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86e4109510 0x7f86e4199a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43444/0 (socket says 172.21.15.107:43444) 2024-05-10T10:53:37.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.653+0000 7f86ea001700 1 -- 172.21.15.107:0/1796631025 learned_addr learned my addr 172.21.15.107:0/1796631025 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:37.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.653+0000 7f86e9800700 1 --2- 172.21.15.107:0/1796631025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86e406bbf0 0x7f86e419f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:37.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.653+0000 7f86e8fff700 1 --2- 172.21.15.107:0/1796631025 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86e406c5b0 0x7f86e419fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:37.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.653+0000 7f86ea001700 1 -- 172.21.15.107:0/1796631025 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86e406c5b0 msgr2=0x7f86e419fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:37.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.653+0000 7f86ea001700 1 --2- 172.21.15.107:0/1796631025 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86e406c5b0 0x7f86e419fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:37.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.653+0000 7f86ea001700 1 -- 172.21.15.107:0/1796631025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86e406bbf0 msgr2=0x7f86e419f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:37.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.653+0000 7f86ea001700 1 --2- 172.21.15.107:0/1796631025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86e406bbf0 0x7f86e419f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:37.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.653+0000 7f86ea001700 1 -- 172.21.15.107:0/1796631025 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e419a1e0 con 0x7f86e4109510 2024-05-10T10:53:37.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.653+0000 7f86e9800700 1 --2- 172.21.15.107:0/1796631025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86e406bbf0 0x7f86e419f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:53:37.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.654+0000 7f86ea001700 1 --2- 172.21.15.107:0/1796631025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86e4109510 0x7f86e4199a80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f86dc007d70 tx=0x7f86dc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:37.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.654+0000 7f86da7fc700 1 -- 172.21.15.107:0/1796631025 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc016020 con 0x7f86e4109510 2024-05-10T10:53:37.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.654+0000 7f86eba64700 1 -- 172.21.15.107:0/1796631025 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e419a4d0 con 0x7f86e4109510 2024-05-10T10:53:37.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.654+0000 7f86da7fc700 1 -- 172.21.15.107:0/1796631025 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f86dc00ad40 con 0x7f86e4109510 2024-05-10T10:53:37.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.654+0000 7f86da7fc700 1 -- 172.21.15.107:0/1796631025 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0116f0 con 0x7f86e4109510 2024-05-10T10:53:37.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.654+0000 7f86eba64700 1 -- 172.21.15.107:0/1796631025 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e41a6790 con 0x7f86e4109510 2024-05-10T10:53:37.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.655+0000 7f86eba64700 1 -- 172.21.15.107:0/1796631025 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f86e4063c30 con 0x7f86e4109510 2024-05-10T10:53:37.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.657+0000 7f86da7fc700 1 -- 172.21.15.107:0/1796631025 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f86dc019020 con 0x7f86e4109510 2024-05-10T10:53:37.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.658+0000 7f86da7fc700 1 --2- 172.21.15.107:0/1796631025 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f86d00b2910 0x7f86d00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:37.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.658+0000 7f86e9800700 1 --2- 172.21.15.107:0/1796631025 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f86d00b2910 0x7f86d00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:37.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.658+0000 7f86da7fc700 1 -- 172.21.15.107:0/1796631025 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f86dc0e2730 con 0x7f86e4109510 2024-05-10T10:53:37.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.658+0000 7f86da7fc700 1 --2- 172.21.15.107:0/1796631025 >> [v2:172.21.15.184:6808/271550329,v1:172.21.15.184:6809/271550329] conn(0x7f86d00bc350 0x7f86d00be7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:37.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.658+0000 7f86da7fc700 1 -- 172.21.15.107:0/1796631025 --> [v2:172.21.15.184:6808/271550329,v1:172.21.15.184:6809/271550329] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f86d00beec0 con 0x7f86d00bc350 2024-05-10T10:53:37.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.658+0000 7f86da7fc700 1 -- 172.21.15.107:0/1796631025 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f86dc0e2c10 con 0x7f86e4109510 2024-05-10T10:53:37.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.659+0000 7f86e9800700 1 --2- 172.21.15.107:0/1796631025 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f86d00b2910 0x7f86d00b4dd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f86e0006010 tx=0x7f86e000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:37.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.659+0000 7f86e8fff700 1 --2- 172.21.15.107:0/1796631025 >> [v2:172.21.15.184:6808/271550329,v1:172.21.15.184:6809/271550329] conn(0x7f86d00bc350 0x7f86d00be7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:37.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.659+0000 7f86e8fff700 1 --2- 172.21.15.107:0/1796631025 >> [v2:172.21.15.184:6808/271550329,v1:172.21.15.184:6809/271550329] conn(0x7f86d00bc350 0x7f86d00be7f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:37.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.660+0000 7f86da7fc700 1 -- 172.21.15.107:0/1796631025 <== osd.4 v2:172.21.15.184:6808/271550329 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f86d00beec0 con 0x7f86d00bc350 2024-05-10T10:53:37.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.679+0000 7f86eba64700 1 -- 172.21.15.107:0/1796631025 --> [v2:172.21.15.184:6808/271550329,v1:172.21.15.184:6809/271550329] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f86e4064030 con 0x7f86d00bc350 2024-05-10T10:53:37.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.680+0000 7f86da7fc700 1 -- 172.21.15.107:0/1796631025 <== osd.4 v2:172.21.15.184:6808/271550329 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f86e4064030 con 0x7f86d00bc350 2024-05-10T10:53:37.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.680+0000 7f86eba64700 1 -- 172.21.15.107:0/1796631025 >> [v2:172.21.15.184:6808/271550329,v1:172.21.15.184:6809/271550329] conn(0x7f86d00bc350 msgr2=0x7f86d00be7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:37.263 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.680+0000 7f86eba64700 1 --2- 172.21.15.107:0/1796631025 >> [v2:172.21.15.184:6808/271550329,v1:172.21.15.184:6809/271550329] conn(0x7f86d00bc350 0x7f86d00be7f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:37.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.680+0000 7f86eba64700 1 -- 172.21.15.107:0/1796631025 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f86d00b2910 msgr2=0x7f86d00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:37.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.680+0000 7f86eba64700 1 --2- 172.21.15.107:0/1796631025 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f86d00b2910 0x7f86d00b4dd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f86e0006010 tx=0x7f86e000b540 comp rx=0 tx=0).stop 2024-05-10T10:53:37.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.680+0000 7f86eba64700 1 -- 172.21.15.107:0/1796631025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86e4109510 msgr2=0x7f86e4199a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:37.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.680+0000 7f86eba64700 1 --2- 172.21.15.107:0/1796631025 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86e4109510 0x7f86e4199a80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f86dc007d70 tx=0x7f86dc00a340 comp rx=0 tx=0).stop 2024-05-10T10:53:37.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.680+0000 7f86ea001700 1 -- 172.21.15.107:0/1796631025 reap_dead start 2024-05-10T10:53:37.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.680+0000 7f86eba64700 1 -- 172.21.15.107:0/1796631025 shutdown_connections 2024-05-10T10:53:37.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.680+0000 7f86eba64700 1 -- 172.21.15.107:0/1796631025 >> 172.21.15.107:0/1796631025 conn(0x7f86e4079370 msgr2=0x7f86e4100fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:37.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.680+0000 7f86eba64700 1 -- 172.21.15.107:0/1796631025 shutdown_connections 2024-05-10T10:53:37.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:36.680+0000 7f86eba64700 1 -- 172.21.15.107:0/1796631025 wait complete. 2024-05-10T10:53:37.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.916+0000 7f682b526700 1 -- 172.21.15.107:0/1764178711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6824102d60 msgr2=0x7f682410f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:37.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.916+0000 7f682b526700 1 --2- 172.21.15.107:0/1764178711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6824102d60 0x7f682410f250 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f681c00b0a0 tx=0x7f681c00b3b0 comp rx=0 tx=0).stop 2024-05-10T10:53:37.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.916+0000 7f682b526700 1 -- 172.21.15.107:0/1764178711 shutdown_connections 2024-05-10T10:53:37.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.916+0000 7f682b526700 1 --2- 172.21.15.107:0/1764178711 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6824108410 0x7f68241087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:37.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.916+0000 7f682b526700 1 --2- 172.21.15.107:0/1764178711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6824102d60 0x7f682410f250 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:37.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.916+0000 7f682b526700 1 --2- 172.21.15.107:0/1764178711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68241023a0 0x7f6824102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:37.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.916+0000 7f682b526700 1 -- 172.21.15.107:0/1764178711 >> 172.21.15.107:0/1764178711 conn(0x7f6824079350 msgr2=0x7f6824079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:37.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.916+0000 7f682b526700 1 -- 172.21.15.107:0/1764178711 shutdown_connections 2024-05-10T10:53:37.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.916+0000 7f682b526700 1 -- 172.21.15.107:0/1764178711 wait complete. 2024-05-10T10:53:37.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.917+0000 7f682b526700 1 Processor -- start 2024-05-10T10:53:37.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.917+0000 7f682b526700 1 -- start start 2024-05-10T10:53:37.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.917+0000 7f682b526700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68241023a0 0x7f682419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:37.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.917+0000 7f682b526700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6824102d60 0x7f682419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:37.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.917+0000 7f682b526700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6824108410 0x7f6824199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:37.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.917+0000 7f682b526700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6824112690 con 0x7f68241023a0 2024-05-10T10:53:37.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.917+0000 7f682b526700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6824112510 con 0x7f6824108410 2024-05-10T10:53:37.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.917+0000 7f682b526700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6824112810 con 0x7f6824102d60 2024-05-10T10:53:37.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.917+0000 7f68292c2700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68241023a0 0x7f682419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:37.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.917+0000 7f68292c2700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68241023a0 0x7f682419f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43470/0 (socket says 172.21.15.107:43470) 2024-05-10T10:53:37.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.917+0000 7f68292c2700 1 -- 172.21.15.107:0/3771623178 learned_addr learned my addr 172.21.15.107:0/3771623178 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:37.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.918+0000 7f6829ac3700 1 --2- 172.21.15.107:0/3771623178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6824108410 0x7f6824199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:37.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.918+0000 7f6828ac1700 1 --2- 172.21.15.107:0/3771623178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6824102d60 0x7f682419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:37.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.918+0000 7f68292c2700 1 -- 172.21.15.107:0/3771623178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6824102d60 msgr2=0x7f682419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:37.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.918+0000 7f68292c2700 1 --2- 172.21.15.107:0/3771623178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6824102d60 0x7f682419fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:37.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.918+0000 7f68292c2700 1 -- 172.21.15.107:0/3771623178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6824108410 msgr2=0x7f6824199a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:37.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.918+0000 7f68292c2700 1 --2- 172.21.15.107:0/3771623178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6824108410 0x7f6824199a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:37.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.918+0000 7f68292c2700 1 -- 172.21.15.107:0/3771623178 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682419a1a0 con 0x7f68241023a0 2024-05-10T10:53:37.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.918+0000 7f6828ac1700 1 --2- 172.21.15.107:0/3771623178 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6824102d60 0x7f682419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:53:37.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.918+0000 7f6829ac3700 1 --2- 172.21.15.107:0/3771623178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6824108410 0x7f6824199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:53:37.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.918+0000 7f68292c2700 1 --2- 172.21.15.107:0/3771623178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68241023a0 0x7f682419f880 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f681800d980 tx=0x7f681800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:37.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.918+0000 7f68167fc700 1 -- 172.21.15.107:0/3771623178 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6818017070 con 0x7f68241023a0 2024-05-10T10:53:37.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.918+0000 7f682b526700 1 -- 172.21.15.107:0/3771623178 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f682419a490 con 0x7f68241023a0 2024-05-10T10:53:37.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.918+0000 7f68167fc700 1 -- 172.21.15.107:0/3771623178 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6818004d00 con 0x7f68241023a0 2024-05-10T10:53:37.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.918+0000 7f68167fc700 1 -- 172.21.15.107:0/3771623178 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6818005500 con 0x7f68241023a0 2024-05-10T10:53:37.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.918+0000 7f682b526700 1 -- 172.21.15.107:0/3771623178 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68241a6750 con 0x7f68241023a0 2024-05-10T10:53:37.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.919+0000 7f682b526700 1 -- 172.21.15.107:0/3771623178 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f682406b410 con 0x7f68241023a0 2024-05-10T10:53:37.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.920+0000 7f68167fc700 1 -- 172.21.15.107:0/3771623178 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f6818009b40 con 0x7f68241023a0 2024-05-10T10:53:37.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.921+0000 7f68167fc700 1 --2- 172.21.15.107:0/3771623178 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f68100b2910 0x7f68100b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:37.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.921+0000 7f6828ac1700 1 --2- 172.21.15.107:0/3771623178 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f68100b2910 0x7f68100b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:37.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.921+0000 7f68167fc700 1 -- 172.21.15.107:0/3771623178 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f68180e2840 con 0x7f68241023a0 2024-05-10T10:53:37.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.921+0000 7f68167fc700 1 --2- 172.21.15.107:0/3771623178 >> [v2:172.21.15.196:6800/137473043,v1:172.21.15.196:6801/137473043] conn(0x7f68100bc350 0x7f68100be7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:37.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.921+0000 7f68167fc700 1 -- 172.21.15.107:0/3771623178 --> [v2:172.21.15.196:6800/137473043,v1:172.21.15.196:6801/137473043] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68100beec0 con 0x7f68100bc350 2024-05-10T10:53:37.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.921+0000 7f68167fc700 1 -- 172.21.15.107:0/3771623178 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f68180e2d20 con 0x7f68241023a0 2024-05-10T10:53:37.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.922+0000 7f6828ac1700 1 --2- 172.21.15.107:0/3771623178 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f68100b2910 0x7f68100b4dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6820005fd0 tx=0x7f6820005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:37.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.922+0000 7f6829ac3700 1 --2- 172.21.15.107:0/3771623178 >> [v2:172.21.15.196:6800/137473043,v1:172.21.15.196:6801/137473043] conn(0x7f68100bc350 0x7f68100be7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:37.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.922+0000 7f6829ac3700 1 --2- 172.21.15.107:0/3771623178 >> [v2:172.21.15.196:6800/137473043,v1:172.21.15.196:6801/137473043] conn(0x7f68100bc350 0x7f68100be7f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:37.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.923+0000 7f68167fc700 1 -- 172.21.15.107:0/3771623178 <== osd.2 v2:172.21.15.196:6800/137473043 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f68100beec0 con 0x7f68100bc350 2024-05-10T10:53:37.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.940+0000 7f682b526700 1 -- 172.21.15.107:0/3771623178 --> [v2:172.21.15.196:6800/137473043,v1:172.21.15.196:6801/137473043] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6824103ac0 con 0x7f68100bc350 2024-05-10T10:53:37.941 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.940+0000 7f68167fc700 1 -- 172.21.15.107:0/3771623178 <== osd.2 v2:172.21.15.196:6800/137473043 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6824103ac0 con 0x7f68100bc350 2024-05-10T10:53:37.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.941+0000 7f682b526700 1 -- 172.21.15.107:0/3771623178 >> [v2:172.21.15.196:6800/137473043,v1:172.21.15.196:6801/137473043] conn(0x7f68100bc350 msgr2=0x7f68100be7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:37.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.941+0000 7f682b526700 1 --2- 172.21.15.107:0/3771623178 >> [v2:172.21.15.196:6800/137473043,v1:172.21.15.196:6801/137473043] conn(0x7f68100bc350 0x7f68100be7f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:37.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.941+0000 7f682b526700 1 -- 172.21.15.107:0/3771623178 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f68100b2910 msgr2=0x7f68100b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:37.942 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.941+0000 7f682b526700 1 --2- 172.21.15.107:0/3771623178 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f68100b2910 0x7f68100b4dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6820005fd0 tx=0x7f6820005e20 comp rx=0 tx=0).stop 2024-05-10T10:53:37.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.941+0000 7f682b526700 1 -- 172.21.15.107:0/3771623178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68241023a0 msgr2=0x7f682419f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:37.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.941+0000 7f682b526700 1 --2- 172.21.15.107:0/3771623178 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68241023a0 0x7f682419f880 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f681800d980 tx=0x7f681800dd40 comp rx=0 tx=0).stop 2024-05-10T10:53:37.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.941+0000 7f6829ac3700 1 -- 172.21.15.107:0/3771623178 reap_dead start 2024-05-10T10:53:37.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.941+0000 7f682b526700 1 -- 172.21.15.107:0/3771623178 shutdown_connections 2024-05-10T10:53:37.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.941+0000 7f682b526700 1 -- 172.21.15.107:0/3771623178 >> 172.21.15.107:0/3771623178 conn(0x7f6824079350 msgr2=0x7f68241063e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:37.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.941+0000 7f682b526700 1 -- 172.21.15.107:0/3771623178 shutdown_connections 2024-05-10T10:53:37.943 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:37.941+0000 7f682b526700 1 -- 172.21.15.107:0/3771623178 wait complete. 2024-05-10T10:53:38.544 INFO:teuthology.orchestra.run.smithi107.stdout:133143986244 2024-05-10T10:53:38.544 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-10T10:53:38.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.783+0000 7f450bef6700 1 -- 172.21.15.107:0/1118802182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4504102540 msgr2=0x7f450410e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:38.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.783+0000 7f450bef6700 1 --2- 172.21.15.107:0/1118802182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4504102540 0x7f450410e9b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f44fc00b0d0 tx=0x7f44fc00b3e0 comp rx=0 tx=0).stop 2024-05-10T10:53:38.785 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.783+0000 7f450bef6700 1 -- 172.21.15.107:0/1118802182 shutdown_connections 2024-05-10T10:53:38.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.783+0000 7f450bef6700 1 --2- 172.21.15.107:0/1118802182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4504107be0 0x7f4504107fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:38.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.783+0000 7f450bef6700 1 --2- 172.21.15.107:0/1118802182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4504102540 0x7f450410e9b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:38.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.783+0000 7f450bef6700 1 --2- 172.21.15.107:0/1118802182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4504101b80 0x7f4504102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:38.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.783+0000 7f450bef6700 1 -- 172.21.15.107:0/1118802182 >> 172.21.15.107:0/1118802182 conn(0x7f4504078a10 msgr2=0x7f45040ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:38.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.783+0000 7f450bef6700 1 -- 172.21.15.107:0/1118802182 shutdown_connections 2024-05-10T10:53:38.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.783+0000 7f450bef6700 1 -- 172.21.15.107:0/1118802182 wait complete. 2024-05-10T10:53:38.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.783+0000 7f450bef6700 1 Processor -- start 2024-05-10T10:53:38.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.783+0000 7f450bef6700 1 -- start start 2024-05-10T10:53:38.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f450bef6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4504101b80 0x7f450419f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:38.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f450bef6700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4504102540 0x7f450419fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:38.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f450bef6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4504107be0 0x7f4504199a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:38.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f450bef6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4504111f00 con 0x7f4504101b80 2024-05-10T10:53:38.786 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f450bef6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4504111d80 con 0x7f4504107be0 2024-05-10T10:53:38.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f450bef6700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4504112080 con 0x7f4504102540 2024-05-10T10:53:38.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f4509c92700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4504101b80 0x7f450419f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:38.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f4509c92700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4504101b80 0x7f450419f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43480/0 (socket says 172.21.15.107:43480) 2024-05-10T10:53:38.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f4509c92700 1 -- 172.21.15.107:0/1436632788 learned_addr learned my addr 172.21.15.107:0/1436632788 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:38.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f4509491700 1 --2- 172.21.15.107:0/1436632788 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4504102540 0x7f450419fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:38.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f450a493700 1 --2- 172.21.15.107:0/1436632788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4504107be0 0x7f4504199a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:38.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f4509c92700 1 -- 172.21.15.107:0/1436632788 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4504102540 msgr2=0x7f450419fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:38.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f4509c92700 1 --2- 172.21.15.107:0/1436632788 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4504102540 0x7f450419fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:38.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f4509c92700 1 -- 172.21.15.107:0/1436632788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4504107be0 msgr2=0x7f4504199a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:38.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f4509c92700 1 --2- 172.21.15.107:0/1436632788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4504107be0 0x7f4504199a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:38.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f4509c92700 1 -- 172.21.15.107:0/1436632788 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450419a1f0 con 0x7f4504101b80 2024-05-10T10:53:38.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f4509c92700 1 --2- 172.21.15.107:0/1436632788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4504101b80 0x7f450419f8d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f450000b530 tx=0x7f450000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:38.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f44faffd700 1 -- 172.21.15.107:0/1436632788 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4500015020 con 0x7f4504101b80 2024-05-10T10:53:38.787 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f44faffd700 1 -- 172.21.15.107:0/1436632788 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4500011d00 con 0x7f4504101b80 2024-05-10T10:53:38.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f450bef6700 1 -- 172.21.15.107:0/1436632788 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f450419a4e0 con 0x7f4504101b80 2024-05-10T10:53:38.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.784+0000 7f44faffd700 1 -- 172.21.15.107:0/1436632788 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4500010e40 con 0x7f4504101b80 2024-05-10T10:53:38.788 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.785+0000 7f450bef6700 1 -- 172.21.15.107:0/1436632788 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45041a67a0 con 0x7f4504101b80 2024-05-10T10:53:38.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.785+0000 7f450bef6700 1 -- 172.21.15.107:0/1436632788 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f45041007f0 con 0x7f4504101b80 2024-05-10T10:53:38.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.787+0000 7f44faffd700 1 -- 172.21.15.107:0/1436632788 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f4500018020 con 0x7f4504101b80 2024-05-10T10:53:38.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.788+0000 7f44faffd700 1 --2- 172.21.15.107:0/1436632788 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f44f00b2990 0x7f44f00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:38.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.788+0000 7f4509491700 1 --2- 172.21.15.107:0/1436632788 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f44f00b2990 0x7f44f00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:38.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.788+0000 7f44faffd700 1 -- 172.21.15.107:0/1436632788 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f45000e1ef0 con 0x7f4504101b80 2024-05-10T10:53:38.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.788+0000 7f44faffd700 1 --2- 172.21.15.107:0/1436632788 >> [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004] conn(0x7f44f00bc3d0 0x7f44f00be870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:38.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.788+0000 7f44faffd700 1 -- 172.21.15.107:0/1436632788 --> [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f450001be50 con 0x7f44f00bc3d0 2024-05-10T10:53:38.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.788+0000 7f44faffd700 1 -- 172.21.15.107:0/1436632788 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f45000e23d0 con 0x7f4504101b80 2024-05-10T10:53:38.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.788+0000 7f450a493700 1 --2- 172.21.15.107:0/1436632788 >> [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004] conn(0x7f44f00bc3d0 0x7f44f00be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:38.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.788+0000 7f4509491700 1 --2- 172.21.15.107:0/1436632788 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f44f00b2990 0x7f44f00b4e50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4504106b10 tx=0x7f44f4009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:38.789 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.788+0000 7f450a493700 1 --2- 172.21.15.107:0/1436632788 >> [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004] conn(0x7f44f00bc3d0 0x7f44f00be870 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:38.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.789+0000 7f44faffd700 1 -- 172.21.15.107:0/1436632788 <== osd.0 v2:172.21.15.107:6802/4213004004 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f450001be50 con 0x7f44f00bc3d0 2024-05-10T10:53:38.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.805+0000 7f450bef6700 1 -- 172.21.15.107:0/1436632788 --> [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f45041031e0 con 0x7f44f00bc3d0 2024-05-10T10:53:38.806 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:38 smithi107 ceph-mon[30373]: pgmap v327: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:53:38.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.806+0000 7f44faffd700 1 -- 172.21.15.107:0/1436632788 <== osd.0 v2:172.21.15.107:6802/4213004004 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f45041031e0 con 0x7f44f00bc3d0 2024-05-10T10:53:38.807 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.806+0000 7f450bef6700 1 -- 172.21.15.107:0/1436632788 >> [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004] conn(0x7f44f00bc3d0 msgr2=0x7f44f00be870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:38.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.806+0000 7f450bef6700 1 --2- 172.21.15.107:0/1436632788 >> [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004] conn(0x7f44f00bc3d0 0x7f44f00be870 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:38.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.806+0000 7f450bef6700 1 -- 172.21.15.107:0/1436632788 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f44f00b2990 msgr2=0x7f44f00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:38.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.806+0000 7f450bef6700 1 --2- 172.21.15.107:0/1436632788 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f44f00b2990 0x7f44f00b4e50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4504106b10 tx=0x7f44f4009190 comp rx=0 tx=0).stop 2024-05-10T10:53:38.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.806+0000 7f450bef6700 1 -- 172.21.15.107:0/1436632788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4504101b80 msgr2=0x7f450419f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:38.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.806+0000 7f450bef6700 1 --2- 172.21.15.107:0/1436632788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4504101b80 0x7f450419f8d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f450000b530 tx=0x7f450000b840 comp rx=0 tx=0).stop 2024-05-10T10:53:38.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.806+0000 7f450a493700 1 -- 172.21.15.107:0/1436632788 reap_dead start 2024-05-10T10:53:38.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.806+0000 7f450bef6700 1 -- 172.21.15.107:0/1436632788 shutdown_connections 2024-05-10T10:53:38.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.806+0000 7f450bef6700 1 -- 172.21.15.107:0/1436632788 >> 172.21.15.107:0/1436632788 conn(0x7f4504078a10 msgr2=0x7f45040ffd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:38.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.806+0000 7f450bef6700 1 -- 172.21.15.107:0/1436632788 shutdown_connections 2024-05-10T10:53:38.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:38.806+0000 7f450bef6700 1 -- 172.21.15.107:0/1436632788 wait complete. 2024-05-10T10:53:39.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:38 smithi196 ceph-mon[34872]: pgmap v327: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:53:39.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:38 smithi184 ceph-mon[34585]: pgmap v327: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:53:39.600 INFO:teuthology.orchestra.run.smithi107.stdout:77309411405 2024-05-10T10:53:39.601 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-10T10:53:39.946 INFO:teuthology.orchestra.run.smithi107.stdout:231928234030 2024-05-10T10:53:39.946 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-10T10:53:40.278 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:40.282 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:40.659 INFO:teuthology.orchestra.run.smithi107.stdout:34359738455 2024-05-10T10:53:40.659 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-10T10:53:40.719 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:40.719 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:40.722 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:40.724 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:40.726 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:40.727 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:40.735 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:40.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:40 smithi107 ceph-mon[30373]: pgmap v328: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-05-10T10:53:41.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:40 smithi196 ceph-mon[34872]: pgmap v328: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-05-10T10:53:41.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:40 smithi184 ceph-mon[34585]: pgmap v328: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-05-10T10:53:42.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:42 smithi107 ceph-mon[30373]: pgmap v329: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:53:43.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:42 smithi196 ceph-mon[34872]: pgmap v329: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:53:43.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:42 smithi184 ceph-mon[34585]: pgmap v329: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:53:44.886 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:44 smithi107 ceph-mon[30373]: pgmap v330: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:53:44.886 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:44 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/393264286' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-10T10:53:45.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:44 smithi196 ceph-mon[34872]: pgmap v330: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:53:45.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:44 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/393264286' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-10T10:53:45.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:44 smithi184 ceph-mon[34585]: pgmap v330: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:53:45.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:44 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/393264286' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-10T10:53:47.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:46 smithi196 ceph-mon[34872]: pgmap v331: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-10T10:53:47.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:46 smithi184 ceph-mon[34585]: pgmap v331: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-10T10:53:47.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:46 smithi107 ceph-mon[30373]: pgmap v331: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-10T10:53:47.660 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.031+0000 7f26d9c0a700 1 -- 172.21.15.107:0/64384763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26d406c590 msgr2=0x7f26d4110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:47.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.031+0000 7f26d9c0a700 1 --2- 172.21.15.107:0/64384763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26d406c590 0x7f26d4110330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00b0a0 tx=0x7f26cc00b3b0 comp rx=0 tx=0).stop 2024-05-10T10:53:47.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.031+0000 7f26d9c0a700 1 -- 172.21.15.107:0/64384763 shutdown_connections 2024-05-10T10:53:47.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.031+0000 7f26d9c0a700 1 --2- 172.21.15.107:0/64384763 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26d4109510 0x7f26d41098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:47.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.031+0000 7f26d9c0a700 1 --2- 172.21.15.107:0/64384763 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26d406c590 0x7f26d4110330 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:47.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.031+0000 7f26d9c0a700 1 --2- 172.21.15.107:0/64384763 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d406bbd0 0x7f26d406c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:47.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.031+0000 7f26d9c0a700 1 -- 172.21.15.107:0/64384763 >> 172.21.15.107:0/64384763 conn(0x7f26d4079350 msgr2=0x7f26d4079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:47.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.031+0000 7f26d9c0a700 1 -- 172.21.15.107:0/64384763 shutdown_connections 2024-05-10T10:53:47.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.031+0000 7f26d9c0a700 1 -- 172.21.15.107:0/64384763 wait complete. 2024-05-10T10:53:47.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.032+0000 7f26d9c0a700 1 Processor -- start 2024-05-10T10:53:47.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.032+0000 7f26d9c0a700 1 -- start start 2024-05-10T10:53:47.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.032+0000 7f26d9c0a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26d406bbd0 0x7f26d419f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:47.661 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d9c0a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d406c590 0x7f26d419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:47.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d9c0a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26d4109510 0x7f26d41999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:47.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d9c0a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f26d41137c0 con 0x7f26d4109510 2024-05-10T10:53:47.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d9c0a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f26d4113640 con 0x7f26d406c590 2024-05-10T10:53:47.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d9c0a700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f26d4113940 con 0x7f26d406bbd0 2024-05-10T10:53:47.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26d4109510 0x7f26d41999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:47.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26d4109510 0x7f26d41999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43496/0 (socket says 172.21.15.107:43496) 2024-05-10T10:53:47.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d3fff700 1 -- 172.21.15.107:0/393264286 learned_addr learned my addr 172.21.15.107:0/393264286 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:47.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d37fe700 1 --2- 172.21.15.107:0/393264286 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26d406bbd0 0x7f26d419f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:47.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d3fff700 1 -- 172.21.15.107:0/393264286 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26d406bbd0 msgr2=0x7f26d419f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:47.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d3fff700 1 --2- 172.21.15.107:0/393264286 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26d406bbd0 0x7f26d419f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:47.662 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d3fff700 1 -- 172.21.15.107:0/393264286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d406c590 msgr2=0x7f26d419fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:47.663 INFO:teuthology.orchestra.run.smithi107.stdout:158913790014 2024-05-10T10:53:47.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d3fff700 1 --2- 172.21.15.107:0/393264286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d406c590 0x7f26d419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:47.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d3fff700 1 -- 172.21.15.107:0/393264286 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d419a140 con 0x7f26d4109510 2024-05-10T10:53:47.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d37fe700 1 --2- 172.21.15.107:0/393264286 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26d406bbd0 0x7f26d419f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:53:47.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d3fff700 1 --2- 172.21.15.107:0/393264286 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26d4109510 0x7f26d41999e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00b830 tx=0x7f26cc007b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:47.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d0ff9700 1 -- 172.21.15.107:0/393264286 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc021020 con 0x7f26d4109510 2024-05-10T10:53:47.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d0ff9700 1 -- 172.21.15.107:0/393264286 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f26cc01db40 con 0x7f26d4109510 2024-05-10T10:53:47.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d9c0a700 1 -- 172.21.15.107:0/393264286 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d419a3d0 con 0x7f26d4109510 2024-05-10T10:53:47.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d0ff9700 1 -- 172.21.15.107:0/393264286 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc01bcf0 con 0x7f26d4109510 2024-05-10T10:53:47.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.033+0000 7f26d9c0a700 1 -- 172.21.15.107:0/393264286 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d41a66f0 con 0x7f26d4109510 2024-05-10T10:53:47.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.034+0000 7f26d9c0a700 1 -- 172.21.15.107:0/393264286 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26d406a190 con 0x7f26d4109510 2024-05-10T10:53:47.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.036+0000 7f26d0ff9700 1 -- 172.21.15.107:0/393264286 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f26cc024020 con 0x7f26d4109510 2024-05-10T10:53:47.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.037+0000 7f26d0ff9700 1 --2- 172.21.15.107:0/393264286 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f26bc0b2910 0x7f26bc0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:47.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.037+0000 7f26d37fe700 1 --2- 172.21.15.107:0/393264286 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f26bc0b2910 0x7f26bc0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:47.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.037+0000 7f26d0ff9700 1 -- 172.21.15.107:0/393264286 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f26cc00f020 con 0x7f26d4109510 2024-05-10T10:53:47.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.037+0000 7f26d37fe700 1 --2- 172.21.15.107:0/393264286 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f26bc0b2910 0x7f26bc0b4dd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f26c8005fd0 tx=0x7f26c8005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:47.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.040+0000 7f26d0ff9700 1 -- 172.21.15.107:0/393264286 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f26cc0abed0 con 0x7f26d4109510 2024-05-10T10:53:47.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.255+0000 7f26d9c0a700 1 -- 172.21.15.107:0/393264286 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f26d402e510 con 0x7f26d4109510 2024-05-10T10:53:47.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.255+0000 7f26d0ff9700 1 -- 172.21.15.107:0/393264286 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f26cc0ab7d0 con 0x7f26d4109510 2024-05-10T10:53:47.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.257+0000 7f26d9c0a700 1 -- 172.21.15.107:0/393264286 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f26bc0b2910 msgr2=0x7f26bc0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:47.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.257+0000 7f26d9c0a700 1 --2- 172.21.15.107:0/393264286 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f26bc0b2910 0x7f26bc0b4dd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f26c8005fd0 tx=0x7f26c8005d60 comp rx=0 tx=0).stop 2024-05-10T10:53:47.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.257+0000 7f26d9c0a700 1 -- 172.21.15.107:0/393264286 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26d4109510 msgr2=0x7f26d41999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:47.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.257+0000 7f26d9c0a700 1 --2- 172.21.15.107:0/393264286 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26d4109510 0x7f26d41999e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00b830 tx=0x7f26cc007b40 comp rx=0 tx=0).stop 2024-05-10T10:53:47.664 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.257+0000 7f26d9c0a700 1 -- 172.21.15.107:0/393264286 shutdown_connections 2024-05-10T10:53:47.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.257+0000 7f26d9c0a700 1 --2- 172.21.15.107:0/393264286 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f26bc0b2910 0x7f26bc0b4dd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:47.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.257+0000 7f26d9c0a700 1 --2- 172.21.15.107:0/393264286 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26d406bbd0 0x7f26d419f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:47.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.257+0000 7f26d9c0a700 1 --2- 172.21.15.107:0/393264286 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f26d4109510 0x7f26d41999e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:47.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.257+0000 7f26d9c0a700 1 --2- 172.21.15.107:0/393264286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d406c590 0x7f26d419fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:47.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.257+0000 7f26d9c0a700 1 -- 172.21.15.107:0/393264286 >> 172.21.15.107:0/393264286 conn(0x7f26d4079350 msgr2=0x7f26d4100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:47.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.257+0000 7f26d9c0a700 1 -- 172.21.15.107:0/393264286 shutdown_connections 2024-05-10T10:53:47.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:44.258+0000 7f26d9c0a700 1 -- 172.21.15.107:0/393264286 wait complete. 2024-05-10T10:53:48.239 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790011 got 158913790014 for osd.5 2024-05-10T10:53:48.239 DEBUG:teuthology.parallel:result is None 2024-05-10T10:53:48.955 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:48 smithi107 ceph-mon[30373]: pgmap v332: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:53:49.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:48 smithi196 ceph-mon[34872]: pgmap v332: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:53:49.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:48 smithi184 ceph-mon[34585]: pgmap v332: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:53:50.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.213+0000 7f1280625700 1 -- 172.21.15.107:0/1997616325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1278108850 msgr2=0x7f12781103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:50.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.213+0000 7f1280625700 1 --2- 172.21.15.107:0/1997616325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1278108850 0x7f12781103d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f127000b0d0 tx=0x7f127000b3e0 comp rx=0 tx=0).stop 2024-05-10T10:53:50.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.214+0000 7f1280625700 1 -- 172.21.15.107:0/1997616325 shutdown_connections 2024-05-10T10:53:50.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.214+0000 7f1280625700 1 --2- 172.21.15.107:0/1997616325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1278103750 0x7f1278103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:50.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.214+0000 7f1280625700 1 --2- 172.21.15.107:0/1997616325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1278108850 0x7f12781103d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:50.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.214+0000 7f1280625700 1 --2- 172.21.15.107:0/1997616325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1278104100 0x7f1278108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:50.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.214+0000 7f1280625700 1 -- 172.21.15.107:0/1997616325 >> 172.21.15.107:0/1997616325 conn(0x7f127807a600 msgr2=0x7f127807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:50.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.214+0000 7f1280625700 1 -- 172.21.15.107:0/1997616325 shutdown_connections 2024-05-10T10:53:50.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.214+0000 7f1280625700 1 -- 172.21.15.107:0/1997616325 wait complete. 2024-05-10T10:53:50.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.214+0000 7f1280625700 1 Processor -- start 2024-05-10T10:53:50.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.214+0000 7f1280625700 1 -- start start 2024-05-10T10:53:50.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.214+0000 7f1280625700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1278103750 0x7f127819f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:50.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.214+0000 7f1280625700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1278104100 0x7f127819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:50.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.214+0000 7f1280625700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1278108850 0x7f1278199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:50.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.214+0000 7f1280625700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1278113790 con 0x7f1278103750 2024-05-10T10:53:50.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.214+0000 7f1280625700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1278113610 con 0x7f1278104100 2024-05-10T10:53:50.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.214+0000 7f1280625700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1278113910 con 0x7f1278108850 2024-05-10T10:53:50.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.215+0000 7f127e3c1700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1278103750 0x7f127819f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:50.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.215+0000 7f127e3c1700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1278103750 0x7f127819f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57576/0 (socket says 172.21.15.107:57576) 2024-05-10T10:53:50.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.215+0000 7f127e3c1700 1 -- 172.21.15.107:0/3354422429 learned_addr learned my addr 172.21.15.107:0/3354422429 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:50.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.215+0000 7f127ebc2700 1 --2- 172.21.15.107:0/3354422429 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1278108850 0x7f1278199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:50.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.215+0000 7f127dbc0700 1 --2- 172.21.15.107:0/3354422429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1278104100 0x7f127819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:50.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.215+0000 7f127e3c1700 1 -- 172.21.15.107:0/3354422429 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1278108850 msgr2=0x7f1278199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:50.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.215+0000 7f127e3c1700 1 --2- 172.21.15.107:0/3354422429 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1278108850 0x7f1278199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:50.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.215+0000 7f127e3c1700 1 -- 172.21.15.107:0/3354422429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1278104100 msgr2=0x7f127819fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:50.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.215+0000 7f127e3c1700 1 --2- 172.21.15.107:0/3354422429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1278104100 0x7f127819fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:50.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.215+0000 7f127e3c1700 1 -- 172.21.15.107:0/3354422429 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127819a0d0 con 0x7f1278103750 2024-05-10T10:53:50.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.215+0000 7f127e3c1700 1 --2- 172.21.15.107:0/3354422429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1278103750 0x7f127819f7b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f127400c920 tx=0x7f127400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:50.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.215+0000 7f126f7fe700 1 -- 172.21.15.107:0/3354422429 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274004a30 con 0x7f1278103750 2024-05-10T10:53:50.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.215+0000 7f126f7fe700 1 -- 172.21.15.107:0/3354422429 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f12740054f0 con 0x7f1278103750 2024-05-10T10:53:50.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.215+0000 7f1280625700 1 -- 172.21.15.107:0/3354422429 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f127819a3c0 con 0x7f1278103750 2024-05-10T10:53:50.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.215+0000 7f126f7fe700 1 -- 172.21.15.107:0/3354422429 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274007cd0 con 0x7f1278103750 2024-05-10T10:53:50.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.215+0000 7f1280625700 1 -- 172.21.15.107:0/3354422429 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12781a6680 con 0x7f1278103750 2024-05-10T10:53:50.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.216+0000 7f1280625700 1 -- 172.21.15.107:0/3354422429 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f127806a190 con 0x7f1278103750 2024-05-10T10:53:50.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.218+0000 7f126f7fe700 1 -- 172.21.15.107:0/3354422429 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f1274004eb0 con 0x7f1278103750 2024-05-10T10:53:50.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.218+0000 7f126f7fe700 1 --2- 172.21.15.107:0/3354422429 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f12640b2910 0x7f12640b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:50.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.218+0000 7f127dbc0700 1 --2- 172.21.15.107:0/3354422429 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f12640b2910 0x7f12640b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:50.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.218+0000 7f126f7fe700 1 -- 172.21.15.107:0/3354422429 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f12740e21c0 con 0x7f1278103750 2024-05-10T10:53:50.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.219+0000 7f127dbc0700 1 --2- 172.21.15.107:0/3354422429 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f12640b2910 0x7f12640b4dd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1278109ce0 tx=0x7f126800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:50.222 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.222+0000 7f126f7fe700 1 -- 172.21.15.107:0/3354422429 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f1274014030 con 0x7f1278103750 2024-05-10T10:53:50.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.431+0000 7f1280625700 1 -- 172.21.15.107:0/3354422429 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f127819aea0 con 0x7f1278103750 2024-05-10T10:53:50.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.431+0000 7f126f7fe700 1 -- 172.21.15.107:0/3354422429 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f12740a9e80 con 0x7f1278103750 2024-05-10T10:53:50.432 INFO:teuthology.orchestra.run.smithi107.stdout:283467841576 2024-05-10T10:53:50.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.433+0000 7f1280625700 1 -- 172.21.15.107:0/3354422429 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f12640b2910 msgr2=0x7f12640b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:50.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.433+0000 7f1280625700 1 --2- 172.21.15.107:0/3354422429 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f12640b2910 0x7f12640b4dd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1278109ce0 tx=0x7f126800a380 comp rx=0 tx=0).stop 2024-05-10T10:53:50.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.433+0000 7f1280625700 1 -- 172.21.15.107:0/3354422429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1278103750 msgr2=0x7f127819f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:50.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.433+0000 7f1280625700 1 --2- 172.21.15.107:0/3354422429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1278103750 0x7f127819f7b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f127400c920 tx=0x7f127400cc30 comp rx=0 tx=0).stop 2024-05-10T10:53:50.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.433+0000 7f1280625700 1 -- 172.21.15.107:0/3354422429 shutdown_connections 2024-05-10T10:53:50.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.433+0000 7f1280625700 1 --2- 172.21.15.107:0/3354422429 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f12640b2910 0x7f12640b4dd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:50.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.433+0000 7f1280625700 1 --2- 172.21.15.107:0/3354422429 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1278108850 0x7f1278199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:50.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.433+0000 7f1280625700 1 --2- 172.21.15.107:0/3354422429 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1278103750 0x7f127819f7b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:50.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.433+0000 7f1280625700 1 --2- 172.21.15.107:0/3354422429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1278104100 0x7f127819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:50.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.433+0000 7f1280625700 1 -- 172.21.15.107:0/3354422429 >> 172.21.15.107:0/3354422429 conn(0x7f127807a600 msgr2=0x7f12781015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:50.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.433+0000 7f1280625700 1 -- 172.21.15.107:0/3354422429 shutdown_connections 2024-05-10T10:53:50.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:50.433+0000 7f1280625700 1 -- 172.21.15.107:0/3354422429 wait complete. 2024-05-10T10:53:51.035 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:50 smithi107 ceph-mon[30373]: pgmap v333: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:53:51.035 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:50 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3354422429' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-10T10:53:51.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:50 smithi196 ceph-mon[34872]: pgmap v333: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:53:51.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:50 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3354422429' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-10T10:53:51.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:50 smithi184 ceph-mon[34585]: pgmap v333: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:53:51.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:50 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3354422429' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-10T10:53:51.238 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:51.695 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.694+0000 7f641f30f700 1 -- 172.21.15.107:0/1691871037 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f641806b180 msgr2=0x7f641806b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:51.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.694+0000 7f641f30f700 1 --2- 172.21.15.107:0/1691871037 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f641806b180 0x7f641806b600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6408009990 tx=0x7f6408009ca0 comp rx=0 tx=0).stop 2024-05-10T10:53:51.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.694+0000 7f641f30f700 1 -- 172.21.15.107:0/1691871037 shutdown_connections 2024-05-10T10:53:51.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.694+0000 7f641f30f700 1 --2- 172.21.15.107:0/1691871037 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f641806bb40 0x7f6418110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:51.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.694+0000 7f641f30f700 1 --2- 172.21.15.107:0/1691871037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6418109510 0x7f64181098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:51.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.694+0000 7f641f30f700 1 --2- 172.21.15.107:0/1691871037 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f641806b180 0x7f641806b600 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:51.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.694+0000 7f641f30f700 1 -- 172.21.15.107:0/1691871037 >> 172.21.15.107:0/1691871037 conn(0x7f6418079350 msgr2=0x7f6418079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:51.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.695+0000 7f641f30f700 1 -- 172.21.15.107:0/1691871037 shutdown_connections 2024-05-10T10:53:51.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.695+0000 7f641f30f700 1 -- 172.21.15.107:0/1691871037 wait complete. 2024-05-10T10:53:51.696 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.695+0000 7f641f30f700 1 Processor -- start 2024-05-10T10:53:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.695+0000 7f641f30f700 1 -- start start 2024-05-10T10:53:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.695+0000 7f641f30f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f641806b180 0x7f641819f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.695+0000 7f641f30f700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f641806bb40 0x7f641819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.695+0000 7f641f30f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6418109510 0x7f6418199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.695+0000 7f641f30f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f64181137c0 con 0x7f641806b180 2024-05-10T10:53:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.695+0000 7f641f30f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6418113640 con 0x7f6418109510 2024-05-10T10:53:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.695+0000 7f641f30f700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6418113940 con 0x7f641806bb40 2024-05-10T10:53:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.696+0000 7f641d0ab700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f641806b180 0x7f641819f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.696+0000 7f641d0ab700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f641806b180 0x7f641819f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57594/0 (socket says 172.21.15.107:57594) 2024-05-10T10:53:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.696+0000 7f641d0ab700 1 -- 172.21.15.107:0/433707504 learned_addr learned my addr 172.21.15.107:0/433707504 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.696+0000 7f641c8aa700 1 --2- 172.21.15.107:0/433707504 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f641806bb40 0x7f641819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:51.698 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.696+0000 7f641d8ac700 1 --2- 172.21.15.107:0/433707504 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6418109510 0x7f6418199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:51.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.696+0000 7f641d0ab700 1 -- 172.21.15.107:0/433707504 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f641806bb40 msgr2=0x7f641819fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:51.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.696+0000 7f641d0ab700 1 --2- 172.21.15.107:0/433707504 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f641806bb40 0x7f641819fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:51.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.696+0000 7f641d0ab700 1 -- 172.21.15.107:0/433707504 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6418109510 msgr2=0x7f6418199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:51.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.696+0000 7f641d0ab700 1 --2- 172.21.15.107:0/433707504 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6418109510 0x7f6418199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:51.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.696+0000 7f641d0ab700 1 -- 172.21.15.107:0/433707504 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641819a1e0 con 0x7f641806b180 2024-05-10T10:53:51.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.696+0000 7f641d0ab700 1 --2- 172.21.15.107:0/433707504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f641806b180 0x7f641819f8c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f641400d950 tx=0x7f641400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:51.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.696+0000 7f640e7fc700 1 -- 172.21.15.107:0/433707504 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6414016070 con 0x7f641806b180 2024-05-10T10:53:51.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.696+0000 7f640e7fc700 1 -- 172.21.15.107:0/433707504 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f641400fd60 con 0x7f641806b180 2024-05-10T10:53:51.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.696+0000 7f641f30f700 1 -- 172.21.15.107:0/433707504 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641819a4d0 con 0x7f641806b180 2024-05-10T10:53:51.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.696+0000 7f640e7fc700 1 -- 172.21.15.107:0/433707504 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641400e610 con 0x7f641806b180 2024-05-10T10:53:51.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.696+0000 7f641f30f700 1 -- 172.21.15.107:0/433707504 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64181a6790 con 0x7f641806b180 2024-05-10T10:53:51.699 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.697+0000 7f641f30f700 1 -- 172.21.15.107:0/433707504 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f641806a190 con 0x7f641806b180 2024-05-10T10:53:51.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.699+0000 7f640e7fc700 1 -- 172.21.15.107:0/433707504 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f6414019070 con 0x7f641806b180 2024-05-10T10:53:51.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.699+0000 7f640e7fc700 1 --2- 172.21.15.107:0/433707504 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f64040b2990 0x7f64040b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:51.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.699+0000 7f641c8aa700 1 --2- 172.21.15.107:0/433707504 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f64040b2990 0x7f64040b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:51.700 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.699+0000 7f640e7fc700 1 -- 172.21.15.107:0/433707504 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f64140e1c00 con 0x7f641806b180 2024-05-10T10:53:51.701 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.700+0000 7f641c8aa700 1 --2- 172.21.15.107:0/433707504 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f64040b2990 0x7f64040b4e50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f64080098e0 tx=0x7f6408005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:51.703 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.703+0000 7f640e7fc700 1 -- 172.21.15.107:0/433707504 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f64140a98c0 con 0x7f641806b180 2024-05-10T10:53:51.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.910+0000 7f641f30f700 1 -- 172.21.15.107:0/433707504 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f641802e510 con 0x7f641806b180 2024-05-10T10:53:51.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.910+0000 7f640e7fc700 1 -- 172.21.15.107:0/433707504 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f64140a91c0 con 0x7f641806b180 2024-05-10T10:53:51.911 INFO:teuthology.orchestra.run.smithi107.stdout:133143986246 2024-05-10T10:53:51.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.913+0000 7f641f30f700 1 -- 172.21.15.107:0/433707504 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f64040b2990 msgr2=0x7f64040b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:51.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.913+0000 7f641f30f700 1 --2- 172.21.15.107:0/433707504 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f64040b2990 0x7f64040b4e50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f64080098e0 tx=0x7f6408005960 comp rx=0 tx=0).stop 2024-05-10T10:53:51.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.913+0000 7f641f30f700 1 -- 172.21.15.107:0/433707504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f641806b180 msgr2=0x7f641819f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:51.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.913+0000 7f641f30f700 1 --2- 172.21.15.107:0/433707504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f641806b180 0x7f641819f8c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f641400d950 tx=0x7f641400dc60 comp rx=0 tx=0).stop 2024-05-10T10:53:51.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.913+0000 7f641f30f700 1 -- 172.21.15.107:0/433707504 shutdown_connections 2024-05-10T10:53:51.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.913+0000 7f641f30f700 1 --2- 172.21.15.107:0/433707504 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f64040b2990 0x7f64040b4e50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:51.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.913+0000 7f641f30f700 1 --2- 172.21.15.107:0/433707504 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6418109510 0x7f6418199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:51.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.913+0000 7f641f30f700 1 --2- 172.21.15.107:0/433707504 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f641806b180 0x7f641819f8c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:51.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.913+0000 7f641f30f700 1 --2- 172.21.15.107:0/433707504 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f641806bb40 0x7f641819fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:51.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.913+0000 7f641f30f700 1 -- 172.21.15.107:0/433707504 >> 172.21.15.107:0/433707504 conn(0x7f6418079350 msgr2=0x7f6418101090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:51.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.913+0000 7f641f30f700 1 -- 172.21.15.107:0/433707504 shutdown_connections 2024-05-10T10:53:51.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:51.913+0000 7f641f30f700 1 -- 172.21.15.107:0/433707504 wait complete. 2024-05-10T10:53:52.081 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:53:52.816 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:52 smithi107 ceph-mon[30373]: pgmap v334: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:53:52.816 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:52 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/433707504' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-10T10:53:53.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:52 smithi196 ceph-mon[34872]: pgmap v334: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:53:53.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:52 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/433707504' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-10T10:53:53.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:52 smithi184 ceph-mon[34585]: pgmap v334: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:53:53.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:52 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/433707504' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-10T10:53:53.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.751+0000 7f1dc43af700 1 -- 172.21.15.107:0/2874323983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dbc1037b0 msgr2=0x7f1dbc107030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:53.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.751+0000 7f1dc43af700 1 --2- 172.21.15.107:0/2874323983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dbc1037b0 0x7f1dbc107030 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1dac0099c0 tx=0x7f1dac009cd0 comp rx=0 tx=0).stop 2024-05-10T10:53:53.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.751+0000 7f1dc43af700 1 -- 172.21.15.107:0/2874323983 shutdown_connections 2024-05-10T10:53:53.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.751+0000 7f1dc43af700 1 --2- 172.21.15.107:0/2874323983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dbc107760 0x7f1dbc10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:53.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.751+0000 7f1dc43af700 1 --2- 172.21.15.107:0/2874323983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dbc102e00 0x7f1dbc1031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:53.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.751+0000 7f1dc43af700 1 --2- 172.21.15.107:0/2874323983 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dbc1037b0 0x7f1dbc107030 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:53.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.751+0000 7f1dc43af700 1 -- 172.21.15.107:0/2874323983 >> 172.21.15.107:0/2874323983 conn(0x7f1dbc078a10 msgr2=0x7f1dbc0ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:53.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.751+0000 7f1dc43af700 1 -- 172.21.15.107:0/2874323983 shutdown_connections 2024-05-10T10:53:53.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.751+0000 7f1dc43af700 1 -- 172.21.15.107:0/2874323983 wait complete. 2024-05-10T10:53:53.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.752+0000 7f1dc43af700 1 Processor -- start 2024-05-10T10:53:53.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.752+0000 7f1dc43af700 1 -- start start 2024-05-10T10:53:53.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.752+0000 7f1dc43af700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dbc102e00 0x7f1dbc0fde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:53.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.752+0000 7f1dc43af700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dbc1037b0 0x7f1dbc0fe3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:53.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.752+0000 7f1dc43af700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dbc107760 0x7f1dbc0fe900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:53.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.752+0000 7f1dc214b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dbc102e00 0x7f1dbc0fde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:53.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.752+0000 7f1dc214b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dbc102e00 0x7f1dbc0fde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57600/0 (socket says 172.21.15.107:57600) 2024-05-10T10:53:53.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.752+0000 7f1dc214b700 1 -- 172.21.15.107:0/478424218 learned_addr learned my addr 172.21.15.107:0/478424218 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:53.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.752+0000 7f1dc43af700 1 -- 172.21.15.107:0/478424218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc112760 con 0x7f1dbc102e00 2024-05-10T10:53:53.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.752+0000 7f1dc43af700 1 -- 172.21.15.107:0/478424218 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc1125e0 con 0x7f1dbc107760 2024-05-10T10:53:53.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.752+0000 7f1dc43af700 1 -- 172.21.15.107:0/478424218 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc1128e0 con 0x7f1dbc1037b0 2024-05-10T10:53:53.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.752+0000 7f1dc194a700 1 --2- 172.21.15.107:0/478424218 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dbc1037b0 0x7f1dbc0fe3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:53.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.752+0000 7f1dc214b700 1 -- 172.21.15.107:0/478424218 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dbc1037b0 msgr2=0x7f1dbc0fe3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:53.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.752+0000 7f1dc214b700 1 --2- 172.21.15.107:0/478424218 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dbc1037b0 0x7f1dbc0fe3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:53.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.752+0000 7f1dc214b700 1 -- 172.21.15.107:0/478424218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dbc107760 msgr2=0x7f1dbc0fe900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:53.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.752+0000 7f1dc214b700 1 --2- 172.21.15.107:0/478424218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dbc107760 0x7f1dbc0fe900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:53.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.752+0000 7f1dc214b700 1 -- 172.21.15.107:0/478424218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dbc1a8190 con 0x7f1dbc102e00 2024-05-10T10:53:53.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.753+0000 7f1dc214b700 1 --2- 172.21.15.107:0/478424218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dbc102e00 0x7f1dbc0fde80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1db800b530 tx=0x7f1db800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:53.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.753+0000 7f1db37fe700 1 -- 172.21.15.107:0/478424218 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8015020 con 0x7f1dbc102e00 2024-05-10T10:53:53.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.753+0000 7f1db37fe700 1 -- 172.21.15.107:0/478424218 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1db8011d00 con 0x7f1dbc102e00 2024-05-10T10:53:53.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.753+0000 7f1dc43af700 1 -- 172.21.15.107:0/478424218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dbc1a8480 con 0x7f1dbc102e00 2024-05-10T10:53:53.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.753+0000 7f1db37fe700 1 -- 172.21.15.107:0/478424218 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8010e60 con 0x7f1dbc102e00 2024-05-10T10:53:53.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.753+0000 7f1dc43af700 1 -- 172.21.15.107:0/478424218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dbc1a8990 con 0x7f1dbc102e00 2024-05-10T10:53:53.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.754+0000 7f1dc43af700 1 -- 172.21.15.107:0/478424218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dbc0ff360 con 0x7f1dbc102e00 2024-05-10T10:53:53.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.755+0000 7f1db37fe700 1 -- 172.21.15.107:0/478424218 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f1db8018020 con 0x7f1dbc102e00 2024-05-10T10:53:53.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.756+0000 7f1db37fe700 1 --2- 172.21.15.107:0/478424218 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1da80b2910 0x7f1da80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:53.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.756+0000 7f1dc194a700 1 --2- 172.21.15.107:0/478424218 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1da80b2910 0x7f1da80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:53.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.756+0000 7f1db37fe700 1 -- 172.21.15.107:0/478424218 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f1db80e1f40 con 0x7f1dbc102e00 2024-05-10T10:53:53.757 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.756+0000 7f1dc194a700 1 --2- 172.21.15.107:0/478424218 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1da80b2910 0x7f1da80b4dd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0ff8c0 tx=0x7f1dac005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:53.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.759+0000 7f1db37fe700 1 -- 172.21.15.107:0/478424218 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f1db801f020 con 0x7f1dbc102e00 2024-05-10T10:53:53.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.962+0000 7f0af6d33700 1 -- 172.21.15.107:0/2094095355 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0af0109510 msgr2=0x7f0af01098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:53.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.962+0000 7f0af6d33700 1 --2- 172.21.15.107:0/2094095355 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0af0109510 0x7f0af01098f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000b0a0 tx=0x7f0ae000b3b0 comp rx=0 tx=0).stop 2024-05-10T10:53:53.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.962+0000 7f0af6d33700 1 -- 172.21.15.107:0/2094095355 shutdown_connections 2024-05-10T10:53:53.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.962+0000 7f0af6d33700 1 --2- 172.21.15.107:0/2094095355 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0af006bb40 0x7f0af0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:53.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.962+0000 7f0af6d33700 1 --2- 172.21.15.107:0/2094095355 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0af0109510 0x7f0af01098f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:53.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.962+0000 7f0af6d33700 1 --2- 172.21.15.107:0/2094095355 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0af006b180 0x7f0af006b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:53.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.962+0000 7f0af6d33700 1 -- 172.21.15.107:0/2094095355 >> 172.21.15.107:0/2094095355 conn(0x7f0af0079350 msgr2=0x7f0af0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:53.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.962+0000 7f0af6d33700 1 -- 172.21.15.107:0/2094095355 shutdown_connections 2024-05-10T10:53:53.963 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.962+0000 7f0af6d33700 1 -- 172.21.15.107:0/2094095355 wait complete. 2024-05-10T10:53:53.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.963+0000 7f0af6d33700 1 Processor -- start 2024-05-10T10:53:53.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.963+0000 7f0af6d33700 1 -- start start 2024-05-10T10:53:53.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.963+0000 7f0af6d33700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0af006b180 0x7f0af0102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:53.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.963+0000 7f0af6d33700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0af006bb40 0x7f0af01029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:53.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.963+0000 7f0af6d33700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0af0109510 0x7f0af0102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:53.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.963+0000 7f0af4acf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0af006b180 0x7f0af0102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:53.965 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.963+0000 7f0af6d33700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0af0113770 con 0x7f0af006b180 2024-05-10T10:53:53.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.963+0000 7f0af6d33700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0af01135f0 con 0x7f0af0109510 2024-05-10T10:53:53.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.963+0000 7f0af6d33700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0af01138f0 con 0x7f0af006bb40 2024-05-10T10:53:53.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.963+0000 7f0af4acf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0af006b180 0x7f0af0102470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57628/0 (socket says 172.21.15.107:57628) 2024-05-10T10:53:53.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.964+0000 7f0af4acf700 1 -- 172.21.15.107:0/3958720707 learned_addr learned my addr 172.21.15.107:0/3958720707 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:53.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.964+0000 7f0aeffff700 1 --2- 172.21.15.107:0/3958720707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0af006bb40 0x7f0af01029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:53.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.964+0000 7f0af52d0700 1 --2- 172.21.15.107:0/3958720707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0af0109510 0x7f0af0102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:53.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.964+0000 7f0af4acf700 1 -- 172.21.15.107:0/3958720707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0af006bb40 msgr2=0x7f0af01029b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:53.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.964+0000 7f0af4acf700 1 --2- 172.21.15.107:0/3958720707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0af006bb40 0x7f0af01029b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:53.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.964+0000 7f0af4acf700 1 -- 172.21.15.107:0/3958720707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0af0109510 msgr2=0x7f0af0102ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:53.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.964+0000 7f0af4acf700 1 --2- 172.21.15.107:0/3958720707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0af0109510 0x7f0af0102ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:53.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.964+0000 7f0af4acf700 1 -- 172.21.15.107:0/3958720707 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af01a8190 con 0x7f0af006b180 2024-05-10T10:53:53.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.964+0000 7f0af52d0700 1 --2- 172.21.15.107:0/3958720707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0af0109510 0x7f0af0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:53:53.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.964+0000 7f0aeffff700 1 --2- 172.21.15.107:0/3958720707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0af006bb40 0x7f0af01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:53:53.966 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.964+0000 7f0af4acf700 1 --2- 172.21.15.107:0/3958720707 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0af006b180 0x7f0af0102470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000b070 tx=0x7f0ae0004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:53.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.964+0000 7f0aedffb700 1 -- 172.21.15.107:0/3958720707 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0021070 con 0x7f0af006b180 2024-05-10T10:53:53.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.965+0000 7f0aedffb700 1 -- 172.21.15.107:0/3958720707 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0ae0007b80 con 0x7f0af006b180 2024-05-10T10:53:53.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.965+0000 7f0aedffb700 1 -- 172.21.15.107:0/3958720707 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae00052a0 con 0x7f0af006b180 2024-05-10T10:53:53.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.965+0000 7f0af6d33700 1 -- 172.21.15.107:0/3958720707 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af01a8420 con 0x7f0af006b180 2024-05-10T10:53:53.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.965+0000 7f0af6d33700 1 -- 172.21.15.107:0/3958720707 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af01a8880 con 0x7f0af006b180 2024-05-10T10:53:53.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.966+0000 7f0af6d33700 1 -- 172.21.15.107:0/3958720707 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0af010b9f0 con 0x7f0af006b180 2024-05-10T10:53:53.968 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.968+0000 7f0aedffb700 1 -- 172.21.15.107:0/3958720707 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f0ae0024070 con 0x7f0af006b180 2024-05-10T10:53:53.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.968+0000 7f0aedffb700 1 --2- 172.21.15.107:0/3958720707 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0adc0b2990 0x7f0adc0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:53.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.968+0000 7f0aedffb700 1 -- 172.21.15.107:0/3958720707 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f0ae000f020 con 0x7f0af006b180 2024-05-10T10:53:53.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.969+0000 7f0aeffff700 1 --2- 172.21.15.107:0/3958720707 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0adc0b2990 0x7f0adc0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:53.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.969+0000 7f0aeffff700 1 --2- 172.21.15.107:0/3958720707 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0adc0b2990 0x7f0adc0b4e50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0af00799c0 tx=0x7f0ad8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:53.974 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.974+0000 7f0aedffb700 1 -- 172.21.15.107:0/3958720707 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0ae002b020 con 0x7f0af006b180 2024-05-10T10:53:53.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.979+0000 7f1dc43af700 1 -- 172.21.15.107:0/478424218 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1dbc02e510 con 0x7f1dbc102e00 2024-05-10T10:53:53.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.979+0000 7f1db37fe700 1 -- 172.21.15.107:0/478424218 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1db80a9d10 con 0x7f1dbc102e00 2024-05-10T10:53:53.979 INFO:teuthology.orchestra.run.smithi107.stdout:77309411408 2024-05-10T10:53:53.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.981+0000 7f1dc43af700 1 -- 172.21.15.107:0/478424218 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1da80b2910 msgr2=0x7f1da80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:53.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.981+0000 7f1dc43af700 1 --2- 172.21.15.107:0/478424218 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1da80b2910 0x7f1da80b4dd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0ff8c0 tx=0x7f1dac005fb0 comp rx=0 tx=0).stop 2024-05-10T10:53:53.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.981+0000 7f1dc43af700 1 -- 172.21.15.107:0/478424218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dbc102e00 msgr2=0x7f1dbc0fde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:53.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.981+0000 7f1dc43af700 1 --2- 172.21.15.107:0/478424218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dbc102e00 0x7f1dbc0fde80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1db800b530 tx=0x7f1db800b8f0 comp rx=0 tx=0).stop 2024-05-10T10:53:53.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.981+0000 7f1dc43af700 1 -- 172.21.15.107:0/478424218 shutdown_connections 2024-05-10T10:53:53.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.981+0000 7f1dc43af700 1 --2- 172.21.15.107:0/478424218 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1da80b2910 0x7f1da80b4dd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:53.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.981+0000 7f1dc43af700 1 --2- 172.21.15.107:0/478424218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dbc107760 0x7f1dbc0fe900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:53.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.981+0000 7f1dc43af700 1 --2- 172.21.15.107:0/478424218 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dbc102e00 0x7f1dbc0fde80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:53.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.981+0000 7f1dc43af700 1 --2- 172.21.15.107:0/478424218 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1dbc1037b0 0x7f1dbc0fe3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:53.982 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.981+0000 7f1dc43af700 1 -- 172.21.15.107:0/478424218 >> 172.21.15.107:0/478424218 conn(0x7f1dbc078a10 msgr2=0x7f1dbc101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:53.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.981+0000 7f1dc43af700 1 -- 172.21.15.107:0/478424218 shutdown_connections 2024-05-10T10:53:53.983 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:53.981+0000 7f1dc43af700 1 -- 172.21.15.107:0/478424218 wait complete. 2024-05-10T10:53:54.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:54.192+0000 7f0af6d33700 1 -- 172.21.15.107:0/3958720707 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0af010b3d0 con 0x7f0af006b180 2024-05-10T10:53:54.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:54.193+0000 7f0aedffb700 1 -- 172.21.15.107:0/3958720707 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0ae00ab860 con 0x7f0af006b180 2024-05-10T10:53:54.194 INFO:teuthology.orchestra.run.smithi107.stdout:184683593788 2024-05-10T10:53:54.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:54.195+0000 7f0af6d33700 1 -- 172.21.15.107:0/3958720707 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0adc0b2990 msgr2=0x7f0adc0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:54.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:54.195+0000 7f0af6d33700 1 --2- 172.21.15.107:0/3958720707 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0adc0b2990 0x7f0adc0b4e50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0af00799c0 tx=0x7f0ad8009260 comp rx=0 tx=0).stop 2024-05-10T10:53:54.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:54.195+0000 7f0af6d33700 1 -- 172.21.15.107:0/3958720707 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0af006b180 msgr2=0x7f0af0102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:54.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:54.195+0000 7f0af6d33700 1 --2- 172.21.15.107:0/3958720707 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0af006b180 0x7f0af0102470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000b070 tx=0x7f0ae0004d00 comp rx=0 tx=0).stop 2024-05-10T10:53:54.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:54.195+0000 7f0af6d33700 1 -- 172.21.15.107:0/3958720707 shutdown_connections 2024-05-10T10:53:54.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:54.195+0000 7f0af6d33700 1 --2- 172.21.15.107:0/3958720707 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0adc0b2990 0x7f0adc0b4e50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:54.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:54.195+0000 7f0af6d33700 1 --2- 172.21.15.107:0/3958720707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0af0109510 0x7f0af0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:54.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:54.195+0000 7f0af6d33700 1 --2- 172.21.15.107:0/3958720707 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0af006b180 0x7f0af0102470 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:54.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:54.195+0000 7f0af6d33700 1 --2- 172.21.15.107:0/3958720707 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0af006bb40 0x7f0af01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:54.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:54.195+0000 7f0af6d33700 1 -- 172.21.15.107:0/3958720707 >> 172.21.15.107:0/3958720707 conn(0x7f0af0079350 msgr2=0x7f0af0101060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:54.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:54.195+0000 7f0af6d33700 1 -- 172.21.15.107:0/3958720707 shutdown_connections 2024-05-10T10:53:54.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:54.195+0000 7f0af6d33700 1 -- 172.21.15.107:0/3958720707 wait complete. 2024-05-10T10:53:54.732 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986244 got 133143986246 for osd.4 2024-05-10T10:53:54.733 DEBUG:teuthology.parallel:result is None 2024-05-10T10:53:54.969 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:54 smithi107 ceph-mon[30373]: pgmap v335: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:53:54.969 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:54 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/478424218' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-10T10:53:54.969 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:54 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3958720707' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-10T10:53:55.067 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:54 smithi196 ceph-mon[34872]: pgmap v335: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:53:55.067 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:54 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/478424218' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-10T10:53:55.067 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:54 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3958720707' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-10T10:53:55.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:54 smithi184 ceph-mon[34585]: pgmap v335: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:53:55.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:54 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/478424218' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-10T10:53:55.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:54 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3958720707' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-10T10:53:56.325 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841573 got 283467841576 for osd.10 2024-05-10T10:53:56.325 DEBUG:teuthology.parallel:result is None 2024-05-10T10:53:56.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.498+0000 7f27991fe700 1 -- 172.21.15.107:0/3277470907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2794103560 msgr2=0x7f27941039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:56.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.498+0000 7f27991fe700 1 --2- 172.21.15.107:0/3277470907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2794103560 0x7f27941039e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f277c0099c0 tx=0x7f277c009cd0 comp rx=0 tx=0).stop 2024-05-10T10:53:56.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.498+0000 7f27991fe700 1 -- 172.21.15.107:0/3277470907 shutdown_connections 2024-05-10T10:53:56.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.498+0000 7f27991fe700 1 --2- 172.21.15.107:0/3277470907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2794103f20 0x7f2794110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:56.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.498+0000 7f27991fe700 1 --2- 172.21.15.107:0/3277470907 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2794109540 0x7f2794109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:56.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.498+0000 7f27991fe700 1 --2- 172.21.15.107:0/3277470907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2794103560 0x7f27941039e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:56.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.498+0000 7f27991fe700 1 -- 172.21.15.107:0/3277470907 >> 172.21.15.107:0/3277470907 conn(0x7f279407a660 msgr2=0x7f279407aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:56.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.498+0000 7f27991fe700 1 -- 172.21.15.107:0/3277470907 shutdown_connections 2024-05-10T10:53:56.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.498+0000 7f27991fe700 1 -- 172.21.15.107:0/3277470907 wait complete. 2024-05-10T10:53:56.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.499+0000 7f27991fe700 1 Processor -- start 2024-05-10T10:53:56.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.499+0000 7f27991fe700 1 -- start start 2024-05-10T10:53:56.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.499+0000 7f27991fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2794103560 0x7f27940757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:56.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.499+0000 7f27991fe700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2794103f20 0x7f2794075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:56.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.499+0000 7f27991fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2794109540 0x7f2794076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:56.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.499+0000 7f27991fe700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2794113860 con 0x7f2794103560 2024-05-10T10:53:56.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.499+0000 7f27991fe700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f27941136e0 con 0x7f2794109540 2024-05-10T10:53:56.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.499+0000 7f27991fe700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f27941139e0 con 0x7f2794103f20 2024-05-10T10:53:56.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.499+0000 7f2792d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2794103560 0x7f27940757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:56.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.499+0000 7f2792d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2794103560 0x7f27940757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:57646/0 (socket says 172.21.15.107:57646) 2024-05-10T10:53:56.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.499+0000 7f2792d9d700 1 -- 172.21.15.107:0/3390656848 learned_addr learned my addr 172.21.15.107:0/3390656848 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:56.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.499+0000 7f278bfff700 1 --2- 172.21.15.107:0/3390656848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2794103f20 0x7f2794075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:56.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.499+0000 7f279359e700 1 --2- 172.21.15.107:0/3390656848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2794109540 0x7f2794076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:56.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.499+0000 7f2792d9d700 1 -- 172.21.15.107:0/3390656848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2794103f20 msgr2=0x7f2794075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:56.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.499+0000 7f2792d9d700 1 --2- 172.21.15.107:0/3390656848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2794103f20 0x7f2794075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:56.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.499+0000 7f2792d9d700 1 -- 172.21.15.107:0/3390656848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2794109540 msgr2=0x7f2794076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:56.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.499+0000 7f2792d9d700 1 --2- 172.21.15.107:0/3390656848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2794109540 0x7f2794076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:56.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.499+0000 7f2792d9d700 1 -- 172.21.15.107:0/3390656848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27941a81b0 con 0x7f2794103560 2024-05-10T10:53:56.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.500+0000 7f278bfff700 1 --2- 172.21.15.107:0/3390656848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2794103f20 0x7f2794075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:53:56.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.500+0000 7f2792d9d700 1 --2- 172.21.15.107:0/3390656848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2794103560 0x7f27940757a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f278400b530 tx=0x7f278400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:56.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.500+0000 7f2790d99700 1 -- 172.21.15.107:0/3390656848 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2784015020 con 0x7f2794103560 2024-05-10T10:53:56.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.500+0000 7f27991fe700 1 -- 172.21.15.107:0/3390656848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27941a84a0 con 0x7f2794103560 2024-05-10T10:53:56.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.500+0000 7f2790d99700 1 -- 172.21.15.107:0/3390656848 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2784011d00 con 0x7f2794103560 2024-05-10T10:53:56.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.500+0000 7f2790d99700 1 -- 172.21.15.107:0/3390656848 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2784010e60 con 0x7f2794103560 2024-05-10T10:53:56.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.500+0000 7f27991fe700 1 -- 172.21.15.107:0/3390656848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27941a8a00 con 0x7f2794103560 2024-05-10T10:53:56.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.501+0000 7f27991fe700 1 -- 172.21.15.107:0/3390656848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f279410b9d0 con 0x7f2794103560 2024-05-10T10:53:56.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.502+0000 7f2790d99700 1 -- 172.21.15.107:0/3390656848 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f2784018020 con 0x7f2794103560 2024-05-10T10:53:56.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.503+0000 7f2790d99700 1 --2- 172.21.15.107:0/3390656848 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f27800b2910 0x7f27800b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:56.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.503+0000 7f278bfff700 1 --2- 172.21.15.107:0/3390656848 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f27800b2910 0x7f27800b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:56.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.503+0000 7f2790d99700 1 -- 172.21.15.107:0/3390656848 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f27840e1fb0 con 0x7f2794103560 2024-05-10T10:53:56.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.503+0000 7f278bfff700 1 --2- 172.21.15.107:0/3390656848 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f27800b2910 0x7f27800b4dd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f27940771e0 tx=0x7f277c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:56.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.506+0000 7f2790d99700 1 -- 172.21.15.107:0/3390656848 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f278401f020 con 0x7f2794103560 2024-05-10T10:53:56.720 INFO:teuthology.orchestra.run.smithi107.stdout:309237645346 2024-05-10T10:53:56.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.719+0000 7f27991fe700 1 -- 172.21.15.107:0/3390656848 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f279410b3b0 con 0x7f2794103560 2024-05-10T10:53:56.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.719+0000 7f2790d99700 1 -- 172.21.15.107:0/3390656848 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f27840a9d80 con 0x7f2794103560 2024-05-10T10:53:56.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.722+0000 7f27991fe700 1 -- 172.21.15.107:0/3390656848 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f27800b2910 msgr2=0x7f27800b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:56.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.722+0000 7f27991fe700 1 --2- 172.21.15.107:0/3390656848 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f27800b2910 0x7f27800b4dd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f27940771e0 tx=0x7f277c005fb0 comp rx=0 tx=0).stop 2024-05-10T10:53:56.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.722+0000 7f27991fe700 1 -- 172.21.15.107:0/3390656848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2794103560 msgr2=0x7f27940757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:56.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.722+0000 7f27991fe700 1 --2- 172.21.15.107:0/3390656848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2794103560 0x7f27940757a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f278400b530 tx=0x7f278400b8f0 comp rx=0 tx=0).stop 2024-05-10T10:53:56.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.722+0000 7f27991fe700 1 -- 172.21.15.107:0/3390656848 shutdown_connections 2024-05-10T10:53:56.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.722+0000 7f27991fe700 1 --2- 172.21.15.107:0/3390656848 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f27800b2910 0x7f27800b4dd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:56.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.722+0000 7f27991fe700 1 --2- 172.21.15.107:0/3390656848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2794109540 0x7f2794076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:56.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.722+0000 7f27991fe700 1 --2- 172.21.15.107:0/3390656848 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2794103560 0x7f27940757a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:56.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.722+0000 7f27991fe700 1 --2- 172.21.15.107:0/3390656848 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2794103f20 0x7f2794075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:56.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.722+0000 7f27991fe700 1 -- 172.21.15.107:0/3390656848 >> 172.21.15.107:0/3390656848 conn(0x7f279407a660 msgr2=0x7f2794102130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:56.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.722+0000 7f27991fe700 1 -- 172.21.15.107:0/3390656848 shutdown_connections 2024-05-10T10:53:56.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:56.722+0000 7f27991fe700 1 -- 172.21.15.107:0/3390656848 wait complete. 2024-05-10T10:53:56.903 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:56 smithi107 ceph-mon[30373]: pgmap v336: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:53:57.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:56 smithi196 ceph-mon[34872]: pgmap v336: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:53:57.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.099+0000 7fb9452e4700 1 -- 172.21.15.107:0/1095844110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb940109530 msgr2=0x7fb940109910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:57.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.099+0000 7fb9452e4700 1 --2- 172.21.15.107:0/1095844110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb940109530 0x7fb940109910 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb930009990 tx=0x7fb930009ca0 comp rx=0 tx=0).stop 2024-05-10T10:53:57.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.099+0000 7fb9452e4700 1 -- 172.21.15.107:0/1095844110 shutdown_connections 2024-05-10T10:53:57.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.099+0000 7fb9452e4700 1 --2- 172.21.15.107:0/1095844110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb940103ee0 0x7fb940110370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:57.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.099+0000 7fb9452e4700 1 --2- 172.21.15.107:0/1095844110 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb940109530 0x7fb940109910 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:57.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.099+0000 7fb9452e4700 1 --2- 172.21.15.107:0/1095844110 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb940103520 0x7fb9401039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:57.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.099+0000 7fb9452e4700 1 -- 172.21.15.107:0/1095844110 >> 172.21.15.107:0/1095844110 conn(0x7fb94007a570 msgr2=0x7fb94007a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:57.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.099+0000 7fb9452e4700 1 -- 172.21.15.107:0/1095844110 shutdown_connections 2024-05-10T10:53:57.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.099+0000 7fb9452e4700 1 -- 172.21.15.107:0/1095844110 wait complete. 2024-05-10T10:53:57.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.099+0000 7fb9452e4700 1 Processor -- start 2024-05-10T10:53:57.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.100+0000 7fb9452e4700 1 -- start start 2024-05-10T10:53:57.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.100+0000 7fb9452e4700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb940103520 0x7fb94019be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:57.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.100+0000 7fb9452e4700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb940103ee0 0x7fb94019c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:57.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.100+0000 7fb9452e4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb940109530 0x7fb9401a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:57.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.100+0000 7fb9452e4700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb9401137c0 con 0x7fb940103ee0 2024-05-10T10:53:57.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.100+0000 7fb9452e4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb940113640 con 0x7fb940109530 2024-05-10T10:53:57.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.100+0000 7fb9452e4700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb940113940 con 0x7fb940103520 2024-05-10T10:53:57.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.100+0000 7fb9367fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb940103ee0 0x7fb94019c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:57.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.100+0000 7fb9367fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb940103ee0 0x7fb94019c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48456/0 (socket says 172.21.15.107:48456) 2024-05-10T10:53:57.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.100+0000 7fb9367fc700 1 -- 172.21.15.107:0/549812103 learned_addr learned my addr 172.21.15.107:0/549812103 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:57.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.100+0000 7fb93effd700 1 --2- 172.21.15.107:0/549812103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb940103520 0x7fb94019be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:57.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.100+0000 7fb93f7fe700 1 --2- 172.21.15.107:0/549812103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb940109530 0x7fb9401a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:57.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.100+0000 7fb9367fc700 1 -- 172.21.15.107:0/549812103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb940103520 msgr2=0x7fb94019be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:57.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.100+0000 7fb9367fc700 1 --2- 172.21.15.107:0/549812103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb940103520 0x7fb94019be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:57.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.100+0000 7fb9367fc700 1 -- 172.21.15.107:0/549812103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb940109530 msgr2=0x7fb9401a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:57.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.100+0000 7fb9367fc700 1 --2- 172.21.15.107:0/549812103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb940109530 0x7fb9401a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:57.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.100+0000 7fb9367fc700 1 -- 172.21.15.107:0/549812103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9401a0e10 con 0x7fb940103ee0 2024-05-10T10:53:57.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.100+0000 7fb93f7fe700 1 --2- 172.21.15.107:0/549812103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb940109530 0x7fb9401a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:53:57.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.100+0000 7fb9367fc700 1 --2- 172.21.15.107:0/549812103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb940103ee0 0x7fb94019c340 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb92800d950 tx=0x7fb92800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:57.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.101+0000 7fb93cff9700 1 -- 172.21.15.107:0/549812103 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb928016070 con 0x7fb940103ee0 2024-05-10T10:53:57.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.101+0000 7fb9452e4700 1 -- 172.21.15.107:0/549812103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9401a1100 con 0x7fb940103ee0 2024-05-10T10:53:57.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.101+0000 7fb93cff9700 1 -- 172.21.15.107:0/549812103 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb928009e10 con 0x7fb940103ee0 2024-05-10T10:53:57.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.101+0000 7fb93cff9700 1 -- 172.21.15.107:0/549812103 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92800f620 con 0x7fb940103ee0 2024-05-10T10:53:57.105 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.101+0000 7fb9452e4700 1 -- 172.21.15.107:0/549812103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9401a8980 con 0x7fb940103ee0 2024-05-10T10:53:57.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.102+0000 7fb9452e4700 1 -- 172.21.15.107:0/549812103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb94006a190 con 0x7fb940103ee0 2024-05-10T10:53:57.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.103+0000 7fb93cff9700 1 -- 172.21.15.107:0/549812103 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7fb928019070 con 0x7fb940103ee0 2024-05-10T10:53:57.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.104+0000 7fb93cff9700 1 --2- 172.21.15.107:0/549812103 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb92c0b2910 0x7fb92c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:57.106 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.104+0000 7fb93effd700 1 --2- 172.21.15.107:0/549812103 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb92c0b2910 0x7fb92c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:57.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.104+0000 7fb93cff9700 1 -- 172.21.15.107:0/549812103 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fb9280e1f90 con 0x7fb940103ee0 2024-05-10T10:53:57.107 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.104+0000 7fb93effd700 1 --2- 172.21.15.107:0/549812103 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb92c0b2910 0x7fb92c0b4dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb93000b5c0 tx=0x7fb930005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:57.108 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.107+0000 7fb93cff9700 1 -- 172.21.15.107:0/549812103 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb9280a9b50 con 0x7fb940103ee0 2024-05-10T10:53:57.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:56 smithi184 ceph-mon[34585]: pgmap v336: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:53:57.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.317+0000 7fb9452e4700 1 -- 172.21.15.107:0/549812103 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fb9401a8b80 con 0x7fb940103ee0 2024-05-10T10:53:57.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.317+0000 7fb93cff9700 1 -- 172.21.15.107:0/549812103 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb9280a9450 con 0x7fb940103ee0 2024-05-10T10:53:57.318 INFO:teuthology.orchestra.run.smithi107.stdout:257698037807 2024-05-10T10:53:57.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.319+0000 7fb9452e4700 1 -- 172.21.15.107:0/549812103 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb92c0b2910 msgr2=0x7fb92c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:57.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.319+0000 7fb9452e4700 1 --2- 172.21.15.107:0/549812103 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb92c0b2910 0x7fb92c0b4dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb93000b5c0 tx=0x7fb930005960 comp rx=0 tx=0).stop 2024-05-10T10:53:57.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.319+0000 7fb9452e4700 1 -- 172.21.15.107:0/549812103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb940103ee0 msgr2=0x7fb94019c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:57.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.319+0000 7fb9452e4700 1 --2- 172.21.15.107:0/549812103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb940103ee0 0x7fb94019c340 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb92800d950 tx=0x7fb92800dc60 comp rx=0 tx=0).stop 2024-05-10T10:53:57.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.320+0000 7fb9452e4700 1 -- 172.21.15.107:0/549812103 shutdown_connections 2024-05-10T10:53:57.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.320+0000 7fb9452e4700 1 --2- 172.21.15.107:0/549812103 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb92c0b2910 0x7fb92c0b4dd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:57.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.320+0000 7fb9452e4700 1 --2- 172.21.15.107:0/549812103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb940103520 0x7fb94019be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:57.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.320+0000 7fb9452e4700 1 --2- 172.21.15.107:0/549812103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb940109530 0x7fb9401a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:57.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.320+0000 7fb9452e4700 1 --2- 172.21.15.107:0/549812103 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb940103ee0 0x7fb94019c340 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:57.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.320+0000 7fb9452e4700 1 -- 172.21.15.107:0/549812103 >> 172.21.15.107:0/549812103 conn(0x7fb94007a570 msgr2=0x7fb940075960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:57.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.320+0000 7fb9452e4700 1 -- 172.21.15.107:0/549812103 shutdown_connections 2024-05-10T10:53:57.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:57.320+0000 7fb9452e4700 1 -- 172.21.15.107:0/549812103 wait complete. 2024-05-10T10:53:57.912 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:57 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3390656848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-10T10:53:57.912 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:57 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/549812103' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-10T10:53:57.947 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593782 got 184683593788 for osd.6 2024-05-10T10:53:57.947 DEBUG:teuthology.parallel:result is None 2024-05-10T10:53:58.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:57 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3390656848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-10T10:53:58.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:57 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/549812103' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-10T10:53:58.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:57 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3390656848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-10T10:53:58.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:57 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/549812103' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-10T10:53:58.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.139+0000 7f861a498700 1 -- 172.21.15.107:0/3073770450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86141037b0 msgr2=0x7f8614103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:58.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.139+0000 7f861a498700 1 --2- 172.21.15.107:0/3073770450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86141037b0 0x7f8614103b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f86040099c0 tx=0x7f8604009cd0 comp rx=0 tx=0).stop 2024-05-10T10:53:58.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.139+0000 7f861a498700 1 -- 172.21.15.107:0/3073770450 shutdown_connections 2024-05-10T10:53:58.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.139+0000 7f861a498700 1 --2- 172.21.15.107:0/3073770450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8614108880 0x7f8614110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:58.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.139+0000 7f861a498700 1 --2- 172.21.15.107:0/3073770450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86141037b0 0x7f8614103b90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:58.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.139+0000 7f861a498700 1 --2- 172.21.15.107:0/3073770450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8614104160 0x7f8614108150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:58.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.139+0000 7f861a498700 1 -- 172.21.15.107:0/3073770450 >> 172.21.15.107:0/3073770450 conn(0x7f861407a530 msgr2=0x7f861407a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:58.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.140+0000 7f861a498700 1 -- 172.21.15.107:0/3073770450 shutdown_connections 2024-05-10T10:53:58.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.140+0000 7f861a498700 1 -- 172.21.15.107:0/3073770450 wait complete. 2024-05-10T10:53:58.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.140+0000 7f861a498700 1 Processor -- start 2024-05-10T10:53:58.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.140+0000 7f861a498700 1 -- start start 2024-05-10T10:53:58.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.140+0000 7f861a498700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86141037b0 0x7f861419f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:58.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.140+0000 7f861a498700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8614104160 0x7f861419fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:58.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.140+0000 7f861a498700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8614108880 0x7f8614199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:58.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.140+0000 7f861a498700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8614113880 con 0x7f8614108880 2024-05-10T10:53:58.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.140+0000 7f861a498700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8614113700 con 0x7f8614104160 2024-05-10T10:53:58.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.140+0000 7f861a498700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8614113a00 con 0x7f86141037b0 2024-05-10T10:53:58.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.141+0000 7f8618a35700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8614108880 0x7f8614199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:58.147 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.141+0000 7f8618a35700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8614108880 0x7f8614199ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48474/0 (socket says 172.21.15.107:48474) 2024-05-10T10:53:58.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.141+0000 7f8618a35700 1 -- 172.21.15.107:0/22644077 learned_addr learned my addr 172.21.15.107:0/22644077 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:53:58.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.141+0000 7f8613fff700 1 --2- 172.21.15.107:0/22644077 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86141037b0 0x7f861419f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:58.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.141+0000 7f860bfff700 1 --2- 172.21.15.107:0/22644077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8614104160 0x7f861419fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:58.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.141+0000 7f8618a35700 1 -- 172.21.15.107:0/22644077 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86141037b0 msgr2=0x7f861419f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:58.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.141+0000 7f8618a35700 1 --2- 172.21.15.107:0/22644077 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86141037b0 0x7f861419f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:58.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.141+0000 7f8618a35700 1 -- 172.21.15.107:0/22644077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8614104160 msgr2=0x7f861419fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:58.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.141+0000 7f8618a35700 1 --2- 172.21.15.107:0/22644077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8614104160 0x7f861419fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:58.148 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.141+0000 7f8618a35700 1 -- 172.21.15.107:0/22644077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861419a240 con 0x7f8614108880 2024-05-10T10:53:58.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.141+0000 7f860bfff700 1 --2- 172.21.15.107:0/22644077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8614104160 0x7f861419fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:53:58.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.141+0000 7f8618a35700 1 --2- 172.21.15.107:0/22644077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8614108880 0x7f8614199ae0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f860c00b970 tx=0x7f860c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:58.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.141+0000 7f8611ffb700 1 -- 172.21.15.107:0/22644077 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c019070 con 0x7f8614108880 2024-05-10T10:53:58.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.141+0000 7f861a498700 1 -- 172.21.15.107:0/22644077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f861419a530 con 0x7f8614108880 2024-05-10T10:53:58.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.141+0000 7f8611ffb700 1 -- 172.21.15.107:0/22644077 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f860c00ce00 con 0x7f8614108880 2024-05-10T10:53:58.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.141+0000 7f8611ffb700 1 -- 172.21.15.107:0/22644077 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c007370 con 0x7f8614108880 2024-05-10T10:53:58.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.141+0000 7f861a498700 1 -- 172.21.15.107:0/22644077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86141a67a0 con 0x7f8614108880 2024-05-10T10:53:58.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.142+0000 7f861a498700 1 -- 172.21.15.107:0/22644077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f861410bac0 con 0x7f8614108880 2024-05-10T10:53:58.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.143+0000 7f8611ffb700 1 -- 172.21.15.107:0/22644077 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f860c01c070 con 0x7f8614108880 2024-05-10T10:53:58.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.144+0000 7f8611ffb700 1 --2- 172.21.15.107:0/22644077 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f86000b2910 0x7f86000b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:53:58.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.144+0000 7f8613fff700 1 --2- 172.21.15.107:0/22644077 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f86000b2910 0x7f86000b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:53:58.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.144+0000 7f8611ffb700 1 -- 172.21.15.107:0/22644077 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f860c0e1ad0 con 0x7f8614108880 2024-05-10T10:53:58.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.145+0000 7f8613fff700 1 --2- 172.21.15.107:0/22644077 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f86000b2910 0x7f86000b4dd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f86141083e0 tx=0x7f860400b7f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:53:58.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.148+0000 7f8611ffb700 1 -- 172.21.15.107:0/22644077 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f860c0a97a0 con 0x7f8614108880 2024-05-10T10:53:58.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.358+0000 7f861a498700 1 -- 172.21.15.107:0/22644077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f861419afc0 con 0x7f8614108880 2024-05-10T10:53:58.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.359+0000 7f8611ffb700 1 -- 172.21.15.107:0/22644077 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f860c0a90a0 con 0x7f8614108880 2024-05-10T10:53:58.360 INFO:teuthology.orchestra.run.smithi107.stdout:206158430264 2024-05-10T10:53:58.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.361+0000 7f861a498700 1 -- 172.21.15.107:0/22644077 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f86000b2910 msgr2=0x7f86000b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:58.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.361+0000 7f861a498700 1 --2- 172.21.15.107:0/22644077 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f86000b2910 0x7f86000b4dd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f86141083e0 tx=0x7f860400b7f0 comp rx=0 tx=0).stop 2024-05-10T10:53:58.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.361+0000 7f861a498700 1 -- 172.21.15.107:0/22644077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8614108880 msgr2=0x7f8614199ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:53:58.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.361+0000 7f861a498700 1 --2- 172.21.15.107:0/22644077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8614108880 0x7f8614199ae0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f860c00b970 tx=0x7f860c00bc80 comp rx=0 tx=0).stop 2024-05-10T10:53:58.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.361+0000 7f861a498700 1 -- 172.21.15.107:0/22644077 shutdown_connections 2024-05-10T10:53:58.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.361+0000 7f861a498700 1 --2- 172.21.15.107:0/22644077 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f86000b2910 0x7f86000b4dd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:58.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.361+0000 7f861a498700 1 --2- 172.21.15.107:0/22644077 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86141037b0 0x7f861419f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:58.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.361+0000 7f861a498700 1 --2- 172.21.15.107:0/22644077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8614108880 0x7f8614199ae0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:58.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.361+0000 7f861a498700 1 --2- 172.21.15.107:0/22644077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8614104160 0x7f861419fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:53:58.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.361+0000 7f861a498700 1 -- 172.21.15.107:0/22644077 >> 172.21.15.107:0/22644077 conn(0x7f861407a530 msgr2=0x7f8614102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:53:58.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.361+0000 7f861a498700 1 -- 172.21.15.107:0/22644077 shutdown_connections 2024-05-10T10:53:58.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:53:58.361+0000 7f861a498700 1 -- 172.21.15.107:0/22644077 wait complete. 2024-05-10T10:53:59.048 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:58 smithi107 ceph-mon[30373]: pgmap v337: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:53:59.049 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:53:58 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/22644077' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-10T10:53:59.062 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:58 smithi196 ceph-mon[34872]: pgmap v337: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:53:59.062 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:53:58 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/22644077' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-10T10:53:59.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:58 smithi184 ceph-mon[34585]: pgmap v337: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:53:59.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:53:58 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/22644077' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-10T10:54:00.375 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037801 got 257698037807 for osd.9 2024-05-10T10:54:00.375 DEBUG:teuthology.parallel:result is None 2024-05-10T10:54:00.975 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:00 smithi107 ceph-mon[30373]: pgmap v338: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:54:01.009 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430260 got 206158430264 for osd.7 2024-05-10T10:54:01.009 DEBUG:teuthology.parallel:result is None 2024-05-10T10:54:01.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:00 smithi196 ceph-mon[34872]: pgmap v338: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:54:01.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:00 smithi184 ceph-mon[34585]: pgmap v338: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:54:01.225 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:54:01.737 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645340 got 309237645346 for osd.11 2024-05-10T10:54:01.737 DEBUG:teuthology.parallel:result is None 2024-05-10T10:54:01.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:01 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2722492361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-10T10:54:01.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:01 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/4265625774' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-10T10:54:02.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:01 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/2722492361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-10T10:54:02.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:01 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/4265625774' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-10T10:54:02.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:01 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/2722492361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-10T10:54:02.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:01 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/4265625774' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-10T10:54:02.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.812+0000 7f7c818ea700 1 -- 172.21.15.107:0/171870759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c7c103780 msgr2=0x7f7c7c103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:02.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.812+0000 7f7c818ea700 1 --2- 172.21.15.107:0/171870759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c7c103780 0x7f7c7c103b60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c0099c0 tx=0x7f7c6c009cd0 comp rx=0 tx=0).stop 2024-05-10T10:54:02.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.812+0000 7f7c818ea700 1 -- 172.21.15.107:0/171870759 shutdown_connections 2024-05-10T10:54:02.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.812+0000 7f7c818ea700 1 --2- 172.21.15.107:0/171870759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c7c108870 0x7f7c7c1103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:02.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.812+0000 7f7c818ea700 1 --2- 172.21.15.107:0/171870759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c7c103780 0x7f7c7c103b60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:02.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.812+0000 7f7c818ea700 1 --2- 172.21.15.107:0/171870759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c7c104130 0x7f7c7c108140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:02.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.812+0000 7f7c818ea700 1 -- 172.21.15.107:0/171870759 >> 172.21.15.107:0/171870759 conn(0x7f7c7c07a610 msgr2=0x7f7c7c07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:02.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.812+0000 7f7c818ea700 1 -- 172.21.15.107:0/171870759 shutdown_connections 2024-05-10T10:54:02.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.812+0000 7f7c818ea700 1 -- 172.21.15.107:0/171870759 wait complete. 2024-05-10T10:54:02.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.813+0000 7f7c818ea700 1 Processor -- start 2024-05-10T10:54:02.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.813+0000 7f7c818ea700 1 -- start start 2024-05-10T10:54:02.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.813+0000 7f7c818ea700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c7c103780 0x7f7c7c19f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:02.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.813+0000 7f7c818ea700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c7c104130 0x7f7c7c19fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:02.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.813+0000 7f7c818ea700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c7c108870 0x7f7c7c199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:02.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.813+0000 7f7c818ea700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7c113870 con 0x7f7c7c108870 2024-05-10T10:54:02.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.813+0000 7f7c818ea700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7c1136f0 con 0x7f7c7c104130 2024-05-10T10:54:02.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.813+0000 7f7c818ea700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7c1139f0 con 0x7f7c7c103780 2024-05-10T10:54:02.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.813+0000 7f7c7b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c7c108870 0x7f7c7c199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:02.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.814+0000 7f7c7b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c7c108870 0x7f7c7c199ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48486/0 (socket says 172.21.15.107:48486) 2024-05-10T10:54:02.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.814+0000 7f7c7b7fe700 1 -- 172.21.15.107:0/2722492361 learned_addr learned my addr 172.21.15.107:0/2722492361 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:02.218 INFO:teuthology.orchestra.run.smithi107.stdout:55834574934 2024-05-10T10:54:02.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.814+0000 7f7c7a7fc700 1 --2- 172.21.15.107:0/2722492361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c7c104130 0x7f7c7c19fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:02.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.814+0000 7f7c7affd700 1 --2- 172.21.15.107:0/2722492361 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c7c103780 0x7f7c7c19f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:02.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.814+0000 7f7c7b7fe700 1 -- 172.21.15.107:0/2722492361 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c7c103780 msgr2=0x7f7c7c19f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:02.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.814+0000 7f7c7b7fe700 1 --2- 172.21.15.107:0/2722492361 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c7c103780 0x7f7c7c19f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:02.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.814+0000 7f7c7b7fe700 1 -- 172.21.15.107:0/2722492361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c7c104130 msgr2=0x7f7c7c19fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:02.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.814+0000 7f7c7b7fe700 1 --2- 172.21.15.107:0/2722492361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c7c104130 0x7f7c7c19fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:02.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.814+0000 7f7c7b7fe700 1 -- 172.21.15.107:0/2722492361 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7c19a230 con 0x7f7c7c108870 2024-05-10T10:54:02.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.814+0000 7f7c7b7fe700 1 --2- 172.21.15.107:0/2722492361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c7c108870 0x7f7c7c199ad0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400b970 tx=0x7f7c7400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:02.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.814+0000 7f7c808e8700 1 -- 172.21.15.107:0/2722492361 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c74019070 con 0x7f7c7c108870 2024-05-10T10:54:02.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.814+0000 7f7c818ea700 1 -- 172.21.15.107:0/2722492361 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c7c19a520 con 0x7f7c7c108870 2024-05-10T10:54:02.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.814+0000 7f7c808e8700 1 -- 172.21.15.107:0/2722492361 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7c7400ce00 con 0x7f7c7c108870 2024-05-10T10:54:02.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.814+0000 7f7c808e8700 1 -- 172.21.15.107:0/2722492361 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c74007370 con 0x7f7c7c108870 2024-05-10T10:54:02.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.814+0000 7f7c818ea700 1 -- 172.21.15.107:0/2722492361 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c7c1a6790 con 0x7f7c7c108870 2024-05-10T10:54:02.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.815+0000 7f7c818ea700 1 -- 172.21.15.107:0/2722492361 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c7c10bab0 con 0x7f7c7c108870 2024-05-10T10:54:02.219 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.817+0000 7f7c808e8700 1 -- 172.21.15.107:0/2722492361 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f7c7401c070 con 0x7f7c7c108870 2024-05-10T10:54:02.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.817+0000 7f7c808e8700 1 --2- 172.21.15.107:0/2722492361 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7c640b2990 0x7f7c640b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:02.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.817+0000 7f7c808e8700 1 -- 172.21.15.107:0/2722492361 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f7c740e1980 con 0x7f7c7c108870 2024-05-10T10:54:02.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.817+0000 7f7c7affd700 1 --2- 172.21.15.107:0/2722492361 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7c640b2990 0x7f7c640b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:02.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.818+0000 7f7c7affd700 1 --2- 172.21.15.107:0/2722492361 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7c640b2990 0x7f7c640b4e50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c000c00 tx=0x7f7c6c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:02.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:00.821+0000 7f7c808e8700 1 -- 172.21.15.107:0/2722492361 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f7c740a9750 con 0x7f7c7c108870 2024-05-10T10:54:02.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.043+0000 7f7c818ea700 1 -- 172.21.15.107:0/2722492361 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7c7c10b490 con 0x7f7c7c108870 2024-05-10T10:54:02.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.044+0000 7f7c808e8700 1 -- 172.21.15.107:0/2722492361 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7c740a9050 con 0x7f7c7c108870 2024-05-10T10:54:02.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.046+0000 7f7c818ea700 1 -- 172.21.15.107:0/2722492361 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7c640b2990 msgr2=0x7f7c640b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:02.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.046+0000 7f7c818ea700 1 --2- 172.21.15.107:0/2722492361 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7c640b2990 0x7f7c640b4e50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c000c00 tx=0x7f7c6c005fb0 comp rx=0 tx=0).stop 2024-05-10T10:54:02.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.046+0000 7f7c818ea700 1 -- 172.21.15.107:0/2722492361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c7c108870 msgr2=0x7f7c7c199ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:02.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.046+0000 7f7c818ea700 1 --2- 172.21.15.107:0/2722492361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c7c108870 0x7f7c7c199ad0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400b970 tx=0x7f7c7400bc80 comp rx=0 tx=0).stop 2024-05-10T10:54:02.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.046+0000 7f7c818ea700 1 -- 172.21.15.107:0/2722492361 shutdown_connections 2024-05-10T10:54:02.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.046+0000 7f7c818ea700 1 --2- 172.21.15.107:0/2722492361 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7c640b2990 0x7f7c640b4e50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:02.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.046+0000 7f7c818ea700 1 --2- 172.21.15.107:0/2722492361 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c7c103780 0x7f7c7c19f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:02.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.046+0000 7f7c818ea700 1 --2- 172.21.15.107:0/2722492361 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7c7c108870 0x7f7c7c199ad0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:02.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.046+0000 7f7c818ea700 1 --2- 172.21.15.107:0/2722492361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c7c104130 0x7f7c7c19fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:02.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.046+0000 7f7c818ea700 1 -- 172.21.15.107:0/2722492361 >> 172.21.15.107:0/2722492361 conn(0x7f7c7c07a610 msgr2=0x7f7c7c1014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:02.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.046+0000 7f7c818ea700 1 -- 172.21.15.107:0/2722492361 shutdown_connections 2024-05-10T10:54:02.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.046+0000 7f7c818ea700 1 -- 172.21.15.107:0/2722492361 wait complete. 2024-05-10T10:54:02.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:02 smithi107 ceph-mon[30373]: pgmap v339: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:54:02.954 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574926 got 55834574934 for osd.1 2024-05-10T10:54:02.955 DEBUG:teuthology.parallel:result is None 2024-05-10T10:54:03.055 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411405 got 77309411408 for osd.2 2024-05-10T10:54:03.055 DEBUG:teuthology.parallel:result is None 2024-05-10T10:54:03.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:02 smithi196 ceph-mon[34872]: pgmap v339: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:54:03.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:02 smithi184 ceph-mon[34585]: pgmap v339: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:54:03.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.430+0000 7f74d8d64700 1 -- 172.21.15.107:0/2652638823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74d4108410 msgr2=0x7f74d41087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:03.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.430+0000 7f74d8d64700 1 --2- 172.21.15.107:0/2652638823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74d4108410 0x7f74d41087f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00b0a0 tx=0x7f74cc00b3b0 comp rx=0 tx=0).stop 2024-05-10T10:54:03.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.430+0000 7f74d8d64700 1 -- 172.21.15.107:0/2652638823 shutdown_connections 2024-05-10T10:54:03.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.430+0000 7f74d8d64700 1 --2- 172.21.15.107:0/2652638823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74d4102d60 0x7f74d410f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:03.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.430+0000 7f74d8d64700 1 --2- 172.21.15.107:0/2652638823 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74d4108410 0x7f74d41087f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:03.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.430+0000 7f74d8d64700 1 --2- 172.21.15.107:0/2652638823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74d41023a0 0x7f74d4102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:03.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.430+0000 7f74d8d64700 1 -- 172.21.15.107:0/2652638823 >> 172.21.15.107:0/2652638823 conn(0x7f74d4079350 msgr2=0x7f74d4079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:03.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.430+0000 7f74d8d64700 1 -- 172.21.15.107:0/2652638823 shutdown_connections 2024-05-10T10:54:03.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.430+0000 7f74d8d64700 1 -- 172.21.15.107:0/2652638823 wait complete. 2024-05-10T10:54:03.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d8d64700 1 Processor -- start 2024-05-10T10:54:03.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d8d64700 1 -- start start 2024-05-10T10:54:03.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d8d64700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74d41023a0 0x7f74d41988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:03.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d8d64700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74d4102d60 0x7f74d4198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:03.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d8d64700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74d4108410 0x7f74d4199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:03.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d8d64700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f74d41126f0 con 0x7f74d41023a0 2024-05-10T10:54:03.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d8d64700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f74d4112570 con 0x7f74d4108410 2024-05-10T10:54:03.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d8d64700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f74d4112870 con 0x7f74d4102d60 2024-05-10T10:54:03.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74d41023a0 0x7f74d41988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:03.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74d41023a0 0x7f74d41988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48500/0 (socket says 172.21.15.107:48500) 2024-05-10T10:54:03.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d259c700 1 -- 172.21.15.107:0/4265625774 learned_addr learned my addr 172.21.15.107:0/4265625774 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:03.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d2d9d700 1 --2- 172.21.15.107:0/4265625774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74d4108410 0x7f74d4199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:03.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d1d9b700 1 --2- 172.21.15.107:0/4265625774 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74d4102d60 0x7f74d4198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:03.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d259c700 1 -- 172.21.15.107:0/4265625774 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74d4102d60 msgr2=0x7f74d4198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:03.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d259c700 1 --2- 172.21.15.107:0/4265625774 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74d4102d60 0x7f74d4198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:03.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d259c700 1 -- 172.21.15.107:0/4265625774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74d4108410 msgr2=0x7f74d4199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:03.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d259c700 1 --2- 172.21.15.107:0/4265625774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74d4108410 0x7f74d4199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:03.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d259c700 1 -- 172.21.15.107:0/4265625774 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d41a8130 con 0x7f74d41023a0 2024-05-10T10:54:03.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d2d9d700 1 --2- 172.21.15.107:0/4265625774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74d4108410 0x7f74d4199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:54:03.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.431+0000 7f74d259c700 1 --2- 172.21.15.107:0/4265625774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74d41023a0 0x7f74d41988c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00b070 tx=0x7f74cc007b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:03.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.432+0000 7f74cb7fe700 1 -- 172.21.15.107:0/4265625774 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc021020 con 0x7f74d41023a0 2024-05-10T10:54:03.156 INFO:teuthology.orchestra.run.smithi107.stdout:107374182475 2024-05-10T10:54:03.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.432+0000 7f74d8d64700 1 -- 172.21.15.107:0/4265625774 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d41a83c0 con 0x7f74d41023a0 2024-05-10T10:54:03.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.432+0000 7f74cb7fe700 1 -- 172.21.15.107:0/4265625774 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f74cc007e10 con 0x7f74d41023a0 2024-05-10T10:54:03.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.432+0000 7f74cb7fe700 1 -- 172.21.15.107:0/4265625774 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc01bd80 con 0x7f74d41023a0 2024-05-10T10:54:03.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.432+0000 7f74d8d64700 1 -- 172.21.15.107:0/4265625774 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d41a88c0 con 0x7f74d41023a0 2024-05-10T10:54:03.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.433+0000 7f74d8d64700 1 -- 172.21.15.107:0/4265625774 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74d406a190 con 0x7f74d41023a0 2024-05-10T10:54:03.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.434+0000 7f74cb7fe700 1 -- 172.21.15.107:0/4265625774 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f74cc024020 con 0x7f74d41023a0 2024-05-10T10:54:03.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.434+0000 7f74cb7fe700 1 --2- 172.21.15.107:0/4265625774 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f74c00b2910 0x7f74c00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:03.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.435+0000 7f74d1d9b700 1 --2- 172.21.15.107:0/4265625774 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f74c00b2910 0x7f74c00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:03.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.435+0000 7f74cb7fe700 1 -- 172.21.15.107:0/4265625774 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f74cc00f020 con 0x7f74d41023a0 2024-05-10T10:54:03.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.435+0000 7f74d1d9b700 1 --2- 172.21.15.107:0/4265625774 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f74c00b2910 0x7f74c00b4dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f74bc005fd0 tx=0x7f74bc00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:03.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.438+0000 7f74cb7fe700 1 -- 172.21.15.107:0/4265625774 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f74cc0abcc0 con 0x7f74d41023a0 2024-05-10T10:54:03.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.645+0000 7f74d8d64700 1 -- 172.21.15.107:0/4265625774 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f74d402e510 con 0x7f74d41023a0 2024-05-10T10:54:03.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.646+0000 7f74cb7fe700 1 -- 172.21.15.107:0/4265625774 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f74cc0ab5c0 con 0x7f74d41023a0 2024-05-10T10:54:03.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.648+0000 7f74d8d64700 1 -- 172.21.15.107:0/4265625774 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f74c00b2910 msgr2=0x7f74c00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:03.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.648+0000 7f74d8d64700 1 --2- 172.21.15.107:0/4265625774 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f74c00b2910 0x7f74c00b4dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f74bc005fd0 tx=0x7f74bc00a560 comp rx=0 tx=0).stop 2024-05-10T10:54:03.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.648+0000 7f74d8d64700 1 -- 172.21.15.107:0/4265625774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74d41023a0 msgr2=0x7f74d41988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:03.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.648+0000 7f74d8d64700 1 --2- 172.21.15.107:0/4265625774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74d41023a0 0x7f74d41988c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00b070 tx=0x7f74cc007b40 comp rx=0 tx=0).stop 2024-05-10T10:54:03.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.648+0000 7f74d8d64700 1 -- 172.21.15.107:0/4265625774 shutdown_connections 2024-05-10T10:54:03.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.648+0000 7f74d8d64700 1 --2- 172.21.15.107:0/4265625774 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f74c00b2910 0x7f74c00b4dd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:03.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.648+0000 7f74d8d64700 1 --2- 172.21.15.107:0/4265625774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74d4108410 0x7f74d4199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:03.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.648+0000 7f74d8d64700 1 --2- 172.21.15.107:0/4265625774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74d41023a0 0x7f74d41988c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:03.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.648+0000 7f74d8d64700 1 --2- 172.21.15.107:0/4265625774 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f74d4102d60 0x7f74d4198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:03.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.648+0000 7f74d8d64700 1 -- 172.21.15.107:0/4265625774 >> 172.21.15.107:0/4265625774 conn(0x7f74d4079350 msgr2=0x7f74d4100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:03.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.648+0000 7f74d8d64700 1 -- 172.21.15.107:0/4265625774 shutdown_connections 2024-05-10T10:54:03.158 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:01.648+0000 7f74d8d64700 1 -- 172.21.15.107:0/4265625774 wait complete. 2024-05-10T10:54:03.701 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182470 got 107374182475 for osd.3 2024-05-10T10:54:03.702 DEBUG:teuthology.parallel:result is None 2024-05-10T10:54:04.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.363+0000 7f0b9c379700 1 -- 172.21.15.107:0/3903702127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b94102d50 msgr2=0x7f0b9410f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:04.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.363+0000 7f0b9c379700 1 --2- 172.21.15.107:0/3903702127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b94102d50 0x7f0b9410f240 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c00b0a0 tx=0x7f0b8c00b3b0 comp rx=0 tx=0).stop 2024-05-10T10:54:04.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.363+0000 7f0b9c379700 1 -- 172.21.15.107:0/3903702127 shutdown_connections 2024-05-10T10:54:04.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.363+0000 7f0b9c379700 1 --2- 172.21.15.107:0/3903702127 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b94102d50 0x7f0b9410f240 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:04.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.363+0000 7f0b9c379700 1 --2- 172.21.15.107:0/3903702127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b94108400 0x7f0b941087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:04.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.363+0000 7f0b9c379700 1 --2- 172.21.15.107:0/3903702127 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b94102390 0x7f0b94102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:04.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.363+0000 7f0b9c379700 1 -- 172.21.15.107:0/3903702127 >> 172.21.15.107:0/3903702127 conn(0x7f0b94079310 msgr2=0x7f0b94079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:04.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.363+0000 7f0b9c379700 1 -- 172.21.15.107:0/3903702127 shutdown_connections 2024-05-10T10:54:04.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.363+0000 7f0b9c379700 1 -- 172.21.15.107:0/3903702127 wait complete. 2024-05-10T10:54:04.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.364+0000 7f0b9c379700 1 Processor -- start 2024-05-10T10:54:04.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.364+0000 7f0b9c379700 1 -- start start 2024-05-10T10:54:04.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.364+0000 7f0b9c379700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b94102390 0x7f0b9419f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:04.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.364+0000 7f0b9c379700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b94102d50 0x7f0b9419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:04.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.364+0000 7f0b9c379700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b94108400 0x7f0b94199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:04.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.364+0000 7f0b9c379700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0b94112690 con 0x7f0b94102390 2024-05-10T10:54:04.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.364+0000 7f0b9c379700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0b94112510 con 0x7f0b94102d50 2024-05-10T10:54:04.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.364+0000 7f0b9c379700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0b94112810 con 0x7f0b94108400 2024-05-10T10:54:04.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.364+0000 7f0b9a115700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b94102390 0x7f0b9419f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:04.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.364+0000 7f0b9a115700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b94102390 0x7f0b9419f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48524/0 (socket says 172.21.15.107:48524) 2024-05-10T10:54:04.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.364+0000 7f0b9a115700 1 -- 172.21.15.107:0/2964448591 learned_addr learned my addr 172.21.15.107:0/2964448591 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:04.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.364+0000 7f0b99914700 1 --2- 172.21.15.107:0/2964448591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b94102d50 0x7f0b9419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:04.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.365+0000 7f0b9a115700 1 -- 172.21.15.107:0/2964448591 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b94108400 msgr2=0x7f0b94199a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:04.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.365+0000 7f0b9a916700 1 --2- 172.21.15.107:0/2964448591 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b94108400 0x7f0b94199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:04.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.365+0000 7f0b9a115700 1 --2- 172.21.15.107:0/2964448591 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b94108400 0x7f0b94199a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:04.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.365+0000 7f0b9a115700 1 -- 172.21.15.107:0/2964448591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b94102d50 msgr2=0x7f0b9419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:04.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.365+0000 7f0b9a115700 1 --2- 172.21.15.107:0/2964448591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b94102d50 0x7f0b9419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:04.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.365+0000 7f0b9a115700 1 -- 172.21.15.107:0/2964448591 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9419a170 con 0x7f0b94102390 2024-05-10T10:54:04.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.365+0000 7f0b99914700 1 --2- 172.21.15.107:0/2964448591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b94102d50 0x7f0b9419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:54:04.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.365+0000 7f0b9a115700 1 --2- 172.21.15.107:0/2964448591 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b94102390 0x7f0b9419f800 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400c9b0 tx=0x7f0b8400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:04.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.365+0000 7f0b8b7fe700 1 -- 172.21.15.107:0/2964448591 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b84007b00 con 0x7f0b94102390 2024-05-10T10:54:04.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.365+0000 7f0b8b7fe700 1 -- 172.21.15.107:0/2964448591 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0b84007ca0 con 0x7f0b94102390 2024-05-10T10:54:04.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.365+0000 7f0b9c379700 1 -- 172.21.15.107:0/2964448591 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b9419a460 con 0x7f0b94102390 2024-05-10T10:54:04.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.365+0000 7f0b8b7fe700 1 -- 172.21.15.107:0/2964448591 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b840187c0 con 0x7f0b94102390 2024-05-10T10:54:04.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.365+0000 7f0b9c379700 1 -- 172.21.15.107:0/2964448591 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b941a66d0 con 0x7f0b94102390 2024-05-10T10:54:04.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.366+0000 7f0b9c379700 1 -- 172.21.15.107:0/2964448591 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b9406a190 con 0x7f0b94102390 2024-05-10T10:54:04.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.367+0000 7f0b8b7fe700 1 -- 172.21.15.107:0/2964448591 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f0b8400f450 con 0x7f0b94102390 2024-05-10T10:54:04.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.368+0000 7f0b8b7fe700 1 --2- 172.21.15.107:0/2964448591 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0b800b2910 0x7f0b800b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:04.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.368+0000 7f0b99914700 1 --2- 172.21.15.107:0/2964448591 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0b800b2910 0x7f0b800b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:04.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.368+0000 7f0b8b7fe700 1 -- 172.21.15.107:0/2964448591 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f0b840e2320 con 0x7f0b94102390 2024-05-10T10:54:04.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.369+0000 7f0b99914700 1 --2- 172.21.15.107:0/2964448591 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0b800b2910 0x7f0b800b4dd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0b94079910 tx=0x7f0b9000b2c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:04.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.373+0000 7f0b8b7fe700 1 -- 172.21.15.107:0/2964448591 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0b84014030 con 0x7f0b94102390 2024-05-10T10:54:04.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.592+0000 7f0b9c379700 1 -- 172.21.15.107:0/2964448591 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f0b941a6960 con 0x7f0b94102390 2024-05-10T10:54:04.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.592+0000 7f0b8b7fe700 1 -- 172.21.15.107:0/2964448591 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0b840a9fe0 con 0x7f0b94102390 2024-05-10T10:54:04.593 INFO:teuthology.orchestra.run.smithi107.stdout:231928234036 2024-05-10T10:54:04.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.595+0000 7f0b9c379700 1 -- 172.21.15.107:0/2964448591 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0b800b2910 msgr2=0x7f0b800b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:04.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.595+0000 7f0b9c379700 1 --2- 172.21.15.107:0/2964448591 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0b800b2910 0x7f0b800b4dd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0b94079910 tx=0x7f0b9000b2c0 comp rx=0 tx=0).stop 2024-05-10T10:54:04.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.595+0000 7f0b9c379700 1 -- 172.21.15.107:0/2964448591 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b94102390 msgr2=0x7f0b9419f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:04.595 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.595+0000 7f0b9c379700 1 --2- 172.21.15.107:0/2964448591 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b94102390 0x7f0b9419f800 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400c9b0 tx=0x7f0b8400cd70 comp rx=0 tx=0).stop 2024-05-10T10:54:04.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.595+0000 7f0b9c379700 1 -- 172.21.15.107:0/2964448591 shutdown_connections 2024-05-10T10:54:04.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.595+0000 7f0b9c379700 1 --2- 172.21.15.107:0/2964448591 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0b800b2910 0x7f0b800b4dd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:04.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.595+0000 7f0b9c379700 1 --2- 172.21.15.107:0/2964448591 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0b94108400 0x7f0b94199a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:04.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.595+0000 7f0b9c379700 1 --2- 172.21.15.107:0/2964448591 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0b94102390 0x7f0b9419f800 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:04.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.595+0000 7f0b9c379700 1 --2- 172.21.15.107:0/2964448591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b94102d50 0x7f0b9419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:04.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.595+0000 7f0b9c379700 1 -- 172.21.15.107:0/2964448591 >> 172.21.15.107:0/2964448591 conn(0x7f0b94079310 msgr2=0x7f0b94101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:04.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.595+0000 7f0b9c379700 1 -- 172.21.15.107:0/2964448591 shutdown_connections 2024-05-10T10:54:04.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:04.595+0000 7f0b9c379700 1 -- 172.21.15.107:0/2964448591 wait complete. 2024-05-10T10:54:04.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:04 smithi107 ceph-mon[30373]: pgmap v340: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:04.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:04 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2964448591' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-10T10:54:05.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:04 smithi196 ceph-mon[34872]: pgmap v340: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:05.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:04 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/2964448591' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-10T10:54:05.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:04 smithi184 ceph-mon[34585]: pgmap v340: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:05.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:04 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/2964448591' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-10T10:54:05.651 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234030 got 231928234036 for osd.8 2024-05-10T10:54:05.966 DEBUG:teuthology.parallel:result is None 2024-05-10T10:54:06.599 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.597+0000 7f185bfda700 1 -- 172.21.15.107:0/3767530928 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1854103540 msgr2=0x7f18541039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:06.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.597+0000 7f185bfda700 1 --2- 172.21.15.107:0/3767530928 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1854103540 0x7f18541039c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f18480099c0 tx=0x7f1848009cd0 comp rx=0 tx=0).stop 2024-05-10T10:54:06.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.597+0000 7f185bfda700 1 -- 172.21.15.107:0/3767530928 shutdown_connections 2024-05-10T10:54:06.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.597+0000 7f185bfda700 1 --2- 172.21.15.107:0/3767530928 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18541095e0 0x7f18541099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:06.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.597+0000 7f185bfda700 1 --2- 172.21.15.107:0/3767530928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1854103f00 0x7f18541103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:06.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.597+0000 7f185bfda700 1 --2- 172.21.15.107:0/3767530928 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1854103540 0x7f18541039c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:06.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.597+0000 7f185bfda700 1 -- 172.21.15.107:0/3767530928 >> 172.21.15.107:0/3767530928 conn(0x7f185407a650 msgr2=0x7f185407aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:06.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.597+0000 7f185bfda700 1 -- 172.21.15.107:0/3767530928 shutdown_connections 2024-05-10T10:54:06.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.597+0000 7f185bfda700 1 -- 172.21.15.107:0/3767530928 wait complete. 2024-05-10T10:54:06.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.598+0000 7f185bfda700 1 Processor -- start 2024-05-10T10:54:06.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.598+0000 7f185bfda700 1 -- start start 2024-05-10T10:54:06.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.598+0000 7f185bfda700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1854103540 0x7f185419f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:06.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.598+0000 7f185bfda700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1854103f00 0x7f185419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:06.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.598+0000 7f185bfda700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18541095e0 0x7f1854199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:06.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.598+0000 7f185bfda700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1854113880 con 0x7f1854103540 2024-05-10T10:54:06.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.598+0000 7f185bfda700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1854113700 con 0x7f18541095e0 2024-05-10T10:54:06.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.598+0000 7f185bfda700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1854113a00 con 0x7f1854103f00 2024-05-10T10:54:06.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.598+0000 7f1859d76700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1854103540 0x7f185419f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:06.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.598+0000 7f1859d76700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1854103540 0x7f185419f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48544/0 (socket says 172.21.15.107:48544) 2024-05-10T10:54:06.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.598+0000 7f1859d76700 1 -- 172.21.15.107:0/1668948082 learned_addr learned my addr 172.21.15.107:0/1668948082 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:06.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.598+0000 7f1859575700 1 --2- 172.21.15.107:0/1668948082 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1854103f00 0x7f185419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:06.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.598+0000 7f185a577700 1 --2- 172.21.15.107:0/1668948082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18541095e0 0x7f1854199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:06.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.598+0000 7f1859d76700 1 -- 172.21.15.107:0/1668948082 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1854103f00 msgr2=0x7f185419fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:06.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.598+0000 7f1859d76700 1 --2- 172.21.15.107:0/1668948082 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1854103f00 0x7f185419fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:06.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.598+0000 7f1859d76700 1 -- 172.21.15.107:0/1668948082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18541095e0 msgr2=0x7f1854199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:06.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.598+0000 7f1859d76700 1 --2- 172.21.15.107:0/1668948082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18541095e0 0x7f1854199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:06.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.599+0000 7f1859d76700 1 -- 172.21.15.107:0/1668948082 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f185419a1c0 con 0x7f1854103540 2024-05-10T10:54:06.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.599+0000 7f1859d76700 1 --2- 172.21.15.107:0/1668948082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1854103540 0x7f185419f850 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f185000b530 tx=0x7f185000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:06.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.599+0000 7f1846ffd700 1 -- 172.21.15.107:0/1668948082 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1850015020 con 0x7f1854103540 2024-05-10T10:54:06.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.599+0000 7f1846ffd700 1 -- 172.21.15.107:0/1668948082 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1850011d00 con 0x7f1854103540 2024-05-10T10:54:06.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.599+0000 7f1846ffd700 1 -- 172.21.15.107:0/1668948082 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185000f2e0 con 0x7f1854103540 2024-05-10T10:54:06.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.599+0000 7f185bfda700 1 -- 172.21.15.107:0/1668948082 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f185419a4b0 con 0x7f1854103540 2024-05-10T10:54:06.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.599+0000 7f185bfda700 1 -- 172.21.15.107:0/1668948082 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18540756d0 con 0x7f1854103540 2024-05-10T10:54:06.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.600+0000 7f185bfda700 1 -- 172.21.15.107:0/1668948082 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f185410ba70 con 0x7f1854103540 2024-05-10T10:54:06.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.602+0000 7f1846ffd700 1 -- 172.21.15.107:0/1668948082 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 17) ==== 149704+0+0 (secure 0 0 0) 0x7f1850018020 con 0x7f1854103540 2024-05-10T10:54:06.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.602+0000 7f1846ffd700 1 --2- 172.21.15.107:0/1668948082 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f18400b2910 0x7f18400b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:06.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.602+0000 7f1859575700 1 --2- 172.21.15.107:0/1668948082 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f18400b2910 0x7f18400b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:06.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.602+0000 7f1846ffd700 1 -- 172.21.15.107:0/1668948082 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f18500e1f70 con 0x7f1854103540 2024-05-10T10:54:06.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.603+0000 7f1859575700 1 --2- 172.21.15.107:0/1668948082 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f18400b2910 0x7f18400b4dd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1848009990 tx=0x7f18480095f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:06.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.605+0000 7f1846ffd700 1 -- 172.21.15.107:0/1668948082 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f185001f020 con 0x7f1854103540 2024-05-10T10:54:06.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.812+0000 7f185bfda700 1 -- 172.21.15.107:0/1668948082 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f185406a1c0 con 0x7f1854103540 2024-05-10T10:54:06.813 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.812+0000 7f1846ffd700 1 -- 172.21.15.107:0/1668948082 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f185406a1c0 con 0x7f1854103540 2024-05-10T10:54:06.813 INFO:teuthology.orchestra.run.smithi107.stdout:34359738460 2024-05-10T10:54:06.815 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.815+0000 7f185bfda700 1 -- 172.21.15.107:0/1668948082 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f18400b2910 msgr2=0x7f18400b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:06.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.815+0000 7f185bfda700 1 --2- 172.21.15.107:0/1668948082 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f18400b2910 0x7f18400b4dd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1848009990 tx=0x7f18480095f0 comp rx=0 tx=0).stop 2024-05-10T10:54:06.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.815+0000 7f185bfda700 1 -- 172.21.15.107:0/1668948082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1854103540 msgr2=0x7f185419f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:06.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.815+0000 7f185bfda700 1 --2- 172.21.15.107:0/1668948082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1854103540 0x7f185419f850 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f185000b530 tx=0x7f185000b840 comp rx=0 tx=0).stop 2024-05-10T10:54:06.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.815+0000 7f185bfda700 1 -- 172.21.15.107:0/1668948082 shutdown_connections 2024-05-10T10:54:06.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.815+0000 7f185bfda700 1 --2- 172.21.15.107:0/1668948082 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f18400b2910 0x7f18400b4dd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:06.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.815+0000 7f185bfda700 1 --2- 172.21.15.107:0/1668948082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18541095e0 0x7f1854199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:06.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.815+0000 7f185bfda700 1 --2- 172.21.15.107:0/1668948082 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1854103540 0x7f185419f850 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:06.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.815+0000 7f185bfda700 1 --2- 172.21.15.107:0/1668948082 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1854103f00 0x7f185419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:06.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.815+0000 7f185bfda700 1 -- 172.21.15.107:0/1668948082 >> 172.21.15.107:0/1668948082 conn(0x7f185407a650 msgr2=0x7f1854102030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:06.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.815+0000 7f185bfda700 1 -- 172.21.15.107:0/1668948082 shutdown_connections 2024-05-10T10:54:06.816 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:06.815+0000 7f185bfda700 1 -- 172.21.15.107:0/1668948082 wait complete. 2024-05-10T10:54:06.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:06 smithi107 ceph-mon[30373]: pgmap v341: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:54:07.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:06 smithi196 ceph-mon[34872]: pgmap v341: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:54:07.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:06 smithi184 ceph-mon[34585]: pgmap v341: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:54:07.558 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738455 got 34359738460 for osd.0 2024-05-10T10:54:07.558 DEBUG:teuthology.parallel:result is None 2024-05-10T10:54:07.558 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-10T10:54:07.559 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-10T10:54:07.837 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:54:07.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:07 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1668948082' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-10T10:54:08.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:07 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1668948082' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-10T10:54:08.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:07 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1668948082' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-10T10:54:08.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:08 smithi107 ceph-mon[30373]: pgmap v342: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:08.925 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:08 smithi107 ceph-mon[30373]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-05-10T10:54:09.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:08 smithi196 ceph-mon[34872]: pgmap v342: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:09.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:08 smithi196 ceph-mon[34872]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-05-10T10:54:09.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:08 smithi184 ceph-mon[34585]: pgmap v342: 97 pgs: 97 active+clean; 647 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:09.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:08 smithi184 ceph-mon[34585]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-05-10T10:54:09.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.577+0000 7f486c051700 1 -- 172.21.15.107:0/3203677119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4864108850 msgr2=0x7f48641103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:09.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.577+0000 7f486c051700 1 --2- 172.21.15.107:0/3203677119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4864108850 0x7f48641103d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f485c00b0d0 tx=0x7f485c00b3e0 comp rx=0 tx=0).stop 2024-05-10T10:54:09.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.577+0000 7f486c051700 1 -- 172.21.15.107:0/3203677119 shutdown_connections 2024-05-10T10:54:09.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.577+0000 7f486c051700 1 --2- 172.21.15.107:0/3203677119 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4864108850 0x7f48641103d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:09.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.577+0000 7f486c051700 1 --2- 172.21.15.107:0/3203677119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4864103750 0x7f4864103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:09.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.577+0000 7f486c051700 1 --2- 172.21.15.107:0/3203677119 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4864104100 0x7f4864108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:09.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.577+0000 7f486c051700 1 -- 172.21.15.107:0/3203677119 >> 172.21.15.107:0/3203677119 conn(0x7f486407a600 msgr2=0x7f486407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:09.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.577+0000 7f486c051700 1 -- 172.21.15.107:0/3203677119 shutdown_connections 2024-05-10T10:54:09.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.577+0000 7f486c051700 1 -- 172.21.15.107:0/3203677119 wait complete. 2024-05-10T10:54:09.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.577+0000 7f486c051700 1 Processor -- start 2024-05-10T10:54:09.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f486c051700 1 -- start start 2024-05-10T10:54:09.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f486c051700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4864103750 0x7f486419f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:09.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f486c051700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4864104100 0x7f486419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:09.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f486c051700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4864108850 0x7f4864199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:09.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f486c051700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f48641137d0 con 0x7f4864104100 2024-05-10T10:54:09.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f486c051700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4864113650 con 0x7f4864103750 2024-05-10T10:54:09.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f486c051700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4864113950 con 0x7f4864108850 2024-05-10T10:54:09.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f48695ec700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4864104100 0x7f486419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:09.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f48695ec700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4864104100 0x7f486419fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60792/0 (socket says 172.21.15.107:60792) 2024-05-10T10:54:09.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f48695ec700 1 -- 172.21.15.107:0/1382092437 learned_addr learned my addr 172.21.15.107:0/1382092437 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:09.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f486a5ee700 1 --2- 172.21.15.107:0/1382092437 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4864108850 0x7f4864199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:09.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f4869ded700 1 --2- 172.21.15.107:0/1382092437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4864103750 0x7f486419f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:09.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f48695ec700 1 -- 172.21.15.107:0/1382092437 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4864108850 msgr2=0x7f4864199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:09.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f48695ec700 1 --2- 172.21.15.107:0/1382092437 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4864108850 0x7f4864199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:09.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f48695ec700 1 -- 172.21.15.107:0/1382092437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4864103750 msgr2=0x7f486419f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:09.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f48695ec700 1 --2- 172.21.15.107:0/1382092437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4864103750 0x7f486419f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:09.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f48695ec700 1 -- 172.21.15.107:0/1382092437 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486419a0b0 con 0x7f4864104100 2024-05-10T10:54:09.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f486a5ee700 1 --2- 172.21.15.107:0/1382092437 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4864108850 0x7f4864199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:54:09.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f48695ec700 1 --2- 172.21.15.107:0/1382092437 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4864104100 0x7f486419fcd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f485400c9b0 tx=0x7f485400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:09.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.578+0000 7f485affd700 1 -- 172.21.15.107:0/1382092437 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854007b00 con 0x7f4864104100 2024-05-10T10:54:09.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.579+0000 7f485affd700 1 -- 172.21.15.107:0/1382092437 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4854007ca0 con 0x7f4864104100 2024-05-10T10:54:09.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.579+0000 7f486c051700 1 -- 172.21.15.107:0/1382092437 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f486419a3a0 con 0x7f4864104100 2024-05-10T10:54:09.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.579+0000 7f485affd700 1 -- 172.21.15.107:0/1382092437 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48540187c0 con 0x7f4864104100 2024-05-10T10:54:09.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.579+0000 7f486c051700 1 -- 172.21.15.107:0/1382092437 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48641a6660 con 0x7f4864104100 2024-05-10T10:54:09.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.580+0000 7f486c051700 1 -- 172.21.15.107:0/1382092437 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f486406a190 con 0x7f4864104100 2024-05-10T10:54:09.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.581+0000 7f485affd700 1 -- 172.21.15.107:0/1382092437 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f485400f450 con 0x7f4864104100 2024-05-10T10:54:09.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.581+0000 7f485affd700 1 --2- 172.21.15.107:0/1382092437 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f48500b2880 0x7f48500b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:09.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.582+0000 7f4869ded700 1 --2- 172.21.15.107:0/1382092437 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f48500b2880 0x7f48500b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:09.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.582+0000 7f485affd700 1 -- 172.21.15.107:0/1382092437 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f48540e2530 con 0x7f4864104100 2024-05-10T10:54:09.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.582+0000 7f4869ded700 1 --2- 172.21.15.107:0/1382092437 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f48500b2880 0x7f48500b4d40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4860006fd0 tx=0x7f4860008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:09.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.585+0000 7f485affd700 1 -- 172.21.15.107:0/1382092437 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4854014030 con 0x7f4864104100 2024-05-10T10:54:09.790 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.790+0000 7f486c051700 1 -- 172.21.15.107:0/1382092437 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4864101b10 con 0x7f48500b2880 2024-05-10T10:54:09.798 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.797+0000 7f485affd700 1 -- 172.21.15.107:0/1382092437 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258887 (secure 0 0 0) 0x7f4864101b10 con 0x7f48500b2880 2024-05-10T10:54:09.802 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:54:09.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.800+0000 7f486c051700 1 -- 172.21.15.107:0/1382092437 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f48500b2880 msgr2=0x7f48500b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:09.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.800+0000 7f486c051700 1 --2- 172.21.15.107:0/1382092437 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f48500b2880 0x7f48500b4d40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4860006fd0 tx=0x7f4860008040 comp rx=0 tx=0).stop 2024-05-10T10:54:09.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.800+0000 7f486c051700 1 -- 172.21.15.107:0/1382092437 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4864104100 msgr2=0x7f486419fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:09.804 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.800+0000 7f486c051700 1 --2- 172.21.15.107:0/1382092437 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4864104100 0x7f486419fcd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f485400c9b0 tx=0x7f485400cd70 comp rx=0 tx=0).stop 2024-05-10T10:54:09.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.800+0000 7f486c051700 1 -- 172.21.15.107:0/1382092437 shutdown_connections 2024-05-10T10:54:09.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.800+0000 7f486c051700 1 --2- 172.21.15.107:0/1382092437 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f48500b2880 0x7f48500b4d40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:09.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.800+0000 7f486c051700 1 --2- 172.21.15.107:0/1382092437 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4864108850 0x7f4864199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:09.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.800+0000 7f486c051700 1 --2- 172.21.15.107:0/1382092437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4864103750 0x7f486419f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:09.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.800+0000 7f486c051700 1 --2- 172.21.15.107:0/1382092437 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4864104100 0x7f486419fcd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:09.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.800+0000 7f486c051700 1 -- 172.21.15.107:0/1382092437 >> 172.21.15.107:0/1382092437 conn(0x7f486407a600 msgr2=0x7f4864101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:09.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.800+0000 7f486c051700 1 -- 172.21.15.107:0/1382092437 shutdown_connections 2024-05-10T10:54:09.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:09.800+0000 7f486c051700 1 -- 172.21.15.107:0/1382092437 wait complete. 2024-05-10T10:54:09.805 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-05-10T10:54:10.482 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-05-10T10:54:09.631881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662139,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1051,"num_read_kb":630,"num_write":373,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951840,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":558,"ondisk_log_size":558,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374376,"kb_used_data":12696,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567448,"statfs":{"total":1151940427776,"available":1151557066752,"internally_reserved":0,"allocated":13000704,"data_stored":7212795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":60,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003053"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.634811+0000","last_change":"2024-05-10T10:52:15.686294+0000","last_active":"2024-05-10T10:54:07.634811+0000","last_peered":"2024-05-10T10:54:07.634811+0000","last_clean":"2024-05-10T10:54:07.634811+0000","last_became_active":"2024-05-10T10:52:15.685324+0000","last_became_peered":"2024-05-10T10:52:15.685324+0000","last_unstale":"2024-05-10T10:54:07.634811+0000","last_undegraded":"2024-05-10T10:54:07.634811+0000","last_fullsized":"2024-05-10T10:54:07.634811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:20.777432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.907043+0000","last_change":"2024-05-10T10:52:15.687542+0000","last_active":"2024-05-10T10:53:08.907043+0000","last_peered":"2024-05-10T10:53:08.907043+0000","last_clean":"2024-05-10T10:53:08.907043+0000","last_became_active":"2024-05-10T10:52:15.687258+0000","last_became_peered":"2024-05-10T10:52:15.687258+0000","last_unstale":"2024-05-10T10:53:08.907043+0000","last_undegraded":"2024-05-10T10:53:08.907043+0000","last_fullsized":"2024-05-10T10:53:08.907043+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:08.522392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.905518+0000","last_change":"2024-05-10T10:52:15.682314+0000","last_active":"2024-05-10T10:53:08.905518+0000","last_peered":"2024-05-10T10:53:08.905518+0000","last_clean":"2024-05-10T10:53:08.905518+0000","last_became_active":"2024-05-10T10:52:15.681939+0000","last_became_peered":"2024-05-10T10:52:15.681939+0000","last_unstale":"2024-05-10T10:53:08.905518+0000","last_undegraded":"2024-05-10T10:53:08.905518+0000","last_fullsized":"2024-05-10T10:53:08.905518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:04.857969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.057979+0000","last_change":"2024-05-10T10:52:15.693451+0000","last_active":"2024-05-10T10:53:09.057979+0000","last_peered":"2024-05-10T10:53:09.057979+0000","last_clean":"2024-05-10T10:53:09.057979+0000","last_became_active":"2024-05-10T10:52:15.693041+0000","last_became_peered":"2024-05-10T10:52:15.693041+0000","last_unstale":"2024-05-10T10:53:09.057979+0000","last_undegraded":"2024-05-10T10:53:09.057979+0000","last_fullsized":"2024-05-10T10:53:09.057979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:57:14.959699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908484+0000","last_change":"2024-05-10T10:52:15.679527+0000","last_active":"2024-05-10T10:53:08.908484+0000","last_peered":"2024-05-10T10:53:08.908484+0000","last_clean":"2024-05-10T10:53:08.908484+0000","last_became_active":"2024-05-10T10:52:15.679153+0000","last_became_peered":"2024-05-10T10:52:15.679153+0000","last_unstale":"2024-05-10T10:53:08.908484+0000","last_undegraded":"2024-05-10T10:53:08.908484+0000","last_fullsized":"2024-05-10T10:53:08.908484+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:58.738486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.724128+0000","last_change":"2024-05-10T10:52:15.685905+0000","last_active":"2024-05-10T10:53:09.724128+0000","last_peered":"2024-05-10T10:53:09.724128+0000","last_clean":"2024-05-10T10:53:09.724128+0000","last_became_active":"2024-05-10T10:52:15.685628+0000","last_became_peered":"2024-05-10T10:52:15.685628+0000","last_unstale":"2024-05-10T10:53:09.724128+0000","last_undegraded":"2024-05-10T10:53:09.724128+0000","last_fullsized":"2024-05-10T10:53:09.724128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:16.776307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.627333+0000","last_change":"2024-05-10T10:52:15.692951+0000","last_active":"2024-05-10T10:54:07.627333+0000","last_peered":"2024-05-10T10:54:07.627333+0000","last_clean":"2024-05-10T10:54:07.627333+0000","last_became_active":"2024-05-10T10:52:15.692594+0000","last_became_peered":"2024-05-10T10:52:15.692594+0000","last_unstale":"2024-05-10T10:54:07.627333+0000","last_undegraded":"2024-05-10T10:54:07.627333+0000","last_fullsized":"2024-05-10T10:54:07.627333+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:04.105565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.909333+0000","last_change":"2024-05-10T10:52:15.692349+0000","last_active":"2024-05-10T10:53:08.909333+0000","last_peered":"2024-05-10T10:53:08.909333+0000","last_clean":"2024-05-10T10:53:08.909333+0000","last_became_active":"2024-05-10T10:52:15.691840+0000","last_became_peered":"2024-05-10T10:52:15.691840+0000","last_unstale":"2024-05-10T10:53:08.909333+0000","last_undegraded":"2024-05-10T10:53:08.909333+0000","last_fullsized":"2024-05-10T10:53:08.909333+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:32:25.011085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645232+0000","last_change":"2024-05-10T10:52:15.686531+0000","last_active":"2024-05-10T10:54:07.645232+0000","last_peered":"2024-05-10T10:54:07.645232+0000","last_clean":"2024-05-10T10:54:07.645232+0000","last_became_active":"2024-05-10T10:52:15.686029+0000","last_became_peered":"2024-05-10T10:52:15.686029+0000","last_unstale":"2024-05-10T10:54:07.645232+0000","last_undegraded":"2024-05-10T10:54:07.645232+0000","last_fullsized":"2024-05-10T10:54:07.645232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:30.836606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.724558+0000","last_change":"2024-05-10T10:52:15.697314+0000","last_active":"2024-05-10T10:53:09.724558+0000","last_peered":"2024-05-10T10:53:09.724558+0000","last_clean":"2024-05-10T10:53:09.724558+0000","last_became_active":"2024-05-10T10:52:15.696944+0000","last_became_peered":"2024-05-10T10:52:15.696944+0000","last_unstale":"2024-05-10T10:53:09.724558+0000","last_undegraded":"2024-05-10T10:53:09.724558+0000","last_fullsized":"2024-05-10T10:53:09.724558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:10.098904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.644616+0000","last_change":"2024-05-10T10:52:15.690866+0000","last_active":"2024-05-10T10:54:07.644616+0000","last_peered":"2024-05-10T10:54:07.644616+0000","last_clean":"2024-05-10T10:54:07.644616+0000","last_became_active":"2024-05-10T10:52:15.690533+0000","last_became_peered":"2024-05-10T10:52:15.690533+0000","last_unstale":"2024-05-10T10:54:07.644616+0000","last_undegraded":"2024-05-10T10:54:07.644616+0000","last_fullsized":"2024-05-10T10:54:07.644616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:48.290897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.057957+0000","last_change":"2024-05-10T10:52:15.696386+0000","last_active":"2024-05-10T10:53:09.057957+0000","last_peered":"2024-05-10T10:53:09.057957+0000","last_clean":"2024-05-10T10:53:09.057957+0000","last_became_active":"2024-05-10T10:52:15.696044+0000","last_became_peered":"2024-05-10T10:52:15.696044+0000","last_unstale":"2024-05-10T10:53:09.057957+0000","last_undegraded":"2024-05-10T10:53:09.057957+0000","last_fullsized":"2024-05-10T10:53:09.057957+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:48.259860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.638846+0000","last_change":"2024-05-10T10:52:15.691796+0000","last_active":"2024-05-10T10:54:07.638846+0000","last_peered":"2024-05-10T10:54:07.638846+0000","last_clean":"2024-05-10T10:54:07.638846+0000","last_became_active":"2024-05-10T10:52:15.690952+0000","last_became_peered":"2024-05-10T10:52:15.690952+0000","last_unstale":"2024-05-10T10:54:07.638846+0000","last_undegraded":"2024-05-10T10:54:07.638846+0000","last_fullsized":"2024-05-10T10:54:07.638846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:10.645645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.905276+0000","last_change":"2024-05-10T10:52:15.683303+0000","last_active":"2024-05-10T10:53:08.905276+0000","last_peered":"2024-05-10T10:53:08.905276+0000","last_clean":"2024-05-10T10:53:08.905276+0000","last_became_active":"2024-05-10T10:52:15.682753+0000","last_became_peered":"2024-05-10T10:52:15.682753+0000","last_unstale":"2024-05-10T10:53:08.905276+0000","last_undegraded":"2024-05-10T10:53:08.905276+0000","last_fullsized":"2024-05-10T10:53:08.905276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:00.167463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.905081+0000","last_change":"2024-05-10T10:52:15.691668+0000","last_active":"2024-05-10T10:53:08.905081+0000","last_peered":"2024-05-10T10:53:08.905081+0000","last_clean":"2024-05-10T10:53:08.905081+0000","last_became_active":"2024-05-10T10:52:15.691323+0000","last_became_peered":"2024-05-10T10:52:15.691323+0000","last_unstale":"2024-05-10T10:53:08.905081+0000","last_undegraded":"2024-05-10T10:53:08.905081+0000","last_fullsized":"2024-05-10T10:53:08.905081+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:09.235092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.643801+0000","last_change":"2024-05-10T10:52:15.689859+0000","last_active":"2024-05-10T10:54:07.643801+0000","last_peered":"2024-05-10T10:54:07.643801+0000","last_clean":"2024-05-10T10:54:07.643801+0000","last_became_active":"2024-05-10T10:52:15.689060+0000","last_became_peered":"2024-05-10T10:52:15.689060+0000","last_unstale":"2024-05-10T10:54:07.643801+0000","last_undegraded":"2024-05-10T10:54:07.643801+0000","last_fullsized":"2024-05-10T10:54:07.643801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:42.029942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.634944+0000","last_change":"2024-05-10T10:52:15.686711+0000","last_active":"2024-05-10T10:54:07.634944+0000","last_peered":"2024-05-10T10:54:07.634944+0000","last_clean":"2024-05-10T10:54:07.634944+0000","last_became_active":"2024-05-10T10:52:15.685817+0000","last_became_peered":"2024-05-10T10:52:15.685817+0000","last_unstale":"2024-05-10T10:54:07.634944+0000","last_undegraded":"2024-05-10T10:54:07.634944+0000","last_fullsized":"2024-05-10T10:54:07.634944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:50:25.703341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.621883+0000","last_change":"2024-05-10T10:52:15.681702+0000","last_active":"2024-05-10T10:54:07.621883+0000","last_peered":"2024-05-10T10:54:07.621883+0000","last_clean":"2024-05-10T10:54:07.621883+0000","last_became_active":"2024-05-10T10:52:15.681400+0000","last_became_peered":"2024-05-10T10:52:15.681400+0000","last_unstale":"2024-05-10T10:54:07.621883+0000","last_undegraded":"2024-05-10T10:54:07.621883+0000","last_fullsized":"2024-05-10T10:54:07.621883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:07.520500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.590219+0000","last_change":"2024-05-10T10:52:15.684321+0000","last_active":"2024-05-10T10:53:09.590219+0000","last_peered":"2024-05-10T10:53:09.590219+0000","last_clean":"2024-05-10T10:53:09.590219+0000","last_became_active":"2024-05-10T10:52:15.683099+0000","last_became_peered":"2024-05-10T10:52:15.683099+0000","last_unstale":"2024-05-10T10:53:09.590219+0000","last_undegraded":"2024-05-10T10:53:09.590219+0000","last_fullsized":"2024-05-10T10:53:09.590219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:09.310292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":136,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.798832+0000","last_change":"2024-05-10T10:52:12.530258+0000","last_active":"2024-05-10T10:54:07.798832+0000","last_peered":"2024-05-10T10:54:07.798832+0000","last_clean":"2024-05-10T10:54:07.798832+0000","last_became_active":"2024-05-10T10:52:12.529842+0000","last_became_peered":"2024-05-10T10:52:12.529842+0000","last_unstale":"2024-05-10T10:54:07.798832+0000","last_undegraded":"2024-05-10T10:54:07.798832+0000","last_fullsized":"2024-05-10T10:54:07.798832+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:13.525038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.625673+0000","last_change":"2024-05-10T10:53:09.698541+0000","last_active":"2024-05-10T10:54:07.625673+0000","last_peered":"2024-05-10T10:54:07.625673+0000","last_clean":"2024-05-10T10:54:07.625673+0000","last_became_active":"2024-05-10T10:53:09.698219+0000","last_became_peered":"2024-05-10T10:53:09.698219+0000","last_unstale":"2024-05-10T10:54:07.625673+0000","last_undegraded":"2024-05-10T10:54:07.625673+0000","last_fullsized":"2024-05-10T10:54:07.625673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:27:11.837418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.910078+0000","last_change":"2024-05-10T10:52:12.630918+0000","last_active":"2024-05-10T10:53:08.910078+0000","last_peered":"2024-05-10T10:53:08.910078+0000","last_clean":"2024-05-10T10:53:08.910078+0000","last_became_active":"2024-05-10T10:52:12.630563+0000","last_became_peered":"2024-05-10T10:52:12.630563+0000","last_unstale":"2024-05-10T10:53:08.910078+0000","last_undegraded":"2024-05-10T10:53:08.910078+0000","last_fullsized":"2024-05-10T10:53:08.910078+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:58:03.341362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.907063+0000","last_change":"2024-05-10T10:52:15.676831+0000","last_active":"2024-05-10T10:53:08.907063+0000","last_peered":"2024-05-10T10:53:08.907063+0000","last_clean":"2024-05-10T10:53:08.907063+0000","last_became_active":"2024-05-10T10:52:15.676506+0000","last_became_peered":"2024-05-10T10:52:15.676506+0000","last_unstale":"2024-05-10T10:53:08.907063+0000","last_undegraded":"2024-05-10T10:53:08.907063+0000","last_fullsized":"2024-05-10T10:53:08.907063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:43.498800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908910+0000","last_change":"2024-05-10T10:52:12.532092+0000","last_active":"2024-05-10T10:53:08.908910+0000","last_peered":"2024-05-10T10:53:08.908910+0000","last_clean":"2024-05-10T10:53:08.908910+0000","last_became_active":"2024-05-10T10:52:12.531649+0000","last_became_peered":"2024-05-10T10:52:12.531649+0000","last_unstale":"2024-05-10T10:53:08.908910+0000","last_undegraded":"2024-05-10T10:53:08.908910+0000","last_fullsized":"2024-05-10T10:53:08.908910+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.709935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.641535+0000","last_change":"2024-05-10T10:52:15.683024+0000","last_active":"2024-05-10T10:54:07.641535+0000","last_peered":"2024-05-10T10:54:07.641535+0000","last_clean":"2024-05-10T10:54:07.641535+0000","last_became_active":"2024-05-10T10:52:15.682655+0000","last_became_peered":"2024-05-10T10:52:15.682655+0000","last_unstale":"2024-05-10T10:54:07.641535+0000","last_undegraded":"2024-05-10T10:54:07.641535+0000","last_fullsized":"2024-05-10T10:54:07.641535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:27.922746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908770+0000","last_change":"2024-05-10T10:52:12.534000+0000","last_active":"2024-05-10T10:53:08.908770+0000","last_peered":"2024-05-10T10:53:08.908770+0000","last_clean":"2024-05-10T10:53:08.908770+0000","last_became_active":"2024-05-10T10:52:12.533609+0000","last_became_peered":"2024-05-10T10:52:12.533609+0000","last_unstale":"2024-05-10T10:53:08.908770+0000","last_undegraded":"2024-05-10T10:53:08.908770+0000","last_fullsized":"2024-05-10T10:53:08.908770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:38:18.115926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697348+0000","last_change":"2024-05-10T10:52:15.695263+0000","last_active":"2024-05-10T10:53:09.697348+0000","last_peered":"2024-05-10T10:53:09.697348+0000","last_clean":"2024-05-10T10:53:09.697348+0000","last_became_active":"2024-05-10T10:52:15.694890+0000","last_became_peered":"2024-05-10T10:52:15.694890+0000","last_unstale":"2024-05-10T10:53:09.697348+0000","last_undegraded":"2024-05-10T10:53:09.697348+0000","last_fullsized":"2024-05-10T10:53:09.697348+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:50:32.361110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"80'6","reported_seq":127,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:03.804392+0000","last_change":"2024-05-10T10:52:12.534673+0000","last_active":"2024-05-10T10:54:03.804392+0000","last_peered":"2024-05-10T10:54:03.804392+0000","last_clean":"2024-05-10T10:54:03.804392+0000","last_became_active":"2024-05-10T10:52:12.534031+0000","last_became_peered":"2024-05-10T10:52:12.534031+0000","last_unstale":"2024-05-10T10:54:03.804392+0000","last_undegraded":"2024-05-10T10:54:03.804392+0000","last_fullsized":"2024-05-10T10:54:03.804392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:32.030866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908406+0000","last_change":"2024-05-10T10:52:15.683282+0000","last_active":"2024-05-10T10:53:08.908406+0000","last_peered":"2024-05-10T10:53:08.908406+0000","last_clean":"2024-05-10T10:53:08.908406+0000","last_became_active":"2024-05-10T10:52:15.682421+0000","last_became_peered":"2024-05-10T10:52:15.682421+0000","last_unstale":"2024-05-10T10:53:08.908406+0000","last_undegraded":"2024-05-10T10:53:08.908406+0000","last_fullsized":"2024-05-10T10:53:08.908406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:12.014145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.724072+0000","last_change":"2024-05-10T10:52:12.532161+0000","last_active":"2024-05-10T10:53:09.724072+0000","last_peered":"2024-05-10T10:53:09.724072+0000","last_clean":"2024-05-10T10:53:09.724072+0000","last_became_active":"2024-05-10T10:52:12.531780+0000","last_became_peered":"2024-05-10T10:52:12.531780+0000","last_unstale":"2024-05-10T10:53:09.724072+0000","last_undegraded":"2024-05-10T10:53:09.724072+0000","last_fullsized":"2024-05-10T10:53:09.724072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:08.724945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697363+0000","last_change":"2024-05-10T10:52:15.694602+0000","last_active":"2024-05-10T10:53:09.697363+0000","last_peered":"2024-05-10T10:53:09.697363+0000","last_clean":"2024-05-10T10:53:09.697363+0000","last_became_active":"2024-05-10T10:52:15.694279+0000","last_became_peered":"2024-05-10T10:52:15.694279+0000","last_unstale":"2024-05-10T10:53:09.697363+0000","last_undegraded":"2024-05-10T10:53:09.697363+0000","last_fullsized":"2024-05-10T10:53:09.697363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:12:16.286092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.902432+0000","last_change":"2024-05-10T10:52:12.526817+0000","last_active":"2024-05-10T10:53:08.902432+0000","last_peered":"2024-05-10T10:53:08.902432+0000","last_clean":"2024-05-10T10:53:08.902432+0000","last_became_active":"2024-05-10T10:52:12.526315+0000","last_became_peered":"2024-05-10T10:52:12.526315+0000","last_unstale":"2024-05-10T10:53:08.902432+0000","last_undegraded":"2024-05-10T10:53:08.902432+0000","last_fullsized":"2024-05-10T10:53:08.902432+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:49.968299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.909414+0000","last_change":"2024-05-10T10:52:15.683201+0000","last_active":"2024-05-10T10:53:08.909414+0000","last_peered":"2024-05-10T10:53:08.909414+0000","last_clean":"2024-05-10T10:53:08.909414+0000","last_became_active":"2024-05-10T10:52:15.682412+0000","last_became_peered":"2024-05-10T10:52:15.682412+0000","last_unstale":"2024-05-10T10:53:08.909414+0000","last_undegraded":"2024-05-10T10:53:08.909414+0000","last_fullsized":"2024-05-10T10:53:08.909414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:22.001179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.696993+0000","last_change":"2024-05-10T10:52:12.531058+0000","last_active":"2024-05-10T10:53:09.696993+0000","last_peered":"2024-05-10T10:53:09.696993+0000","last_clean":"2024-05-10T10:53:09.696993+0000","last_became_active":"2024-05-10T10:52:12.530655+0000","last_became_peered":"2024-05-10T10:52:12.530655+0000","last_unstale":"2024-05-10T10:53:09.696993+0000","last_undegraded":"2024-05-10T10:53:09.696993+0000","last_fullsized":"2024-05-10T10:53:09.696993+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:36:52.300420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.622098+0000","last_change":"2024-05-10T10:52:15.681697+0000","last_active":"2024-05-10T10:54:07.622098+0000","last_peered":"2024-05-10T10:54:07.622098+0000","last_clean":"2024-05-10T10:54:07.622098+0000","last_became_active":"2024-05-10T10:52:15.681396+0000","last_became_peered":"2024-05-10T10:52:15.681396+0000","last_unstale":"2024-05-10T10:54:07.622098+0000","last_undegraded":"2024-05-10T10:54:07.622098+0000","last_fullsized":"2024-05-10T10:54:07.622098+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:35.390837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:04.805141+0000","last_change":"2024-05-10T10:52:12.532089+0000","last_active":"2024-05-10T10:54:04.805141+0000","last_peered":"2024-05-10T10:54:04.805141+0000","last_clean":"2024-05-10T10:54:04.805141+0000","last_became_active":"2024-05-10T10:52:12.531641+0000","last_became_peered":"2024-05-10T10:52:12.531641+0000","last_unstale":"2024-05-10T10:54:04.805141+0000","last_undegraded":"2024-05-10T10:54:04.805141+0000","last_fullsized":"2024-05-10T10:54:04.805141+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:34.517079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":184,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.641247+0000","last_change":"2024-05-10T10:52:15.685566+0000","last_active":"2024-05-10T10:54:07.641247+0000","last_peered":"2024-05-10T10:54:07.641247+0000","last_clean":"2024-05-10T10:54:07.641247+0000","last_became_active":"2024-05-10T10:52:15.685220+0000","last_became_peered":"2024-05-10T10:52:15.685220+0000","last_unstale":"2024-05-10T10:54:07.641247+0000","last_undegraded":"2024-05-10T10:54:07.641247+0000","last_fullsized":"2024-05-10T10:54:07.641247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:06.140961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.906334+0000","last_change":"2024-05-10T10:52:12.533182+0000","last_active":"2024-05-10T10:53:08.906334+0000","last_peered":"2024-05-10T10:53:08.906334+0000","last_clean":"2024-05-10T10:53:08.906334+0000","last_became_active":"2024-05-10T10:52:12.532821+0000","last_became_peered":"2024-05-10T10:52:12.532821+0000","last_unstale":"2024-05-10T10:53:08.906334+0000","last_undegraded":"2024-05-10T10:53:08.906334+0000","last_fullsized":"2024-05-10T10:53:08.906334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:54:15.930093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.907039+0000","last_change":"2024-05-10T10:52:15.690491+0000","last_active":"2024-05-10T10:53:08.907039+0000","last_peered":"2024-05-10T10:53:08.907039+0000","last_clean":"2024-05-10T10:53:08.907039+0000","last_became_active":"2024-05-10T10:52:15.690200+0000","last_became_peered":"2024-05-10T10:52:15.690200+0000","last_unstale":"2024-05-10T10:53:08.907039+0000","last_undegraded":"2024-05-10T10:53:08.907039+0000","last_fullsized":"2024-05-10T10:53:08.907039+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:28.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697478+0000","last_change":"2024-05-10T10:52:12.631966+0000","last_active":"2024-05-10T10:53:09.697478+0000","last_peered":"2024-05-10T10:53:09.697478+0000","last_clean":"2024-05-10T10:53:09.697478+0000","last_became_active":"2024-05-10T10:52:12.631539+0000","last_became_peered":"2024-05-10T10:52:12.631539+0000","last_unstale":"2024-05-10T10:53:09.697478+0000","last_undegraded":"2024-05-10T10:53:09.697478+0000","last_fullsized":"2024-05-10T10:53:09.697478+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:32:52.392307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645823+0000","last_change":"2024-05-10T10:52:15.692893+0000","last_active":"2024-05-10T10:54:07.645823+0000","last_peered":"2024-05-10T10:54:07.645823+0000","last_clean":"2024-05-10T10:54:07.645823+0000","last_became_active":"2024-05-10T10:52:15.692528+0000","last_became_peered":"2024-05-10T10:52:15.692528+0000","last_unstale":"2024-05-10T10:54:07.645823+0000","last_undegraded":"2024-05-10T10:54:07.645823+0000","last_fullsized":"2024-05-10T10:54:07.645823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:51.452294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'33","reported_seq":252,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:04.812459+0000","last_change":"2024-05-10T10:52:12.532094+0000","last_active":"2024-05-10T10:54:04.812459+0000","last_peered":"2024-05-10T10:54:04.812459+0000","last_clean":"2024-05-10T10:54:04.812459+0000","last_became_active":"2024-05-10T10:52:12.531719+0000","last_became_peered":"2024-05-10T10:52:12.531719+0000","last_unstale":"2024-05-10T10:54:04.812459+0000","last_undegraded":"2024-05-10T10:54:04.812459+0000","last_fullsized":"2024-05-10T10:54:04.812459+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:43:52.697528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64724,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":193,"num_read_kb":159,"num_write":35,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908644+0000","last_change":"2024-05-10T10:52:15.688187+0000","last_active":"2024-05-10T10:53:08.908644+0000","last_peered":"2024-05-10T10:53:08.908644+0000","last_clean":"2024-05-10T10:53:08.908644+0000","last_became_active":"2024-05-10T10:52:15.687821+0000","last_became_peered":"2024-05-10T10:52:15.687821+0000","last_unstale":"2024-05-10T10:53:08.908644+0000","last_undegraded":"2024-05-10T10:53:08.908644+0000","last_fullsized":"2024-05-10T10:53:08.908644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:54.425892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.589972+0000","last_change":"2024-05-10T10:52:12.532185+0000","last_active":"2024-05-10T10:53:09.589972+0000","last_peered":"2024-05-10T10:53:09.589972+0000","last_clean":"2024-05-10T10:53:09.589972+0000","last_became_active":"2024-05-10T10:52:12.531795+0000","last_became_peered":"2024-05-10T10:52:12.531795+0000","last_unstale":"2024-05-10T10:53:09.589972+0000","last_undegraded":"2024-05-10T10:53:09.589972+0000","last_fullsized":"2024-05-10T10:53:09.589972+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:51.704767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.634427+0000","last_change":"2024-05-10T10:52:15.684388+0000","last_active":"2024-05-10T10:54:07.634427+0000","last_peered":"2024-05-10T10:54:07.634427+0000","last_clean":"2024-05-10T10:54:07.634427+0000","last_became_active":"2024-05-10T10:52:15.684061+0000","last_became_peered":"2024-05-10T10:52:15.684061+0000","last_unstale":"2024-05-10T10:54:07.634427+0000","last_undegraded":"2024-05-10T10:54:07.634427+0000","last_fullsized":"2024-05-10T10:54:07.634427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:19.462083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697004+0000","last_change":"2024-05-10T10:52:12.531912+0000","last_active":"2024-05-10T10:53:09.697004+0000","last_peered":"2024-05-10T10:53:09.697004+0000","last_clean":"2024-05-10T10:53:09.697004+0000","last_became_active":"2024-05-10T10:52:12.531501+0000","last_became_peered":"2024-05-10T10:52:12.531501+0000","last_unstale":"2024-05-10T10:53:09.697004+0000","last_undegraded":"2024-05-10T10:53:09.697004+0000","last_fullsized":"2024-05-10T10:53:09.697004+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:15.086519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.639397+0000","last_change":"2024-05-10T10:52:15.686521+0000","last_active":"2024-05-10T10:54:07.639397+0000","last_peered":"2024-05-10T10:54:07.639397+0000","last_clean":"2024-05-10T10:54:07.639397+0000","last_became_active":"2024-05-10T10:52:15.686142+0000","last_became_peered":"2024-05-10T10:52:15.686142+0000","last_unstale":"2024-05-10T10:54:07.639397+0000","last_undegraded":"2024-05-10T10:54:07.639397+0000","last_fullsized":"2024-05-10T10:54:07.639397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:40.315401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":126,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:04.813112+0000","last_change":"2024-05-10T10:52:12.527774+0000","last_active":"2024-05-10T10:54:04.813112+0000","last_peered":"2024-05-10T10:54:04.813112+0000","last_clean":"2024-05-10T10:54:04.813112+0000","last_became_active":"2024-05-10T10:52:12.527412+0000","last_became_peered":"2024-05-10T10:52:12.527412+0000","last_unstale":"2024-05-10T10:54:04.813112+0000","last_undegraded":"2024-05-10T10:54:04.813112+0000","last_fullsized":"2024-05-10T10:54:04.813112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:51:21.334653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628067+0000","last_change":"2024-05-10T10:52:15.693427+0000","last_active":"2024-05-10T10:54:07.628067+0000","last_peered":"2024-05-10T10:54:07.628067+0000","last_clean":"2024-05-10T10:54:07.628067+0000","last_became_active":"2024-05-10T10:52:15.693114+0000","last_became_peered":"2024-05-10T10:52:15.693114+0000","last_unstale":"2024-05-10T10:54:07.628067+0000","last_undegraded":"2024-05-10T10:54:07.628067+0000","last_fullsized":"2024-05-10T10:54:07.628067+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:25:36.423413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908346+0000","last_change":"2024-05-10T10:52:12.631475+0000","last_active":"2024-05-10T10:53:08.908346+0000","last_peered":"2024-05-10T10:53:08.908346+0000","last_clean":"2024-05-10T10:53:08.908346+0000","last_became_active":"2024-05-10T10:52:12.631079+0000","last_became_peered":"2024-05-10T10:52:12.631079+0000","last_unstale":"2024-05-10T10:53:08.908346+0000","last_undegraded":"2024-05-10T10:53:08.908346+0000","last_fullsized":"2024-05-10T10:53:08.908346+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:52.975413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.630966+0000","last_change":"2024-05-10T10:53:09.302243+0000","last_active":"2024-05-10T10:54:07.630966+0000","last_peered":"2024-05-10T10:54:07.630966+0000","last_clean":"2024-05-10T10:54:07.630966+0000","last_became_active":"2024-05-10T10:53:09.301866+0000","last_became_peered":"2024-05-10T10:53:09.301866+0000","last_unstale":"2024-05-10T10:54:07.630966+0000","last_undegraded":"2024-05-10T10:54:07.630966+0000","last_fullsized":"2024-05-10T10:54:07.630966+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:07.609569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908982+0000","last_change":"2024-05-10T10:52:12.533071+0000","last_active":"2024-05-10T10:53:08.908982+0000","last_peered":"2024-05-10T10:53:08.908982+0000","last_clean":"2024-05-10T10:53:08.908982+0000","last_became_active":"2024-05-10T10:52:12.532655+0000","last_became_peered":"2024-05-10T10:52:12.532655+0000","last_unstale":"2024-05-10T10:53:08.908982+0000","last_undegraded":"2024-05-10T10:53:08.908982+0000","last_fullsized":"2024-05-10T10:53:08.908982+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:30.723701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.613687+0000","last_change":"2024-05-10T10:52:15.697362+0000","last_active":"2024-05-10T10:54:07.613687+0000","last_peered":"2024-05-10T10:54:07.613687+0000","last_clean":"2024-05-10T10:54:07.613687+0000","last_became_active":"2024-05-10T10:52:15.696915+0000","last_became_peered":"2024-05-10T10:52:15.696915+0000","last_unstale":"2024-05-10T10:54:07.613687+0000","last_undegraded":"2024-05-10T10:54:07.613687+0000","last_fullsized":"2024-05-10T10:54:07.613687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:29:03.365667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.909109+0000","last_change":"2024-05-10T10:53:08.909109+0000","last_active":"2024-05-10T10:53:08.909109+0000","last_peered":"2024-05-10T10:53:08.909109+0000","last_clean":"2024-05-10T10:53:08.909109+0000","last_became_active":"2024-05-10T10:53:08.908677+0000","last_became_peered":"2024-05-10T10:53:08.908677+0000","last_unstale":"2024-05-10T10:53:08.909109+0000","last_undegraded":"2024-05-10T10:53:08.909109+0000","last_fullsized":"2024-05-10T10:53:08.909109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:51.380479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.724303+0000","last_change":"2024-05-10T10:52:15.675837+0000","last_active":"2024-05-10T10:53:09.724303+0000","last_peered":"2024-05-10T10:53:09.724303+0000","last_clean":"2024-05-10T10:53:09.724303+0000","last_became_active":"2024-05-10T10:52:15.675438+0000","last_became_peered":"2024-05-10T10:52:15.675438+0000","last_unstale":"2024-05-10T10:53:09.724303+0000","last_undegraded":"2024-05-10T10:53:09.724303+0000","last_fullsized":"2024-05-10T10:53:09.724303+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:23.142008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":128,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.799360+0000","last_change":"2024-05-10T10:52:12.530141+0000","last_active":"2024-05-10T10:54:07.799360+0000","last_peered":"2024-05-10T10:54:07.799360+0000","last_clean":"2024-05-10T10:54:07.799360+0000","last_became_active":"2024-05-10T10:52:12.529771+0000","last_became_peered":"2024-05-10T10:52:12.529771+0000","last_unstale":"2024-05-10T10:54:07.799360+0000","last_undegraded":"2024-05-10T10:54:07.799360+0000","last_fullsized":"2024-05-10T10:54:07.799360+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:42.803789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.724269+0000","last_change":"2024-05-10T10:52:15.686934+0000","last_active":"2024-05-10T10:53:09.724269+0000","last_peered":"2024-05-10T10:53:09.724269+0000","last_clean":"2024-05-10T10:53:09.724269+0000","last_became_active":"2024-05-10T10:52:15.686494+0000","last_became_peered":"2024-05-10T10:52:15.686494+0000","last_unstale":"2024-05-10T10:53:09.724269+0000","last_undegraded":"2024-05-10T10:53:09.724269+0000","last_fullsized":"2024-05-10T10:53:09.724269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:18.049088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697461+0000","last_change":"2024-05-10T10:52:15.693243+0000","last_active":"2024-05-10T10:53:09.697461+0000","last_peered":"2024-05-10T10:53:09.697461+0000","last_clean":"2024-05-10T10:53:09.697461+0000","last_became_active":"2024-05-10T10:52:15.692868+0000","last_became_peered":"2024-05-10T10:52:15.692868+0000","last_unstale":"2024-05-10T10:53:09.697461+0000","last_undegraded":"2024-05-10T10:53:09.697461+0000","last_fullsized":"2024-05-10T10:53:09.697461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:25.316500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":128,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.816856+0000","last_change":"2024-05-10T10:52:12.630916+0000","last_active":"2024-05-10T10:54:07.816856+0000","last_peered":"2024-05-10T10:54:07.816856+0000","last_clean":"2024-05-10T10:54:07.816856+0000","last_became_active":"2024-05-10T10:52:12.630564+0000","last_became_peered":"2024-05-10T10:52:12.630564+0000","last_unstale":"2024-05-10T10:54:07.816856+0000","last_undegraded":"2024-05-10T10:54:07.816856+0000","last_fullsized":"2024-05-10T10:54:07.816856+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:09:46.434409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.909804+0000","last_change":"2024-05-10T10:52:15.691017+0000","last_active":"2024-05-10T10:53:08.909804+0000","last_peered":"2024-05-10T10:53:08.909804+0000","last_clean":"2024-05-10T10:53:08.909804+0000","last_became_active":"2024-05-10T10:52:15.690705+0000","last_became_peered":"2024-05-10T10:52:15.690705+0000","last_unstale":"2024-05-10T10:53:08.909804+0000","last_undegraded":"2024-05-10T10:53:08.909804+0000","last_fullsized":"2024-05-10T10:53:08.909804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:50:43.517455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.057942+0000","last_change":"2024-05-10T10:52:12.529180+0000","last_active":"2024-05-10T10:53:09.057942+0000","last_peered":"2024-05-10T10:53:09.057942+0000","last_clean":"2024-05-10T10:53:09.057942+0000","last_became_active":"2024-05-10T10:52:12.528570+0000","last_became_peered":"2024-05-10T10:52:12.528570+0000","last_unstale":"2024-05-10T10:53:09.057942+0000","last_undegraded":"2024-05-10T10:53:09.057942+0000","last_fullsized":"2024-05-10T10:53:09.057942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:31:53.254302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.906014+0000","last_change":"2024-05-10T10:50:51.113120+0000","last_active":"2024-05-10T10:53:08.906014+0000","last_peered":"2024-05-10T10:53:08.906014+0000","last_clean":"2024-05-10T10:53:08.906014+0000","last_became_active":"2024-05-10T10:50:51.107803+0000","last_became_peered":"2024-05-10T10:50:51.107803+0000","last_unstale":"2024-05-10T10:53:08.906014+0000","last_undegraded":"2024-05-10T10:53:08.906014+0000","last_fullsized":"2024-05-10T10:53:08.906014+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:47:32.190034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:47:32.190034+0000","last_clean_scrub_stamp":"2024-05-10T10:47:32.190034+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:53.599839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.634838+0000","last_change":"2024-05-10T10:52:15.689856+0000","last_active":"2024-05-10T10:54:07.634838+0000","last_peered":"2024-05-10T10:54:07.634838+0000","last_clean":"2024-05-10T10:54:07.634838+0000","last_became_active":"2024-05-10T10:52:15.689544+0000","last_became_peered":"2024-05-10T10:52:15.689544+0000","last_unstale":"2024-05-10T10:54:07.634838+0000","last_undegraded":"2024-05-10T10:54:07.634838+0000","last_fullsized":"2024-05-10T10:54:07.634838+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:39.374857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.905925+0000","last_change":"2024-05-10T10:52:12.532217+0000","last_active":"2024-05-10T10:53:08.905925+0000","last_peered":"2024-05-10T10:53:08.905925+0000","last_clean":"2024-05-10T10:53:08.905925+0000","last_became_active":"2024-05-10T10:52:12.531575+0000","last_became_peered":"2024-05-10T10:52:12.531575+0000","last_unstale":"2024-05-10T10:53:08.905925+0000","last_undegraded":"2024-05-10T10:53:08.905925+0000","last_fullsized":"2024-05-10T10:53:08.905925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:15:59.493728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908830+0000","last_change":"2024-05-10T10:52:12.631990+0000","last_active":"2024-05-10T10:53:08.908830+0000","last_peered":"2024-05-10T10:53:08.908830+0000","last_clean":"2024-05-10T10:53:08.908830+0000","last_became_active":"2024-05-10T10:52:12.631061+0000","last_became_peered":"2024-05-10T10:52:12.631061+0000","last_unstale":"2024-05-10T10:53:08.908830+0000","last_undegraded":"2024-05-10T10:53:08.908830+0000","last_fullsized":"2024-05-10T10:53:08.908830+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:30.298079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.629605+0000","last_change":"2024-05-10T10:52:15.678797+0000","last_active":"2024-05-10T10:54:07.629605+0000","last_peered":"2024-05-10T10:54:07.629605+0000","last_clean":"2024-05-10T10:54:07.629605+0000","last_became_active":"2024-05-10T10:52:15.678388+0000","last_became_peered":"2024-05-10T10:52:15.678388+0000","last_unstale":"2024-05-10T10:54:07.629605+0000","last_undegraded":"2024-05-10T10:54:07.629605+0000","last_fullsized":"2024-05-10T10:54:07.629605+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:15.314479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'16","reported_seq":58,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.917374+0000","last_change":"2024-05-10T10:53:08.916967+0000","last_active":"2024-05-10T10:53:08.917374+0000","last_peered":"2024-05-10T10:53:08.917374+0000","last_clean":"2024-05-10T10:53:08.917374+0000","last_became_active":"2024-05-10T10:53:08.910538+0000","last_became_peered":"2024-05-10T10:53:08.910538+0000","last_unstale":"2024-05-10T10:53:08.917374+0000","last_undegraded":"2024-05-10T10:53:08.917374+0000","last_fullsized":"2024-05-10T10:53:08.917374+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:32.747935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.909204+0000","last_change":"2024-05-10T10:52:15.688313+0000","last_active":"2024-05-10T10:53:08.909204+0000","last_peered":"2024-05-10T10:53:08.909204+0000","last_clean":"2024-05-10T10:53:08.909204+0000","last_became_active":"2024-05-10T10:52:15.688028+0000","last_became_peered":"2024-05-10T10:52:15.688028+0000","last_unstale":"2024-05-10T10:53:08.909204+0000","last_undegraded":"2024-05-10T10:53:08.909204+0000","last_fullsized":"2024-05-10T10:53:08.909204+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:03.815985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.058115+0000","last_change":"2024-05-10T10:52:12.529409+0000","last_active":"2024-05-10T10:53:09.058115+0000","last_peered":"2024-05-10T10:53:09.058115+0000","last_clean":"2024-05-10T10:53:09.058115+0000","last_became_active":"2024-05-10T10:52:12.528837+0000","last_became_peered":"2024-05-10T10:52:12.528837+0000","last_unstale":"2024-05-10T10:53:09.058115+0000","last_undegraded":"2024-05-10T10:53:09.058115+0000","last_fullsized":"2024-05-10T10:53:09.058115+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:28.280292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.910952+0000","last_change":"2024-05-10T10:53:08.910952+0000","last_active":"2024-05-10T10:53:08.910952+0000","last_peered":"2024-05-10T10:53:08.910952+0000","last_clean":"2024-05-10T10:53:08.910952+0000","last_became_active":"2024-05-10T10:53:08.910564+0000","last_became_peered":"2024-05-10T10:53:08.910564+0000","last_unstale":"2024-05-10T10:53:08.910952+0000","last_undegraded":"2024-05-10T10:53:08.910952+0000","last_fullsized":"2024-05-10T10:53:08.910952+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:20.289280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.300698+0000","last_change":"2024-05-10T10:52:12.631048+0000","last_active":"2024-05-10T10:53:09.300698+0000","last_peered":"2024-05-10T10:53:09.300698+0000","last_clean":"2024-05-10T10:53:09.300698+0000","last_became_active":"2024-05-10T10:52:12.630754+0000","last_became_peered":"2024-05-10T10:52:12.630754+0000","last_unstale":"2024-05-10T10:53:09.300698+0000","last_undegraded":"2024-05-10T10:53:09.300698+0000","last_fullsized":"2024-05-10T10:53:09.300698+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:57.755423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908311+0000","last_change":"2024-05-10T10:52:15.684552+0000","last_active":"2024-05-10T10:53:08.908311+0000","last_peered":"2024-05-10T10:53:08.908311+0000","last_clean":"2024-05-10T10:53:08.908311+0000","last_became_active":"2024-05-10T10:52:15.684174+0000","last_became_peered":"2024-05-10T10:52:15.684174+0000","last_unstale":"2024-05-10T10:53:08.908311+0000","last_undegraded":"2024-05-10T10:53:08.908311+0000","last_fullsized":"2024-05-10T10:53:08.908311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:21:51.633525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.909634+0000","last_change":"2024-05-10T10:52:12.525692+0000","last_active":"2024-05-10T10:53:08.909634+0000","last_peered":"2024-05-10T10:53:08.909634+0000","last_clean":"2024-05-10T10:53:08.909634+0000","last_became_active":"2024-05-10T10:52:12.525436+0000","last_became_peered":"2024-05-10T10:52:12.525436+0000","last_unstale":"2024-05-10T10:53:08.909634+0000","last_undegraded":"2024-05-10T10:53:08.909634+0000","last_fullsized":"2024-05-10T10:53:08.909634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:34:40.801973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.627450+0000","last_change":"2024-05-10T10:52:15.689838+0000","last_active":"2024-05-10T10:54:07.627450+0000","last_peered":"2024-05-10T10:54:07.627450+0000","last_clean":"2024-05-10T10:54:07.627450+0000","last_became_active":"2024-05-10T10:52:15.689481+0000","last_became_peered":"2024-05-10T10:52:15.689481+0000","last_unstale":"2024-05-10T10:54:07.627450+0000","last_undegraded":"2024-05-10T10:54:07.627450+0000","last_fullsized":"2024-05-10T10:54:07.627450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:02:27.382859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.590054+0000","last_change":"2024-05-10T10:52:12.533782+0000","last_active":"2024-05-10T10:53:09.590054+0000","last_peered":"2024-05-10T10:53:09.590054+0000","last_clean":"2024-05-10T10:53:09.590054+0000","last_became_active":"2024-05-10T10:52:12.533457+0000","last_became_peered":"2024-05-10T10:52:12.533457+0000","last_unstale":"2024-05-10T10:53:09.590054+0000","last_undegraded":"2024-05-10T10:53:09.590054+0000","last_fullsized":"2024-05-10T10:53:09.590054+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:17.372672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908792+0000","last_change":"2024-05-10T10:52:15.691594+0000","last_active":"2024-05-10T10:53:08.908792+0000","last_peered":"2024-05-10T10:53:08.908792+0000","last_clean":"2024-05-10T10:53:08.908792+0000","last_became_active":"2024-05-10T10:52:15.690300+0000","last_became_peered":"2024-05-10T10:52:15.690300+0000","last_unstale":"2024-05-10T10:53:08.908792+0000","last_undegraded":"2024-05-10T10:53:08.908792+0000","last_fullsized":"2024-05-10T10:53:08.908792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:05.228834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908547+0000","last_change":"2024-05-10T10:52:12.530693+0000","last_active":"2024-05-10T10:53:08.908547+0000","last_peered":"2024-05-10T10:53:08.908547+0000","last_clean":"2024-05-10T10:53:08.908547+0000","last_became_active":"2024-05-10T10:52:12.530310+0000","last_became_peered":"2024-05-10T10:52:12.530310+0000","last_unstale":"2024-05-10T10:53:08.908547+0000","last_undegraded":"2024-05-10T10:53:08.908547+0000","last_fullsized":"2024-05-10T10:53:08.908547+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:42:46.967318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645791+0000","last_change":"2024-05-10T10:52:15.695473+0000","last_active":"2024-05-10T10:54:07.645791+0000","last_peered":"2024-05-10T10:54:07.645791+0000","last_clean":"2024-05-10T10:54:07.645791+0000","last_became_active":"2024-05-10T10:52:15.695121+0000","last_became_peered":"2024-05-10T10:52:15.695121+0000","last_unstale":"2024-05-10T10:54:07.645791+0000","last_undegraded":"2024-05-10T10:54:07.645791+0000","last_fullsized":"2024-05-10T10:54:07.645791+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:48:08.019465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":127,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:05.807854+0000","last_change":"2024-05-10T10:52:12.630799+0000","last_active":"2024-05-10T10:54:05.807854+0000","last_peered":"2024-05-10T10:54:05.807854+0000","last_clean":"2024-05-10T10:54:05.807854+0000","last_became_active":"2024-05-10T10:52:12.630448+0000","last_became_peered":"2024-05-10T10:52:12.630448+0000","last_unstale":"2024-05-10T10:54:05.807854+0000","last_undegraded":"2024-05-10T10:54:05.807854+0000","last_fullsized":"2024-05-10T10:54:05.807854+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:27.335062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.644600+0000","last_change":"2024-05-10T10:52:15.686691+0000","last_active":"2024-05-10T10:54:07.644600+0000","last_peered":"2024-05-10T10:54:07.644600+0000","last_clean":"2024-05-10T10:54:07.644600+0000","last_became_active":"2024-05-10T10:52:15.685886+0000","last_became_peered":"2024-05-10T10:52:15.685886+0000","last_unstale":"2024-05-10T10:54:07.644600+0000","last_undegraded":"2024-05-10T10:54:07.644600+0000","last_fullsized":"2024-05-10T10:54:07.644600+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:45.199414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697313+0000","last_change":"2024-05-10T10:52:12.533535+0000","last_active":"2024-05-10T10:53:09.697313+0000","last_peered":"2024-05-10T10:53:09.697313+0000","last_clean":"2024-05-10T10:53:09.697313+0000","last_became_active":"2024-05-10T10:52:12.533146+0000","last_became_peered":"2024-05-10T10:52:12.533146+0000","last_unstale":"2024-05-10T10:53:09.697313+0000","last_undegraded":"2024-05-10T10:53:09.697313+0000","last_fullsized":"2024-05-10T10:53:09.697313+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:07:16.138240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.633863+0000","last_change":"2024-05-10T10:52:15.692013+0000","last_active":"2024-05-10T10:54:07.633863+0000","last_peered":"2024-05-10T10:54:07.633863+0000","last_clean":"2024-05-10T10:54:07.633863+0000","last_became_active":"2024-05-10T10:52:15.691660+0000","last_became_peered":"2024-05-10T10:52:15.691660+0000","last_unstale":"2024-05-10T10:54:07.633863+0000","last_undegraded":"2024-05-10T10:54:07.633863+0000","last_fullsized":"2024-05-10T10:54:07.633863+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:58.780961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.902457+0000","last_change":"2024-05-10T10:52:12.530962+0000","last_active":"2024-05-10T10:53:08.902457+0000","last_peered":"2024-05-10T10:53:08.902457+0000","last_clean":"2024-05-10T10:53:08.902457+0000","last_became_active":"2024-05-10T10:52:12.530610+0000","last_became_peered":"2024-05-10T10:52:12.530610+0000","last_unstale":"2024-05-10T10:53:08.902457+0000","last_undegraded":"2024-05-10T10:53:08.902457+0000","last_fullsized":"2024-05-10T10:53:08.902457+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:04:13.484713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.637709+0000","last_change":"2024-05-10T10:52:15.687218+0000","last_active":"2024-05-10T10:54:07.637709+0000","last_peered":"2024-05-10T10:54:07.637709+0000","last_clean":"2024-05-10T10:54:07.637709+0000","last_became_active":"2024-05-10T10:52:15.686888+0000","last_became_peered":"2024-05-10T10:52:15.686888+0000","last_unstale":"2024-05-10T10:54:07.637709+0000","last_undegraded":"2024-05-10T10:54:07.637709+0000","last_fullsized":"2024-05-10T10:54:07.637709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:53:53.420063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.627323+0000","last_change":"2024-05-10T10:52:15.691196+0000","last_active":"2024-05-10T10:54:07.627323+0000","last_peered":"2024-05-10T10:54:07.627323+0000","last_clean":"2024-05-10T10:54:07.627323+0000","last_became_active":"2024-05-10T10:52:15.690865+0000","last_became_peered":"2024-05-10T10:52:15.690865+0000","last_unstale":"2024-05-10T10:54:07.627323+0000","last_undegraded":"2024-05-10T10:54:07.627323+0000","last_fullsized":"2024-05-10T10:54:07.627323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:02:04.666193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.589851+0000","last_change":"2024-05-10T10:52:15.691239+0000","last_active":"2024-05-10T10:53:09.589851+0000","last_peered":"2024-05-10T10:53:09.589851+0000","last_clean":"2024-05-10T10:53:09.589851+0000","last_became_active":"2024-05-10T10:52:15.690877+0000","last_became_peered":"2024-05-10T10:52:15.690877+0000","last_unstale":"2024-05-10T10:53:09.589851+0000","last_undegraded":"2024-05-10T10:53:09.589851+0000","last_fullsized":"2024-05-10T10:53:09.589851+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:16.564872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.589831+0000","last_change":"2024-05-10T10:52:15.681784+0000","last_active":"2024-05-10T10:53:09.589831+0000","last_peered":"2024-05-10T10:53:09.589831+0000","last_clean":"2024-05-10T10:53:09.589831+0000","last_became_active":"2024-05-10T10:52:15.680900+0000","last_became_peered":"2024-05-10T10:52:15.680900+0000","last_unstale":"2024-05-10T10:53:09.589831+0000","last_undegraded":"2024-05-10T10:53:09.589831+0000","last_fullsized":"2024-05-10T10:53:09.589831+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:56.393338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.905256+0000","last_change":"2024-05-10T10:52:15.690659+0000","last_active":"2024-05-10T10:53:08.905256+0000","last_peered":"2024-05-10T10:53:08.905256+0000","last_clean":"2024-05-10T10:53:08.905256+0000","last_became_active":"2024-05-10T10:52:15.689723+0000","last_became_peered":"2024-05-10T10:52:15.689723+0000","last_unstale":"2024-05-10T10:53:08.905256+0000","last_undegraded":"2024-05-10T10:53:08.905256+0000","last_fullsized":"2024-05-10T10:53:08.905256+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:53:35.212066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.638558+0000","last_change":"2024-05-10T10:53:08.908043+0000","last_active":"2024-05-10T10:54:07.638558+0000","last_peered":"2024-05-10T10:54:07.638558+0000","last_clean":"2024-05-10T10:54:07.638558+0000","last_became_active":"2024-05-10T10:53:08.907635+0000","last_became_peered":"2024-05-10T10:53:08.907635+0000","last_unstale":"2024-05-10T10:54:07.638558+0000","last_undegraded":"2024-05-10T10:54:07.638558+0000","last_fullsized":"2024-05-10T10:54:07.638558+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:03.613885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.613847+0000","last_change":"2024-05-10T10:52:15.690573+0000","last_active":"2024-05-10T10:54:07.613847+0000","last_peered":"2024-05-10T10:54:07.613847+0000","last_clean":"2024-05-10T10:54:07.613847+0000","last_became_active":"2024-05-10T10:52:15.690257+0000","last_became_peered":"2024-05-10T10:52:15.690257+0000","last_unstale":"2024-05-10T10:54:07.613847+0000","last_undegraded":"2024-05-10T10:54:07.613847+0000","last_fullsized":"2024-05-10T10:54:07.613847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:37:27.128718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.590165+0000","last_change":"2024-05-10T10:52:15.684914+0000","last_active":"2024-05-10T10:53:09.590165+0000","last_peered":"2024-05-10T10:53:09.590165+0000","last_clean":"2024-05-10T10:53:09.590165+0000","last_became_active":"2024-05-10T10:52:15.684557+0000","last_became_peered":"2024-05-10T10:52:15.684557+0000","last_unstale":"2024-05-10T10:53:09.590165+0000","last_undegraded":"2024-05-10T10:53:09.590165+0000","last_fullsized":"2024-05-10T10:53:09.590165+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:17.444305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.909108+0000","last_change":"2024-05-10T10:52:15.697047+0000","last_active":"2024-05-10T10:53:08.909108+0000","last_peered":"2024-05-10T10:53:08.909108+0000","last_clean":"2024-05-10T10:53:08.909108+0000","last_became_active":"2024-05-10T10:52:15.696726+0000","last_became_peered":"2024-05-10T10:52:15.696726+0000","last_unstale":"2024-05-10T10:53:08.909108+0000","last_undegraded":"2024-05-10T10:53:08.909108+0000","last_fullsized":"2024-05-10T10:53:08.909108+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:14:30.777403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697222+0000","last_change":"2024-05-10T10:52:15.695613+0000","last_active":"2024-05-10T10:53:09.697222+0000","last_peered":"2024-05-10T10:53:09.697222+0000","last_clean":"2024-05-10T10:53:09.697222+0000","last_became_active":"2024-05-10T10:52:15.695147+0000","last_became_peered":"2024-05-10T10:52:15.695147+0000","last_unstale":"2024-05-10T10:53:09.697222+0000","last_undegraded":"2024-05-10T10:53:09.697222+0000","last_fullsized":"2024-05-10T10:53:09.697222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:14.175158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.909842+0000","last_change":"2024-05-10T10:52:15.683914+0000","last_active":"2024-05-10T10:53:08.909842+0000","last_peered":"2024-05-10T10:53:08.909842+0000","last_clean":"2024-05-10T10:53:08.909842+0000","last_became_active":"2024-05-10T10:52:15.682359+0000","last_became_peered":"2024-05-10T10:52:15.682359+0000","last_unstale":"2024-05-10T10:53:08.909842+0000","last_undegraded":"2024-05-10T10:53:08.909842+0000","last_fullsized":"2024-05-10T10:53:08.909842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:23:41.018064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.644839+0000","last_change":"2024-05-10T10:52:15.690862+0000","last_active":"2024-05-10T10:54:07.644839+0000","last_peered":"2024-05-10T10:54:07.644839+0000","last_clean":"2024-05-10T10:54:07.644839+0000","last_became_active":"2024-05-10T10:52:15.690520+0000","last_became_peered":"2024-05-10T10:52:15.690520+0000","last_unstale":"2024-05-10T10:54:07.644839+0000","last_undegraded":"2024-05-10T10:54:07.644839+0000","last_fullsized":"2024-05-10T10:54:07.644839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:39.819473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.640463+0000","last_change":"2024-05-10T10:52:15.684605+0000","last_active":"2024-05-10T10:54:07.640463+0000","last_peered":"2024-05-10T10:54:07.640463+0000","last_clean":"2024-05-10T10:54:07.640463+0000","last_became_active":"2024-05-10T10:52:15.683863+0000","last_became_peered":"2024-05-10T10:52:15.683863+0000","last_unstale":"2024-05-10T10:54:07.640463+0000","last_undegraded":"2024-05-10T10:54:07.640463+0000","last_fullsized":"2024-05-10T10:54:07.640463+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:49:35.187932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.619468+0000","last_change":"2024-05-10T10:52:15.698014+0000","last_active":"2024-05-10T10:54:07.619468+0000","last_peered":"2024-05-10T10:54:07.619468+0000","last_clean":"2024-05-10T10:54:07.619468+0000","last_became_active":"2024-05-10T10:52:15.697583+0000","last_became_peered":"2024-05-10T10:52:15.697583+0000","last_unstale":"2024-05-10T10:54:07.619468+0000","last_undegraded":"2024-05-10T10:54:07.619468+0000","last_fullsized":"2024-05-10T10:54:07.619468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:30.792127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":254,"ondisk_log_size":254,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71537,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":975,"num_read_kb":566,"num_write":248,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":215001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645349,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":436691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841580,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36904,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708248,"statfs":{"total":95995035648,"available":95957245952,"internally_reserved":0,"allocated":1601536,"data_stored":1092444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037810,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":921600,"data_stored":436621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234037,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":436999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430267,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1515520,"data_stored":1029658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593792,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":436338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":502224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":925696,"data_stored":437677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":502586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":436163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986250,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":436199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790019,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36832,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708320,"statfs":{"total":95995035648,"available":95957319680,"internally_reserved":0,"allocated":1527808,"data_stored":1029195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":66460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T10:54:10.488 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-10T10:54:10.746 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:54:11.018 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:10 smithi107 ceph-mon[30373]: pgmap v343: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-10T10:54:11.018 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:10 smithi107 ceph-mon[30373]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:54:11.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:10 smithi196 ceph-mon[34872]: pgmap v343: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-10T10:54:11.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:10 smithi196 ceph-mon[34872]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:54:11.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:10 smithi184 ceph-mon[34585]: pgmap v343: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-10T10:54:11.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:10 smithi184 ceph-mon[34585]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:54:12.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.527+0000 7ff442532700 1 -- 172.21.15.107:0/654162918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff43c108510 msgr2=0x7ff43c1088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:12.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.527+0000 7ff442532700 1 --2- 172.21.15.107:0/654162918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff43c108510 0x7ff43c1088f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009990 tx=0x7ff42c009ca0 comp rx=0 tx=0).stop 2024-05-10T10:54:12.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.527+0000 7ff442532700 1 -- 172.21.15.107:0/654162918 shutdown_connections 2024-05-10T10:54:12.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.527+0000 7ff442532700 1 --2- 172.21.15.107:0/654162918 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff43c103080 0x7ff43c10f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:12.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.527+0000 7ff442532700 1 --2- 172.21.15.107:0/654162918 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff43c108510 0x7ff43c1088f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:12.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.527+0000 7ff442532700 1 --2- 172.21.15.107:0/654162918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff43c1026c0 0x7ff43c102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:12.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.527+0000 7ff442532700 1 -- 172.21.15.107:0/654162918 >> 172.21.15.107:0/654162918 conn(0x7ff43c079100 msgr2=0x7ff43c079510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:12.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.527+0000 7ff442532700 1 -- 172.21.15.107:0/654162918 shutdown_connections 2024-05-10T10:54:12.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.527+0000 7ff442532700 1 -- 172.21.15.107:0/654162918 wait complete. 2024-05-10T10:54:12.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.528+0000 7ff442532700 1 Processor -- start 2024-05-10T10:54:12.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.528+0000 7ff442532700 1 -- start start 2024-05-10T10:54:12.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.528+0000 7ff442532700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff43c1026c0 0x7ff43c19e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:12.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.528+0000 7ff442532700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff43c103080 0x7ff43c19ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:12.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.528+0000 7ff442532700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff43c108510 0x7ff43c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:12.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.528+0000 7ff442532700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c112760 con 0x7ff43c108510 2024-05-10T10:54:12.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.528+0000 7ff442532700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c1125e0 con 0x7ff43c1026c0 2024-05-10T10:54:12.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.528+0000 7ff442532700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c1128e0 con 0x7ff43c103080 2024-05-10T10:54:12.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.528+0000 7ff440acf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff43c108510 0x7ff43c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:12.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.528+0000 7ff440acf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff43c108510 0x7ff43c1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60816/0 (socket says 172.21.15.107:60816) 2024-05-10T10:54:12.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.528+0000 7ff440acf700 1 -- 172.21.15.107:0/1337850542 learned_addr learned my addr 172.21.15.107:0/1337850542 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:12.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.528+0000 7ff43bfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff43c1026c0 0x7ff43c19e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:12.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.528+0000 7ff43b7fe700 1 --2- 172.21.15.107:0/1337850542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff43c103080 0x7ff43c19ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:12.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.529+0000 7ff440acf700 1 -- 172.21.15.107:0/1337850542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff43c103080 msgr2=0x7ff43c19ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:12.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.529+0000 7ff440acf700 1 --2- 172.21.15.107:0/1337850542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff43c103080 0x7ff43c19ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:12.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.529+0000 7ff440acf700 1 -- 172.21.15.107:0/1337850542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff43c1026c0 msgr2=0x7ff43c19e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:12.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.529+0000 7ff440acf700 1 --2- 172.21.15.107:0/1337850542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff43c1026c0 0x7ff43c19e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:12.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.529+0000 7ff440acf700 1 -- 172.21.15.107:0/1337850542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c199100 con 0x7ff43c108510 2024-05-10T10:54:12.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.529+0000 7ff440acf700 1 --2- 172.21.15.107:0/1337850542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff43c108510 0x7ff43c1989a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff43400ecd0 tx=0x7ff43400c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:12.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.529+0000 7ff4397fa700 1 -- 172.21.15.107:0/1337850542 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43400cd80 con 0x7ff43c108510 2024-05-10T10:54:12.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.529+0000 7ff4397fa700 1 -- 172.21.15.107:0/1337850542 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff434004020 con 0x7ff43c108510 2024-05-10T10:54:12.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.529+0000 7ff442532700 1 -- 172.21.15.107:0/1337850542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff43c1993f0 con 0x7ff43c108510 2024-05-10T10:54:12.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.529+0000 7ff4397fa700 1 -- 172.21.15.107:0/1337850542 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4340116d0 con 0x7ff43c108510 2024-05-10T10:54:12.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.529+0000 7ff442532700 1 -- 172.21.15.107:0/1337850542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff43c06bbb0 con 0x7ff43c108510 2024-05-10T10:54:12.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.530+0000 7ff442532700 1 -- 172.21.15.107:0/1337850542 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff43c06a190 con 0x7ff43c108510 2024-05-10T10:54:12.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.532+0000 7ff4397fa700 1 -- 172.21.15.107:0/1337850542 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7ff4340041d0 con 0x7ff43c108510 2024-05-10T10:54:12.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.532+0000 7ff4397fa700 1 --2- 172.21.15.107:0/1337850542 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff4280b2900 0x7ff4280b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:12.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.532+0000 7ff43bfff700 1 --2- 172.21.15.107:0/1337850542 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff4280b2900 0x7ff4280b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:12.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.532+0000 7ff4397fa700 1 -- 172.21.15.107:0/1337850542 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7ff4340e4600 con 0x7ff43c108510 2024-05-10T10:54:12.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.533+0000 7ff43bfff700 1 --2- 172.21.15.107:0/1337850542 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff4280b2900 0x7ff4280b4dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00b5c0 tx=0x7ff42c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:12.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.536+0000 7ff4397fa700 1 -- 172.21.15.107:0/1337850542 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff434016030 con 0x7ff43c108510 2024-05-10T10:54:12.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.735+0000 7ff442532700 1 -- 172.21.15.107:0/1337850542 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff43c10a400 con 0x7ff4280b2900 2024-05-10T10:54:12.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.742+0000 7ff4397fa700 1 -- 172.21.15.107:0/1337850542 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258959 (secure 0 0 0) 0x7ff43c10a400 con 0x7ff4280b2900 2024-05-10T10:54:12.745 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:54:12.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.745+0000 7ff442532700 1 -- 172.21.15.107:0/1337850542 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff4280b2900 msgr2=0x7ff4280b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:12.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.745+0000 7ff442532700 1 --2- 172.21.15.107:0/1337850542 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff4280b2900 0x7ff4280b4dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00b5c0 tx=0x7ff42c005960 comp rx=0 tx=0).stop 2024-05-10T10:54:12.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.745+0000 7ff442532700 1 -- 172.21.15.107:0/1337850542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff43c108510 msgr2=0x7ff43c1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:12.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.745+0000 7ff442532700 1 --2- 172.21.15.107:0/1337850542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff43c108510 0x7ff43c1989a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff43400ecd0 tx=0x7ff43400c270 comp rx=0 tx=0).stop 2024-05-10T10:54:12.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.745+0000 7ff442532700 1 -- 172.21.15.107:0/1337850542 shutdown_connections 2024-05-10T10:54:12.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.745+0000 7ff442532700 1 --2- 172.21.15.107:0/1337850542 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff4280b2900 0x7ff4280b4dc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:12.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.745+0000 7ff442532700 1 --2- 172.21.15.107:0/1337850542 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff43c108510 0x7ff43c1989a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:12.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.745+0000 7ff442532700 1 --2- 172.21.15.107:0/1337850542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff43c1026c0 0x7ff43c19e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:12.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.745+0000 7ff442532700 1 --2- 172.21.15.107:0/1337850542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff43c103080 0x7ff43c19ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:12.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.745+0000 7ff442532700 1 -- 172.21.15.107:0/1337850542 >> 172.21.15.107:0/1337850542 conn(0x7ff43c079100 msgr2=0x7ff43c1012f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:12.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.745+0000 7ff442532700 1 -- 172.21.15.107:0/1337850542 shutdown_connections 2024-05-10T10:54:12.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:12.745+0000 7ff442532700 1 -- 172.21.15.107:0/1337850542 wait complete. 2024-05-10T10:54:12.748 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-05-10T10:54:12.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:12 smithi107 ceph-mon[30373]: pgmap v344: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-10T10:54:13.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:12 smithi196 ceph-mon[34872]: pgmap v344: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-10T10:54:13.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:12 smithi184 ceph-mon[34585]: pgmap v344: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-10T10:54:13.432 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2024-05-10T10:54:11.632360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662529,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1078,"num_read_kb":647,"num_write":378,"num_write_kb":2296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951840,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":735,"ondisk_log_size":735,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374360,"kb_used_data":12696,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567464,"statfs":{"total":1151940427776,"available":1151557083136,"internally_reserved":0,"allocated":13000704,"data_stored":7213185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":390,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":67,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003138"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.634811+0000","last_change":"2024-05-10T10:52:15.686294+0000","last_active":"2024-05-10T10:54:07.634811+0000","last_peered":"2024-05-10T10:54:07.634811+0000","last_clean":"2024-05-10T10:54:07.634811+0000","last_became_active":"2024-05-10T10:52:15.685324+0000","last_became_peered":"2024-05-10T10:52:15.685324+0000","last_unstale":"2024-05-10T10:54:07.634811+0000","last_undegraded":"2024-05-10T10:54:07.634811+0000","last_fullsized":"2024-05-10T10:54:07.634811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:20.777432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.623624+0000","last_change":"2024-05-10T10:52:15.687542+0000","last_active":"2024-05-10T10:54:07.623624+0000","last_peered":"2024-05-10T10:54:07.623624+0000","last_clean":"2024-05-10T10:54:07.623624+0000","last_became_active":"2024-05-10T10:52:15.687258+0000","last_became_peered":"2024-05-10T10:52:15.687258+0000","last_unstale":"2024-05-10T10:54:07.623624+0000","last_undegraded":"2024-05-10T10:54:07.623624+0000","last_fullsized":"2024-05-10T10:54:07.623624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:08.522392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.635884+0000","last_change":"2024-05-10T10:52:15.682314+0000","last_active":"2024-05-10T10:54:07.635884+0000","last_peered":"2024-05-10T10:54:07.635884+0000","last_clean":"2024-05-10T10:54:07.635884+0000","last_became_active":"2024-05-10T10:52:15.681939+0000","last_became_peered":"2024-05-10T10:52:15.681939+0000","last_unstale":"2024-05-10T10:54:07.635884+0000","last_undegraded":"2024-05-10T10:54:07.635884+0000","last_fullsized":"2024-05-10T10:54:07.635884+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:04.857969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.057979+0000","last_change":"2024-05-10T10:52:15.693451+0000","last_active":"2024-05-10T10:53:09.057979+0000","last_peered":"2024-05-10T10:53:09.057979+0000","last_clean":"2024-05-10T10:53:09.057979+0000","last_became_active":"2024-05-10T10:52:15.693041+0000","last_became_peered":"2024-05-10T10:52:15.693041+0000","last_unstale":"2024-05-10T10:53:09.057979+0000","last_undegraded":"2024-05-10T10:53:09.057979+0000","last_fullsized":"2024-05-10T10:53:09.057979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:57:14.959699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908484+0000","last_change":"2024-05-10T10:52:15.679527+0000","last_active":"2024-05-10T10:53:08.908484+0000","last_peered":"2024-05-10T10:53:08.908484+0000","last_clean":"2024-05-10T10:53:08.908484+0000","last_became_active":"2024-05-10T10:52:15.679153+0000","last_became_peered":"2024-05-10T10:52:15.679153+0000","last_unstale":"2024-05-10T10:53:08.908484+0000","last_undegraded":"2024-05-10T10:53:08.908484+0000","last_fullsized":"2024-05-10T10:53:08.908484+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:58.738486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628536+0000","last_change":"2024-05-10T10:52:15.685905+0000","last_active":"2024-05-10T10:54:07.628536+0000","last_peered":"2024-05-10T10:54:07.628536+0000","last_clean":"2024-05-10T10:54:07.628536+0000","last_became_active":"2024-05-10T10:52:15.685628+0000","last_became_peered":"2024-05-10T10:52:15.685628+0000","last_unstale":"2024-05-10T10:54:07.628536+0000","last_undegraded":"2024-05-10T10:54:07.628536+0000","last_fullsized":"2024-05-10T10:54:07.628536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:16.776307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.627333+0000","last_change":"2024-05-10T10:52:15.692951+0000","last_active":"2024-05-10T10:54:07.627333+0000","last_peered":"2024-05-10T10:54:07.627333+0000","last_clean":"2024-05-10T10:54:07.627333+0000","last_became_active":"2024-05-10T10:52:15.692594+0000","last_became_peered":"2024-05-10T10:52:15.692594+0000","last_unstale":"2024-05-10T10:54:07.627333+0000","last_undegraded":"2024-05-10T10:54:07.627333+0000","last_fullsized":"2024-05-10T10:54:07.627333+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:04.105565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628192+0000","last_change":"2024-05-10T10:52:15.692349+0000","last_active":"2024-05-10T10:54:07.628192+0000","last_peered":"2024-05-10T10:54:07.628192+0000","last_clean":"2024-05-10T10:54:07.628192+0000","last_became_active":"2024-05-10T10:52:15.691840+0000","last_became_peered":"2024-05-10T10:52:15.691840+0000","last_unstale":"2024-05-10T10:54:07.628192+0000","last_undegraded":"2024-05-10T10:54:07.628192+0000","last_fullsized":"2024-05-10T10:54:07.628192+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:32:25.011085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645232+0000","last_change":"2024-05-10T10:52:15.686531+0000","last_active":"2024-05-10T10:54:07.645232+0000","last_peered":"2024-05-10T10:54:07.645232+0000","last_clean":"2024-05-10T10:54:07.645232+0000","last_became_active":"2024-05-10T10:52:15.686029+0000","last_became_peered":"2024-05-10T10:52:15.686029+0000","last_unstale":"2024-05-10T10:54:07.645232+0000","last_undegraded":"2024-05-10T10:54:07.645232+0000","last_fullsized":"2024-05-10T10:54:07.645232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:30.836606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.631624+0000","last_change":"2024-05-10T10:52:15.697314+0000","last_active":"2024-05-10T10:54:07.631624+0000","last_peered":"2024-05-10T10:54:07.631624+0000","last_clean":"2024-05-10T10:54:07.631624+0000","last_became_active":"2024-05-10T10:52:15.696944+0000","last_became_peered":"2024-05-10T10:52:15.696944+0000","last_unstale":"2024-05-10T10:54:07.631624+0000","last_undegraded":"2024-05-10T10:54:07.631624+0000","last_fullsized":"2024-05-10T10:54:07.631624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:10.098904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.644616+0000","last_change":"2024-05-10T10:52:15.690866+0000","last_active":"2024-05-10T10:54:07.644616+0000","last_peered":"2024-05-10T10:54:07.644616+0000","last_clean":"2024-05-10T10:54:07.644616+0000","last_became_active":"2024-05-10T10:52:15.690533+0000","last_became_peered":"2024-05-10T10:52:15.690533+0000","last_unstale":"2024-05-10T10:54:07.644616+0000","last_undegraded":"2024-05-10T10:54:07.644616+0000","last_fullsized":"2024-05-10T10:54:07.644616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:48.290897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.057957+0000","last_change":"2024-05-10T10:52:15.696386+0000","last_active":"2024-05-10T10:53:09.057957+0000","last_peered":"2024-05-10T10:53:09.057957+0000","last_clean":"2024-05-10T10:53:09.057957+0000","last_became_active":"2024-05-10T10:52:15.696044+0000","last_became_peered":"2024-05-10T10:52:15.696044+0000","last_unstale":"2024-05-10T10:53:09.057957+0000","last_undegraded":"2024-05-10T10:53:09.057957+0000","last_fullsized":"2024-05-10T10:53:09.057957+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:48.259860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.638846+0000","last_change":"2024-05-10T10:52:15.691796+0000","last_active":"2024-05-10T10:54:07.638846+0000","last_peered":"2024-05-10T10:54:07.638846+0000","last_clean":"2024-05-10T10:54:07.638846+0000","last_became_active":"2024-05-10T10:52:15.690952+0000","last_became_peered":"2024-05-10T10:52:15.690952+0000","last_unstale":"2024-05-10T10:54:07.638846+0000","last_undegraded":"2024-05-10T10:54:07.638846+0000","last_fullsized":"2024-05-10T10:54:07.638846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:10.645645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.623206+0000","last_change":"2024-05-10T10:52:15.683303+0000","last_active":"2024-05-10T10:54:07.623206+0000","last_peered":"2024-05-10T10:54:07.623206+0000","last_clean":"2024-05-10T10:54:07.623206+0000","last_became_active":"2024-05-10T10:52:15.682753+0000","last_became_peered":"2024-05-10T10:52:15.682753+0000","last_unstale":"2024-05-10T10:54:07.623206+0000","last_undegraded":"2024-05-10T10:54:07.623206+0000","last_fullsized":"2024-05-10T10:54:07.623206+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:00.167463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.630822+0000","last_change":"2024-05-10T10:52:15.691668+0000","last_active":"2024-05-10T10:54:07.630822+0000","last_peered":"2024-05-10T10:54:07.630822+0000","last_clean":"2024-05-10T10:54:07.630822+0000","last_became_active":"2024-05-10T10:52:15.691323+0000","last_became_peered":"2024-05-10T10:52:15.691323+0000","last_unstale":"2024-05-10T10:54:07.630822+0000","last_undegraded":"2024-05-10T10:54:07.630822+0000","last_fullsized":"2024-05-10T10:54:07.630822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:09.235092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.643801+0000","last_change":"2024-05-10T10:52:15.689859+0000","last_active":"2024-05-10T10:54:07.643801+0000","last_peered":"2024-05-10T10:54:07.643801+0000","last_clean":"2024-05-10T10:54:07.643801+0000","last_became_active":"2024-05-10T10:52:15.689060+0000","last_became_peered":"2024-05-10T10:52:15.689060+0000","last_unstale":"2024-05-10T10:54:07.643801+0000","last_undegraded":"2024-05-10T10:54:07.643801+0000","last_fullsized":"2024-05-10T10:54:07.643801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:42.029942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.634944+0000","last_change":"2024-05-10T10:52:15.686711+0000","last_active":"2024-05-10T10:54:07.634944+0000","last_peered":"2024-05-10T10:54:07.634944+0000","last_clean":"2024-05-10T10:54:07.634944+0000","last_became_active":"2024-05-10T10:52:15.685817+0000","last_became_peered":"2024-05-10T10:52:15.685817+0000","last_unstale":"2024-05-10T10:54:07.634944+0000","last_undegraded":"2024-05-10T10:54:07.634944+0000","last_fullsized":"2024-05-10T10:54:07.634944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:50:25.703341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.621883+0000","last_change":"2024-05-10T10:52:15.681702+0000","last_active":"2024-05-10T10:54:07.621883+0000","last_peered":"2024-05-10T10:54:07.621883+0000","last_clean":"2024-05-10T10:54:07.621883+0000","last_became_active":"2024-05-10T10:52:15.681400+0000","last_became_peered":"2024-05-10T10:52:15.681400+0000","last_unstale":"2024-05-10T10:54:07.621883+0000","last_undegraded":"2024-05-10T10:54:07.621883+0000","last_fullsized":"2024-05-10T10:54:07.621883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:07.520500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.590219+0000","last_change":"2024-05-10T10:52:15.684321+0000","last_active":"2024-05-10T10:53:09.590219+0000","last_peered":"2024-05-10T10:53:09.590219+0000","last_clean":"2024-05-10T10:53:09.590219+0000","last_became_active":"2024-05-10T10:52:15.683099+0000","last_became_peered":"2024-05-10T10:52:15.683099+0000","last_unstale":"2024-05-10T10:53:09.590219+0000","last_undegraded":"2024-05-10T10:53:09.590219+0000","last_fullsized":"2024-05-10T10:53:09.590219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:09.310292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":136,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.798832+0000","last_change":"2024-05-10T10:52:12.530258+0000","last_active":"2024-05-10T10:54:07.798832+0000","last_peered":"2024-05-10T10:54:07.798832+0000","last_clean":"2024-05-10T10:54:07.798832+0000","last_became_active":"2024-05-10T10:52:12.529842+0000","last_became_peered":"2024-05-10T10:52:12.529842+0000","last_unstale":"2024-05-10T10:54:07.798832+0000","last_undegraded":"2024-05-10T10:54:07.798832+0000","last_fullsized":"2024-05-10T10:54:07.798832+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:13.525038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.625673+0000","last_change":"2024-05-10T10:53:09.698541+0000","last_active":"2024-05-10T10:54:07.625673+0000","last_peered":"2024-05-10T10:54:07.625673+0000","last_clean":"2024-05-10T10:54:07.625673+0000","last_became_active":"2024-05-10T10:53:09.698219+0000","last_became_peered":"2024-05-10T10:53:09.698219+0000","last_unstale":"2024-05-10T10:54:07.625673+0000","last_undegraded":"2024-05-10T10:54:07.625673+0000","last_fullsized":"2024-05-10T10:54:07.625673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:27:11.837418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.910078+0000","last_change":"2024-05-10T10:52:12.630918+0000","last_active":"2024-05-10T10:53:08.910078+0000","last_peered":"2024-05-10T10:53:08.910078+0000","last_clean":"2024-05-10T10:53:08.910078+0000","last_became_active":"2024-05-10T10:52:12.630563+0000","last_became_peered":"2024-05-10T10:52:12.630563+0000","last_unstale":"2024-05-10T10:53:08.910078+0000","last_undegraded":"2024-05-10T10:53:08.910078+0000","last_fullsized":"2024-05-10T10:53:08.910078+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:58:03.341362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.643508+0000","last_change":"2024-05-10T10:52:15.676831+0000","last_active":"2024-05-10T10:54:07.643508+0000","last_peered":"2024-05-10T10:54:07.643508+0000","last_clean":"2024-05-10T10:54:07.643508+0000","last_became_active":"2024-05-10T10:52:15.676506+0000","last_became_peered":"2024-05-10T10:52:15.676506+0000","last_unstale":"2024-05-10T10:54:07.643508+0000","last_undegraded":"2024-05-10T10:54:07.643508+0000","last_fullsized":"2024-05-10T10:54:07.643508+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:43.498800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908910+0000","last_change":"2024-05-10T10:52:12.532092+0000","last_active":"2024-05-10T10:53:08.908910+0000","last_peered":"2024-05-10T10:53:08.908910+0000","last_clean":"2024-05-10T10:53:08.908910+0000","last_became_active":"2024-05-10T10:52:12.531649+0000","last_became_peered":"2024-05-10T10:52:12.531649+0000","last_unstale":"2024-05-10T10:53:08.908910+0000","last_undegraded":"2024-05-10T10:53:08.908910+0000","last_fullsized":"2024-05-10T10:53:08.908910+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.709935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.641535+0000","last_change":"2024-05-10T10:52:15.683024+0000","last_active":"2024-05-10T10:54:07.641535+0000","last_peered":"2024-05-10T10:54:07.641535+0000","last_clean":"2024-05-10T10:54:07.641535+0000","last_became_active":"2024-05-10T10:52:15.682655+0000","last_became_peered":"2024-05-10T10:52:15.682655+0000","last_unstale":"2024-05-10T10:54:07.641535+0000","last_undegraded":"2024-05-10T10:54:07.641535+0000","last_fullsized":"2024-05-10T10:54:07.641535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:27.922746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908770+0000","last_change":"2024-05-10T10:52:12.534000+0000","last_active":"2024-05-10T10:53:08.908770+0000","last_peered":"2024-05-10T10:53:08.908770+0000","last_clean":"2024-05-10T10:53:08.908770+0000","last_became_active":"2024-05-10T10:52:12.533609+0000","last_became_peered":"2024-05-10T10:52:12.533609+0000","last_unstale":"2024-05-10T10:53:08.908770+0000","last_undegraded":"2024-05-10T10:53:08.908770+0000","last_fullsized":"2024-05-10T10:53:08.908770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:38:18.115926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.643918+0000","last_change":"2024-05-10T10:52:15.695263+0000","last_active":"2024-05-10T10:54:07.643918+0000","last_peered":"2024-05-10T10:54:07.643918+0000","last_clean":"2024-05-10T10:54:07.643918+0000","last_became_active":"2024-05-10T10:52:15.694890+0000","last_became_peered":"2024-05-10T10:52:15.694890+0000","last_unstale":"2024-05-10T10:54:07.643918+0000","last_undegraded":"2024-05-10T10:54:07.643918+0000","last_fullsized":"2024-05-10T10:54:07.643918+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:50:32.361110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":134,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:08.812808+0000","last_change":"2024-05-10T10:52:12.534673+0000","last_active":"2024-05-10T10:54:08.812808+0000","last_peered":"2024-05-10T10:54:08.812808+0000","last_clean":"2024-05-10T10:54:08.812808+0000","last_became_active":"2024-05-10T10:52:12.534031+0000","last_became_peered":"2024-05-10T10:52:12.534031+0000","last_unstale":"2024-05-10T10:54:08.812808+0000","last_undegraded":"2024-05-10T10:54:08.812808+0000","last_fullsized":"2024-05-10T10:54:08.812808+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:32.030866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908406+0000","last_change":"2024-05-10T10:52:15.683282+0000","last_active":"2024-05-10T10:53:08.908406+0000","last_peered":"2024-05-10T10:53:08.908406+0000","last_clean":"2024-05-10T10:53:08.908406+0000","last_became_active":"2024-05-10T10:52:15.682421+0000","last_became_peered":"2024-05-10T10:52:15.682421+0000","last_unstale":"2024-05-10T10:53:08.908406+0000","last_undegraded":"2024-05-10T10:53:08.908406+0000","last_fullsized":"2024-05-10T10:53:08.908406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:12.014145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.724072+0000","last_change":"2024-05-10T10:52:12.532161+0000","last_active":"2024-05-10T10:53:09.724072+0000","last_peered":"2024-05-10T10:53:09.724072+0000","last_clean":"2024-05-10T10:53:09.724072+0000","last_became_active":"2024-05-10T10:52:12.531780+0000","last_became_peered":"2024-05-10T10:52:12.531780+0000","last_unstale":"2024-05-10T10:53:09.724072+0000","last_undegraded":"2024-05-10T10:53:09.724072+0000","last_fullsized":"2024-05-10T10:53:09.724072+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:08.724945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.631948+0000","last_change":"2024-05-10T10:52:15.694602+0000","last_active":"2024-05-10T10:54:07.631948+0000","last_peered":"2024-05-10T10:54:07.631948+0000","last_clean":"2024-05-10T10:54:07.631948+0000","last_became_active":"2024-05-10T10:52:15.694279+0000","last_became_peered":"2024-05-10T10:52:15.694279+0000","last_unstale":"2024-05-10T10:54:07.631948+0000","last_undegraded":"2024-05-10T10:54:07.631948+0000","last_fullsized":"2024-05-10T10:54:07.631948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:12:16.286092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.902432+0000","last_change":"2024-05-10T10:52:12.526817+0000","last_active":"2024-05-10T10:53:08.902432+0000","last_peered":"2024-05-10T10:53:08.902432+0000","last_clean":"2024-05-10T10:53:08.902432+0000","last_became_active":"2024-05-10T10:52:12.526315+0000","last_became_peered":"2024-05-10T10:52:12.526315+0000","last_unstale":"2024-05-10T10:53:08.902432+0000","last_undegraded":"2024-05-10T10:53:08.902432+0000","last_fullsized":"2024-05-10T10:53:08.902432+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:49.968299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.635782+0000","last_change":"2024-05-10T10:52:15.683201+0000","last_active":"2024-05-10T10:54:07.635782+0000","last_peered":"2024-05-10T10:54:07.635782+0000","last_clean":"2024-05-10T10:54:07.635782+0000","last_became_active":"2024-05-10T10:52:15.682412+0000","last_became_peered":"2024-05-10T10:52:15.682412+0000","last_unstale":"2024-05-10T10:54:07.635782+0000","last_undegraded":"2024-05-10T10:54:07.635782+0000","last_fullsized":"2024-05-10T10:54:07.635782+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:22.001179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.696993+0000","last_change":"2024-05-10T10:52:12.531058+0000","last_active":"2024-05-10T10:53:09.696993+0000","last_peered":"2024-05-10T10:53:09.696993+0000","last_clean":"2024-05-10T10:53:09.696993+0000","last_became_active":"2024-05-10T10:52:12.530655+0000","last_became_peered":"2024-05-10T10:52:12.530655+0000","last_unstale":"2024-05-10T10:53:09.696993+0000","last_undegraded":"2024-05-10T10:53:09.696993+0000","last_fullsized":"2024-05-10T10:53:09.696993+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:36:52.300420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.622098+0000","last_change":"2024-05-10T10:52:15.681697+0000","last_active":"2024-05-10T10:54:07.622098+0000","last_peered":"2024-05-10T10:54:07.622098+0000","last_clean":"2024-05-10T10:54:07.622098+0000","last_became_active":"2024-05-10T10:52:15.681396+0000","last_became_peered":"2024-05-10T10:52:15.681396+0000","last_unstale":"2024-05-10T10:54:07.622098+0000","last_undegraded":"2024-05-10T10:54:07.622098+0000","last_fullsized":"2024-05-10T10:54:07.622098+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:35.390837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'5","reported_seq":225,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:09.813805+0000","last_change":"2024-05-10T10:52:12.532089+0000","last_active":"2024-05-10T10:54:09.813805+0000","last_peered":"2024-05-10T10:54:09.813805+0000","last_clean":"2024-05-10T10:54:09.813805+0000","last_became_active":"2024-05-10T10:52:12.531641+0000","last_became_peered":"2024-05-10T10:52:12.531641+0000","last_unstale":"2024-05-10T10:54:09.813805+0000","last_undegraded":"2024-05-10T10:54:09.813805+0000","last_fullsized":"2024-05-10T10:54:09.813805+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:34.517079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":194,"num_read_kb":194,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.641247+0000","last_change":"2024-05-10T10:52:15.685566+0000","last_active":"2024-05-10T10:54:07.641247+0000","last_peered":"2024-05-10T10:54:07.641247+0000","last_clean":"2024-05-10T10:54:07.641247+0000","last_became_active":"2024-05-10T10:52:15.685220+0000","last_became_peered":"2024-05-10T10:52:15.685220+0000","last_unstale":"2024-05-10T10:54:07.641247+0000","last_undegraded":"2024-05-10T10:54:07.641247+0000","last_fullsized":"2024-05-10T10:54:07.641247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:06.140961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.906334+0000","last_change":"2024-05-10T10:52:12.533182+0000","last_active":"2024-05-10T10:53:08.906334+0000","last_peered":"2024-05-10T10:53:08.906334+0000","last_clean":"2024-05-10T10:53:08.906334+0000","last_became_active":"2024-05-10T10:52:12.532821+0000","last_became_peered":"2024-05-10T10:52:12.532821+0000","last_unstale":"2024-05-10T10:53:08.906334+0000","last_undegraded":"2024-05-10T10:53:08.906334+0000","last_fullsized":"2024-05-10T10:53:08.906334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:54:15.930093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628517+0000","last_change":"2024-05-10T10:52:15.690491+0000","last_active":"2024-05-10T10:54:07.628517+0000","last_peered":"2024-05-10T10:54:07.628517+0000","last_clean":"2024-05-10T10:54:07.628517+0000","last_became_active":"2024-05-10T10:52:15.690200+0000","last_became_peered":"2024-05-10T10:52:15.690200+0000","last_unstale":"2024-05-10T10:54:07.628517+0000","last_undegraded":"2024-05-10T10:54:07.628517+0000","last_fullsized":"2024-05-10T10:54:07.628517+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:28.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697478+0000","last_change":"2024-05-10T10:52:12.631966+0000","last_active":"2024-05-10T10:53:09.697478+0000","last_peered":"2024-05-10T10:53:09.697478+0000","last_clean":"2024-05-10T10:53:09.697478+0000","last_became_active":"2024-05-10T10:52:12.631539+0000","last_became_peered":"2024-05-10T10:52:12.631539+0000","last_unstale":"2024-05-10T10:53:09.697478+0000","last_undegraded":"2024-05-10T10:53:09.697478+0000","last_fullsized":"2024-05-10T10:53:09.697478+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:32:52.392307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645823+0000","last_change":"2024-05-10T10:52:15.692893+0000","last_active":"2024-05-10T10:54:07.645823+0000","last_peered":"2024-05-10T10:54:07.645823+0000","last_clean":"2024-05-10T10:54:07.645823+0000","last_became_active":"2024-05-10T10:52:15.692528+0000","last_became_peered":"2024-05-10T10:52:15.692528+0000","last_unstale":"2024-05-10T10:54:07.645823+0000","last_undegraded":"2024-05-10T10:54:07.645823+0000","last_fullsized":"2024-05-10T10:54:07.645823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:51.452294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'36","reported_seq":266,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:09.819822+0000","last_change":"2024-05-10T10:52:12.532094+0000","last_active":"2024-05-10T10:54:09.819822+0000","last_peered":"2024-05-10T10:54:09.819822+0000","last_clean":"2024-05-10T10:54:09.819822+0000","last_became_active":"2024-05-10T10:52:12.531719+0000","last_became_peered":"2024-05-10T10:52:12.531719+0000","last_unstale":"2024-05-10T10:54:09.819822+0000","last_undegraded":"2024-05-10T10:54:09.819822+0000","last_fullsized":"2024-05-10T10:54:09.819822+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:43:52.697528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64973,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":204,"num_read_kb":165,"num_write":38,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908644+0000","last_change":"2024-05-10T10:52:15.688187+0000","last_active":"2024-05-10T10:53:08.908644+0000","last_peered":"2024-05-10T10:53:08.908644+0000","last_clean":"2024-05-10T10:53:08.908644+0000","last_became_active":"2024-05-10T10:52:15.687821+0000","last_became_peered":"2024-05-10T10:52:15.687821+0000","last_unstale":"2024-05-10T10:53:08.908644+0000","last_undegraded":"2024-05-10T10:53:08.908644+0000","last_fullsized":"2024-05-10T10:53:08.908644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:54.425892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.589972+0000","last_change":"2024-05-10T10:52:12.532185+0000","last_active":"2024-05-10T10:53:09.589972+0000","last_peered":"2024-05-10T10:53:09.589972+0000","last_clean":"2024-05-10T10:53:09.589972+0000","last_became_active":"2024-05-10T10:52:12.531795+0000","last_became_peered":"2024-05-10T10:52:12.531795+0000","last_unstale":"2024-05-10T10:53:09.589972+0000","last_undegraded":"2024-05-10T10:53:09.589972+0000","last_fullsized":"2024-05-10T10:53:09.589972+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:51.704767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.634427+0000","last_change":"2024-05-10T10:52:15.684388+0000","last_active":"2024-05-10T10:54:07.634427+0000","last_peered":"2024-05-10T10:54:07.634427+0000","last_clean":"2024-05-10T10:54:07.634427+0000","last_became_active":"2024-05-10T10:52:15.684061+0000","last_became_peered":"2024-05-10T10:52:15.684061+0000","last_unstale":"2024-05-10T10:54:07.634427+0000","last_undegraded":"2024-05-10T10:54:07.634427+0000","last_fullsized":"2024-05-10T10:54:07.634427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:19.462083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697004+0000","last_change":"2024-05-10T10:52:12.531912+0000","last_active":"2024-05-10T10:53:09.697004+0000","last_peered":"2024-05-10T10:53:09.697004+0000","last_clean":"2024-05-10T10:53:09.697004+0000","last_became_active":"2024-05-10T10:52:12.531501+0000","last_became_peered":"2024-05-10T10:52:12.531501+0000","last_unstale":"2024-05-10T10:53:09.697004+0000","last_undegraded":"2024-05-10T10:53:09.697004+0000","last_fullsized":"2024-05-10T10:53:09.697004+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:15.086519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.639397+0000","last_change":"2024-05-10T10:52:15.686521+0000","last_active":"2024-05-10T10:54:07.639397+0000","last_peered":"2024-05-10T10:54:07.639397+0000","last_clean":"2024-05-10T10:54:07.639397+0000","last_became_active":"2024-05-10T10:52:15.686142+0000","last_became_peered":"2024-05-10T10:52:15.686142+0000","last_unstale":"2024-05-10T10:54:07.639397+0000","last_undegraded":"2024-05-10T10:54:07.639397+0000","last_fullsized":"2024-05-10T10:54:07.639397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:40.315401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":126,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:04.813112+0000","last_change":"2024-05-10T10:52:12.527774+0000","last_active":"2024-05-10T10:54:04.813112+0000","last_peered":"2024-05-10T10:54:04.813112+0000","last_clean":"2024-05-10T10:54:04.813112+0000","last_became_active":"2024-05-10T10:52:12.527412+0000","last_became_peered":"2024-05-10T10:52:12.527412+0000","last_unstale":"2024-05-10T10:54:04.813112+0000","last_undegraded":"2024-05-10T10:54:04.813112+0000","last_fullsized":"2024-05-10T10:54:04.813112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:51:21.334653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628067+0000","last_change":"2024-05-10T10:52:15.693427+0000","last_active":"2024-05-10T10:54:07.628067+0000","last_peered":"2024-05-10T10:54:07.628067+0000","last_clean":"2024-05-10T10:54:07.628067+0000","last_became_active":"2024-05-10T10:52:15.693114+0000","last_became_peered":"2024-05-10T10:52:15.693114+0000","last_unstale":"2024-05-10T10:54:07.628067+0000","last_undegraded":"2024-05-10T10:54:07.628067+0000","last_fullsized":"2024-05-10T10:54:07.628067+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:25:36.423413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908346+0000","last_change":"2024-05-10T10:52:12.631475+0000","last_active":"2024-05-10T10:53:08.908346+0000","last_peered":"2024-05-10T10:53:08.908346+0000","last_clean":"2024-05-10T10:53:08.908346+0000","last_became_active":"2024-05-10T10:52:12.631079+0000","last_became_peered":"2024-05-10T10:52:12.631079+0000","last_unstale":"2024-05-10T10:53:08.908346+0000","last_undegraded":"2024-05-10T10:53:08.908346+0000","last_fullsized":"2024-05-10T10:53:08.908346+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:52.975413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.630966+0000","last_change":"2024-05-10T10:53:09.302243+0000","last_active":"2024-05-10T10:54:07.630966+0000","last_peered":"2024-05-10T10:54:07.630966+0000","last_clean":"2024-05-10T10:54:07.630966+0000","last_became_active":"2024-05-10T10:53:09.301866+0000","last_became_peered":"2024-05-10T10:53:09.301866+0000","last_unstale":"2024-05-10T10:54:07.630966+0000","last_undegraded":"2024-05-10T10:54:07.630966+0000","last_fullsized":"2024-05-10T10:54:07.630966+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:07.609569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908982+0000","last_change":"2024-05-10T10:52:12.533071+0000","last_active":"2024-05-10T10:53:08.908982+0000","last_peered":"2024-05-10T10:53:08.908982+0000","last_clean":"2024-05-10T10:53:08.908982+0000","last_became_active":"2024-05-10T10:52:12.532655+0000","last_became_peered":"2024-05-10T10:52:12.532655+0000","last_unstale":"2024-05-10T10:53:08.908982+0000","last_undegraded":"2024-05-10T10:53:08.908982+0000","last_fullsized":"2024-05-10T10:53:08.908982+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:30.723701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.613687+0000","last_change":"2024-05-10T10:52:15.697362+0000","last_active":"2024-05-10T10:54:07.613687+0000","last_peered":"2024-05-10T10:54:07.613687+0000","last_clean":"2024-05-10T10:54:07.613687+0000","last_became_active":"2024-05-10T10:52:15.696915+0000","last_became_peered":"2024-05-10T10:52:15.696915+0000","last_unstale":"2024-05-10T10:54:07.613687+0000","last_undegraded":"2024-05-10T10:54:07.613687+0000","last_fullsized":"2024-05-10T10:54:07.613687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:29:03.365667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.909109+0000","last_change":"2024-05-10T10:53:08.909109+0000","last_active":"2024-05-10T10:53:08.909109+0000","last_peered":"2024-05-10T10:53:08.909109+0000","last_clean":"2024-05-10T10:53:08.909109+0000","last_became_active":"2024-05-10T10:53:08.908677+0000","last_became_peered":"2024-05-10T10:53:08.908677+0000","last_unstale":"2024-05-10T10:53:08.909109+0000","last_undegraded":"2024-05-10T10:53:08.909109+0000","last_fullsized":"2024-05-10T10:53:08.909109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:51.380479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.636171+0000","last_change":"2024-05-10T10:52:15.675837+0000","last_active":"2024-05-10T10:54:07.636171+0000","last_peered":"2024-05-10T10:54:07.636171+0000","last_clean":"2024-05-10T10:54:07.636171+0000","last_became_active":"2024-05-10T10:52:15.675438+0000","last_became_peered":"2024-05-10T10:52:15.675438+0000","last_unstale":"2024-05-10T10:54:07.636171+0000","last_undegraded":"2024-05-10T10:54:07.636171+0000","last_fullsized":"2024-05-10T10:54:07.636171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:23.142008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":128,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.799360+0000","last_change":"2024-05-10T10:52:12.530141+0000","last_active":"2024-05-10T10:54:07.799360+0000","last_peered":"2024-05-10T10:54:07.799360+0000","last_clean":"2024-05-10T10:54:07.799360+0000","last_became_active":"2024-05-10T10:52:12.529771+0000","last_became_peered":"2024-05-10T10:52:12.529771+0000","last_unstale":"2024-05-10T10:54:07.799360+0000","last_undegraded":"2024-05-10T10:54:07.799360+0000","last_fullsized":"2024-05-10T10:54:07.799360+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:42.803789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628048+0000","last_change":"2024-05-10T10:52:15.686934+0000","last_active":"2024-05-10T10:54:07.628048+0000","last_peered":"2024-05-10T10:54:07.628048+0000","last_clean":"2024-05-10T10:54:07.628048+0000","last_became_active":"2024-05-10T10:52:15.686494+0000","last_became_peered":"2024-05-10T10:52:15.686494+0000","last_unstale":"2024-05-10T10:54:07.628048+0000","last_undegraded":"2024-05-10T10:54:07.628048+0000","last_fullsized":"2024-05-10T10:54:07.628048+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:18.049088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.632339+0000","last_change":"2024-05-10T10:52:15.693243+0000","last_active":"2024-05-10T10:54:07.632339+0000","last_peered":"2024-05-10T10:54:07.632339+0000","last_clean":"2024-05-10T10:54:07.632339+0000","last_became_active":"2024-05-10T10:52:15.692868+0000","last_became_peered":"2024-05-10T10:52:15.692868+0000","last_unstale":"2024-05-10T10:54:07.632339+0000","last_undegraded":"2024-05-10T10:54:07.632339+0000","last_fullsized":"2024-05-10T10:54:07.632339+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:25.316500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":128,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.816856+0000","last_change":"2024-05-10T10:52:12.630916+0000","last_active":"2024-05-10T10:54:07.816856+0000","last_peered":"2024-05-10T10:54:07.816856+0000","last_clean":"2024-05-10T10:54:07.816856+0000","last_became_active":"2024-05-10T10:52:12.630564+0000","last_became_peered":"2024-05-10T10:52:12.630564+0000","last_unstale":"2024-05-10T10:54:07.816856+0000","last_undegraded":"2024-05-10T10:54:07.816856+0000","last_fullsized":"2024-05-10T10:54:07.816856+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:09:46.434409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.627806+0000","last_change":"2024-05-10T10:52:15.691017+0000","last_active":"2024-05-10T10:54:07.627806+0000","last_peered":"2024-05-10T10:54:07.627806+0000","last_clean":"2024-05-10T10:54:07.627806+0000","last_became_active":"2024-05-10T10:52:15.690705+0000","last_became_peered":"2024-05-10T10:52:15.690705+0000","last_unstale":"2024-05-10T10:54:07.627806+0000","last_undegraded":"2024-05-10T10:54:07.627806+0000","last_fullsized":"2024-05-10T10:54:07.627806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:50:43.517455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.057942+0000","last_change":"2024-05-10T10:52:12.529180+0000","last_active":"2024-05-10T10:53:09.057942+0000","last_peered":"2024-05-10T10:53:09.057942+0000","last_clean":"2024-05-10T10:53:09.057942+0000","last_became_active":"2024-05-10T10:52:12.528570+0000","last_became_peered":"2024-05-10T10:52:12.528570+0000","last_unstale":"2024-05-10T10:53:09.057942+0000","last_undegraded":"2024-05-10T10:53:09.057942+0000","last_fullsized":"2024-05-10T10:53:09.057942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:31:53.254302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.906014+0000","last_change":"2024-05-10T10:50:51.113120+0000","last_active":"2024-05-10T10:53:08.906014+0000","last_peered":"2024-05-10T10:53:08.906014+0000","last_clean":"2024-05-10T10:53:08.906014+0000","last_became_active":"2024-05-10T10:50:51.107803+0000","last_became_peered":"2024-05-10T10:50:51.107803+0000","last_unstale":"2024-05-10T10:53:08.906014+0000","last_undegraded":"2024-05-10T10:53:08.906014+0000","last_fullsized":"2024-05-10T10:53:08.906014+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:47:32.190034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:47:32.190034+0000","last_clean_scrub_stamp":"2024-05-10T10:47:32.190034+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:53.599839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.634838+0000","last_change":"2024-05-10T10:52:15.689856+0000","last_active":"2024-05-10T10:54:07.634838+0000","last_peered":"2024-05-10T10:54:07.634838+0000","last_clean":"2024-05-10T10:54:07.634838+0000","last_became_active":"2024-05-10T10:52:15.689544+0000","last_became_peered":"2024-05-10T10:52:15.689544+0000","last_unstale":"2024-05-10T10:54:07.634838+0000","last_undegraded":"2024-05-10T10:54:07.634838+0000","last_fullsized":"2024-05-10T10:54:07.634838+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:39.374857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.905925+0000","last_change":"2024-05-10T10:52:12.532217+0000","last_active":"2024-05-10T10:53:08.905925+0000","last_peered":"2024-05-10T10:53:08.905925+0000","last_clean":"2024-05-10T10:53:08.905925+0000","last_became_active":"2024-05-10T10:52:12.531575+0000","last_became_peered":"2024-05-10T10:52:12.531575+0000","last_unstale":"2024-05-10T10:53:08.905925+0000","last_undegraded":"2024-05-10T10:53:08.905925+0000","last_fullsized":"2024-05-10T10:53:08.905925+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:15:59.493728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908830+0000","last_change":"2024-05-10T10:52:12.631990+0000","last_active":"2024-05-10T10:53:08.908830+0000","last_peered":"2024-05-10T10:53:08.908830+0000","last_clean":"2024-05-10T10:53:08.908830+0000","last_became_active":"2024-05-10T10:52:12.631061+0000","last_became_peered":"2024-05-10T10:52:12.631061+0000","last_unstale":"2024-05-10T10:53:08.908830+0000","last_undegraded":"2024-05-10T10:53:08.908830+0000","last_fullsized":"2024-05-10T10:53:08.908830+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:30.298079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.629605+0000","last_change":"2024-05-10T10:52:15.678797+0000","last_active":"2024-05-10T10:54:07.629605+0000","last_peered":"2024-05-10T10:54:07.629605+0000","last_clean":"2024-05-10T10:54:07.629605+0000","last_became_active":"2024-05-10T10:52:15.678388+0000","last_became_peered":"2024-05-10T10:52:15.678388+0000","last_unstale":"2024-05-10T10:54:07.629605+0000","last_undegraded":"2024-05-10T10:54:07.629605+0000","last_fullsized":"2024-05-10T10:54:07.629605+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:15.314479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'16","reported_seq":58,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.917374+0000","last_change":"2024-05-10T10:53:08.916967+0000","last_active":"2024-05-10T10:53:08.917374+0000","last_peered":"2024-05-10T10:53:08.917374+0000","last_clean":"2024-05-10T10:53:08.917374+0000","last_became_active":"2024-05-10T10:53:08.910538+0000","last_became_peered":"2024-05-10T10:53:08.910538+0000","last_unstale":"2024-05-10T10:53:08.917374+0000","last_undegraded":"2024-05-10T10:53:08.917374+0000","last_fullsized":"2024-05-10T10:53:08.917374+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:32.747935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.624977+0000","last_change":"2024-05-10T10:52:15.688313+0000","last_active":"2024-05-10T10:54:07.624977+0000","last_peered":"2024-05-10T10:54:07.624977+0000","last_clean":"2024-05-10T10:54:07.624977+0000","last_became_active":"2024-05-10T10:52:15.688028+0000","last_became_peered":"2024-05-10T10:52:15.688028+0000","last_unstale":"2024-05-10T10:54:07.624977+0000","last_undegraded":"2024-05-10T10:54:07.624977+0000","last_fullsized":"2024-05-10T10:54:07.624977+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:03.815985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.058115+0000","last_change":"2024-05-10T10:52:12.529409+0000","last_active":"2024-05-10T10:53:09.058115+0000","last_peered":"2024-05-10T10:53:09.058115+0000","last_clean":"2024-05-10T10:53:09.058115+0000","last_became_active":"2024-05-10T10:52:12.528837+0000","last_became_peered":"2024-05-10T10:52:12.528837+0000","last_unstale":"2024-05-10T10:53:09.058115+0000","last_undegraded":"2024-05-10T10:53:09.058115+0000","last_fullsized":"2024-05-10T10:53:09.058115+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:28.280292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.638814+0000","last_change":"2024-05-10T10:53:08.910952+0000","last_active":"2024-05-10T10:54:07.638814+0000","last_peered":"2024-05-10T10:54:07.638814+0000","last_clean":"2024-05-10T10:54:07.638814+0000","last_became_active":"2024-05-10T10:53:08.910564+0000","last_became_peered":"2024-05-10T10:53:08.910564+0000","last_unstale":"2024-05-10T10:54:07.638814+0000","last_undegraded":"2024-05-10T10:54:07.638814+0000","last_fullsized":"2024-05-10T10:54:07.638814+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:20.289280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.300698+0000","last_change":"2024-05-10T10:52:12.631048+0000","last_active":"2024-05-10T10:53:09.300698+0000","last_peered":"2024-05-10T10:53:09.300698+0000","last_clean":"2024-05-10T10:53:09.300698+0000","last_became_active":"2024-05-10T10:52:12.630754+0000","last_became_peered":"2024-05-10T10:52:12.630754+0000","last_unstale":"2024-05-10T10:53:09.300698+0000","last_undegraded":"2024-05-10T10:53:09.300698+0000","last_fullsized":"2024-05-10T10:53:09.300698+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:57.755423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908311+0000","last_change":"2024-05-10T10:52:15.684552+0000","last_active":"2024-05-10T10:53:08.908311+0000","last_peered":"2024-05-10T10:53:08.908311+0000","last_clean":"2024-05-10T10:53:08.908311+0000","last_became_active":"2024-05-10T10:52:15.684174+0000","last_became_peered":"2024-05-10T10:52:15.684174+0000","last_unstale":"2024-05-10T10:53:08.908311+0000","last_undegraded":"2024-05-10T10:53:08.908311+0000","last_fullsized":"2024-05-10T10:53:08.908311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:21:51.633525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.909634+0000","last_change":"2024-05-10T10:52:12.525692+0000","last_active":"2024-05-10T10:53:08.909634+0000","last_peered":"2024-05-10T10:53:08.909634+0000","last_clean":"2024-05-10T10:53:08.909634+0000","last_became_active":"2024-05-10T10:52:12.525436+0000","last_became_peered":"2024-05-10T10:52:12.525436+0000","last_unstale":"2024-05-10T10:53:08.909634+0000","last_undegraded":"2024-05-10T10:53:08.909634+0000","last_fullsized":"2024-05-10T10:53:08.909634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:34:40.801973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.627450+0000","last_change":"2024-05-10T10:52:15.689838+0000","last_active":"2024-05-10T10:54:07.627450+0000","last_peered":"2024-05-10T10:54:07.627450+0000","last_clean":"2024-05-10T10:54:07.627450+0000","last_became_active":"2024-05-10T10:52:15.689481+0000","last_became_peered":"2024-05-10T10:52:15.689481+0000","last_unstale":"2024-05-10T10:54:07.627450+0000","last_undegraded":"2024-05-10T10:54:07.627450+0000","last_fullsized":"2024-05-10T10:54:07.627450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:02:27.382859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.590054+0000","last_change":"2024-05-10T10:52:12.533782+0000","last_active":"2024-05-10T10:53:09.590054+0000","last_peered":"2024-05-10T10:53:09.590054+0000","last_clean":"2024-05-10T10:53:09.590054+0000","last_became_active":"2024-05-10T10:52:12.533457+0000","last_became_peered":"2024-05-10T10:52:12.533457+0000","last_unstale":"2024-05-10T10:53:09.590054+0000","last_undegraded":"2024-05-10T10:53:09.590054+0000","last_fullsized":"2024-05-10T10:53:09.590054+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:17.372672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628194+0000","last_change":"2024-05-10T10:52:15.691594+0000","last_active":"2024-05-10T10:54:07.628194+0000","last_peered":"2024-05-10T10:54:07.628194+0000","last_clean":"2024-05-10T10:54:07.628194+0000","last_became_active":"2024-05-10T10:52:15.690300+0000","last_became_peered":"2024-05-10T10:52:15.690300+0000","last_unstale":"2024-05-10T10:54:07.628194+0000","last_undegraded":"2024-05-10T10:54:07.628194+0000","last_fullsized":"2024-05-10T10:54:07.628194+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:05.228834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908547+0000","last_change":"2024-05-10T10:52:12.530693+0000","last_active":"2024-05-10T10:53:08.908547+0000","last_peered":"2024-05-10T10:53:08.908547+0000","last_clean":"2024-05-10T10:53:08.908547+0000","last_became_active":"2024-05-10T10:52:12.530310+0000","last_became_peered":"2024-05-10T10:52:12.530310+0000","last_unstale":"2024-05-10T10:53:08.908547+0000","last_undegraded":"2024-05-10T10:53:08.908547+0000","last_fullsized":"2024-05-10T10:53:08.908547+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:42:46.967318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645791+0000","last_change":"2024-05-10T10:52:15.695473+0000","last_active":"2024-05-10T10:54:07.645791+0000","last_peered":"2024-05-10T10:54:07.645791+0000","last_clean":"2024-05-10T10:54:07.645791+0000","last_became_active":"2024-05-10T10:52:15.695121+0000","last_became_peered":"2024-05-10T10:52:15.695121+0000","last_unstale":"2024-05-10T10:54:07.645791+0000","last_undegraded":"2024-05-10T10:54:07.645791+0000","last_fullsized":"2024-05-10T10:54:07.645791+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:48:08.019465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":127,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:05.807854+0000","last_change":"2024-05-10T10:52:12.630799+0000","last_active":"2024-05-10T10:54:05.807854+0000","last_peered":"2024-05-10T10:54:05.807854+0000","last_clean":"2024-05-10T10:54:05.807854+0000","last_became_active":"2024-05-10T10:52:12.630448+0000","last_became_peered":"2024-05-10T10:52:12.630448+0000","last_unstale":"2024-05-10T10:54:05.807854+0000","last_undegraded":"2024-05-10T10:54:05.807854+0000","last_fullsized":"2024-05-10T10:54:05.807854+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:27.335062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.644600+0000","last_change":"2024-05-10T10:52:15.686691+0000","last_active":"2024-05-10T10:54:07.644600+0000","last_peered":"2024-05-10T10:54:07.644600+0000","last_clean":"2024-05-10T10:54:07.644600+0000","last_became_active":"2024-05-10T10:52:15.685886+0000","last_became_peered":"2024-05-10T10:52:15.685886+0000","last_unstale":"2024-05-10T10:54:07.644600+0000","last_undegraded":"2024-05-10T10:54:07.644600+0000","last_fullsized":"2024-05-10T10:54:07.644600+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:45.199414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697313+0000","last_change":"2024-05-10T10:52:12.533535+0000","last_active":"2024-05-10T10:53:09.697313+0000","last_peered":"2024-05-10T10:53:09.697313+0000","last_clean":"2024-05-10T10:53:09.697313+0000","last_became_active":"2024-05-10T10:52:12.533146+0000","last_became_peered":"2024-05-10T10:52:12.533146+0000","last_unstale":"2024-05-10T10:53:09.697313+0000","last_undegraded":"2024-05-10T10:53:09.697313+0000","last_fullsized":"2024-05-10T10:53:09.697313+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:07:16.138240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.633863+0000","last_change":"2024-05-10T10:52:15.692013+0000","last_active":"2024-05-10T10:54:07.633863+0000","last_peered":"2024-05-10T10:54:07.633863+0000","last_clean":"2024-05-10T10:54:07.633863+0000","last_became_active":"2024-05-10T10:52:15.691660+0000","last_became_peered":"2024-05-10T10:52:15.691660+0000","last_unstale":"2024-05-10T10:54:07.633863+0000","last_undegraded":"2024-05-10T10:54:07.633863+0000","last_fullsized":"2024-05-10T10:54:07.633863+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:58.780961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.902457+0000","last_change":"2024-05-10T10:52:12.530962+0000","last_active":"2024-05-10T10:53:08.902457+0000","last_peered":"2024-05-10T10:53:08.902457+0000","last_clean":"2024-05-10T10:53:08.902457+0000","last_became_active":"2024-05-10T10:52:12.530610+0000","last_became_peered":"2024-05-10T10:52:12.530610+0000","last_unstale":"2024-05-10T10:53:08.902457+0000","last_undegraded":"2024-05-10T10:53:08.902457+0000","last_fullsized":"2024-05-10T10:53:08.902457+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:04:13.484713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.637709+0000","last_change":"2024-05-10T10:52:15.687218+0000","last_active":"2024-05-10T10:54:07.637709+0000","last_peered":"2024-05-10T10:54:07.637709+0000","last_clean":"2024-05-10T10:54:07.637709+0000","last_became_active":"2024-05-10T10:52:15.686888+0000","last_became_peered":"2024-05-10T10:52:15.686888+0000","last_unstale":"2024-05-10T10:54:07.637709+0000","last_undegraded":"2024-05-10T10:54:07.637709+0000","last_fullsized":"2024-05-10T10:54:07.637709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:53:53.420063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.627323+0000","last_change":"2024-05-10T10:52:15.691196+0000","last_active":"2024-05-10T10:54:07.627323+0000","last_peered":"2024-05-10T10:54:07.627323+0000","last_clean":"2024-05-10T10:54:07.627323+0000","last_became_active":"2024-05-10T10:52:15.690865+0000","last_became_peered":"2024-05-10T10:52:15.690865+0000","last_unstale":"2024-05-10T10:54:07.627323+0000","last_undegraded":"2024-05-10T10:54:07.627323+0000","last_fullsized":"2024-05-10T10:54:07.627323+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:02:04.666193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.589851+0000","last_change":"2024-05-10T10:52:15.691239+0000","last_active":"2024-05-10T10:53:09.589851+0000","last_peered":"2024-05-10T10:53:09.589851+0000","last_clean":"2024-05-10T10:53:09.589851+0000","last_became_active":"2024-05-10T10:52:15.690877+0000","last_became_peered":"2024-05-10T10:52:15.690877+0000","last_unstale":"2024-05-10T10:53:09.589851+0000","last_undegraded":"2024-05-10T10:53:09.589851+0000","last_fullsized":"2024-05-10T10:53:09.589851+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:16.564872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.589831+0000","last_change":"2024-05-10T10:52:15.681784+0000","last_active":"2024-05-10T10:53:09.589831+0000","last_peered":"2024-05-10T10:53:09.589831+0000","last_clean":"2024-05-10T10:53:09.589831+0000","last_became_active":"2024-05-10T10:52:15.680900+0000","last_became_peered":"2024-05-10T10:52:15.680900+0000","last_unstale":"2024-05-10T10:53:09.589831+0000","last_undegraded":"2024-05-10T10:53:09.589831+0000","last_fullsized":"2024-05-10T10:53:09.589831+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:56.393338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.639121+0000","last_change":"2024-05-10T10:52:15.690659+0000","last_active":"2024-05-10T10:54:07.639121+0000","last_peered":"2024-05-10T10:54:07.639121+0000","last_clean":"2024-05-10T10:54:07.639121+0000","last_became_active":"2024-05-10T10:52:15.689723+0000","last_became_peered":"2024-05-10T10:52:15.689723+0000","last_unstale":"2024-05-10T10:54:07.639121+0000","last_undegraded":"2024-05-10T10:54:07.639121+0000","last_fullsized":"2024-05-10T10:54:07.639121+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:53:35.212066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.638558+0000","last_change":"2024-05-10T10:53:08.908043+0000","last_active":"2024-05-10T10:54:07.638558+0000","last_peered":"2024-05-10T10:54:07.638558+0000","last_clean":"2024-05-10T10:54:07.638558+0000","last_became_active":"2024-05-10T10:53:08.907635+0000","last_became_peered":"2024-05-10T10:53:08.907635+0000","last_unstale":"2024-05-10T10:54:07.638558+0000","last_undegraded":"2024-05-10T10:54:07.638558+0000","last_fullsized":"2024-05-10T10:54:07.638558+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:03.613885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.613847+0000","last_change":"2024-05-10T10:52:15.690573+0000","last_active":"2024-05-10T10:54:07.613847+0000","last_peered":"2024-05-10T10:54:07.613847+0000","last_clean":"2024-05-10T10:54:07.613847+0000","last_became_active":"2024-05-10T10:52:15.690257+0000","last_became_peered":"2024-05-10T10:52:15.690257+0000","last_unstale":"2024-05-10T10:54:07.613847+0000","last_undegraded":"2024-05-10T10:54:07.613847+0000","last_fullsized":"2024-05-10T10:54:07.613847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:37:27.128718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.590165+0000","last_change":"2024-05-10T10:52:15.684914+0000","last_active":"2024-05-10T10:53:09.590165+0000","last_peered":"2024-05-10T10:53:09.590165+0000","last_clean":"2024-05-10T10:53:09.590165+0000","last_became_active":"2024-05-10T10:52:15.684557+0000","last_became_peered":"2024-05-10T10:52:15.684557+0000","last_unstale":"2024-05-10T10:53:09.590165+0000","last_undegraded":"2024-05-10T10:53:09.590165+0000","last_fullsized":"2024-05-10T10:53:09.590165+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:17.444305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.629290+0000","last_change":"2024-05-10T10:52:15.697047+0000","last_active":"2024-05-10T10:54:07.629290+0000","last_peered":"2024-05-10T10:54:07.629290+0000","last_clean":"2024-05-10T10:54:07.629290+0000","last_became_active":"2024-05-10T10:52:15.696726+0000","last_became_peered":"2024-05-10T10:52:15.696726+0000","last_unstale":"2024-05-10T10:54:07.629290+0000","last_undegraded":"2024-05-10T10:54:07.629290+0000","last_fullsized":"2024-05-10T10:54:07.629290+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:14:30.777403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.629057+0000","last_change":"2024-05-10T10:52:15.695613+0000","last_active":"2024-05-10T10:54:07.629057+0000","last_peered":"2024-05-10T10:54:07.629057+0000","last_clean":"2024-05-10T10:54:07.629057+0000","last_became_active":"2024-05-10T10:52:15.695147+0000","last_became_peered":"2024-05-10T10:52:15.695147+0000","last_unstale":"2024-05-10T10:54:07.629057+0000","last_undegraded":"2024-05-10T10:54:07.629057+0000","last_fullsized":"2024-05-10T10:54:07.629057+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:14.175158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628677+0000","last_change":"2024-05-10T10:52:15.683914+0000","last_active":"2024-05-10T10:54:07.628677+0000","last_peered":"2024-05-10T10:54:07.628677+0000","last_clean":"2024-05-10T10:54:07.628677+0000","last_became_active":"2024-05-10T10:52:15.682359+0000","last_became_peered":"2024-05-10T10:52:15.682359+0000","last_unstale":"2024-05-10T10:54:07.628677+0000","last_undegraded":"2024-05-10T10:54:07.628677+0000","last_fullsized":"2024-05-10T10:54:07.628677+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:23:41.018064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.644839+0000","last_change":"2024-05-10T10:52:15.690862+0000","last_active":"2024-05-10T10:54:07.644839+0000","last_peered":"2024-05-10T10:54:07.644839+0000","last_clean":"2024-05-10T10:54:07.644839+0000","last_became_active":"2024-05-10T10:52:15.690520+0000","last_became_peered":"2024-05-10T10:52:15.690520+0000","last_unstale":"2024-05-10T10:54:07.644839+0000","last_undegraded":"2024-05-10T10:54:07.644839+0000","last_fullsized":"2024-05-10T10:54:07.644839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:39.819473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.640463+0000","last_change":"2024-05-10T10:52:15.684605+0000","last_active":"2024-05-10T10:54:07.640463+0000","last_peered":"2024-05-10T10:54:07.640463+0000","last_clean":"2024-05-10T10:54:07.640463+0000","last_became_active":"2024-05-10T10:52:15.683863+0000","last_became_peered":"2024-05-10T10:52:15.683863+0000","last_unstale":"2024-05-10T10:54:07.640463+0000","last_undegraded":"2024-05-10T10:54:07.640463+0000","last_fullsized":"2024-05-10T10:54:07.640463+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:49:35.187932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.619468+0000","last_change":"2024-05-10T10:52:15.698014+0000","last_active":"2024-05-10T10:54:07.619468+0000","last_peered":"2024-05-10T10:54:07.619468+0000","last_clean":"2024-05-10T10:54:07.619468+0000","last_became_active":"2024-05-10T10:52:15.697583+0000","last_became_peered":"2024-05-10T10:52:15.697583+0000","last_unstale":"2024-05-10T10:54:07.619468+0000","last_undegraded":"2024-05-10T10:54:07.619468+0000","last_fullsized":"2024-05-10T10:54:07.619468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:30.792127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":426,"ondisk_log_size":426,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71927,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1002,"num_read_kb":583,"num_write":253,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":215391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645349,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":436691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841581,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36900,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708252,"statfs":{"total":95995035648,"available":95957250048,"internally_reserved":0,"allocated":1601536,"data_stored":1092693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037810,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":921600,"data_stored":436621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234037,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":436999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430267,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1515520,"data_stored":1029658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593792,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":436338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":502224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":925696,"data_stored":437677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":502586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":436163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986250,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":436199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790020,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36828,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708324,"statfs":{"total":95995035648,"available":95957323776,"internally_reserved":0,"allocated":1527808,"data_stored":1029336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":66709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T10:54:13.436 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-10T10:54:13.436 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-10T10:54:13.437 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-10T10:54:13.437 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph health --format=json 2024-05-10T10:54:13.681 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:54:14.041 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:13 smithi107 ceph-mon[30373]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:54:14.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:13 smithi196 ceph-mon[34872]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:54:14.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:13 smithi184 ceph-mon[34585]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:54:15.029 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:14 smithi107 ceph-mon[30373]: pgmap v345: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-10T10:54:15.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:14 smithi196 ceph-mon[34872]: pgmap v345: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-10T10:54:15.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:14 smithi184 ceph-mon[34585]: pgmap v345: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-10T10:54:15.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.372+0000 7f7f2209e700 1 -- 172.21.15.107:0/2853179767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f1c1037b0 msgr2=0x7f7f1c103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:15.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.372+0000 7f7f2209e700 1 --2- 172.21.15.107:0/2853179767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f1c1037b0 0x7f7f1c103b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7f100099c0 tx=0x7f7f10009cd0 comp rx=0 tx=0).stop 2024-05-10T10:54:15.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.372+0000 7f7f2209e700 1 -- 172.21.15.107:0/2853179767 shutdown_connections 2024-05-10T10:54:15.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.372+0000 7f7f2209e700 1 --2- 172.21.15.107:0/2853179767 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f1c108880 0x7f7f1c110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:15.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.372+0000 7f7f2209e700 1 --2- 172.21.15.107:0/2853179767 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f1c1037b0 0x7f7f1c103b90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:15.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.372+0000 7f7f2209e700 1 --2- 172.21.15.107:0/2853179767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f1c104160 0x7f7f1c108150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:15.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.372+0000 7f7f2209e700 1 -- 172.21.15.107:0/2853179767 >> 172.21.15.107:0/2853179767 conn(0x7f7f1c07a580 msgr2=0x7f7f1c07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:15.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.372+0000 7f7f2209e700 1 -- 172.21.15.107:0/2853179767 shutdown_connections 2024-05-10T10:54:15.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.372+0000 7f7f2209e700 1 -- 172.21.15.107:0/2853179767 wait complete. 2024-05-10T10:54:15.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.373+0000 7f7f2209e700 1 Processor -- start 2024-05-10T10:54:15.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.373+0000 7f7f2209e700 1 -- start start 2024-05-10T10:54:15.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.373+0000 7f7f2209e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f1c1037b0 0x7f7f1c19f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:15.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.373+0000 7f7f2209e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f1c104160 0x7f7f1c19fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:15.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.373+0000 7f7f2209e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f1c108880 0x7f7f1c199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:15.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.373+0000 7f7f2209e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1c113820 con 0x7f7f1c108880 2024-05-10T10:54:15.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.373+0000 7f7f2209e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1c1136a0 con 0x7f7f1c104160 2024-05-10T10:54:15.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.373+0000 7f7f2209e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1c1139a0 con 0x7f7f1c1037b0 2024-05-10T10:54:15.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.373+0000 7f7f1bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f1c108880 0x7f7f1c199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:15.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.373+0000 7f7f1bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f1c108880 0x7f7f1c199a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60834/0 (socket says 172.21.15.107:60834) 2024-05-10T10:54:15.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.373+0000 7f7f1bfff700 1 -- 172.21.15.107:0/1793465777 learned_addr learned my addr 172.21.15.107:0/1793465777 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:15.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.373+0000 7f7f1affd700 1 --2- 172.21.15.107:0/1793465777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f1c104160 0x7f7f1c19fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:15.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.373+0000 7f7f1bfff700 1 -- 172.21.15.107:0/1793465777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f1c1037b0 msgr2=0x7f7f1c19f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:15.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.373+0000 7f7f1bfff700 1 --2- 172.21.15.107:0/1793465777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f1c1037b0 0x7f7f1c19f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:15.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.373+0000 7f7f1bfff700 1 -- 172.21.15.107:0/1793465777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f1c104160 msgr2=0x7f7f1c19fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:15.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.373+0000 7f7f1bfff700 1 --2- 172.21.15.107:0/1793465777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f1c104160 0x7f7f1c19fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:15.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.373+0000 7f7f1bfff700 1 -- 172.21.15.107:0/1793465777 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f1c19a1e0 con 0x7f7f1c108880 2024-05-10T10:54:15.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.374+0000 7f7f1bfff700 1 --2- 172.21.15.107:0/1793465777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f1c108880 0x7f7f1c199a80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7f14007ee0 tx=0x7f7f1400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:15.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.374+0000 7f7f18ff9700 1 -- 172.21.15.107:0/1793465777 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1400dbd0 con 0x7f7f1c108880 2024-05-10T10:54:15.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.374+0000 7f7f2209e700 1 -- 172.21.15.107:0/1793465777 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f1c19a4d0 con 0x7f7f1c108880 2024-05-10T10:54:15.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.374+0000 7f7f18ff9700 1 -- 172.21.15.107:0/1793465777 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7f1400dd70 con 0x7f7f1c108880 2024-05-10T10:54:15.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.374+0000 7f7f18ff9700 1 -- 172.21.15.107:0/1793465777 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f140133f0 con 0x7f7f1c108880 2024-05-10T10:54:15.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.374+0000 7f7f2209e700 1 -- 172.21.15.107:0/1793465777 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f1c1a6790 con 0x7f7f1c108880 2024-05-10T10:54:15.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.375+0000 7f7f2209e700 1 -- 172.21.15.107:0/1793465777 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f1c10bac0 con 0x7f7f1c108880 2024-05-10T10:54:15.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.376+0000 7f7f18ff9700 1 -- 172.21.15.107:0/1793465777 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f7f1401a020 con 0x7f7f1c108880 2024-05-10T10:54:15.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.377+0000 7f7f18ff9700 1 --2- 172.21.15.107:0/1793465777 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7f040b2880 0x7f7f040b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:15.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.377+0000 7f7f1b7fe700 1 --2- 172.21.15.107:0/1793465777 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7f040b2880 0x7f7f040b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:15.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.377+0000 7f7f18ff9700 1 -- 172.21.15.107:0/1793465777 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f7f140e2100 con 0x7f7f1c108880 2024-05-10T10:54:15.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.377+0000 7f7f1b7fe700 1 --2- 172.21.15.107:0/1793465777 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7f040b2880 0x7f7f040b4d40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7f100098e0 tx=0x7f7f10009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:15.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.380+0000 7f7f18ff9700 1 -- 172.21.15.107:0/1793465777 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f7f14010070 con 0x7f7f1c108880 2024-05-10T10:54:15.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.634+0000 7f7f2209e700 1 -- 172.21.15.107:0/1793465777 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7f1c06a190 con 0x7f7f1c108880 2024-05-10T10:54:15.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.635+0000 7f7f18ff9700 1 -- 172.21.15.107:0/1793465777 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f7f140a9ea0 con 0x7f7f1c108880 2024-05-10T10:54:15.636 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:54:15.636 INFO:teuthology.orchestra.run.smithi107.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-10T10:54:15.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.638+0000 7f7f2209e700 1 -- 172.21.15.107:0/1793465777 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7f040b2880 msgr2=0x7f7f040b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:15.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.638+0000 7f7f2209e700 1 --2- 172.21.15.107:0/1793465777 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7f040b2880 0x7f7f040b4d40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7f100098e0 tx=0x7f7f10009f10 comp rx=0 tx=0).stop 2024-05-10T10:54:15.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.638+0000 7f7f2209e700 1 -- 172.21.15.107:0/1793465777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f1c108880 msgr2=0x7f7f1c199a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:15.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.638+0000 7f7f2209e700 1 --2- 172.21.15.107:0/1793465777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f1c108880 0x7f7f1c199a80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7f14007ee0 tx=0x7f7f1400d3b0 comp rx=0 tx=0).stop 2024-05-10T10:54:15.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.638+0000 7f7f2209e700 1 -- 172.21.15.107:0/1793465777 shutdown_connections 2024-05-10T10:54:15.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.638+0000 7f7f2209e700 1 --2- 172.21.15.107:0/1793465777 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7f040b2880 0x7f7f040b4d40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:15.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.638+0000 7f7f2209e700 1 --2- 172.21.15.107:0/1793465777 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7f1c1037b0 0x7f7f1c19f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:15.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.638+0000 7f7f2209e700 1 --2- 172.21.15.107:0/1793465777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f1c108880 0x7f7f1c199a80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:15.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.638+0000 7f7f2209e700 1 --2- 172.21.15.107:0/1793465777 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f1c104160 0x7f7f1c19fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:15.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.638+0000 7f7f2209e700 1 -- 172.21.15.107:0/1793465777 >> 172.21.15.107:0/1793465777 conn(0x7f7f1c07a580 msgr2=0x7f7f1c102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:15.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.638+0000 7f7f2209e700 1 -- 172.21.15.107:0/1793465777 shutdown_connections 2024-05-10T10:54:15.639 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:15.638+0000 7f7f2209e700 1 -- 172.21.15.107:0/1793465777 wait complete. 2024-05-10T10:54:15.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:15 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1793465777' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-10T10:54:16.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:15 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1793465777' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-10T10:54:16.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:15 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1793465777' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-10T10:54:16.366 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-10T10:54:16.366 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:54:16.609 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:54:17.014 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:16 smithi107 ceph-mon[30373]: pgmap v346: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 12 op/s 2024-05-10T10:54:17.062 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:16 smithi196 ceph-mon[34872]: pgmap v346: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 12 op/s 2024-05-10T10:54:17.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:16 smithi184 ceph-mon[34585]: pgmap v346: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 12 op/s 2024-05-10T10:54:18.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.330+0000 7feafc60a700 1 -- 172.21.15.107:0/1253248019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaf41076c0 msgr2=0x7feaf410f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:18.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.330+0000 7feafc60a700 1 --2- 172.21.15.107:0/1253248019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaf41076c0 0x7feaf410f290 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feaec00b0d0 tx=0x7feaec00b3e0 comp rx=0 tx=0).stop 2024-05-10T10:54:18.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.331+0000 7feafc60a700 1 -- 172.21.15.107:0/1253248019 shutdown_connections 2024-05-10T10:54:18.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.331+0000 7feafc60a700 1 --2- 172.21.15.107:0/1253248019 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaf41076c0 0x7feaf410f290 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:18.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.331+0000 7feafc60a700 1 --2- 172.21.15.107:0/1253248019 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaf4102630 0x7feaf4102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:18.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.331+0000 7feafc60a700 1 --2- 172.21.15.107:0/1253248019 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaf4102fe0 0x7feaf4106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:18.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.331+0000 7feafc60a700 1 -- 172.21.15.107:0/1253248019 >> 172.21.15.107:0/1253248019 conn(0x7feaf4079370 msgr2=0x7feaf4079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:18.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.331+0000 7feafc60a700 1 -- 172.21.15.107:0/1253248019 shutdown_connections 2024-05-10T10:54:18.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.331+0000 7feafc60a700 1 -- 172.21.15.107:0/1253248019 wait complete. 2024-05-10T10:54:18.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.331+0000 7feafc60a700 1 Processor -- start 2024-05-10T10:54:18.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.331+0000 7feafc60a700 1 -- start start 2024-05-10T10:54:18.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.331+0000 7feafc60a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaf4102630 0x7feaf419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:18.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.331+0000 7feafc60a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaf4102fe0 0x7feaf419b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:18.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.331+0000 7feafc60a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaf41076c0 0x7feaf41a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:18.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.331+0000 7feafc60a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7feaf4112790 con 0x7feaf4102fe0 2024-05-10T10:54:18.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.331+0000 7feafc60a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7feaf4112610 con 0x7feaf41076c0 2024-05-10T10:54:18.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.331+0000 7feafc60a700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7feaf4112910 con 0x7feaf4102630 2024-05-10T10:54:18.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.332+0000 7feaf9ba5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaf4102fe0 0x7feaf419b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:18.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.332+0000 7feaf9ba5700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaf4102fe0 0x7feaf419b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58200/0 (socket says 172.21.15.107:58200) 2024-05-10T10:54:18.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.332+0000 7feaf9ba5700 1 -- 172.21.15.107:0/1306330654 learned_addr learned my addr 172.21.15.107:0/1306330654 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:18.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.332+0000 7feafa3a6700 1 --2- 172.21.15.107:0/1306330654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaf4102630 0x7feaf419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:18.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.332+0000 7feaf9ba5700 1 -- 172.21.15.107:0/1306330654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaf4102630 msgr2=0x7feaf419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:18.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.332+0000 7feaf9ba5700 1 --2- 172.21.15.107:0/1306330654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaf4102630 0x7feaf419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:18.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.332+0000 7feaf9ba5700 1 -- 172.21.15.107:0/1306330654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaf41076c0 msgr2=0x7feaf41a5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:18.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.332+0000 7feaf9ba5700 1 --2- 172.21.15.107:0/1306330654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaf41076c0 0x7feaf41a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:18.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.332+0000 7feaf9ba5700 1 -- 172.21.15.107:0/1306330654 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf41a6190 con 0x7feaf4102fe0 2024-05-10T10:54:18.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.332+0000 7feafa3a6700 1 --2- 172.21.15.107:0/1306330654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaf4102630 0x7feaf419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:54:18.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.332+0000 7feaf9ba5700 1 --2- 172.21.15.107:0/1306330654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaf4102fe0 0x7feaf419b110 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7feae400b500 tx=0x7feae400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:18.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.332+0000 7feaeb7fe700 1 -- 172.21.15.107:0/1306330654 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae4015020 con 0x7feaf4102fe0 2024-05-10T10:54:18.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.332+0000 7feafc60a700 1 -- 172.21.15.107:0/1306330654 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf41a63c0 con 0x7feaf4102fe0 2024-05-10T10:54:18.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.332+0000 7feaeb7fe700 1 -- 172.21.15.107:0/1306330654 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feae4011d00 con 0x7feaf4102fe0 2024-05-10T10:54:18.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.332+0000 7feaeb7fe700 1 -- 172.21.15.107:0/1306330654 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae4010e40 con 0x7feaf4102fe0 2024-05-10T10:54:18.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.332+0000 7feafc60a700 1 -- 172.21.15.107:0/1306330654 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf41a68d0 con 0x7feaf4102fe0 2024-05-10T10:54:18.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.333+0000 7feafc60a700 1 -- 172.21.15.107:0/1306330654 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf406a190 con 0x7feaf4102fe0 2024-05-10T10:54:18.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.335+0000 7feaeb7fe700 1 -- 172.21.15.107:0/1306330654 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7feae4018020 con 0x7feaf4102fe0 2024-05-10T10:54:18.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.336+0000 7feaeb7fe700 1 --2- 172.21.15.107:0/1306330654 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7feae00b2880 0x7feae00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:18.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.336+0000 7feafa3a6700 1 --2- 172.21.15.107:0/1306330654 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7feae00b2880 0x7feae00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:18.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.336+0000 7feaeb7fe700 1 -- 172.21.15.107:0/1306330654 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7feae40e1f60 con 0x7feaf4102fe0 2024-05-10T10:54:18.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.336+0000 7feafa3a6700 1 --2- 172.21.15.107:0/1306330654 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7feae00b2880 0x7feae00b4d40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feaf0007900 tx=0x7feaf0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:18.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.340+0000 7feaeb7fe700 1 -- 172.21.15.107:0/1306330654 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7feae401f020 con 0x7feaf4102fe0 2024-05-10T10:54:18.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.588+0000 7feafc60a700 1 -- 172.21.15.107:0/1306330654 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feaf402e6d0 con 0x7feaf4102fe0 2024-05-10T10:54:18.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.588+0000 7feaeb7fe700 1 -- 172.21.15.107:0/1306330654 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11951 (secure 0 0 0) 0x7feae40a9d20 con 0x7feaf4102fe0 2024-05-10T10:54:18.589 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:54:18.590 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T10:52:17.367732+0000","modified":"2024-05-10T10:52:35.666052+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24482,"mds_1":24449,"mds_2":24442,"mds_3":24431,"mds_4":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/2332963094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":2332963094},{"type":"v1","addr":"172.21.15.107:6841","nonce":2332963094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.184:6839/16501252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":16501252},{"type":"v1","addr":"172.21.15.184:6839","nonce":16501252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24449,24442,24482,24431,24430]},"id":1}]} 2024-05-10T10:54:18.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.591+0000 7feafc60a700 1 -- 172.21.15.107:0/1306330654 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7feae00b2880 msgr2=0x7feae00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:18.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.591+0000 7feafc60a700 1 --2- 172.21.15.107:0/1306330654 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7feae00b2880 0x7feae00b4d40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feaf0007900 tx=0x7feaf0008040 comp rx=0 tx=0).stop 2024-05-10T10:54:18.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.591+0000 7feafc60a700 1 -- 172.21.15.107:0/1306330654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaf4102fe0 msgr2=0x7feaf419b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:18.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.591+0000 7feafc60a700 1 --2- 172.21.15.107:0/1306330654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaf4102fe0 0x7feaf419b110 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7feae400b500 tx=0x7feae400b8c0 comp rx=0 tx=0).stop 2024-05-10T10:54:18.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.591+0000 7feafc60a700 1 -- 172.21.15.107:0/1306330654 shutdown_connections 2024-05-10T10:54:18.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.591+0000 7feafc60a700 1 --2- 172.21.15.107:0/1306330654 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7feae00b2880 0x7feae00b4d40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:18.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.591+0000 7feafc60a700 1 --2- 172.21.15.107:0/1306330654 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaf4102630 0x7feaf419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:18.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.591+0000 7feafc60a700 1 --2- 172.21.15.107:0/1306330654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feaf41076c0 0x7feaf41a5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:18.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.591+0000 7feafc60a700 1 --2- 172.21.15.107:0/1306330654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7feaf4102fe0 0x7feaf419b110 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:18.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.591+0000 7feafc60a700 1 -- 172.21.15.107:0/1306330654 >> 172.21.15.107:0/1306330654 conn(0x7feaf4079370 msgr2=0x7feaf41062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:18.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.591+0000 7feafc60a700 1 -- 172.21.15.107:0/1306330654 shutdown_connections 2024-05-10T10:54:18.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:18.591+0000 7feafc60a700 1 -- 172.21.15.107:0/1306330654 wait complete. 2024-05-10T10:54:18.593 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 26 2024-05-10T10:54:18.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:18 smithi107 ceph-mon[30373]: pgmap v347: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-10T10:54:18.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:18 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1306330654' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:54:19.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:18 smithi196 ceph-mon[34872]: pgmap v347: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-10T10:54:19.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:18 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1306330654' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:54:19.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:18 smithi184 ceph-mon[34585]: pgmap v347: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-10T10:54:19.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:18 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1306330654' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:54:19.261 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:54:19.503 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:54:20.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:20 smithi107 ceph-mon[30373]: pgmap v348: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-10T10:54:21.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:20 smithi196 ceph-mon[34872]: pgmap v348: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-10T10:54:21.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:20 smithi184 ceph-mon[34585]: pgmap v348: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-10T10:54:21.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.179+0000 7f0db13bc700 1 -- 172.21.15.107:0/2178114824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dac101c50 msgr2=0x7f0dac102030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:21.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.179+0000 7f0db13bc700 1 --2- 172.21.15.107:0/2178114824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dac101c50 0x7f0dac102030 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c0099c0 tx=0x7f0d9c009cd0 comp rx=0 tx=0).stop 2024-05-10T10:54:21.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.179+0000 7f0db13bc700 1 -- 172.21.15.107:0/2178114824 shutdown_connections 2024-05-10T10:54:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.179+0000 7f0db13bc700 1 --2- 172.21.15.107:0/2178114824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dac108890 0x7f0dac110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.179+0000 7f0db13bc700 1 --2- 172.21.15.107:0/2178114824 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dac101c50 0x7f0dac102030 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.179+0000 7f0db13bc700 1 --2- 172.21.15.107:0/2178114824 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0dac102600 0x7f0dac108160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.179+0000 7f0db13bc700 1 -- 172.21.15.107:0/2178114824 >> 172.21.15.107:0/2178114824 conn(0x7f0dac0789a0 msgr2=0x7f0dac0ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.179+0000 7f0db13bc700 1 -- 172.21.15.107:0/2178114824 shutdown_connections 2024-05-10T10:54:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.179+0000 7f0db13bc700 1 -- 172.21.15.107:0/2178114824 wait complete. 2024-05-10T10:54:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.179+0000 7f0db13bc700 1 Processor -- start 2024-05-10T10:54:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.180+0000 7f0db13bc700 1 -- start start 2024-05-10T10:54:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.180+0000 7f0db13bc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dac101c50 0x7f0dac199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.180+0000 7f0db13bc700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0dac102600 0x7f0dac19a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.180+0000 7f0db13bc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dac108890 0x7f0dac19e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.180+0000 7f0db13bc700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0dac113890 con 0x7f0dac101c50 2024-05-10T10:54:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.180+0000 7f0db13bc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0dac113710 con 0x7f0dac108890 2024-05-10T10:54:21.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.180+0000 7f0db13bc700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0dac113a10 con 0x7f0dac102600 2024-05-10T10:54:21.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.180+0000 7f0daaffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dac101c50 0x7f0dac199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:21.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.180+0000 7f0daaffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dac101c50 0x7f0dac199da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58226/0 (socket says 172.21.15.107:58226) 2024-05-10T10:54:21.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.180+0000 7f0daaffd700 1 -- 172.21.15.107:0/213636237 learned_addr learned my addr 172.21.15.107:0/213636237 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:21.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.180+0000 7f0dab7fe700 1 --2- 172.21.15.107:0/213636237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dac108890 0x7f0dac19e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:21.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.180+0000 7f0da27fc700 1 --2- 172.21.15.107:0/213636237 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0dac102600 0x7f0dac19a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:21.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.180+0000 7f0daaffd700 1 -- 172.21.15.107:0/213636237 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0dac102600 msgr2=0x7f0dac19a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:21.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.180+0000 7f0daaffd700 1 --2- 172.21.15.107:0/213636237 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0dac102600 0x7f0dac19a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:21.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.180+0000 7f0daaffd700 1 -- 172.21.15.107:0/213636237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dac108890 msgr2=0x7f0dac19e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:21.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.180+0000 7f0daaffd700 1 --2- 172.21.15.107:0/213636237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dac108890 0x7f0dac19e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:21.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.180+0000 7f0daaffd700 1 -- 172.21.15.107:0/213636237 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dac19ed60 con 0x7f0dac101c50 2024-05-10T10:54:21.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.180+0000 7f0da27fc700 1 --2- 172.21.15.107:0/213636237 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0dac102600 0x7f0dac19a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:54:21.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.180+0000 7f0daaffd700 1 --2- 172.21.15.107:0/213636237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dac101c50 0x7f0dac199da0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c000c00 tx=0x7f0d9c003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:21.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.181+0000 7f0da8ff9700 1 -- 172.21.15.107:0/213636237 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c027070 con 0x7f0dac101c50 2024-05-10T10:54:21.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.181+0000 7f0db13bc700 1 -- 172.21.15.107:0/213636237 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dac19eff0 con 0x7f0dac101c50 2024-05-10T10:54:21.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.181+0000 7f0da8ff9700 1 -- 172.21.15.107:0/213636237 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0d9c0041a0 con 0x7f0dac101c50 2024-05-10T10:54:21.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.181+0000 7f0da8ff9700 1 -- 172.21.15.107:0/213636237 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c00f460 con 0x7f0dac101c50 2024-05-10T10:54:21.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.181+0000 7f0db13bc700 1 -- 172.21.15.107:0/213636237 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dac1a68d0 con 0x7f0dac101c50 2024-05-10T10:54:21.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.182+0000 7f0db13bc700 1 -- 172.21.15.107:0/213636237 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dac10bad0 con 0x7f0dac101c50 2024-05-10T10:54:21.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.183+0000 7f0da8ff9700 1 -- 172.21.15.107:0/213636237 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f0d9c02a070 con 0x7f0dac101c50 2024-05-10T10:54:21.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.184+0000 7f0da8ff9700 1 --2- 172.21.15.107:0/213636237 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0d8c0b2880 0x7f0d8c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:21.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.184+0000 7f0da27fc700 1 --2- 172.21.15.107:0/213636237 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0d8c0b2880 0x7f0d8c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:21.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.184+0000 7f0da8ff9700 1 -- 172.21.15.107:0/213636237 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f0d9c0e3230 con 0x7f0dac101c50 2024-05-10T10:54:21.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.184+0000 7f0da27fc700 1 --2- 172.21.15.107:0/213636237 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0d8c0b2880 0x7f0d8c0b4d40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0dac106070 tx=0x7f0d94008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:21.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.188+0000 7f0da8ff9700 1 -- 172.21.15.107:0/213636237 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0d9c013070 con 0x7f0dac101c50 2024-05-10T10:54:21.452 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.450+0000 7f0db13bc700 1 -- 172.21.15.107:0/213636237 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0dac19b0b0 con 0x7f0dac101c50 2024-05-10T10:54:21.453 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.451+0000 7f0da8ff9700 1 -- 172.21.15.107:0/213636237 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11951 (secure 0 0 0) 0x7f0d9c0ab080 con 0x7f0dac101c50 2024-05-10T10:54:21.453 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:54:21.453 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T10:52:17.367732+0000","modified":"2024-05-10T10:52:35.666052+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24482,"mds_1":24449,"mds_2":24442,"mds_3":24431,"mds_4":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/2332963094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":2332963094},{"type":"v1","addr":"172.21.15.107:6841","nonce":2332963094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.184:6839/16501252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":16501252},{"type":"v1","addr":"172.21.15.184:6839","nonce":16501252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24449,24442,24482,24431,24430]},"id":1}]} 2024-05-10T10:54:21.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.453+0000 7f0db13bc700 1 -- 172.21.15.107:0/213636237 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0d8c0b2880 msgr2=0x7f0d8c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:21.454 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.453+0000 7f0db13bc700 1 --2- 172.21.15.107:0/213636237 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0d8c0b2880 0x7f0d8c0b4d40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0dac106070 tx=0x7f0d94008040 comp rx=0 tx=0).stop 2024-05-10T10:54:21.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.453+0000 7f0db13bc700 1 -- 172.21.15.107:0/213636237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dac101c50 msgr2=0x7f0dac199da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:21.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.453+0000 7f0db13bc700 1 --2- 172.21.15.107:0/213636237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dac101c50 0x7f0dac199da0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c000c00 tx=0x7f0d9c003730 comp rx=0 tx=0).stop 2024-05-10T10:54:21.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.453+0000 7f0db13bc700 1 -- 172.21.15.107:0/213636237 shutdown_connections 2024-05-10T10:54:21.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.453+0000 7f0db13bc700 1 --2- 172.21.15.107:0/213636237 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0d8c0b2880 0x7f0d8c0b4d40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:21.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.453+0000 7f0db13bc700 1 --2- 172.21.15.107:0/213636237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0dac108890 0x7f0dac19e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:21.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.453+0000 7f0db13bc700 1 --2- 172.21.15.107:0/213636237 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0dac101c50 0x7f0dac199da0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:21.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.453+0000 7f0db13bc700 1 --2- 172.21.15.107:0/213636237 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0dac102600 0x7f0dac19a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:21.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.453+0000 7f0db13bc700 1 -- 172.21.15.107:0/213636237 >> 172.21.15.107:0/213636237 conn(0x7f0dac0789a0 msgr2=0x7f0dac0ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:21.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.453+0000 7f0db13bc700 1 -- 172.21.15.107:0/213636237 shutdown_connections 2024-05-10T10:54:21.455 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:21.453+0000 7f0db13bc700 1 -- 172.21.15.107:0/213636237 wait complete. 2024-05-10T10:54:21.456 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 26 2024-05-10T10:54:22.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:21 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/213636237' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:54:22.107 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:21 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/213636237' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:54:22.135 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-10T10:54:22.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:21 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/213636237' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:54:22.385 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:54:23.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:22 smithi196 ceph-mon[34872]: pgmap v349: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-10T10:54:23.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:22 smithi184 ceph-mon[34585]: pgmap v349: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-10T10:54:23.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:22 smithi107 ceph-mon[30373]: pgmap v349: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-10T10:54:24.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.029+0000 7f6b59836700 1 -- 172.21.15.107:0/3248766344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b54102d50 msgr2=0x7f6b5410f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:24.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.029+0000 7f6b59836700 1 --2- 172.21.15.107:0/3248766344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b54102d50 0x7f6b5410f240 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00b0a0 tx=0x7f6b4c00b3b0 comp rx=0 tx=0).stop 2024-05-10T10:54:24.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.029+0000 7f6b59836700 1 -- 172.21.15.107:0/3248766344 shutdown_connections 2024-05-10T10:54:24.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.029+0000 7f6b59836700 1 --2- 172.21.15.107:0/3248766344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b54108400 0x7f6b541087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:24.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.029+0000 7f6b59836700 1 --2- 172.21.15.107:0/3248766344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b54102d50 0x7f6b5410f240 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:24.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.029+0000 7f6b59836700 1 --2- 172.21.15.107:0/3248766344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b54102390 0x7f6b54102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:24.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.029+0000 7f6b59836700 1 -- 172.21.15.107:0/3248766344 >> 172.21.15.107:0/3248766344 conn(0x7f6b54079310 msgr2=0x7f6b54079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:24.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.029+0000 7f6b59836700 1 -- 172.21.15.107:0/3248766344 shutdown_connections 2024-05-10T10:54:24.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.029+0000 7f6b59836700 1 -- 172.21.15.107:0/3248766344 wait complete. 2024-05-10T10:54:24.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.029+0000 7f6b59836700 1 Processor -- start 2024-05-10T10:54:24.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.030+0000 7f6b59836700 1 -- start start 2024-05-10T10:54:24.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.030+0000 7f6b59836700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b54102390 0x7f6b5419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:24.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.030+0000 7f6b59836700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b54102d50 0x7f6b5419b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:24.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.030+0000 7f6b59836700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b54108400 0x7f6b541a5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:24.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.030+0000 7f6b59836700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6b541126e0 con 0x7f6b54108400 2024-05-10T10:54:24.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.030+0000 7f6b59836700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6b54112560 con 0x7f6b54102390 2024-05-10T10:54:24.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.030+0000 7f6b59836700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f6b54112860 con 0x7f6b54102d50 2024-05-10T10:54:24.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.030+0000 7f6b537fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b54108400 0x7f6b541a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:24.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.030+0000 7f6b537fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b54108400 0x7f6b541a5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58242/0 (socket says 172.21.15.107:58242) 2024-05-10T10:54:24.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.030+0000 7f6b537fe700 1 -- 172.21.15.107:0/1204455344 learned_addr learned my addr 172.21.15.107:0/1204455344 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:24.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.030+0000 7f6b52ffd700 1 --2- 172.21.15.107:0/1204455344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b54102390 0x7f6b5419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:24.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.030+0000 7f6b527fc700 1 --2- 172.21.15.107:0/1204455344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b54102d50 0x7f6b5419b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:24.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.030+0000 7f6b537fe700 1 -- 172.21.15.107:0/1204455344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b54102d50 msgr2=0x7f6b5419b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:24.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.030+0000 7f6b537fe700 1 --2- 172.21.15.107:0/1204455344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b54102d50 0x7f6b5419b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:24.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.030+0000 7f6b537fe700 1 -- 172.21.15.107:0/1204455344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b54102390 msgr2=0x7f6b5419aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:24.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.030+0000 7f6b537fe700 1 --2- 172.21.15.107:0/1204455344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b54102390 0x7f6b5419aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:24.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.030+0000 7f6b537fe700 1 -- 172.21.15.107:0/1204455344 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b541a6080 con 0x7f6b54108400 2024-05-10T10:54:24.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.030+0000 7f6b537fe700 1 --2- 172.21.15.107:0/1204455344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b54108400 0x7f6b541a5b40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00b830 tx=0x7f6b4c007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:24.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.030+0000 7f6b58834700 1 -- 172.21.15.107:0/1204455344 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c021020 con 0x7f6b54108400 2024-05-10T10:54:24.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.031+0000 7f6b59836700 1 -- 172.21.15.107:0/1204455344 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b541a6250 con 0x7f6b54108400 2024-05-10T10:54:24.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.031+0000 7f6b58834700 1 -- 172.21.15.107:0/1204455344 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6b4c01db40 con 0x7f6b54108400 2024-05-10T10:54:24.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.031+0000 7f6b58834700 1 -- 172.21.15.107:0/1204455344 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c01bc80 con 0x7f6b54108400 2024-05-10T10:54:24.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.031+0000 7f6b59836700 1 -- 172.21.15.107:0/1204455344 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b541a6700 con 0x7f6b54108400 2024-05-10T10:54:24.034 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.031+0000 7f6b59836700 1 -- 172.21.15.107:0/1204455344 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b5410a970 con 0x7f6b54108400 2024-05-10T10:54:24.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.033+0000 7f6b58834700 1 -- 172.21.15.107:0/1204455344 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f6b4c024020 con 0x7f6b54108400 2024-05-10T10:54:24.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.033+0000 7f6b58834700 1 --2- 172.21.15.107:0/1204455344 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f6b3c0b2880 0x7f6b3c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:24.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.034+0000 7f6b52ffd700 1 --2- 172.21.15.107:0/1204455344 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f6b3c0b2880 0x7f6b3c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:24.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.034+0000 7f6b58834700 1 -- 172.21.15.107:0/1204455344 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f6b4c00f020 con 0x7f6b54108400 2024-05-10T10:54:24.035 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.034+0000 7f6b52ffd700 1 --2- 172.21.15.107:0/1204455344 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f6b3c0b2880 0x7f6b3c0b4d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009a10 tx=0x7f6b44009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:24.037 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.037+0000 7f6b58834700 1 -- 172.21.15.107:0/1204455344 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f6b4c01be20 con 0x7f6b54108400 2024-05-10T10:54:24.247 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.247+0000 7f6b59836700 1 -- 172.21.15.107:0/1204455344 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b5406bfb0 con 0x7f6b54108400 2024-05-10T10:54:24.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.248+0000 7f6b58834700 1 -- 172.21.15.107:0/1204455344 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22560 (secure 0 0 0) 0x7f6b4c0abc50 con 0x7f6b54108400 2024-05-10T10:54:24.249 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:54:24.249 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":82,"fsid":"0ba8a8e4-0eba-11ef-bc98-c7b262605968","created":"2024-05-10T10:44:13.064379+0000","modified":"2024-05-10T10:53:08.899432+0000","last_up_change":"2024-05-10T10:51:12.979718+0000","last_in_change":"2024-05-10T10:50:53.297651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T10:47:31.600062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T10:52:10.705022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T10:52:14.377732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"503f960c-a74b-4979-9bf9-42c90a2885a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6803","nonce":4213004004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6805","nonce":4213004004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6809","nonce":4213004004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6807","nonce":4213004004}]},"public_addr":"172.21.15.107:6803/4213004004","cluster_addr":"172.21.15.107:6805/4213004004","heartbeat_back_addr":"172.21.15.107:6809/4213004004","heartbeat_front_addr":"172.21.15.107:6807/4213004004","state":["exists","up"]},{"osd":1,"uuid":"f0f89167-1aa1-40a1-b122-c7f203c587d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6801","nonce":3242825160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6803","nonce":3242825160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6807","nonce":3242825160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6805","nonce":3242825160}]},"public_addr":"172.21.15.184:6801/3242825160","cluster_addr":"172.21.15.184:6803/3242825160","heartbeat_back_addr":"172.21.15.184:6807/3242825160","heartbeat_front_addr":"172.21.15.184:6805/3242825160","state":["exists","up"]},{"osd":2,"uuid":"7588b9be-b935-450a-944f-3feca69c029c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6801","nonce":137473043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6803","nonce":137473043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6807","nonce":137473043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6805","nonce":137473043}]},"public_addr":"172.21.15.196:6801/137473043","cluster_addr":"172.21.15.196:6803/137473043","heartbeat_back_addr":"172.21.15.196:6807/137473043","heartbeat_front_addr":"172.21.15.196:6805/137473043","state":["exists","up"]},{"osd":3,"uuid":"589ec3bb-884a-4441-a9d2-1f34ab372cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6811","nonce":1995642021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6813","nonce":1995642021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6817","nonce":1995642021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6815","nonce":1995642021}]},"public_addr":"172.21.15.107:6811/1995642021","cluster_addr":"172.21.15.107:6813/1995642021","heartbeat_back_addr":"172.21.15.107:6817/1995642021","heartbeat_front_addr":"172.21.15.107:6815/1995642021","state":["exists","up"]},{"osd":4,"uuid":"b72cdb50-492b-4406-8f21-37e4b2cf5a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6809","nonce":271550329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6811","nonce":271550329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6815","nonce":271550329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6813","nonce":271550329}]},"public_addr":"172.21.15.184:6809/271550329","cluster_addr":"172.21.15.184:6811/271550329","heartbeat_back_addr":"172.21.15.184:6815/271550329","heartbeat_front_addr":"172.21.15.184:6813/271550329","state":["exists","up"]},{"osd":5,"uuid":"05b6ad82-9153-44df-ae64-50c82d304429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6809","nonce":3681130435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6811","nonce":3681130435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6815","nonce":3681130435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6813","nonce":3681130435}]},"public_addr":"172.21.15.196:6809/3681130435","cluster_addr":"172.21.15.196:6811/3681130435","heartbeat_back_addr":"172.21.15.196:6815/3681130435","heartbeat_front_addr":"172.21.15.196:6813/3681130435","state":["exists","up"]},{"osd":6,"uuid":"bceadd7a-20bf-4482-aaab-46a2539cf37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6819","nonce":4223253757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6821","nonce":4223253757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6825","nonce":4223253757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6823","nonce":4223253757}]},"public_addr":"172.21.15.107:6819/4223253757","cluster_addr":"172.21.15.107:6821/4223253757","heartbeat_back_addr":"172.21.15.107:6825/4223253757","heartbeat_front_addr":"172.21.15.107:6823/4223253757","state":["exists","up"]},{"osd":7,"uuid":"0d9243a6-0e16-4677-a0b0-010be4162148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6817","nonce":2850715284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6819","nonce":2850715284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6823","nonce":2850715284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6821","nonce":2850715284}]},"public_addr":"172.21.15.184:6817/2850715284","cluster_addr":"172.21.15.184:6819/2850715284","heartbeat_back_addr":"172.21.15.184:6823/2850715284","heartbeat_front_addr":"172.21.15.184:6821/2850715284","state":["exists","up"]},{"osd":8,"uuid":"24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6817","nonce":504426486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6819","nonce":504426486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6823","nonce":504426486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6821","nonce":504426486}]},"public_addr":"172.21.15.196:6817/504426486","cluster_addr":"172.21.15.196:6819/504426486","heartbeat_back_addr":"172.21.15.196:6823/504426486","heartbeat_front_addr":"172.21.15.196:6821/504426486","state":["exists","up"]},{"osd":9,"uuid":"8bcb03ec-1342-4679-9343-fcefd28dd69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6827","nonce":1533051760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6829","nonce":1533051760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6833","nonce":1533051760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6831","nonce":1533051760}]},"public_addr":"172.21.15.107:6827/1533051760","cluster_addr":"172.21.15.107:6829/1533051760","heartbeat_back_addr":"172.21.15.107:6833/1533051760","heartbeat_front_addr":"172.21.15.107:6831/1533051760","state":["exists","up"]},{"osd":10,"uuid":"78374015-aa7f-4288-b5ae-be64a5182bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6825","nonce":1387541139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6827","nonce":1387541139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6831","nonce":1387541139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6829","nonce":1387541139}]},"public_addr":"172.21.15.184:6825/1387541139","cluster_addr":"172.21.15.184:6827/1387541139","heartbeat_back_addr":"172.21.15.184:6831/1387541139","heartbeat_front_addr":"172.21.15.184:6829/1387541139","state":["exists","up"]},{"osd":11,"uuid":"4aeb2b1a-f35e-44ea-be64-f60c31a096e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6825","nonce":3861964533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6827","nonce":3861964533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6831","nonce":3861964533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6829","nonce":3861964533}]},"public_addr":"172.21.15.196:6825/3861964533","cluster_addr":"172.21.15.196:6827/3861964533","heartbeat_back_addr":"172.21.15.196:6831/3861964533","heartbeat_front_addr":"172.21.15.196:6829/3861964533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:46:42.110232+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:06.232727+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:29.623425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:53.466546+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:17.927564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:41.913454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:06.610629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:31.048807+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:54.922097+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:20.727547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:46.072303+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:51:11.022775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:0/3518338734":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/4092342993":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6800/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:6800/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3761740075":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/2215024983":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/2124974715":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3361930986":"2024-05-11T10:44:40.339608+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T10:54:24.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.250+0000 7f6b59836700 1 -- 172.21.15.107:0/1204455344 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f6b3c0b2880 msgr2=0x7f6b3c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:24.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.250+0000 7f6b59836700 1 --2- 172.21.15.107:0/1204455344 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f6b3c0b2880 0x7f6b3c0b4d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009a10 tx=0x7f6b44009190 comp rx=0 tx=0).stop 2024-05-10T10:54:24.251 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.250+0000 7f6b59836700 1 -- 172.21.15.107:0/1204455344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b54108400 msgr2=0x7f6b541a5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:24.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.250+0000 7f6b59836700 1 --2- 172.21.15.107:0/1204455344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b54108400 0x7f6b541a5b40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00b830 tx=0x7f6b4c007a90 comp rx=0 tx=0).stop 2024-05-10T10:54:24.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.250+0000 7f6b59836700 1 -- 172.21.15.107:0/1204455344 shutdown_connections 2024-05-10T10:54:24.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.250+0000 7f6b59836700 1 --2- 172.21.15.107:0/1204455344 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f6b3c0b2880 0x7f6b3c0b4d40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:24.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.250+0000 7f6b59836700 1 --2- 172.21.15.107:0/1204455344 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b54108400 0x7f6b541a5b40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:24.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.250+0000 7f6b59836700 1 --2- 172.21.15.107:0/1204455344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b54102390 0x7f6b5419aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:24.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.250+0000 7f6b59836700 1 --2- 172.21.15.107:0/1204455344 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b54102d50 0x7f6b5419b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:24.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.250+0000 7f6b59836700 1 -- 172.21.15.107:0/1204455344 >> 172.21.15.107:0/1204455344 conn(0x7f6b54079310 msgr2=0x7f6b54100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:24.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.251+0000 7f6b59836700 1 -- 172.21.15.107:0/1204455344 shutdown_connections 2024-05-10T10:54:24.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:24.251+0000 7f6b59836700 1 -- 172.21.15.107:0/1204455344 wait complete. 2024-05-10T10:54:24.983 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:54:25.062 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:24 smithi196 ceph-mon[34872]: pgmap v350: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:25.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:24 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1204455344' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:54:25.063 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:24 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:54:25.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:24 smithi184 ceph-mon[34585]: pgmap v350: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:25.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:24 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1204455344' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:54:25.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:24 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:54:25.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:24 smithi107 ceph-mon[30373]: pgmap v350: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:25.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:24 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1204455344' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:54:25.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:24 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:54:25.247 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:54:27.357 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:27 smithi107 ceph-mon[30373]: pgmap v351: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:54:27.357 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:27 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:27.357 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:27 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:27.357 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:27 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:27.357 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:27 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:27.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:27 smithi196 ceph-mon[34872]: pgmap v351: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:54:27.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:27 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:27.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:27 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:27.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:27 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:27.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:27 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:27.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.598+0000 7fd8de787700 1 -- 172.21.15.107:0/2485141051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8d8107760 msgr2=0x7fd8d810f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:27.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.598+0000 7fd8de787700 1 --2- 172.21.15.107:0/2485141051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8d8107760 0x7fd8d810f2e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd8d000b0d0 tx=0x7fd8d000b3e0 comp rx=0 tx=0).stop 2024-05-10T10:54:27.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.598+0000 7fd8de787700 1 -- 172.21.15.107:0/2485141051 shutdown_connections 2024-05-10T10:54:27.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.598+0000 7fd8de787700 1 --2- 172.21.15.107:0/2485141051 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8d8107760 0x7fd8d810f2e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:27.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.598+0000 7fd8de787700 1 --2- 172.21.15.107:0/2485141051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8d8102e00 0x7fd8d81031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:27.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.598+0000 7fd8de787700 1 --2- 172.21.15.107:0/2485141051 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8d81037b0 0x7fd8d8107030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:27.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.598+0000 7fd8de787700 1 -- 172.21.15.107:0/2485141051 >> 172.21.15.107:0/2485141051 conn(0x7fd8d8078a10 msgr2=0x7fd8d80ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:27.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.598+0000 7fd8de787700 1 -- 172.21.15.107:0/2485141051 shutdown_connections 2024-05-10T10:54:27.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.598+0000 7fd8de787700 1 -- 172.21.15.107:0/2485141051 wait complete. 2024-05-10T10:54:27.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.599+0000 7fd8de787700 1 Processor -- start 2024-05-10T10:54:27.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.599+0000 7fd8de787700 1 -- start start 2024-05-10T10:54:27.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.599+0000 7fd8de787700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8d8102e00 0x7fd8d819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:27.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.599+0000 7fd8de787700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8d81037b0 0x7fd8d819afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:27.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.599+0000 7fd8de787700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8d8107760 0x7fd8d81a5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:27.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.599+0000 7fd8de787700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d81126e0 con 0x7fd8d8107760 2024-05-10T10:54:27.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.599+0000 7fd8de787700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d8112560 con 0x7fd8d8102e00 2024-05-10T10:54:27.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.599+0000 7fd8de787700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d8112860 con 0x7fd8d81037b0 2024-05-10T10:54:27.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.599+0000 7fd8dcd24700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8d8107760 0x7fd8d81a5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:27.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.599+0000 7fd8dcd24700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8d8107760 0x7fd8d81a5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55568/0 (socket says 172.21.15.107:55568) 2024-05-10T10:54:27.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.599+0000 7fd8dcd24700 1 -- 172.21.15.107:0/15733699 learned_addr learned my addr 172.21.15.107:0/15733699 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:27.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.599+0000 7fd8cffff700 1 --2- 172.21.15.107:0/15733699 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8d81037b0 0x7fd8d819afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:27.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.599+0000 7fd8d7fff700 1 --2- 172.21.15.107:0/15733699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8d8102e00 0x7fd8d819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:27.602 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.600+0000 7fd8dcd24700 1 -- 172.21.15.107:0/15733699 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8d81037b0 msgr2=0x7fd8d819afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.600+0000 7fd8dcd24700 1 --2- 172.21.15.107:0/15733699 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8d81037b0 0x7fd8d819afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.600+0000 7fd8dcd24700 1 -- 172.21.15.107:0/15733699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8d8102e00 msgr2=0x7fd8d819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.600+0000 7fd8dcd24700 1 --2- 172.21.15.107:0/15733699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8d8102e00 0x7fd8d819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.600+0000 7fd8dcd24700 1 -- 172.21.15.107:0/15733699 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d81a6020 con 0x7fd8d8107760 2024-05-10T10:54:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.600+0000 7fd8dcd24700 1 --2- 172.21.15.107:0/15733699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8d8107760 0x7fd8d81a5ae0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0007a20 tx=0x7fd8d0007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.600+0000 7fd8d5ffb700 1 -- 172.21.15.107:0/15733699 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d001f070 con 0x7fd8d8107760 2024-05-10T10:54:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.600+0000 7fd8d5ffb700 1 -- 172.21.15.107:0/15733699 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd8d0004c50 con 0x7fd8d8107760 2024-05-10T10:54:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.600+0000 7fd8de787700 1 -- 172.21.15.107:0/15733699 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d81a61f0 con 0x7fd8d8107760 2024-05-10T10:54:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.600+0000 7fd8d5ffb700 1 -- 172.21.15.107:0/15733699 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d001b680 con 0x7fd8d8107760 2024-05-10T10:54:27.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.600+0000 7fd8de787700 1 -- 172.21.15.107:0/15733699 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d81a6640 con 0x7fd8d8107760 2024-05-10T10:54:27.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.601+0000 7fd8de787700 1 -- 172.21.15.107:0/15733699 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8d806a190 con 0x7fd8d8107760 2024-05-10T10:54:27.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.602+0000 7fd8d5ffb700 1 -- 172.21.15.107:0/15733699 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fd8d0022070 con 0x7fd8d8107760 2024-05-10T10:54:27.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.603+0000 7fd8d5ffb700 1 --2- 172.21.15.107:0/15733699 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd8c40b2900 0x7fd8c40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:27.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.603+0000 7fd8d7fff700 1 --2- 172.21.15.107:0/15733699 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd8c40b2900 0x7fd8c40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:27.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.603+0000 7fd8d5ffb700 1 -- 172.21.15.107:0/15733699 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fd8d000f020 con 0x7fd8d8107760 2024-05-10T10:54:27.604 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.604+0000 7fd8d7fff700 1 --2- 172.21.15.107:0/15733699 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd8c40b2900 0x7fd8c40b4dc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8006fd0 tx=0x7fd8c8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:27.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.608+0000 7fd8d5ffb700 1 -- 172.21.15.107:0/15733699 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd8d0029070 con 0x7fd8d8107760 2024-05-10T10:54:27.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:27 smithi184 ceph-mon[34585]: pgmap v351: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:54:27.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:27 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:27.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:27 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:27.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:27 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:27.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:27 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:27.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.887+0000 7fd8de787700 1 -- 172.21.15.107:0/15733699 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8d8102080 con 0x7fd8d8107760 2024-05-10T10:54:27.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.888+0000 7fd8d5ffb700 1 -- 172.21.15.107:0/15733699 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11951 (secure 0 0 0) 0x7fd8d00cbe20 con 0x7fd8d8107760 2024-05-10T10:54:27.888 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:54:27.889 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T10:52:17.367732+0000","modified":"2024-05-10T10:52:35.666052+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24482,"mds_1":24449,"mds_2":24442,"mds_3":24431,"mds_4":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/2332963094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":2332963094},{"type":"v1","addr":"172.21.15.107:6841","nonce":2332963094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.184:6839/16501252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":16501252},{"type":"v1","addr":"172.21.15.184:6839","nonce":16501252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24449,24442,24482,24431,24430]},"id":1}]} 2024-05-10T10:54:27.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.890+0000 7fd8de787700 1 -- 172.21.15.107:0/15733699 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd8c40b2900 msgr2=0x7fd8c40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:27.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.890+0000 7fd8de787700 1 --2- 172.21.15.107:0/15733699 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd8c40b2900 0x7fd8c40b4dc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8006fd0 tx=0x7fd8c8008040 comp rx=0 tx=0).stop 2024-05-10T10:54:27.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.890+0000 7fd8de787700 1 -- 172.21.15.107:0/15733699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8d8107760 msgr2=0x7fd8d81a5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:27.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.890+0000 7fd8de787700 1 --2- 172.21.15.107:0/15733699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8d8107760 0x7fd8d81a5ae0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0007a20 tx=0x7fd8d0007a50 comp rx=0 tx=0).stop 2024-05-10T10:54:27.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.890+0000 7fd8de787700 1 -- 172.21.15.107:0/15733699 shutdown_connections 2024-05-10T10:54:27.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.890+0000 7fd8de787700 1 --2- 172.21.15.107:0/15733699 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd8c40b2900 0x7fd8c40b4dc0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:27.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.890+0000 7fd8de787700 1 --2- 172.21.15.107:0/15733699 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd8d8107760 0x7fd8d81a5ae0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:27.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.890+0000 7fd8de787700 1 --2- 172.21.15.107:0/15733699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8d8102e00 0x7fd8d819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:27.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.890+0000 7fd8de787700 1 --2- 172.21.15.107:0/15733699 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd8d81037b0 0x7fd8d819afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:27.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.890+0000 7fd8de787700 1 -- 172.21.15.107:0/15733699 >> 172.21.15.107:0/15733699 conn(0x7fd8d8078a10 msgr2=0x7fd8d8104e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:27.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.890+0000 7fd8de787700 1 -- 172.21.15.107:0/15733699 shutdown_connections 2024-05-10T10:54:27.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:27.890+0000 7fd8de787700 1 -- 172.21.15.107:0/15733699 wait complete. 2024-05-10T10:54:27.892 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 26 2024-05-10T10:54:28.564 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-10T10:52:17.367732+0000', 'modified': '2024-05-10T10:52:35.666052+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24482, 'mds_1': 24449, 'mds_2': 24442, 'mds_3': 24431, 'mds_4': 24430}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14592': {'gid': 14592, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.107:6839/1923447762', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6838', 'nonce': 1923447762}, {'type': 'v1', 'addr': '172.21.15.107:6839', 'nonce': 1923447762}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14604': {'gid': 14604, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.107:6841/2332963094', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6840', 'nonce': 2332963094}, {'type': 'v1', 'addr': '172.21.15.107:6841', 'nonce': 2332963094}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.196:6833/2603001203', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6832', 'nonce': 2603001203}, {'type': 'v1', 'addr': '172.21.15.196:6833', 'nonce': 2603001203}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24404': {'gid': 24404, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6833/3101071828', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6832', 'nonce': 3101071828}, {'type': 'v1', 'addr': '172.21.15.184:6833', 'nonce': 3101071828}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24418': {'gid': 24418, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.196:6835/3609693196', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6834', 'nonce': 3609693196}, {'type': 'v1', 'addr': '172.21.15.196:6835', 'nonce': 3609693196}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'c', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.196:6837/3628757645', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6836', 'nonce': 3628757645}, {'type': 'v1', 'addr': '172.21.15.196:6837', 'nonce': 3628757645}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'e', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.184:6835/872203477', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 872203477}, {'type': 'v1', 'addr': '172.21.15.184:6835', 'nonce': 872203477}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.196:6839/4142119667', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6838', 'nonce': 4142119667}, {'type': 'v1', 'addr': '172.21.15.196:6839', 'nonce': 4142119667}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.184:6837/4239260328', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6836', 'nonce': 4239260328}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 4239260328}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.184:6839/16501252', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6838', 'nonce': 16501252}, {'type': 'v1', 'addr': '172.21.15.184:6839', 'nonce': 16501252}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24482, 'qdb_cluster': [24449, 24442, 24482, 24431, 24430]} 2024-05-10T10:54:28.564 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-10T10:54:28.564 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell mds.c status 2024-05-10T10:54:28.817 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:54:29.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:28 smithi184 ceph-mon[34585]: pgmap v352: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:29.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:28 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:29.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:28 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:29.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:28 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/15733699' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:54:29.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:28 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:54:29.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:28 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:54:29.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:28 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:29.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:28 smithi107 ceph-mon[30373]: pgmap v352: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:29.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:28 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:29.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:28 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:29.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:28 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/15733699' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:54:29.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:28 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:54:29.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:28 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:54:29.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:28 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:29.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:28 smithi196 ceph-mon[34872]: pgmap v352: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:29.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:28 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:29.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:28 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:29.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:28 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/15733699' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:54:29.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:28 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:54:29.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:28 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:54:29.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:28 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:54:30.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.571+0000 7f62ca909700 1 -- 172.21.15.107:0/599642981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62c4108400 msgr2=0x7f62c41087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:30.574 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.571+0000 7f62ca909700 1 --2- 172.21.15.107:0/599642981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62c4108400 0x7f62c41087e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009990 tx=0x7f62b4009ca0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.571+0000 7f62ca909700 1 -- 172.21.15.107:0/599642981 shutdown_connections 2024-05-10T10:54:30.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.571+0000 7f62ca909700 1 --2- 172.21.15.107:0/599642981 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62c4102d50 0x7f62c410f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.571+0000 7f62ca909700 1 --2- 172.21.15.107:0/599642981 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62c4108400 0x7f62c41087e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.571+0000 7f62ca909700 1 --2- 172.21.15.107:0/599642981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62c4102390 0x7f62c4102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.571+0000 7f62ca909700 1 -- 172.21.15.107:0/599642981 >> 172.21.15.107:0/599642981 conn(0x7f62c4079310 msgr2=0x7f62c4079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:30.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.571+0000 7f62ca909700 1 -- 172.21.15.107:0/599642981 shutdown_connections 2024-05-10T10:54:30.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.572+0000 7f62ca909700 1 -- 172.21.15.107:0/599642981 wait complete. 2024-05-10T10:54:30.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.572+0000 7f62ca909700 1 Processor -- start 2024-05-10T10:54:30.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.572+0000 7f62ca909700 1 -- start start 2024-05-10T10:54:30.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.572+0000 7f62ca909700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62c4102390 0x7f62c4199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:30.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.572+0000 7f62ca909700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62c4102d50 0x7f62c419a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:30.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.572+0000 7f62ca909700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62c4108400 0x7f62c419e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:30.575 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.572+0000 7f62ca909700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f62c4112760 con 0x7f62c4108400 2024-05-10T10:54:30.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.572+0000 7f62ca909700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f62c41125e0 con 0x7f62c4102d50 2024-05-10T10:54:30.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.572+0000 7f62ca909700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f62c41128e0 con 0x7f62c4102390 2024-05-10T10:54:30.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.573+0000 7f62c8ea6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62c4108400 0x7f62c419e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:30.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.573+0000 7f62c8ea6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62c4108400 0x7f62c419e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55586/0 (socket says 172.21.15.107:55586) 2024-05-10T10:54:30.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.573+0000 7f62c8ea6700 1 -- 172.21.15.107:0/605634794 learned_addr learned my addr 172.21.15.107:0/605634794 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:30.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.573+0000 7f62c3fff700 1 --2- 172.21.15.107:0/605634794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62c4102390 0x7f62c4199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:30.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.573+0000 7f62c37fe700 1 --2- 172.21.15.107:0/605634794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62c4102d50 0x7f62c419a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:30.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.573+0000 7f62c8ea6700 1 -- 172.21.15.107:0/605634794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62c4102390 msgr2=0x7f62c4199d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:30.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.573+0000 7f62c8ea6700 1 --2- 172.21.15.107:0/605634794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62c4102390 0x7f62c4199d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.573+0000 7f62c8ea6700 1 -- 172.21.15.107:0/605634794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62c4102d50 msgr2=0x7f62c419a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:30.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.573+0000 7f62c8ea6700 1 --2- 172.21.15.107:0/605634794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62c4102d50 0x7f62c419a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.573+0000 7f62c8ea6700 1 -- 172.21.15.107:0/605634794 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c419ed70 con 0x7f62c4108400 2024-05-10T10:54:30.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.573+0000 7f62c37fe700 1 --2- 172.21.15.107:0/605634794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62c4102d50 0x7f62c419a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:54:30.576 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.573+0000 7f62c8ea6700 1 --2- 172.21.15.107:0/605634794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62c4108400 0x7f62c419e630 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00b970 tx=0x7f62bc00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:30.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.573+0000 7f62c17fa700 1 -- 172.21.15.107:0/605634794 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc019070 con 0x7f62c4108400 2024-05-10T10:54:30.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.573+0000 7f62ca909700 1 -- 172.21.15.107:0/605634794 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62c419f060 con 0x7f62c4108400 2024-05-10T10:54:30.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.573+0000 7f62c17fa700 1 -- 172.21.15.107:0/605634794 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f62bc00ce00 con 0x7f62c4108400 2024-05-10T10:54:30.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.573+0000 7f62c17fa700 1 -- 172.21.15.107:0/605634794 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc007370 con 0x7f62c4108400 2024-05-10T10:54:30.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.573+0000 7f62ca909700 1 -- 172.21.15.107:0/605634794 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62c41a68e0 con 0x7f62c4108400 2024-05-10T10:54:30.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.576+0000 7f62c17fa700 1 -- 172.21.15.107:0/605634794 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f62bc01c070 con 0x7f62c4108400 2024-05-10T10:54:30.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.577+0000 7f62c17fa700 1 --2- 172.21.15.107:0/605634794 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f62ac0b2900 0x7f62ac0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:30.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.577+0000 7f62c3fff700 1 --2- 172.21.15.107:0/605634794 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f62ac0b2900 0x7f62ac0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:30.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.577+0000 7f62c17fa700 1 -- 172.21.15.107:0/605634794 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f62bc0e14e0 con 0x7f62c4108400 2024-05-10T10:54:30.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.577+0000 7f62c3fff700 1 --2- 172.21.15.107:0/605634794 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f62ac0b2900 0x7f62ac0b4dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f62b400b5c0 tx=0x7f62b4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:30.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.577+0000 7f62d519cb80 1 Processor -- start 2024-05-10T10:54:30.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.577+0000 7f62d519cb80 1 -- start start 2024-05-10T10:54:30.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.577+0000 7f62d519cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 0x55613b1e2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:30.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.577+0000 7f62d519cb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1e2e60 0x55613b1dcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:30.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.577+0000 7f62d519cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1dd160 0x55613b1dd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:30.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.577+0000 7f62d519cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55613b12a8f0 con 0x55613b1e2540 2024-05-10T10:54:30.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.577+0000 7f62d519cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55613b08fd50 con 0x55613b1dd160 2024-05-10T10:54:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.577+0000 7f62d519cb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55613b1268b0 con 0x55613b1e2e60 2024-05-10T10:54:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.578+0000 7f62c3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 0x55613b1e2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.578+0000 7f62c3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 0x55613b1e2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55596/0 (socket says 172.21.15.107:55596) 2024-05-10T10:54:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.578+0000 7f62c3fff700 1 -- 172.21.15.107:0/1970873731 learned_addr learned my addr 172.21.15.107:0/1970873731 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.578+0000 7f62c37fe700 1 --2- 172.21.15.107:0/1970873731 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1e2e60 0x55613b1dcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.578+0000 7f62c8ea6700 1 --2- 172.21.15.107:0/1970873731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1dd160 0x55613b1dd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.578+0000 7f62c3fff700 1 -- 172.21.15.107:0/1970873731 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1e2e60 msgr2=0x55613b1dcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.578+0000 7f62c3fff700 1 --2- 172.21.15.107:0/1970873731 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1e2e60 0x55613b1dcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.578+0000 7f62c3fff700 1 -- 172.21.15.107:0/1970873731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1dd160 msgr2=0x55613b1dd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.578+0000 7f62c3fff700 1 --2- 172.21.15.107:0/1970873731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1dd160 0x55613b1dd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.578+0000 7f62c3fff700 1 -- 172.21.15.107:0/1970873731 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55613b077880 con 0x55613b1e2540 2024-05-10T10:54:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.578+0000 7f62c8ea6700 1 --2- 172.21.15.107:0/1970873731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1dd160 0x55613b1dd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:54:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.578+0000 7f62c3fff700 1 --2- 172.21.15.107:0/1970873731 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 0x55613b1e2920 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f62b4015000 tx=0x7f62b4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3155ea5139f85c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:30.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.578+0000 7f62aa7fc700 1 -- 172.21.15.107:0/1970873731 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b400f8f0 con 0x55613b1e2540 2024-05-10T10:54:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.578+0000 7f62aa7fc700 1 -- 172.21.15.107:0/1970873731 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f62b4024410 con 0x55613b1e2540 2024-05-10T10:54:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.578+0000 7f62aa7fc700 1 -- 172.21.15.107:0/1970873731 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b402f660 con 0x55613b1e2540 2024-05-10T10:54:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.579+0000 7f62d519cb80 1 -- 172.21.15.107:0/1970873731 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 msgr2=0x55613b1e2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.579+0000 7f62d519cb80 1 --2- 172.21.15.107:0/1970873731 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 0x55613b1e2920 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f62b4015000 tx=0x7f62b4020000 comp rx=0 tx=0).stop 2024-05-10T10:54:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.579+0000 7f62d519cb80 1 -- 172.21.15.107:0/1970873731 shutdown_connections 2024-05-10T10:54:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.579+0000 7f62d519cb80 1 --2- 172.21.15.107:0/1970873731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1dd160 0x55613b1dd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.579+0000 7f62d519cb80 1 --2- 172.21.15.107:0/1970873731 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 0x55613b1e2920 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.579+0000 7f62d519cb80 1 --2- 172.21.15.107:0/1970873731 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1e2e60 0x55613b1dcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.579+0000 7f62d519cb80 1 -- 172.21.15.107:0/1970873731 >> 172.21.15.107:0/1970873731 conn(0x55613b104b20 msgr2=0x55613b1d3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.579+0000 7f62d519cb80 1 -- 172.21.15.107:0/1970873731 shutdown_connections 2024-05-10T10:54:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.579+0000 7f62d519cb80 1 -- 172.21.15.107:0/1970873731 wait complete. 2024-05-10T10:54:30.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.579+0000 7f62d519cb80 1 -- start start 2024-05-10T10:54:30.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.580+0000 7f62d519cb80 1 Processor -- start 2024-05-10T10:54:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.580+0000 7f62d519cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1dd160 0x55613b1e8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.580+0000 7f62d519cb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1e2540 0x55613b1e5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.580+0000 7f62d519cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2e60 0x55613b1e6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.580+0000 7f62d519cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55613b1e97d0 con 0x55613b1e2e60 2024-05-10T10:54:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.580+0000 7f62d519cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55613b0e3e80 con 0x55613b1dd160 2024-05-10T10:54:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.580+0000 7f62d519cb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55613b1e9950 con 0x55613b1e2540 2024-05-10T10:54:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.580+0000 7f62d519cb80 10 client.0 _ll_register_callbacks cb 0x55613b0be560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:54:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.580+0000 7f62c8ea6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2e60 0x55613b1e6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.580+0000 7f62c8ea6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2e60 0x55613b1e6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55608/0 (socket says 172.21.15.107:55608) 2024-05-10T10:54:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.580+0000 7f62c8ea6700 1 -- 172.21.15.107:0/14541910 learned_addr learned my addr 172.21.15.107:0/14541910 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.580+0000 7f62c37fe700 1 --2- 172.21.15.107:0/14541910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1e2540 0x55613b1e5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.580+0000 7f62c3fff700 1 --2- 172.21.15.107:0/14541910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1dd160 0x55613b1e8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:30.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.580+0000 7f62c8ea6700 1 -- 172.21.15.107:0/14541910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1e2540 msgr2=0x55613b1e5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:30.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.580+0000 7f62c8ea6700 1 --2- 172.21.15.107:0/14541910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1e2540 0x55613b1e5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.580+0000 7f62c8ea6700 1 -- 172.21.15.107:0/14541910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1dd160 msgr2=0x55613b1e8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:30.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.580+0000 7f62c8ea6700 1 --2- 172.21.15.107:0/14541910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1dd160 0x55613b1e8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.580+0000 7f62c8ea6700 1 -- 172.21.15.107:0/14541910 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55613b0e1710 con 0x55613b1e2e60 2024-05-10T10:54:30.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.580+0000 7f62c3fff700 1 --2- 172.21.15.107:0/14541910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1dd160 0x55613b1e8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:54:30.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.581+0000 7f62c8ea6700 1 --2- 172.21.15.107:0/14541910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2e60 0x55613b1e6410 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00bfd0 tx=0x7f62bc0149d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2096fec4b0e2a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:30.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.581+0000 7f62a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:54:30.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.581+0000 7f62a37fe700 1 -- 172.21.15.107:0/14541910 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0b1960 con 0x55613b1e2e60 2024-05-10T10:54:30.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.581+0000 7f62a37fe700 1 -- 172.21.15.107:0/14541910 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f62bc0e1110 con 0x55613b1e2e60 2024-05-10T10:54:30.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.581+0000 7f62d519cb80 1 -- 172.21.15.107:0/14541910 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62b4024410 con 0x55613b1e2e60 2024-05-10T10:54:30.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.581+0000 7f62a37fe700 1 -- 172.21.15.107:0/14541910 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f62bc0b14d0 con 0x55613b1e2e60 2024-05-10T10:54:30.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.581+0000 7f62d519cb80 10 client.14955 fetch_fsmap learned FSMap version 26 2024-05-10T10:54:30.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.581+0000 7f62d519cb80 1 -- 172.21.15.107:0/14541910 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55613b1f40a0 con 0x55613b1e2e60 2024-05-10T10:54:30.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.581+0000 7f62a37fe700 1 -- 172.21.15.107:0/14541910 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f62b4024410 con 0x55613b1e2e60 2024-05-10T10:54:30.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.581+0000 7f62a37fe700 1 -- 172.21.15.107:0/14541910 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f62bc00c9a0 con 0x55613b1e2e60 2024-05-10T10:54:30.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.581+0000 7f62d519cb80 10 client.14955 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:54:30.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.581+0000 7f62d519cb80 10 client.14955 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T10:54:30.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.581+0000 7f62d519cb80 20 client.14955 populate_metadata read hostname 'smithi107' 2024-05-10T10:54:30.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.581+0000 7f62d519cb80 1 --2- 172.21.15.107:0/14541910 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55613b1f66a0 0x55613b1f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:30.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.581+0000 7f62d519cb80 4 client.14955 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:54:30.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.581+0000 7f62d519cb80 1 -- 172.21.15.107:0/14541910 --> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55613b1382d0 con 0x55613b1f66a0 2024-05-10T10:54:30.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.582+0000 7f62c3fff700 1 --2- 172.21.15.107:0/14541910 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55613b1f66a0 0x55613b1f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:30.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.582+0000 7f62a37fe700 10 client.14955 ms_handle_connect on v2:172.21.15.196:6836/3628757645 2024-05-10T10:54:30.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.582+0000 7f62c3fff700 1 --2- 172.21.15.107:0/14541910 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55613b1f66a0 0x55613b1f7b10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=202f2eb9f28d126e server_cookie=7d917ea5bfdf157 in_seq=0 out_seq=0 2024-05-10T10:54:30.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.583+0000 7f62a37fe700 1 -- 172.21.15.107:0/14541910 <== mds.4 v2:172.21.15.196:6836/3628757645 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55613b1382d0 con 0x55613b1f66a0 2024-05-10T10:54:30.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.583+0000 7f62a37fe700 10 client.14955 handle_command_reply: tid=0 2024-05-10T10:54:30.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.583+0000 7f62d519cb80 1 client.14955 shutdown 2024-05-10T10:54:30.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.583+0000 7f62d519cb80 1 -- 172.21.15.107:0/14541910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2e60 msgr2=0x55613b1e6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:30.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.583+0000 7f62d519cb80 1 --2- 172.21.15.107:0/14541910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2e60 0x55613b1e6410 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00bfd0 tx=0x7f62bc0149d0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.583+0000 7f62d519cb80 1 -- 172.21.15.107:0/14541910 shutdown_connections 2024-05-10T10:54:30.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.583+0000 7f62d519cb80 1 --2- 172.21.15.107:0/14541910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2e60 0x55613b1e6410 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.583+0000 7f62d519cb80 1 --2- 172.21.15.107:0/14541910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1dd160 0x55613b1e8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.583+0000 7f62d519cb80 1 --2- 172.21.15.107:0/14541910 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55613b1f66a0 0x55613b1f7b10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.583+0000 7f62d519cb80 1 --2- 172.21.15.107:0/14541910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1e2540 0x55613b1e5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.583+0000 7f62d519cb80 1 -- 172.21.15.107:0/14541910 >> 172.21.15.107:0/14541910 conn(0x55613b104b20 msgr2=0x55613b1cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:30.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.583+0000 7f62a37fe700 0 client.14955 ms_handle_reset on v2:172.21.15.196:6836/3628757645 2024-05-10T10:54:30.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.583+0000 7f62d519cb80 1 -- 172.21.15.107:0/14541910 shutdown_connections 2024-05-10T10:54:30.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.583+0000 7f62d519cb80 1 -- 172.21.15.107:0/14541910 wait complete. 2024-05-10T10:54:30.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.583+0000 7f62d519cb80 20 client.14955 trim_cache size 0 max 16384 2024-05-10T10:54:30.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.604+0000 7f62d519cb80 1 Processor -- start 2024-05-10T10:54:30.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.604+0000 7f62d519cb80 1 -- start start 2024-05-10T10:54:30.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.604+0000 7f62d519cb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1dd160 0x55613b1dcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:30.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.604+0000 7f62d519cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 0x55613b1cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:30.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.604+0000 7f62d519cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1e2e60 0x55613b1e3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:30.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.604+0000 7f62d519cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55613b1f5e50 con 0x55613b1e2540 2024-05-10T10:54:30.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.604+0000 7f62d519cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55613b1f6520 con 0x55613b1e2e60 2024-05-10T10:54:30.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.604+0000 7f62d519cb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55613b1f6bf0 con 0x55613b1dd160 2024-05-10T10:54:30.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.604+0000 7f62c37fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 0x55613b1cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:30.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.604+0000 7f62c37fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 0x55613b1cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55616/0 (socket says 172.21.15.107:55616) 2024-05-10T10:54:30.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.604+0000 7f62c37fe700 1 -- 172.21.15.107:0/122941818 learned_addr learned my addr 172.21.15.107:0/122941818 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:30.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.604+0000 7f62c3fff700 1 --2- 172.21.15.107:0/122941818 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1dd160 0x55613b1dcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:30.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.604+0000 7f62c8ea6700 1 --2- 172.21.15.107:0/122941818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1e2e60 0x55613b1e3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:30.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.604+0000 7f62c37fe700 1 -- 172.21.15.107:0/122941818 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1dd160 msgr2=0x55613b1dcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:30.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.604+0000 7f62c37fe700 1 --2- 172.21.15.107:0/122941818 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1dd160 0x55613b1dcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.604+0000 7f62c37fe700 1 -- 172.21.15.107:0/122941818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1e2e60 msgr2=0x55613b1e3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:30.606 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.604+0000 7f62c37fe700 1 --2- 172.21.15.107:0/122941818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1e2e60 0x55613b1e3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.604+0000 7f62c37fe700 1 -- 172.21.15.107:0/122941818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55613b1d4b20 con 0x55613b1e2540 2024-05-10T10:54:30.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.605+0000 7f62c37fe700 1 --2- 172.21.15.107:0/122941818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 0x55613b1cdbf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f62c4107200 tx=0x7f62b800db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55f00228a8a78b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:30.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.605+0000 7f62a9ffb700 1 -- 172.21.15.107:0/122941818 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b8011540 con 0x55613b1e2540 2024-05-10T10:54:30.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.605+0000 7f62a9ffb700 1 -- 172.21.15.107:0/122941818 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f62b8011bb0 con 0x55613b1e2540 2024-05-10T10:54:30.607 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.605+0000 7f62a9ffb700 1 -- 172.21.15.107:0/122941818 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b8014d10 con 0x55613b1e2540 2024-05-10T10:54:30.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.605+0000 7f62d519cb80 1 -- 172.21.15.107:0/122941818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 msgr2=0x55613b1cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:30.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.605+0000 7f62d519cb80 1 --2- 172.21.15.107:0/122941818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 0x55613b1cdbf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f62c4107200 tx=0x7f62b800db30 comp rx=0 tx=0).stop 2024-05-10T10:54:30.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.605+0000 7f62d519cb80 1 -- 172.21.15.107:0/122941818 shutdown_connections 2024-05-10T10:54:30.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.605+0000 7f62d519cb80 1 --2- 172.21.15.107:0/122941818 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1dd160 0x55613b1dcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.605+0000 7f62d519cb80 1 --2- 172.21.15.107:0/122941818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1e2e60 0x55613b1e3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.605+0000 7f62d519cb80 1 --2- 172.21.15.107:0/122941818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 0x55613b1cdbf0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.605+0000 7f62d519cb80 1 -- 172.21.15.107:0/122941818 >> 172.21.15.107:0/122941818 conn(0x55613b104b20 msgr2=0x55613b1e47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:30.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.605+0000 7f62d519cb80 1 -- 172.21.15.107:0/122941818 shutdown_connections 2024-05-10T10:54:30.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.606+0000 7f62d519cb80 1 -- 172.21.15.107:0/122941818 wait complete. 2024-05-10T10:54:30.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.606+0000 7f62d519cb80 1 -- start start 2024-05-10T10:54:30.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.606+0000 7f62d519cb80 1 Processor -- start 2024-05-10T10:54:30.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.606+0000 7f62d519cb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1dd160 0x55613b1cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:30.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.606+0000 7f62d519cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 0x55613b1cd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:30.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.606+0000 7f62d519cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1e2e60 0x55613b1cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:30.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.606+0000 7f62d519cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55613b1f7990 con 0x55613b1e2540 2024-05-10T10:54:30.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.606+0000 7f62d519cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55613b1f72c0 con 0x55613b1e2e60 2024-05-10T10:54:30.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.606+0000 7f62d519cb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55613b1f8060 con 0x55613b1dd160 2024-05-10T10:54:30.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.606+0000 7f62d519cb80 10 client.0 _ll_register_callbacks cb 0x55613b0be560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:54:30.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.606+0000 7f62c37fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 0x55613b1cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:30.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.606+0000 7f62c37fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 0x55613b1cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55626/0 (socket says 172.21.15.107:55626) 2024-05-10T10:54:30.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.606+0000 7f62c37fe700 1 -- 172.21.15.107:0/1003951193 learned_addr learned my addr 172.21.15.107:0/1003951193 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:30.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.607+0000 7f62c3fff700 1 --2- 172.21.15.107:0/1003951193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1dd160 0x55613b1cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:30.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.607+0000 7f62c8ea6700 1 --2- 172.21.15.107:0/1003951193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1e2e60 0x55613b1cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:30.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.607+0000 7f62c37fe700 1 -- 172.21.15.107:0/1003951193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1dd160 msgr2=0x55613b1cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:30.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.607+0000 7f62c37fe700 1 --2- 172.21.15.107:0/1003951193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1dd160 0x55613b1cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.607+0000 7f62c37fe700 1 -- 172.21.15.107:0/1003951193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1e2e60 msgr2=0x55613b1cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:30.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.607+0000 7f62c37fe700 1 --2- 172.21.15.107:0/1003951193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1e2e60 0x55613b1cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.607+0000 7f62c37fe700 1 -- 172.21.15.107:0/1003951193 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55613b1ff650 con 0x55613b1e2540 2024-05-10T10:54:30.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.607+0000 7f62c3fff700 1 --2- 172.21.15.107:0/1003951193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1dd160 0x55613b1cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:54:30.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.607+0000 7f62c8ea6700 1 --2- 172.21.15.107:0/1003951193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1e2e60 0x55613b1cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:54:30.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.607+0000 7f62c37fe700 1 --2- 172.21.15.107:0/1003951193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 0x55613b1cd720 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f62b8000c00 tx=0x7f62b80118a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f6658c793308fa server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:30.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.607+0000 7f62a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:54:30.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.607+0000 7f62a37fe700 1 -- 172.21.15.107:0/1003951193 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b8029060 con 0x55613b1e2540 2024-05-10T10:54:30.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.607+0000 7f62a37fe700 1 -- 172.21.15.107:0/1003951193 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f62b8014d60 con 0x55613b1e2540 2024-05-10T10:54:30.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.607+0000 7f62d519cb80 1 -- 172.21.15.107:0/1003951193 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62b8011bb0 con 0x55613b1e2540 2024-05-10T10:54:30.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.607+0000 7f62a37fe700 1 -- 172.21.15.107:0/1003951193 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f62b8024400 con 0x55613b1e2540 2024-05-10T10:54:30.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.607+0000 7f62d519cb80 10 client.14961 fetch_fsmap learned FSMap version 26 2024-05-10T10:54:30.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.607+0000 7f62d519cb80 1 -- 172.21.15.107:0/1003951193 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55613b261f20 con 0x55613b1e2540 2024-05-10T10:54:30.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.607+0000 7f62a37fe700 1 -- 172.21.15.107:0/1003951193 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f62b8011bb0 con 0x55613b1e2540 2024-05-10T10:54:30.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.608+0000 7f62a37fe700 1 -- 172.21.15.107:0/1003951193 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f62b802e070 con 0x55613b1e2540 2024-05-10T10:54:30.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.608+0000 7f62d519cb80 10 client.14961 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:54:30.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.608+0000 7f62d519cb80 10 client.14961 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T10:54:30.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.608+0000 7f62d519cb80 20 client.14961 populate_metadata read hostname 'smithi107' 2024-05-10T10:54:30.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.608+0000 7f62d519cb80 1 --2- 172.21.15.107:0/1003951193 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55613b266700 0x55613b265410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:30.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.608+0000 7f62d519cb80 4 client.14961 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T10:54:30.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.608+0000 7f62d519cb80 1 -- 172.21.15.107:0/1003951193 --> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] -- command(tid 0: {"prefix": "status"}) -- 0x55613b132370 con 0x55613b266700 2024-05-10T10:54:30.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.608+0000 7f62c3fff700 1 --2- 172.21.15.107:0/1003951193 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55613b266700 0x55613b265410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:30.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.608+0000 7f62c3fff700 1 --2- 172.21.15.107:0/1003951193 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55613b266700 0x55613b265410 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5f351d3933504761 server_cookie=e67a7a4b4bff37a in_seq=0 out_seq=0 2024-05-10T10:54:30.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.608+0000 7f62a37fe700 10 client.14961 ms_handle_connect on v2:172.21.15.196:6836/3628757645 2024-05-10T10:54:30.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.608+0000 7f62a37fe700 1 -- 172.21.15.107:0/1003951193 <== mds.4 v2:172.21.15.196:6836/3628757645 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55613b132370 con 0x55613b266700 2024-05-10T10:54:30.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.608+0000 7f62a37fe700 10 client.14961 handle_command_reply: tid=0 2024-05-10T10:54:30.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.608+0000 7f62d519cb80 1 client.14961 shutdown 2024-05-10T10:54:30.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.609+0000 7f62d519cb80 1 -- 172.21.15.107:0/1003951193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 msgr2=0x55613b1cd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:30.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.609+0000 7f62d519cb80 1 --2- 172.21.15.107:0/1003951193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 0x55613b1cd720 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f62b8000c00 tx=0x7f62b80118a0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.609+0000 7f62d519cb80 1 -- 172.21.15.107:0/1003951193 shutdown_connections 2024-05-10T10:54:30.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.609+0000 7f62d519cb80 1 --2- 172.21.15.107:0/1003951193 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55613b266700 0x55613b265410 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.609+0000 7f62d519cb80 1 --2- 172.21.15.107:0/1003951193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55613b1dd160 0x55613b1cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.609+0000 7f62d519cb80 1 --2- 172.21.15.107:0/1003951193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55613b1e2e60 0x55613b1cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.609+0000 7f62d519cb80 1 --2- 172.21.15.107:0/1003951193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55613b1e2540 0x55613b1cd720 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.609+0000 7f62d519cb80 1 -- 172.21.15.107:0/1003951193 >> 172.21.15.107:0/1003951193 conn(0x55613b104b20 msgr2=0x55613b1e3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:30.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.609+0000 7f62a37fe700 0 client.14961 ms_handle_reset on v2:172.21.15.196:6836/3628757645 2024-05-10T10:54:30.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.609+0000 7f62d519cb80 1 -- 172.21.15.107:0/1003951193 shutdown_connections 2024-05-10T10:54:30.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.609+0000 7f62d519cb80 1 -- 172.21.15.107:0/1003951193 wait complete. 2024-05-10T10:54:30.616 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.609+0000 7f62d519cb80 20 client.14961 trim_cache size 0 max 16384 2024-05-10T10:54:30.616 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:54:30.616 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "0ba8a8e4-0eba-11ef-bc98-c7b262605968", 2024-05-10T10:54:30.616 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 4, 2024-05-10T10:54:30.616 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24430, 2024-05-10T10:54:30.616 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2024-05-10T10:54:30.616 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2024-05-10T10:54:30.617 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2024-05-10T10:54:30.617 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 117.804788575, 2024-05-10T10:54:30.617 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 26, 2024-05-10T10:54:30.617 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 82, 2024-05-10T10:54:30.617 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 80, 2024-05-10T10:54:30.617 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 165.79136510999999 2024-05-10T10:54:30.617 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:54:30.617 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.609+0000 7f62ca909700 1 -- 172.21.15.107:0/605634794 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f62ac0b2900 msgr2=0x7f62ac0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:30.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.609+0000 7f62ca909700 1 --2- 172.21.15.107:0/605634794 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f62ac0b2900 0x7f62ac0b4dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f62b400b5c0 tx=0x7f62b4005960 comp rx=0 tx=0).stop 2024-05-10T10:54:30.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.609+0000 7f62ca909700 1 -- 172.21.15.107:0/605634794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62c4108400 msgr2=0x7f62c419e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:30.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.609+0000 7f62ca909700 1 --2- 172.21.15.107:0/605634794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62c4108400 0x7f62c419e630 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00b970 tx=0x7f62bc00bc80 comp rx=0 tx=0).stop 2024-05-10T10:54:30.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.610+0000 7f62ca909700 1 -- 172.21.15.107:0/605634794 shutdown_connections 2024-05-10T10:54:30.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.610+0000 7f62ca909700 1 --2- 172.21.15.107:0/605634794 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f62ac0b2900 0x7f62ac0b4dc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.610+0000 7f62ca909700 1 --2- 172.21.15.107:0/605634794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f62c4102390 0x7f62c4199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.610+0000 7f62ca909700 1 --2- 172.21.15.107:0/605634794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f62c4108400 0x7f62c419e630 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.610+0000 7f62ca909700 1 --2- 172.21.15.107:0/605634794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62c4102d50 0x7f62c419a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:30.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.610+0000 7f62ca909700 1 -- 172.21.15.107:0/605634794 >> 172.21.15.107:0/605634794 conn(0x7f62c4079310 msgr2=0x7f62c4101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:30.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.610+0000 7f62ca909700 1 -- 172.21.15.107:0/605634794 shutdown_connections 2024-05-10T10:54:30.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:30.610+0000 7f62ca909700 1 -- 172.21.15.107:0/605634794 wait complete. 2024-05-10T10:54:31.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:30 smithi184 ceph-mon[34585]: pgmap v353: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:54:31.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:30 smithi107 ceph-mon[30373]: pgmap v353: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:54:31.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:30 smithi196 ceph-mon[34872]: pgmap v353: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:54:31.378 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell mds.e status 2024-05-10T10:54:31.619 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:54:33.048 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:32 smithi107 ceph-mon[30373]: pgmap v354: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:54:33.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:32 smithi184 ceph-mon[34585]: pgmap v354: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:54:33.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.306+0000 7faafe455700 1 -- 172.21.15.107:0/372711498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf8102d60 msgr2=0x7faaf810f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:33.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.306+0000 7faafe455700 1 --2- 172.21.15.107:0/372711498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf8102d60 0x7faaf810f250 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faaf000b0a0 tx=0x7faaf000b3b0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.306+0000 7faafe455700 1 -- 172.21.15.107:0/372711498 shutdown_connections 2024-05-10T10:54:33.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.306+0000 7faafe455700 1 --2- 172.21.15.107:0/372711498 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faaf8108410 0x7faaf81087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.306+0000 7faafe455700 1 --2- 172.21.15.107:0/372711498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf8102d60 0x7faaf810f250 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.306+0000 7faafe455700 1 --2- 172.21.15.107:0/372711498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaf81023a0 0x7faaf8102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.306+0000 7faafe455700 1 -- 172.21.15.107:0/372711498 >> 172.21.15.107:0/372711498 conn(0x7faaf8079350 msgr2=0x7faaf8079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:33.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.306+0000 7faafe455700 1 -- 172.21.15.107:0/372711498 shutdown_connections 2024-05-10T10:54:33.309 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.306+0000 7faafe455700 1 -- 172.21.15.107:0/372711498 wait complete. 2024-05-10T10:54:33.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.306+0000 7faafe455700 1 Processor -- start 2024-05-10T10:54:33.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.306+0000 7faafe455700 1 -- start start 2024-05-10T10:54:33.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.307+0000 7faafe455700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf81023a0 0x7faaf819f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:33.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.307+0000 7faafe455700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faaf8102d60 0x7faaf819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:33.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.307+0000 7faafe455700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaf8108410 0x7faaf8199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:33.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.307+0000 7faafe455700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faaf8112670 con 0x7faaf81023a0 2024-05-10T10:54:33.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.307+0000 7faafe455700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7faaf81124f0 con 0x7faaf8108410 2024-05-10T10:54:33.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.307+0000 7faafe455700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7faaf81127f0 con 0x7faaf8102d60 2024-05-10T10:54:33.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.307+0000 7faaf7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf81023a0 0x7faaf819f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:33.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.307+0000 7faaf7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf81023a0 0x7faaf819f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55648/0 (socket says 172.21.15.107:55648) 2024-05-10T10:54:33.310 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.307+0000 7faaf7fff700 1 -- 172.21.15.107:0/1523026108 learned_addr learned my addr 172.21.15.107:0/1523026108 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:33.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.307+0000 7faafc9f2700 1 --2- 172.21.15.107:0/1523026108 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaf8108410 0x7faaf8199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:33.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.307+0000 7faaf77fe700 1 --2- 172.21.15.107:0/1523026108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faaf8102d60 0x7faaf819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:33.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.307+0000 7faaf7fff700 1 -- 172.21.15.107:0/1523026108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faaf8102d60 msgr2=0x7faaf819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:33.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.307+0000 7faaf7fff700 1 --2- 172.21.15.107:0/1523026108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faaf8102d60 0x7faaf819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.307+0000 7faaf7fff700 1 -- 172.21.15.107:0/1523026108 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaf8108410 msgr2=0x7faaf8199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:33.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.307+0000 7faaf7fff700 1 --2- 172.21.15.107:0/1523026108 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaf8108410 0x7faaf8199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.307+0000 7faaf7fff700 1 -- 172.21.15.107:0/1523026108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf819a0a0 con 0x7faaf81023a0 2024-05-10T10:54:33.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.307+0000 7faaf7fff700 1 --2- 172.21.15.107:0/1523026108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf81023a0 0x7faaf819f780 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faae800c920 tx=0x7faae800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:33.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.308+0000 7faaf57fa700 1 -- 172.21.15.107:0/1523026108 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8004a30 con 0x7faaf81023a0 2024-05-10T10:54:33.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.308+0000 7faaf57fa700 1 -- 172.21.15.107:0/1523026108 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faae80054f0 con 0x7faaf81023a0 2024-05-10T10:54:33.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.308+0000 7faafe455700 1 -- 172.21.15.107:0/1523026108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf819a390 con 0x7faaf81023a0 2024-05-10T10:54:33.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.308+0000 7faaf57fa700 1 -- 172.21.15.107:0/1523026108 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8007cd0 con 0x7faaf81023a0 2024-05-10T10:54:33.311 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.308+0000 7faafe455700 1 -- 172.21.15.107:0/1523026108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf81a6650 con 0x7faaf81023a0 2024-05-10T10:54:33.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.311+0000 7faaf57fa700 1 -- 172.21.15.107:0/1523026108 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7faae8004eb0 con 0x7faaf81023a0 2024-05-10T10:54:33.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.312+0000 7faaf57fa700 1 --2- 172.21.15.107:0/1523026108 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7faae00b2900 0x7faae00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:33.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.312+0000 7faaf77fe700 1 --2- 172.21.15.107:0/1523026108 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7faae00b2900 0x7faae00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:33.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.312+0000 7faaf57fa700 1 -- 172.21.15.107:0/1523026108 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7faae80e1b80 con 0x7faaf81023a0 2024-05-10T10:54:33.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.312+0000 7fab08ce8b80 1 Processor -- start 2024-05-10T10:54:33.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.312+0000 7fab08ce8b80 1 -- start start 2024-05-10T10:54:33.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.312+0000 7faaf77fe700 1 --2- 172.21.15.107:0/1523026108 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7faae00b2900 0x7faae00b4dc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faaf80798c0 tx=0x7faaec00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:33.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.312+0000 7fab08ce8b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9784160 0x562de9784540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:33.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.312+0000 7fab08ce8b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de9784a80 0x562de977e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:33.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.312+0000 7fab08ce8b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de977ed00 0x562de977f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:33.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.312+0000 7fab08ce8b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562de96d08f0 con 0x562de9784a80 2024-05-10T10:54:33.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.312+0000 7fab08ce8b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562de9635d50 con 0x562de977ed00 2024-05-10T10:54:33.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.312+0000 7fab08ce8b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562de96cc8b0 con 0x562de9784160 2024-05-10T10:54:33.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.312+0000 7faaf77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de9784a80 0x562de977e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:33.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.312+0000 7faaf7fff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9784160 0x562de9784540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:33.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.312+0000 7faaf77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de9784a80 0x562de977e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55650/0 (socket says 172.21.15.107:55650) 2024-05-10T10:54:33.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.312+0000 7faaf77fe700 1 -- 172.21.15.107:0/2080192159 learned_addr learned my addr 172.21.15.107:0/2080192159 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:33.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.313+0000 7faafc9f2700 1 --2- 172.21.15.107:0/2080192159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de977ed00 0x562de977f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:33.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.313+0000 7faaf7fff700 1 -- 172.21.15.107:0/2080192159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de977ed00 msgr2=0x562de977f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:33.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.313+0000 7faaf7fff700 1 --2- 172.21.15.107:0/2080192159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de977ed00 0x562de977f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.313+0000 7faaf7fff700 1 -- 172.21.15.107:0/2080192159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de9784a80 msgr2=0x562de977e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:33.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.313+0000 7faaf7fff700 1 --2- 172.21.15.107:0/2080192159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de9784a80 0x562de977e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.313+0000 7faaf7fff700 1 -- 172.21.15.107:0/2080192159 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562de961d880 con 0x562de9784160 2024-05-10T10:54:33.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.313+0000 7faaf77fe700 1 --2- 172.21.15.107:0/2080192159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de9784a80 0x562de977e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:54:33.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.313+0000 7faaf7fff700 1 --2- 172.21.15.107:0/2080192159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9784160 0x562de9784540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faae80df770 tx=0x7faae80a8a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f4e44e879e43ca7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:33.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.313+0000 7faade7fc700 1 -- 172.21.15.107:0/2080192159 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae801d030 con 0x562de9784160 2024-05-10T10:54:33.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.313+0000 7faade7fc700 1 -- 172.21.15.107:0/2080192159 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faae80a9240 con 0x562de9784160 2024-05-10T10:54:33.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.313+0000 7faade7fc700 1 -- 172.21.15.107:0/2080192159 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae80a9700 con 0x562de9784160 2024-05-10T10:54:33.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.314+0000 7fab08ce8b80 1 -- 172.21.15.107:0/2080192159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9784160 msgr2=0x562de9784540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:33.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.314+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/2080192159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9784160 0x562de9784540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faae80df770 tx=0x7faae80a8a00 comp rx=0 tx=0).stop 2024-05-10T10:54:33.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.314+0000 7fab08ce8b80 1 -- 172.21.15.107:0/2080192159 shutdown_connections 2024-05-10T10:54:33.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.314+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/2080192159 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9784160 0x562de9784540 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.314+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/2080192159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de977ed00 0x562de977f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.314+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/2080192159 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de9784a80 0x562de977e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.314+0000 7fab08ce8b80 1 -- 172.21.15.107:0/2080192159 >> 172.21.15.107:0/2080192159 conn(0x562de96aab20 msgr2=0x562de9779250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:33.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.314+0000 7fab08ce8b80 1 -- 172.21.15.107:0/2080192159 shutdown_connections 2024-05-10T10:54:33.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.314+0000 7fab08ce8b80 1 -- 172.21.15.107:0/2080192159 wait complete. 2024-05-10T10:54:33.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.314+0000 7fab08ce8b80 1 -- start start 2024-05-10T10:54:33.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.314+0000 7fab08ce8b80 1 Processor -- start 2024-05-10T10:54:33.319 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:32 smithi196 ceph-mon[34872]: pgmap v354: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:54:33.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7fab08ce8b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de977ed00 0x562de978a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:33.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7fab08ce8b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de9784160 0x562de9787ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:33.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7fab08ce8b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de9784a80 0x562de9787ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:33.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7fab08ce8b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562de978b400 con 0x562de9784160 2024-05-10T10:54:33.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7fab08ce8b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562de9689e80 con 0x562de9784a80 2024-05-10T10:54:33.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7fab08ce8b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562de978b580 con 0x562de977ed00 2024-05-10T10:54:33.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7fab08ce8b80 10 client.0 _ll_register_callbacks cb 0x562de9664560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:54:33.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7faaf77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de9784160 0x562de9787ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:33.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7faaf77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de9784160 0x562de9787ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55662/0 (socket says 172.21.15.107:55662) 2024-05-10T10:54:33.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7faaf77fe700 1 -- 172.21.15.107:0/4236391601 learned_addr learned my addr 172.21.15.107:0/4236391601 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:33.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7faaf7fff700 1 --2- 172.21.15.107:0/4236391601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de977ed00 0x562de978a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:33.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7faafc9f2700 1 --2- 172.21.15.107:0/4236391601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de9784a80 0x562de9787ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:33.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7faaf77fe700 1 -- 172.21.15.107:0/4236391601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de977ed00 msgr2=0x562de978a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:33.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7faaf77fe700 1 --2- 172.21.15.107:0/4236391601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de977ed00 0x562de978a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7faaf77fe700 1 -- 172.21.15.107:0/4236391601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de9784a80 msgr2=0x562de9787ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:33.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7faaf77fe700 1 --2- 172.21.15.107:0/4236391601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de9784a80 0x562de9787ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7faaf77fe700 1 -- 172.21.15.107:0/4236391601 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562de9687710 con 0x562de9784160 2024-05-10T10:54:33.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7faaf77fe700 1 --2- 172.21.15.107:0/4236391601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de9784160 0x562de9787ab0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faaec00f750 tx=0x7faaec0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c493e8608367d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:33.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7faad77fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:54:33.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7faad77fe700 1 -- 172.21.15.107:0/4236391601 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec016070 con 0x562de9784160 2024-05-10T10:54:33.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7faad77fe700 1 -- 172.21.15.107:0/4236391601 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7faaec010840 con 0x562de9784160 2024-05-10T10:54:33.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.315+0000 7fab08ce8b80 1 -- 172.21.15.107:0/4236391601 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faae80a9240 con 0x562de9784160 2024-05-10T10:54:33.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.316+0000 7faad77fe700 1 -- 172.21.15.107:0/4236391601 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faaec010a40 con 0x562de9784160 2024-05-10T10:54:33.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.316+0000 7fab08ce8b80 10 client.14973 fetch_fsmap learned FSMap version 26 2024-05-10T10:54:33.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.316+0000 7fab08ce8b80 1 -- 172.21.15.107:0/4236391601 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562de9795d30 con 0x562de9784160 2024-05-10T10:54:33.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.316+0000 7faad77fe700 1 -- 172.21.15.107:0/4236391601 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faae80a9240 con 0x562de9784160 2024-05-10T10:54:33.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.316+0000 7faad77fe700 1 -- 172.21.15.107:0/4236391601 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7faaec027ca0 con 0x562de9784160 2024-05-10T10:54:33.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.316+0000 7fab08ce8b80 10 client.14973 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:54:33.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.316+0000 7fab08ce8b80 10 client.14973 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-10T10:54:33.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.316+0000 7fab08ce8b80 20 client.14973 populate_metadata read hostname 'smithi107' 2024-05-10T10:54:33.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.316+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/4236391601 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x562de9798380 0x562de97997f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:33.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.316+0000 7fab08ce8b80 4 client.14973 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:54:33.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.316+0000 7fab08ce8b80 1 -- 172.21.15.107:0/4236391601 --> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562de96de2d0 con 0x562de9798380 2024-05-10T10:54:33.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.316+0000 7faaf7fff700 1 --2- 172.21.15.107:0/4236391601 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x562de9798380 0x562de97997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:33.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.317+0000 7faaf7fff700 1 --2- 172.21.15.107:0/4236391601 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x562de9798380 0x562de97997f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b0b1e67a9c601158 server_cookie=5ba23d738259427a in_seq=0 out_seq=0 2024-05-10T10:54:33.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.317+0000 7faad77fe700 10 client.14973 ms_handle_connect on v2:172.21.15.184:6834/872203477 2024-05-10T10:54:33.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.318+0000 7faad77fe700 1 -- 172.21.15.107:0/4236391601 <== mds.3 v2:172.21.15.184:6834/872203477 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562de96de2d0 con 0x562de9798380 2024-05-10T10:54:33.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.318+0000 7faad77fe700 10 client.14973 handle_command_reply: tid=0 2024-05-10T10:54:33.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.318+0000 7fab08ce8b80 1 client.14973 shutdown 2024-05-10T10:54:33.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.318+0000 7fab08ce8b80 1 -- 172.21.15.107:0/4236391601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de9784160 msgr2=0x562de9787ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:33.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.318+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/4236391601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de9784160 0x562de9787ab0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faaec00f750 tx=0x7faaec0047c0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.318+0000 7fab08ce8b80 1 -- 172.21.15.107:0/4236391601 shutdown_connections 2024-05-10T10:54:33.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.318+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/4236391601 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x562de9798380 0x562de97997f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.318+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/4236391601 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de977ed00 0x562de978a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.318+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/4236391601 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de9784a80 0x562de9787ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.318+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/4236391601 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de9784160 0x562de9787ab0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.318+0000 7faad77fe700 0 client.14973 ms_handle_reset on v2:172.21.15.184:6834/872203477 2024-05-10T10:54:33.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.318+0000 7fab08ce8b80 1 -- 172.21.15.107:0/4236391601 >> 172.21.15.107:0/4236391601 conn(0x562de96aab20 msgr2=0x562de9773ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:33.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.318+0000 7fab08ce8b80 1 -- 172.21.15.107:0/4236391601 shutdown_connections 2024-05-10T10:54:33.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.318+0000 7fab08ce8b80 1 -- 172.21.15.107:0/4236391601 wait complete. 2024-05-10T10:54:33.327 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.318+0000 7fab08ce8b80 20 client.14973 trim_cache size 0 max 16384 2024-05-10T10:54:33.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.339+0000 7fab08ce8b80 1 Processor -- start 2024-05-10T10:54:33.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.339+0000 7fab08ce8b80 1 -- start start 2024-05-10T10:54:33.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.339+0000 7fab08ce8b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de977ed00 0x562de977e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:33.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.339+0000 7fab08ce8b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de9784160 0x562de9785570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:33.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.339+0000 7fab08ce8b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9784a80 0x562de9773bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:33.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.339+0000 7fab08ce8b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562de9797b30 con 0x562de977ed00 2024-05-10T10:54:33.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.339+0000 7fab08ce8b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562de9798200 con 0x562de9784160 2024-05-10T10:54:33.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.339+0000 7fab08ce8b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562de97988d0 con 0x562de9784a80 2024-05-10T10:54:33.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.339+0000 7faaf7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de977ed00 0x562de977e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:33.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.339+0000 7faaf7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de977ed00 0x562de977e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55674/0 (socket says 172.21.15.107:55674) 2024-05-10T10:54:33.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.339+0000 7faaf7fff700 1 -- 172.21.15.107:0/1851525163 learned_addr learned my addr 172.21.15.107:0/1851525163 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:33.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.339+0000 7faaf7fff700 1 -- 172.21.15.107:0/1851525163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9784a80 msgr2=0x562de9773bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:33.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.339+0000 7faaf7fff700 1 --2- 172.21.15.107:0/1851525163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9784a80 0x562de9773bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.339+0000 7faaf77fe700 1 --2- 172.21.15.107:0/1851525163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de9784160 0x562de9785570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.339+0000 7faaf7fff700 1 -- 172.21.15.107:0/1851525163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de9784160 msgr2=0x562de9785570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.340+0000 7faaf7fff700 1 --2- 172.21.15.107:0/1851525163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de9784160 0x562de9785570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.340+0000 7faaf7fff700 1 -- 172.21.15.107:0/1851525163 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562de9779d20 con 0x562de977ed00 2024-05-10T10:54:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.340+0000 7faaf77fe700 1 --2- 172.21.15.107:0/1851525163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de9784160 0x562de9785570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:54:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.340+0000 7faaf7fff700 1 --2- 172.21.15.107:0/1851525163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de977ed00 0x562de977e7c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7faae80df770 tx=0x7faae80a5230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b956f0f311311f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.340+0000 7faaddffb700 1 -- 172.21.15.107:0/1851525163 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae801d040 con 0x562de977ed00 2024-05-10T10:54:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.340+0000 7faaddffb700 1 -- 172.21.15.107:0/1851525163 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faae80a9240 con 0x562de977ed00 2024-05-10T10:54:33.342 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.340+0000 7faaddffb700 1 -- 172.21.15.107:0/1851525163 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae80a94a0 con 0x562de977ed00 2024-05-10T10:54:33.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.340+0000 7fab08ce8b80 1 -- 172.21.15.107:0/1851525163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de977ed00 msgr2=0x562de977e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:33.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.340+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/1851525163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de977ed00 0x562de977e7c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7faae80df770 tx=0x7faae80a5230 comp rx=0 tx=0).stop 2024-05-10T10:54:33.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.340+0000 7fab08ce8b80 1 -- 172.21.15.107:0/1851525163 shutdown_connections 2024-05-10T10:54:33.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.340+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/1851525163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9784a80 0x562de9773bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.340+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/1851525163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de977ed00 0x562de977e7c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.340+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/1851525163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de9784160 0x562de9785570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.340+0000 7fab08ce8b80 1 -- 172.21.15.107:0/1851525163 >> 172.21.15.107:0/1851525163 conn(0x562de96aab20 msgr2=0x562de9784e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:33.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.340+0000 7fab08ce8b80 1 -- 172.21.15.107:0/1851525163 shutdown_connections 2024-05-10T10:54:33.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.341+0000 7fab08ce8b80 1 -- 172.21.15.107:0/1851525163 wait complete. 2024-05-10T10:54:33.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.341+0000 7fab08ce8b80 1 -- start start 2024-05-10T10:54:33.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.341+0000 7fab08ce8b80 1 Processor -- start 2024-05-10T10:54:33.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.341+0000 7fab08ce8b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de977ed00 0x562de97a1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:33.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.341+0000 7fab08ce8b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de9784160 0x562de97a1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:33.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.341+0000 7fab08ce8b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9784a80 0x562de97a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:33.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.341+0000 7fab08ce8b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562de9799670 con 0x562de977ed00 2024-05-10T10:54:33.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.341+0000 7fab08ce8b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562de9798fa0 con 0x562de9784160 2024-05-10T10:54:33.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.341+0000 7fab08ce8b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562de9799d40 con 0x562de9784a80 2024-05-10T10:54:33.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.341+0000 7fab08ce8b80 10 client.0 _ll_register_callbacks cb 0x562de9664560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:54:33.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.341+0000 7faaf7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de977ed00 0x562de97a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:33.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.341+0000 7faaf7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de977ed00 0x562de97a1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55686/0 (socket says 172.21.15.107:55686) 2024-05-10T10:54:33.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.341+0000 7faaf7fff700 1 -- 172.21.15.107:0/2306419874 learned_addr learned my addr 172.21.15.107:0/2306419874 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:33.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.342+0000 7faaf77fe700 1 --2- 172.21.15.107:0/2306419874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de9784160 0x562de97a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:33.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.342+0000 7faafc9f2700 1 --2- 172.21.15.107:0/2306419874 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9784a80 0x562de97a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:33.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.342+0000 7faaf7fff700 1 -- 172.21.15.107:0/2306419874 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9784a80 msgr2=0x562de97a1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:33.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.342+0000 7faaf7fff700 1 --2- 172.21.15.107:0/2306419874 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9784a80 0x562de97a1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.342+0000 7faaf7fff700 1 -- 172.21.15.107:0/2306419874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de9784160 msgr2=0x562de97a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:33.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.342+0000 7faaf7fff700 1 --2- 172.21.15.107:0/2306419874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de9784160 0x562de97a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.342+0000 7faaf7fff700 1 -- 172.21.15.107:0/2306419874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562de9773290 con 0x562de977ed00 2024-05-10T10:54:33.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.342+0000 7faaf7fff700 1 --2- 172.21.15.107:0/2306419874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de977ed00 0x562de97a1050 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faae800c8f0 tx=0x7faae800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab58800bd134758 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:33.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.342+0000 7faad77fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:54:33.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.342+0000 7faad77fe700 1 -- 172.21.15.107:0/2306419874 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8089060 con 0x562de977ed00 2024-05-10T10:54:33.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.342+0000 7faad77fe700 1 -- 172.21.15.107:0/2306419874 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7faae80a94a0 con 0x562de977ed00 2024-05-10T10:54:33.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.342+0000 7fab08ce8b80 1 -- 172.21.15.107:0/2306419874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faae80a9240 con 0x562de977ed00 2024-05-10T10:54:33.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.342+0000 7faad77fe700 1 -- 172.21.15.107:0/2306419874 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faae801d040 con 0x562de977ed00 2024-05-10T10:54:33.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.342+0000 7fab08ce8b80 10 client.14979 fetch_fsmap learned FSMap version 26 2024-05-10T10:54:33.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.342+0000 7fab08ce8b80 1 -- 172.21.15.107:0/2306419874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562de9803b00 con 0x562de977ed00 2024-05-10T10:54:33.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.342+0000 7faad77fe700 1 -- 172.21.15.107:0/2306419874 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faae80a9240 con 0x562de977ed00 2024-05-10T10:54:33.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.343+0000 7faad77fe700 1 -- 172.21.15.107:0/2306419874 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7faae80b3020 con 0x562de977ed00 2024-05-10T10:54:33.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.343+0000 7fab08ce8b80 10 client.14979 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:54:33.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.343+0000 7fab08ce8b80 10 client.14979 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-10T10:54:33.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.343+0000 7fab08ce8b80 20 client.14979 populate_metadata read hostname 'smithi107' 2024-05-10T10:54:33.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.343+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/2306419874 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x562de9807ff0 0x562de9806d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:33.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.343+0000 7fab08ce8b80 4 client.14979 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T10:54:33.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.343+0000 7fab08ce8b80 1 -- 172.21.15.107:0/2306419874 --> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] -- command(tid 0: {"prefix": "status"}) -- 0x562de96d8370 con 0x562de9807ff0 2024-05-10T10:54:33.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.343+0000 7faaf77fe700 1 --2- 172.21.15.107:0/2306419874 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x562de9807ff0 0x562de9806d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:33.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.343+0000 7faad77fe700 10 client.14979 ms_handle_connect on v2:172.21.15.184:6834/872203477 2024-05-10T10:54:33.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.343+0000 7faaf77fe700 1 --2- 172.21.15.107:0/2306419874 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x562de9807ff0 0x562de9806d00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ccbab1ef37081e93 server_cookie=320cb661f90194f7 in_seq=0 out_seq=0 2024-05-10T10:54:33.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.343+0000 7faad77fe700 1 -- 172.21.15.107:0/2306419874 <== mds.3 v2:172.21.15.184:6834/872203477 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562de96d8370 con 0x562de9807ff0 2024-05-10T10:54:33.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.343+0000 7faad77fe700 10 client.14979 handle_command_reply: tid=0 2024-05-10T10:54:33.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.343+0000 7fab08ce8b80 1 client.14979 shutdown 2024-05-10T10:54:33.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.344+0000 7fab08ce8b80 1 -- 172.21.15.107:0/2306419874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de977ed00 msgr2=0x562de97a1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:33.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.344+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/2306419874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de977ed00 0x562de97a1050 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faae800c8f0 tx=0x7faae800a650 comp rx=0 tx=0).stop 2024-05-10T10:54:33.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.344+0000 7fab08ce8b80 1 -- 172.21.15.107:0/2306419874 shutdown_connections 2024-05-10T10:54:33.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.344+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/2306419874 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x562de9807ff0 0x562de9806d00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.344+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/2306419874 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562de9784a80 0x562de97a1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.344+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/2306419874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562de977ed00 0x562de97a1050 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.344+0000 7fab08ce8b80 1 --2- 172.21.15.107:0/2306419874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562de9784160 0x562de97a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.344+0000 7fab08ce8b80 1 -- 172.21.15.107:0/2306419874 >> 172.21.15.107:0/2306419874 conn(0x562de96aab20 msgr2=0x562de97890b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:33.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.344+0000 7faad77fe700 0 client.14979 ms_handle_reset on v2:172.21.15.184:6834/872203477 2024-05-10T10:54:33.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.344+0000 7fab08ce8b80 1 -- 172.21.15.107:0/2306419874 shutdown_connections 2024-05-10T10:54:33.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.344+0000 7fab08ce8b80 1 -- 172.21.15.107:0/2306419874 wait complete. 2024-05-10T10:54:33.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.344+0000 7fab08ce8b80 20 client.14979 trim_cache size 0 max 16384 2024-05-10T10:54:33.353 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:54:33.353 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "0ba8a8e4-0eba-11ef-bc98-c7b262605968", 2024-05-10T10:54:33.353 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 3, 2024-05-10T10:54:33.353 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24431, 2024-05-10T10:54:33.353 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2024-05-10T10:54:33.353 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2024-05-10T10:54:33.354 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2024-05-10T10:54:33.354 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 121.546120346, 2024-05-10T10:54:33.354 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 26, 2024-05-10T10:54:33.354 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 82, 2024-05-10T10:54:33.354 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 80, 2024-05-10T10:54:33.354 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 173.84587425699999 2024-05-10T10:54:33.354 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:54:33.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.344+0000 7faafe455700 1 -- 172.21.15.107:0/1523026108 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7faae00b2900 msgr2=0x7faae00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:33.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.344+0000 7faafe455700 1 --2- 172.21.15.107:0/1523026108 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7faae00b2900 0x7faae00b4dc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faaf80798c0 tx=0x7faaec00a380 comp rx=0 tx=0).stop 2024-05-10T10:54:33.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.344+0000 7faafe455700 1 -- 172.21.15.107:0/1523026108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf81023a0 msgr2=0x7faaf819f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:33.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.344+0000 7faafe455700 1 --2- 172.21.15.107:0/1523026108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf81023a0 0x7faaf819f780 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faae800c920 tx=0x7faae800cc30 comp rx=0 tx=0).stop 2024-05-10T10:54:33.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.345+0000 7faafe455700 1 -- 172.21.15.107:0/1523026108 shutdown_connections 2024-05-10T10:54:33.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.345+0000 7faafe455700 1 --2- 172.21.15.107:0/1523026108 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7faae00b2900 0x7faae00b4dc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.345+0000 7faafe455700 1 --2- 172.21.15.107:0/1523026108 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faaf8108410 0x7faaf8199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.345+0000 7faafe455700 1 --2- 172.21.15.107:0/1523026108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf81023a0 0x7faaf819f780 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.345+0000 7faafe455700 1 --2- 172.21.15.107:0/1523026108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faaf8102d60 0x7faaf819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:33.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.345+0000 7faafe455700 1 -- 172.21.15.107:0/1523026108 >> 172.21.15.107:0/1523026108 conn(0x7faaf8079350 msgr2=0x7faaf8101510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:33.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.345+0000 7faafe455700 1 -- 172.21.15.107:0/1523026108 shutdown_connections 2024-05-10T10:54:33.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:33.345+0000 7faafe455700 1 -- 172.21.15.107:0/1523026108 wait complete. 2024-05-10T10:54:34.028 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell mds.i status 2024-05-10T10:54:34.271 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:54:35.080 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:34 smithi107 ceph-mon[30373]: pgmap v355: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:35.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:34 smithi184 ceph-mon[34585]: pgmap v355: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:35.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:34 smithi196 ceph-mon[34872]: pgmap v355: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:35.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.879+0000 7f87846c6700 1 -- 172.21.15.107:0/1927203975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f877c103560 msgr2=0x7f877c1039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:35.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.879+0000 7f87846c6700 1 --2- 172.21.15.107:0/1927203975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f877c103560 0x7f877c1039e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f87700099c0 tx=0x7f8770009cd0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.879+0000 7f87846c6700 1 -- 172.21.15.107:0/1927203975 shutdown_connections 2024-05-10T10:54:35.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.879+0000 7f87846c6700 1 --2- 172.21.15.107:0/1927203975 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f877c103f20 0x7f877c110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.879+0000 7f87846c6700 1 --2- 172.21.15.107:0/1927203975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f877c109540 0x7f877c109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.879+0000 7f87846c6700 1 --2- 172.21.15.107:0/1927203975 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f877c103560 0x7f877c1039e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.879+0000 7f87846c6700 1 -- 172.21.15.107:0/1927203975 >> 172.21.15.107:0/1927203975 conn(0x7f877c07a660 msgr2=0x7f877c07aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:35.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.879+0000 7f87846c6700 1 -- 172.21.15.107:0/1927203975 shutdown_connections 2024-05-10T10:54:35.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.879+0000 7f87846c6700 1 -- 172.21.15.107:0/1927203975 wait complete. 2024-05-10T10:54:35.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.879+0000 7f87846c6700 1 Processor -- start 2024-05-10T10:54:35.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f87846c6700 1 -- start start 2024-05-10T10:54:35.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f87846c6700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f877c103560 0x7f877c19f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:35.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f87846c6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f877c103f20 0x7f877c19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:35.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f87846c6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f877c109540 0x7f877c199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:35.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f87846c6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f877c1137e0 con 0x7f877c103f20 2024-05-10T10:54:35.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f87846c6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f877c113660 con 0x7f877c109540 2024-05-10T10:54:35.882 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f87846c6700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f877c113960 con 0x7f877c103560 2024-05-10T10:54:35.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f8781c61700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f877c103f20 0x7f877c19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:35.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f8781c61700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f877c103f20 0x7f877c19fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55714/0 (socket says 172.21.15.107:55714) 2024-05-10T10:54:35.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f8781c61700 1 -- 172.21.15.107:0/4052192673 learned_addr learned my addr 172.21.15.107:0/4052192673 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:35.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f8782c63700 1 --2- 172.21.15.107:0/4052192673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f877c109540 0x7f877c199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:35.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f8782462700 1 --2- 172.21.15.107:0/4052192673 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f877c103560 0x7f877c19f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:35.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f8781c61700 1 -- 172.21.15.107:0/4052192673 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f877c103560 msgr2=0x7f877c19f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:35.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f8781c61700 1 --2- 172.21.15.107:0/4052192673 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f877c103560 0x7f877c19f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f8781c61700 1 -- 172.21.15.107:0/4052192673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f877c109540 msgr2=0x7f877c199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:35.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f8781c61700 1 --2- 172.21.15.107:0/4052192673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f877c109540 0x7f877c199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f8781c61700 1 -- 172.21.15.107:0/4052192673 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877c19a220 con 0x7f877c103f20 2024-05-10T10:54:35.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f8781c61700 1 --2- 172.21.15.107:0/4052192673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f877c103f20 0x7f877c19fda0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f877000b580 tx=0x7f8770005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:35.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f876f7fe700 1 -- 172.21.15.107:0/4052192673 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770027070 con 0x7f877c103f20 2024-05-10T10:54:35.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f87846c6700 1 -- 172.21.15.107:0/4052192673 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f877c19a4b0 con 0x7f877c103f20 2024-05-10T10:54:35.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f876f7fe700 1 -- 172.21.15.107:0/4052192673 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8770003fb0 con 0x7f877c103f20 2024-05-10T10:54:35.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.880+0000 7f876f7fe700 1 -- 172.21.15.107:0/4052192673 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770022e30 con 0x7f877c103f20 2024-05-10T10:54:35.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.881+0000 7f87846c6700 1 -- 172.21.15.107:0/4052192673 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f877c1a6730 con 0x7f877c103f20 2024-05-10T10:54:35.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.884+0000 7f876f7fe700 1 -- 172.21.15.107:0/4052192673 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f8770022590 con 0x7f877c103f20 2024-05-10T10:54:35.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.884+0000 7f876f7fe700 1 --2- 172.21.15.107:0/4052192673 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87680b2880 0x7f87680b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:35.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.884+0000 7f8782462700 1 --2- 172.21.15.107:0/4052192673 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87680b2880 0x7f87680b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:35.885 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.884+0000 7f876f7fe700 1 -- 172.21.15.107:0/4052192673 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f87700e2e40 con 0x7f877c103f20 2024-05-10T10:54:35.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.885+0000 7f878ef59b80 1 Processor -- start 2024-05-10T10:54:35.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.885+0000 7f8782462700 1 --2- 172.21.15.107:0/4052192673 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87680b2880 0x7f87680b4d40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8778005950 tx=0x7f87780058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:35.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.885+0000 7f878ef59b80 1 -- start start 2024-05-10T10:54:35.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.885+0000 7f878ef59b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7160 0x5639f67b7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:35.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.885+0000 7f878ef59b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b7a80 0x5639f67b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:35.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.885+0000 7f878ef59b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b1d00 0x5639f67b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:35.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.885+0000 7f878ef59b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5639f67038f0 con 0x5639f67b7160 2024-05-10T10:54:35.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.885+0000 7f878ef59b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5639f6668d50 con 0x5639f67b7a80 2024-05-10T10:54:35.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.885+0000 7f878ef59b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5639f66ff8b0 con 0x5639f67b1d00 2024-05-10T10:54:35.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.885+0000 7f8782462700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7160 0x5639f67b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:35.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.885+0000 7f8782462700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7160 0x5639f67b7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55722/0 (socket says 172.21.15.107:55722) 2024-05-10T10:54:35.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.885+0000 7f8782462700 1 -- 172.21.15.107:0/2742098254 learned_addr learned my addr 172.21.15.107:0/2742098254 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:35.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.885+0000 7f8781c61700 1 --2- 172.21.15.107:0/2742098254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b7a80 0x5639f67b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:35.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.886+0000 7f8782462700 1 -- 172.21.15.107:0/2742098254 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b1d00 msgr2=0x5639f67b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:35.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.886+0000 7f8782c63700 1 --2- 172.21.15.107:0/2742098254 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b1d00 0x5639f67b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:35.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.886+0000 7f8782462700 1 --2- 172.21.15.107:0/2742098254 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b1d00 0x5639f67b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.886+0000 7f8782462700 1 -- 172.21.15.107:0/2742098254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b7a80 msgr2=0x5639f67b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:35.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.886+0000 7f8782462700 1 --2- 172.21.15.107:0/2742098254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b7a80 0x5639f67b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.886+0000 7f8782462700 1 -- 172.21.15.107:0/2742098254 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f6650880 con 0x5639f67b7160 2024-05-10T10:54:35.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.886+0000 7f8781c61700 1 --2- 172.21.15.107:0/2742098254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b7a80 0x5639f67b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:54:35.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.886+0000 7f8782c63700 1 --2- 172.21.15.107:0/2742098254 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b1d00 0x5639f67b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:54:35.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.886+0000 7f8782462700 1 --2- 172.21.15.107:0/2742098254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7160 0x5639f67b7540 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f877800fd40 tx=0x7f8778012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386332760f7fb53f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:35.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.886+0000 7f876cff9700 1 -- 172.21.15.107:0/2742098254 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8778022070 con 0x5639f67b7160 2024-05-10T10:54:35.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.886+0000 7f876cff9700 1 -- 172.21.15.107:0/2742098254 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8778011c60 con 0x5639f67b7160 2024-05-10T10:54:35.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.886+0000 7f876cff9700 1 -- 172.21.15.107:0/2742098254 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877801d6a0 con 0x5639f67b7160 2024-05-10T10:54:35.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.887+0000 7f878ef59b80 1 -- 172.21.15.107:0/2742098254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7160 msgr2=0x5639f67b7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:35.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.887+0000 7f878ef59b80 1 --2- 172.21.15.107:0/2742098254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7160 0x5639f67b7540 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f877800fd40 tx=0x7f8778012000 comp rx=0 tx=0).stop 2024-05-10T10:54:35.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.887+0000 7f878ef59b80 1 -- 172.21.15.107:0/2742098254 shutdown_connections 2024-05-10T10:54:35.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.887+0000 7f878ef59b80 1 --2- 172.21.15.107:0/2742098254 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b1d00 0x5639f67b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.887+0000 7f878ef59b80 1 --2- 172.21.15.107:0/2742098254 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7160 0x5639f67b7540 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.887+0000 7f878ef59b80 1 --2- 172.21.15.107:0/2742098254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b7a80 0x5639f67b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.887+0000 7f878ef59b80 1 -- 172.21.15.107:0/2742098254 >> 172.21.15.107:0/2742098254 conn(0x5639f66ddb20 msgr2=0x5639f67ac250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:35.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.887+0000 7f878ef59b80 1 -- 172.21.15.107:0/2742098254 shutdown_connections 2024-05-10T10:54:35.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.887+0000 7f878ef59b80 1 -- 172.21.15.107:0/2742098254 wait complete. 2024-05-10T10:54:35.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.887+0000 7f878ef59b80 1 -- start start 2024-05-10T10:54:35.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.887+0000 7f878ef59b80 1 Processor -- start 2024-05-10T10:54:35.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.887+0000 7f878ef59b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b1d00 0x5639f67bd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:35.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.887+0000 7f878ef59b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b7160 0x5639f67baa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:35.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.887+0000 7f878ef59b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7a80 0x5639f67bafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:35.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f878ef59b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5639f67be400 con 0x5639f67b7a80 2024-05-10T10:54:35.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f878ef59b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5639f66bce80 con 0x5639f67b1d00 2024-05-10T10:54:35.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f878ef59b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5639f67be580 con 0x5639f67b7160 2024-05-10T10:54:35.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f878ef59b80 10 client.0 _ll_register_callbacks cb 0x5639f6697560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:54:35.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f8782c63700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7a80 0x5639f67bafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:35.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f8782c63700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7a80 0x5639f67bafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55734/0 (socket says 172.21.15.107:55734) 2024-05-10T10:54:35.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f8782c63700 1 -- 172.21.15.107:0/2513578352 learned_addr learned my addr 172.21.15.107:0/2513578352 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:35.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f8781c61700 1 --2- 172.21.15.107:0/2513578352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b7160 0x5639f67baa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:35.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f8782c63700 1 -- 172.21.15.107:0/2513578352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b7160 msgr2=0x5639f67baa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:35.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f8782c63700 1 --2- 172.21.15.107:0/2513578352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b7160 0x5639f67baa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f8782c63700 1 -- 172.21.15.107:0/2513578352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b1d00 msgr2=0x5639f67bd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:35.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f8782c63700 1 --2- 172.21.15.107:0/2513578352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b1d00 0x5639f67bd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f8782c63700 1 -- 172.21.15.107:0/2513578352 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639f66ba710 con 0x5639f67b7a80 2024-05-10T10:54:35.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f8782c63700 1 --2- 172.21.15.107:0/2513578352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7a80 0x5639f67bafc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f877400aee0 tx=0x7f8774009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421c269383e1eb8c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:35.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f8765ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:54:35.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f8765ffb700 1 -- 172.21.15.107:0/2513578352 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8774007b30 con 0x5639f67b7a80 2024-05-10T10:54:35.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f8765ffb700 1 -- 172.21.15.107:0/2513578352 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f8774007cd0 con 0x5639f67b7a80 2024-05-10T10:54:35.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f878ef59b80 1 -- 172.21.15.107:0/2513578352 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8778011c60 con 0x5639f67b7a80 2024-05-10T10:54:35.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f8765ffb700 1 -- 172.21.15.107:0/2513578352 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8774020440 con 0x5639f67b7a80 2024-05-10T10:54:35.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f878ef59b80 10 client.14991 fetch_fsmap learned FSMap version 26 2024-05-10T10:54:35.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.888+0000 7f878ef59b80 1 -- 172.21.15.107:0/2513578352 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5639f67c8c80 con 0x5639f67b7a80 2024-05-10T10:54:35.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.889+0000 7f8765ffb700 1 -- 172.21.15.107:0/2513578352 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8778011c60 con 0x5639f67b7a80 2024-05-10T10:54:35.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.889+0000 7f8765ffb700 1 -- 172.21.15.107:0/2513578352 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f8774015510 con 0x5639f67b7a80 2024-05-10T10:54:35.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.889+0000 7f878ef59b80 10 client.14991 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:54:35.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.889+0000 7f878ef59b80 10 client.14991 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-10T10:54:35.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.889+0000 7f878ef59b80 20 client.14991 populate_metadata read hostname 'smithi107' 2024-05-10T10:54:35.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.889+0000 7f878ef59b80 1 --2- 172.21.15.107:0/2513578352 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x5639f67cb360 0x5639f67cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:35.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.889+0000 7f878ef59b80 4 client.14991 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:54:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.889+0000 7f878ef59b80 1 -- 172.21.15.107:0/2513578352 --> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639f67112d0 con 0x5639f67cb360 2024-05-10T10:54:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.889+0000 7f8782462700 1 --2- 172.21.15.107:0/2513578352 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x5639f67cb360 0x5639f67cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.890+0000 7f8765ffb700 10 client.14991 ms_handle_connect on v2:172.21.15.196:6838/4142119667 2024-05-10T10:54:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.890+0000 7f8782462700 1 --2- 172.21.15.107:0/2513578352 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x5639f67cb360 0x5639f67cc7d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ae444b085225c9e7 server_cookie=4f661d1bb46ad47d in_seq=0 out_seq=0 2024-05-10T10:54:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.890+0000 7f8765ffb700 1 -- 172.21.15.107:0/2513578352 <== mds.2 v2:172.21.15.196:6838/4142119667 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5639f67112d0 con 0x5639f67cb360 2024-05-10T10:54:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.890+0000 7f8765ffb700 10 client.14991 handle_command_reply: tid=0 2024-05-10T10:54:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.890+0000 7f878ef59b80 1 client.14991 shutdown 2024-05-10T10:54:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.890+0000 7f878ef59b80 1 -- 172.21.15.107:0/2513578352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7a80 msgr2=0x5639f67bafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.890+0000 7f878ef59b80 1 --2- 172.21.15.107:0/2513578352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7a80 0x5639f67bafc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f877400aee0 tx=0x7f8774009d30 comp rx=0 tx=0).stop 2024-05-10T10:54:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.890+0000 7f878ef59b80 1 -- 172.21.15.107:0/2513578352 shutdown_connections 2024-05-10T10:54:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.890+0000 7f878ef59b80 1 --2- 172.21.15.107:0/2513578352 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x5639f67cb360 0x5639f67cc7d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.890+0000 7f878ef59b80 1 --2- 172.21.15.107:0/2513578352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7a80 0x5639f67bafc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.890+0000 7f878ef59b80 1 --2- 172.21.15.107:0/2513578352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b1d00 0x5639f67bd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.890+0000 7f878ef59b80 1 --2- 172.21.15.107:0/2513578352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b7160 0x5639f67baa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.891+0000 7f878ef59b80 1 -- 172.21.15.107:0/2513578352 >> 172.21.15.107:0/2513578352 conn(0x5639f66ddb20 msgr2=0x5639f67a6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:35.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.891+0000 7f8765ffb700 0 client.14991 ms_handle_reset on v2:172.21.15.196:6838/4142119667 2024-05-10T10:54:35.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.891+0000 7f878ef59b80 1 -- 172.21.15.107:0/2513578352 shutdown_connections 2024-05-10T10:54:35.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.891+0000 7f878ef59b80 1 -- 172.21.15.107:0/2513578352 wait complete. 2024-05-10T10:54:35.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.891+0000 7f878ef59b80 20 client.14991 trim_cache size 0 max 16384 2024-05-10T10:54:35.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.911+0000 7f878ef59b80 1 Processor -- start 2024-05-10T10:54:35.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.911+0000 7f878ef59b80 1 -- start start 2024-05-10T10:54:35.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.911+0000 7f878ef59b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b1d00 0x5639f67b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:35.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.911+0000 7f878ef59b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b7160 0x5639f67b8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:35.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.911+0000 7f878ef59b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b7a80 0x5639f67a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:35.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.911+0000 7f878ef59b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5639f67cab10 con 0x5639f67b1d00 2024-05-10T10:54:35.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.911+0000 7f878ef59b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5639f67cb1e0 con 0x5639f67b7160 2024-05-10T10:54:35.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.911+0000 7f878ef59b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5639f67cb8b0 con 0x5639f67b7a80 2024-05-10T10:54:35.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.912+0000 7f8782462700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b1d00 0x5639f67b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:35.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.912+0000 7f8782462700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b1d00 0x5639f67b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55748/0 (socket says 172.21.15.107:55748) 2024-05-10T10:54:35.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.912+0000 7f8782462700 1 -- 172.21.15.107:0/459050618 learned_addr learned my addr 172.21.15.107:0/459050618 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:35.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.912+0000 7f8782462700 1 -- 172.21.15.107:0/459050618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b7a80 msgr2=0x5639f67a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:35.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.912+0000 7f8782462700 1 --2- 172.21.15.107:0/459050618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b7a80 0x5639f67a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.912+0000 7f8782462700 1 -- 172.21.15.107:0/459050618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b7160 msgr2=0x5639f67b8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:35.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.912+0000 7f8781c61700 1 --2- 172.21.15.107:0/459050618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b7160 0x5639f67b8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:35.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.912+0000 7f8782462700 1 --2- 172.21.15.107:0/459050618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b7160 0x5639f67b8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.912+0000 7f8782462700 1 -- 172.21.15.107:0/459050618 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f67cb000 con 0x5639f67b1d00 2024-05-10T10:54:35.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.912+0000 7f8781c61700 1 --2- 172.21.15.107:0/459050618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b7160 0x5639f67b8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:54:35.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.912+0000 7f8782462700 1 --2- 172.21.15.107:0/459050618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b1d00 0x5639f67b20e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8778014040 tx=0x7f8778011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b68c3a9c88db78 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:35.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.912+0000 7f8767fff700 1 -- 172.21.15.107:0/459050618 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8778037070 con 0x5639f67b1d00 2024-05-10T10:54:35.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.912+0000 7f8767fff700 1 -- 172.21.15.107:0/459050618 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f877802b030 con 0x5639f67b1d00 2024-05-10T10:54:35.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.912+0000 7f8767fff700 1 -- 172.21.15.107:0/459050618 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8778022040 con 0x5639f67b1d00 2024-05-10T10:54:35.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.913+0000 7f878ef59b80 1 -- 172.21.15.107:0/459050618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b1d00 msgr2=0x5639f67b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:35.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.913+0000 7f878ef59b80 1 --2- 172.21.15.107:0/459050618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b1d00 0x5639f67b20e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8778014040 tx=0x7f8778011e30 comp rx=0 tx=0).stop 2024-05-10T10:54:35.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.913+0000 7f878ef59b80 1 -- 172.21.15.107:0/459050618 shutdown_connections 2024-05-10T10:54:35.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.913+0000 7f878ef59b80 1 --2- 172.21.15.107:0/459050618 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b7a80 0x5639f67a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.913+0000 7f878ef59b80 1 --2- 172.21.15.107:0/459050618 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b1d00 0x5639f67b20e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.913+0000 7f878ef59b80 1 --2- 172.21.15.107:0/459050618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b7160 0x5639f67b8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.913+0000 7f878ef59b80 1 -- 172.21.15.107:0/459050618 >> 172.21.15.107:0/459050618 conn(0x5639f66ddb20 msgr2=0x5639f67b7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:35.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.913+0000 7f878ef59b80 1 -- 172.21.15.107:0/459050618 shutdown_connections 2024-05-10T10:54:35.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.913+0000 7f878ef59b80 1 -- 172.21.15.107:0/459050618 wait complete. 2024-05-10T10:54:35.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.913+0000 7f878ef59b80 1 -- start start 2024-05-10T10:54:35.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.913+0000 7f878ef59b80 1 Processor -- start 2024-05-10T10:54:35.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.913+0000 7f878ef59b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b1d00 0x5639f6833200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:35.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.913+0000 7f878ef59b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b7160 0x5639f6833740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:35.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f878ef59b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7a80 0x5639f67d5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:35.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f878ef59b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5639f67cc650 con 0x5639f67b7a80 2024-05-10T10:54:35.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f878ef59b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5639f67cbf80 con 0x5639f67b7160 2024-05-10T10:54:35.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f878ef59b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5639f67ccd20 con 0x5639f67b1d00 2024-05-10T10:54:35.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f878ef59b80 10 client.0 _ll_register_callbacks cb 0x5639f6697560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:54:35.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f8782c63700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7a80 0x5639f67d5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:35.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f8782c63700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7a80 0x5639f67d5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:55758/0 (socket says 172.21.15.107:55758) 2024-05-10T10:54:35.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f8782c63700 1 -- 172.21.15.107:0/681334761 learned_addr learned my addr 172.21.15.107:0/681334761 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:35.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f8782462700 1 --2- 172.21.15.107:0/681334761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b1d00 0x5639f6833200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:35.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f8781c61700 1 --2- 172.21.15.107:0/681334761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b7160 0x5639f6833740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:35.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f8782c63700 1 -- 172.21.15.107:0/681334761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b1d00 msgr2=0x5639f6833200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:35.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f8782c63700 1 --2- 172.21.15.107:0/681334761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b1d00 0x5639f6833200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f8782c63700 1 -- 172.21.15.107:0/681334761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b7160 msgr2=0x5639f6833740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:35.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f8782c63700 1 --2- 172.21.15.107:0/681334761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b7160 0x5639f6833740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f8782c63700 1 -- 172.21.15.107:0/681334761 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639f67d5e00 con 0x5639f67b7a80 2024-05-10T10:54:35.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f8781c61700 1 --2- 172.21.15.107:0/681334761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b7160 0x5639f6833740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:54:35.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f8782c63700 1 --2- 172.21.15.107:0/681334761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7a80 0x5639f67d5700 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8774015930 tx=0x7f8774007170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee63f4080f021be server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:35.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f8765ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:54:35.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f8765ffb700 1 -- 172.21.15.107:0/681334761 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877402f060 con 0x5639f67b7a80 2024-05-10T10:54:35.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f8765ffb700 1 -- 172.21.15.107:0/681334761 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f8774007b30 con 0x5639f67b7a80 2024-05-10T10:54:35.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f878ef59b80 1 -- 172.21.15.107:0/681334761 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f877802b030 con 0x5639f67b7a80 2024-05-10T10:54:35.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f8765ffb700 1 -- 172.21.15.107:0/681334761 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8774007d70 con 0x5639f67b7a80 2024-05-10T10:54:35.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f878ef59b80 10 client.14997 fetch_fsmap learned FSMap version 26 2024-05-10T10:54:35.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.914+0000 7f878ef59b80 1 -- 172.21.15.107:0/681334761 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5639f683a9a0 con 0x5639f67b7a80 2024-05-10T10:54:35.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.915+0000 7f8765ffb700 1 -- 172.21.15.107:0/681334761 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f877802b030 con 0x5639f67b7a80 2024-05-10T10:54:35.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.915+0000 7f8765ffb700 1 -- 172.21.15.107:0/681334761 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f8774034070 con 0x5639f67b7a80 2024-05-10T10:54:35.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.915+0000 7f878ef59b80 10 client.14997 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:54:35.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.915+0000 7f878ef59b80 10 client.14997 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-10T10:54:35.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.915+0000 7f878ef59b80 20 client.14997 populate_metadata read hostname 'smithi107' 2024-05-10T10:54:35.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.915+0000 7f878ef59b80 1 --2- 172.21.15.107:0/681334761 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x5639f683f500 0x5639f683e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:35.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.915+0000 7f878ef59b80 4 client.14997 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T10:54:35.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.915+0000 7f878ef59b80 1 -- 172.21.15.107:0/681334761 --> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] -- command(tid 0: {"prefix": "status"}) -- 0x5639f670b370 con 0x5639f683f500 2024-05-10T10:54:35.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.915+0000 7f8782462700 1 --2- 172.21.15.107:0/681334761 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x5639f683f500 0x5639f683e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:35.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.916+0000 7f8765ffb700 10 client.14997 ms_handle_connect on v2:172.21.15.196:6838/4142119667 2024-05-10T10:54:35.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.916+0000 7f8782462700 1 --2- 172.21.15.107:0/681334761 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x5639f683f500 0x5639f683e210 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8bd63421889a912a server_cookie=853385095dfa63c6 in_seq=0 out_seq=0 2024-05-10T10:54:35.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.916+0000 7f8765ffb700 1 -- 172.21.15.107:0/681334761 <== mds.2 v2:172.21.15.196:6838/4142119667 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5639f670b370 con 0x5639f683f500 2024-05-10T10:54:35.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.916+0000 7f8765ffb700 10 client.14997 handle_command_reply: tid=0 2024-05-10T10:54:35.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.916+0000 7f878ef59b80 1 client.14997 shutdown 2024-05-10T10:54:35.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.916+0000 7f878ef59b80 1 -- 172.21.15.107:0/681334761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7a80 msgr2=0x5639f67d5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:35.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.916+0000 7f878ef59b80 1 --2- 172.21.15.107:0/681334761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7a80 0x5639f67d5700 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8774015930 tx=0x7f8774007170 comp rx=0 tx=0).stop 2024-05-10T10:54:35.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.916+0000 7f878ef59b80 1 -- 172.21.15.107:0/681334761 shutdown_connections 2024-05-10T10:54:35.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.916+0000 7f878ef59b80 1 --2- 172.21.15.107:0/681334761 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x5639f683f500 0x5639f683e210 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.916+0000 7f878ef59b80 1 --2- 172.21.15.107:0/681334761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5639f67b1d00 0x5639f6833200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.916+0000 7f878ef59b80 1 --2- 172.21.15.107:0/681334761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5639f67b7a80 0x5639f67d5700 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.916+0000 7f878ef59b80 1 --2- 172.21.15.107:0/681334761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5639f67b7160 0x5639f6833740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.916+0000 7f8765ffb700 0 client.14997 ms_handle_reset on v2:172.21.15.196:6838/4142119667 2024-05-10T10:54:35.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.916+0000 7f878ef59b80 1 -- 172.21.15.107:0/681334761 >> 172.21.15.107:0/681334761 conn(0x5639f66ddb20 msgr2=0x5639f67b5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:35.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.916+0000 7f878ef59b80 1 -- 172.21.15.107:0/681334761 shutdown_connections 2024-05-10T10:54:35.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.916+0000 7f878ef59b80 1 -- 172.21.15.107:0/681334761 wait complete. 2024-05-10T10:54:35.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.916+0000 7f878ef59b80 20 client.14997 trim_cache size 0 max 16384 2024-05-10T10:54:35.923 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:54:35.923 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "0ba8a8e4-0eba-11ef-bc98-c7b262605968", 2024-05-10T10:54:35.923 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 2, 2024-05-10T10:54:35.923 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24442, 2024-05-10T10:54:35.923 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2024-05-10T10:54:35.923 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2024-05-10T10:54:35.923 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2024-05-10T10:54:35.923 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 125.126560063, 2024-05-10T10:54:35.923 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 26, 2024-05-10T10:54:35.923 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 82, 2024-05-10T10:54:35.924 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 80, 2024-05-10T10:54:35.924 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 165.565421517 2024-05-10T10:54:35.924 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:54:35.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.917+0000 7f87846c6700 1 -- 172.21.15.107:0/4052192673 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87680b2880 msgr2=0x7f87680b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:35.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.917+0000 7f87846c6700 1 --2- 172.21.15.107:0/4052192673 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87680b2880 0x7f87680b4d40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8778005950 tx=0x7f87780058e0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.917+0000 7f87846c6700 1 -- 172.21.15.107:0/4052192673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f877c103f20 msgr2=0x7f877c19fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:35.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.917+0000 7f87846c6700 1 --2- 172.21.15.107:0/4052192673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f877c103f20 0x7f877c19fda0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f877000b580 tx=0x7f8770005e80 comp rx=0 tx=0).stop 2024-05-10T10:54:35.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.917+0000 7f87846c6700 1 -- 172.21.15.107:0/4052192673 shutdown_connections 2024-05-10T10:54:35.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.917+0000 7f87846c6700 1 --2- 172.21.15.107:0/4052192673 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87680b2880 0x7f87680b4d40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.917+0000 7f87846c6700 1 --2- 172.21.15.107:0/4052192673 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f877c103560 0x7f877c19f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.917+0000 7f87846c6700 1 --2- 172.21.15.107:0/4052192673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f877c109540 0x7f877c199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.917+0000 7f87846c6700 1 --2- 172.21.15.107:0/4052192673 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f877c103f20 0x7f877c19fda0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:35.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.917+0000 7f87846c6700 1 -- 172.21.15.107:0/4052192673 >> 172.21.15.107:0/4052192673 conn(0x7f877c07a660 msgr2=0x7f877c1021a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:35.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.917+0000 7f87846c6700 1 -- 172.21.15.107:0/4052192673 shutdown_connections 2024-05-10T10:54:35.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:35.917+0000 7f87846c6700 1 -- 172.21.15.107:0/4052192673 wait complete. 2024-05-10T10:54:36.589 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell mds.h status 2024-05-10T10:54:37.086 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:54:37.140 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:36 smithi184 ceph-mon[34585]: pgmap v356: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:54:37.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:36 smithi107 ceph-mon[30373]: pgmap v356: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:54:37.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:36 smithi196 ceph-mon[34872]: pgmap v356: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:54:38.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.709+0000 7f5b06525700 1 -- 172.21.15.107:0/1525209791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b00108450 msgr2=0x7f5b00108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:38.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.709+0000 7f5b06525700 1 --2- 172.21.15.107:0/1525209791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b00108450 0x7f5b00108830 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5af0009990 tx=0x7f5af0009ca0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.709+0000 7f5b06525700 1 -- 172.21.15.107:0/1525209791 shutdown_connections 2024-05-10T10:54:38.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.709+0000 7f5b06525700 1 --2- 172.21.15.107:0/1525209791 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b00102d90 0x7f5b0010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.709+0000 7f5b06525700 1 --2- 172.21.15.107:0/1525209791 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b00108450 0x7f5b00108830 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.709+0000 7f5b06525700 1 --2- 172.21.15.107:0/1525209791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b001023d0 0x7f5b00102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.709+0000 7f5b06525700 1 -- 172.21.15.107:0/1525209791 >> 172.21.15.107:0/1525209791 conn(0x7f5b00078410 msgr2=0x7f5b00078820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:38.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.709+0000 7f5b06525700 1 -- 172.21.15.107:0/1525209791 shutdown_connections 2024-05-10T10:54:38.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.710+0000 7f5b06525700 1 -- 172.21.15.107:0/1525209791 wait complete. 2024-05-10T10:54:38.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.710+0000 7f5b06525700 1 Processor -- start 2024-05-10T10:54:38.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.710+0000 7f5b06525700 1 -- start start 2024-05-10T10:54:38.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.711+0000 7f5b06525700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b001023d0 0x7f5b0019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:38.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.711+0000 7f5b06525700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b00102d90 0x7f5b0019b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:38.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.711+0000 7f5b06525700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b00108450 0x7f5b001a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:38.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.711+0000 7f5b06525700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5b00112700 con 0x7f5b001023d0 2024-05-10T10:54:38.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.711+0000 7f5b06525700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5b00112580 con 0x7f5b00102d90 2024-05-10T10:54:38.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.711+0000 7f5b06525700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5b00112880 con 0x7f5b00108450 2024-05-10T10:54:38.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.711+0000 7f5afffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b001023d0 0x7f5b0019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:38.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.711+0000 7f5afffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b001023d0 0x7f5b0019ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34040/0 (socket says 172.21.15.107:34040) 2024-05-10T10:54:38.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.711+0000 7f5afffff700 1 -- 172.21.15.107:0/2741817622 learned_addr learned my addr 172.21.15.107:0/2741817622 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:38.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.711+0000 7f5aff7fe700 1 --2- 172.21.15.107:0/2741817622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b00102d90 0x7f5b0019b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:38.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.711+0000 7f5b04ac2700 1 --2- 172.21.15.107:0/2741817622 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b00108450 0x7f5b001a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:38.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.711+0000 7f5afffff700 1 -- 172.21.15.107:0/2741817622 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b00108450 msgr2=0x7f5b001a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:38.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.711+0000 7f5afffff700 1 --2- 172.21.15.107:0/2741817622 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b00108450 0x7f5b001a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.711+0000 7f5afffff700 1 -- 172.21.15.107:0/2741817622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b00102d90 msgr2=0x7f5b0019b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:38.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.711+0000 7f5afffff700 1 --2- 172.21.15.107:0/2741817622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b00102d90 0x7f5b0019b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.711+0000 7f5afffff700 1 -- 172.21.15.107:0/2741817622 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b001a60e0 con 0x7f5b001023d0 2024-05-10T10:54:38.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.711+0000 7f5afffff700 1 --2- 172.21.15.107:0/2741817622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b001023d0 0x7f5b0019ab20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5af0000c00 tx=0x7f5af0009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:38.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.711+0000 7f5afd7fa700 1 -- 172.21.15.107:0/2741817622 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0027070 con 0x7f5b001023d0 2024-05-10T10:54:38.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.712+0000 7f5afd7fa700 1 -- 172.21.15.107:0/2741817622 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5af0004020 con 0x7f5b001023d0 2024-05-10T10:54:38.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.712+0000 7f5b06525700 1 -- 172.21.15.107:0/2741817622 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b001a62b0 con 0x7f5b001023d0 2024-05-10T10:54:38.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.712+0000 7f5afd7fa700 1 -- 172.21.15.107:0/2741817622 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0022df0 con 0x7f5b001023d0 2024-05-10T10:54:38.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.712+0000 7f5b06525700 1 -- 172.21.15.107:0/2741817622 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b001a6700 con 0x7f5b001023d0 2024-05-10T10:54:38.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.714+0000 7f5afd7fa700 1 -- 172.21.15.107:0/2741817622 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f5af002a070 con 0x7f5b001023d0 2024-05-10T10:54:38.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.715+0000 7f5afd7fa700 1 --2- 172.21.15.107:0/2741817622 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f5ae80b2880 0x7f5ae80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:38.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.715+0000 7f5aff7fe700 1 --2- 172.21.15.107:0/2741817622 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f5ae80b2880 0x7f5ae80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:38.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.715+0000 7f5afd7fa700 1 -- 172.21.15.107:0/2741817622 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f5af00e2df0 con 0x7f5b001023d0 2024-05-10T10:54:38.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.715+0000 7f5b10db8b80 1 Processor -- start 2024-05-10T10:54:38.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.715+0000 7f5b10db8b80 1 -- start start 2024-05-10T10:54:38.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.715+0000 7f5aff7fe700 1 --2- 172.21.15.107:0/2741817622 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f5ae80b2880 0x7f5ae80b4d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5b00078a80 tx=0x7f5af4009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:38.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.715+0000 7f5b10db8b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986b890 0x562ae986bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:38.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.715+0000 7f5b10db8b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986c1b0 0x562ae986fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:38.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.715+0000 7f5b10db8b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986fff0 0x562ae9870430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:38.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.715+0000 7f5b10db8b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562ae97b9810 con 0x562ae986b890 2024-05-10T10:54:38.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.715+0000 7f5b10db8b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562ae9758770 con 0x562ae986fff0 2024-05-10T10:54:38.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.715+0000 7f5b10db8b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562ae97b57d0 con 0x562ae986c1b0 2024-05-10T10:54:38.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.715+0000 7f5afffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986b890 0x562ae986bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:38.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.715+0000 7f5afffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986b890 0x562ae986bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34050/0 (socket says 172.21.15.107:34050) 2024-05-10T10:54:38.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.715+0000 7f5afffff700 1 -- 172.21.15.107:0/2850202214 learned_addr learned my addr 172.21.15.107:0/2850202214 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:38.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.716+0000 7f5b04ac2700 1 --2- 172.21.15.107:0/2850202214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986fff0 0x562ae9870430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:38.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.716+0000 7f5aff7fe700 1 --2- 172.21.15.107:0/2850202214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986c1b0 0x562ae986fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:38.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.716+0000 7f5afffff700 1 -- 172.21.15.107:0/2850202214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986c1b0 msgr2=0x562ae986fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:38.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.716+0000 7f5afffff700 1 --2- 172.21.15.107:0/2850202214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986c1b0 0x562ae986fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.721 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.716+0000 7f5afffff700 1 -- 172.21.15.107:0/2850202214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986fff0 msgr2=0x562ae9870430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:38.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.716+0000 7f5afffff700 1 --2- 172.21.15.107:0/2850202214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986fff0 0x562ae9870430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.716+0000 7f5afffff700 1 -- 172.21.15.107:0/2850202214 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ae9706880 con 0x562ae986b890 2024-05-10T10:54:38.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.716+0000 7f5aff7fe700 1 --2- 172.21.15.107:0/2850202214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986c1b0 0x562ae986fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:54:38.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.716+0000 7f5afffff700 1 --2- 172.21.15.107:0/2850202214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986b890 0x562ae986bc70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5af00e0900 tx=0x7f5af0009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7cd3c426748d44 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:38.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.716+0000 7f5ae67fc700 1 -- 172.21.15.107:0/2850202214 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af00aa540 con 0x562ae986b890 2024-05-10T10:54:38.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.716+0000 7f5ae67fc700 1 -- 172.21.15.107:0/2850202214 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5af00ae8f0 con 0x562ae986b890 2024-05-10T10:54:38.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.716+0000 7f5ae67fc700 1 -- 172.21.15.107:0/2850202214 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af00aa7a0 con 0x562ae986b890 2024-05-10T10:54:38.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.717+0000 7f5b10db8b80 1 -- 172.21.15.107:0/2850202214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986b890 msgr2=0x562ae986bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:38.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.717+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/2850202214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986b890 0x562ae986bc70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5af00e0900 tx=0x7f5af0009ca0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.717+0000 7f5b10db8b80 1 -- 172.21.15.107:0/2850202214 shutdown_connections 2024-05-10T10:54:38.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.717+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/2850202214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986fff0 0x562ae9870430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.717+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/2850202214 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986b890 0x562ae986bc70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.717+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/2850202214 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986c1b0 0x562ae986fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.717+0000 7f5b10db8b80 1 -- 172.21.15.107:0/2850202214 >> 172.21.15.107:0/2850202214 conn(0x562ae97930b0 msgr2=0x562ae9861c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:38.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.717+0000 7f5b10db8b80 1 -- 172.21.15.107:0/2850202214 shutdown_connections 2024-05-10T10:54:38.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.717+0000 7f5b10db8b80 1 -- 172.21.15.107:0/2850202214 wait complete. 2024-05-10T10:54:38.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.717+0000 7f5b10db8b80 1 -- start start 2024-05-10T10:54:38.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.717+0000 7f5b10db8b80 1 Processor -- start 2024-05-10T10:54:38.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5b10db8b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986b890 0x562ae98773f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:38.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5b10db8b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986c1b0 0x562ae9874790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:38.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5b10db8b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986fff0 0x562ae9874cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:38.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5b10db8b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562ae9877fe0 con 0x562ae986fff0 2024-05-10T10:54:38.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5b10db8b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562ae971fbe0 con 0x562ae986b890 2024-05-10T10:54:38.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5b10db8b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562ae9878160 con 0x562ae986c1b0 2024-05-10T10:54:38.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5b10db8b80 10 client.0 _ll_register_callbacks cb 0x562ae97518d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:54:38.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5b04ac2700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986fff0 0x562ae9874cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:38.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5b04ac2700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986fff0 0x562ae9874cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34056/0 (socket says 172.21.15.107:34056) 2024-05-10T10:54:38.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5b04ac2700 1 -- 172.21.15.107:0/4168759233 learned_addr learned my addr 172.21.15.107:0/4168759233 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:38.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5aff7fe700 1 --2- 172.21.15.107:0/4168759233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986c1b0 0x562ae9874790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:38.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5afffff700 1 --2- 172.21.15.107:0/4168759233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986b890 0x562ae98773f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:38.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5b04ac2700 1 -- 172.21.15.107:0/4168759233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986c1b0 msgr2=0x562ae9874790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:38.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5b04ac2700 1 --2- 172.21.15.107:0/4168759233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986c1b0 0x562ae9874790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5b04ac2700 1 -- 172.21.15.107:0/4168759233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986b890 msgr2=0x562ae98773f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:38.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5b04ac2700 1 --2- 172.21.15.107:0/4168759233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986b890 0x562ae98773f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5b04ac2700 1 -- 172.21.15.107:0/4168759233 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ae9755640 con 0x562ae986fff0 2024-05-10T10:54:38.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5afffff700 1 --2- 172.21.15.107:0/4168759233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986b890 0x562ae98773f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:54:38.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5b04ac2700 1 --2- 172.21.15.107:0/4168759233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986fff0 0x562ae9874cd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5af8007ba0 tx=0x7f5af8007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2bdad901adbe01 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:38.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5adf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:54:38.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5adf7fe700 1 -- 172.21.15.107:0/4168759233 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af801a020 con 0x562ae986fff0 2024-05-10T10:54:38.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5adf7fe700 1 -- 172.21.15.107:0/4168759233 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f5af80118a0 con 0x562ae986fff0 2024-05-10T10:54:38.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.718+0000 7f5b10db8b80 1 -- 172.21.15.107:0/4168759233 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5af00ae8f0 con 0x562ae986fff0 2024-05-10T10:54:38.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.719+0000 7f5adf7fe700 1 -- 172.21.15.107:0/4168759233 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5af8011aa0 con 0x562ae986fff0 2024-05-10T10:54:38.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.719+0000 7f5b10db8b80 10 client.15009 fetch_fsmap learned FSMap version 26 2024-05-10T10:54:38.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.719+0000 7f5b10db8b80 1 -- 172.21.15.107:0/4168759233 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562ae9882780 con 0x562ae986fff0 2024-05-10T10:54:38.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.719+0000 7f5adf7fe700 1 -- 172.21.15.107:0/4168759233 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5af00ae8f0 con 0x562ae986fff0 2024-05-10T10:54:38.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.719+0000 7f5adf7fe700 1 -- 172.21.15.107:0/4168759233 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f5af8021430 con 0x562ae986fff0 2024-05-10T10:54:38.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.719+0000 7f5b10db8b80 10 client.15009 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:54:38.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.719+0000 7f5b10db8b80 10 client.15009 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-10T10:54:38.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.719+0000 7f5b10db8b80 20 client.15009 populate_metadata read hostname 'smithi107' 2024-05-10T10:54:38.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.719+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/4168759233 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x562ae9884eb0 0x562ae9886320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:38.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.719+0000 7f5b10db8b80 4 client.15009 mds_command: new command op to 24449 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:54:38.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.719+0000 7f5b10db8b80 1 -- 172.21.15.107:0/4168759233 --> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ae9833600 con 0x562ae9884eb0 2024-05-10T10:54:38.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.719+0000 7f5afffff700 1 --2- 172.21.15.107:0/4168759233 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x562ae9884eb0 0x562ae9886320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:38.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.720+0000 7f5afffff700 1 --2- 172.21.15.107:0/4168759233 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x562ae9884eb0 0x562ae9886320 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f1955eb844a994c6 server_cookie=6ca52353e8d1e9f8 in_seq=0 out_seq=0 2024-05-10T10:54:38.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.720+0000 7f5adf7fe700 10 client.15009 ms_handle_connect on v2:172.21.15.184:6836/4239260328 2024-05-10T10:54:38.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.720+0000 7f5adf7fe700 1 -- 172.21.15.107:0/4168759233 <== mds.1 v2:172.21.15.184:6836/4239260328 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562ae9833600 con 0x562ae9884eb0 2024-05-10T10:54:38.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.720+0000 7f5adf7fe700 10 client.15009 handle_command_reply: tid=0 2024-05-10T10:54:38.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.720+0000 7f5b10db8b80 1 client.15009 shutdown 2024-05-10T10:54:38.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.721+0000 7f5b10db8b80 1 -- 172.21.15.107:0/4168759233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986fff0 msgr2=0x562ae9874cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:38.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.721+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/4168759233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986fff0 0x562ae9874cd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5af8007ba0 tx=0x7f5af8007eb0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.721+0000 7f5b10db8b80 1 -- 172.21.15.107:0/4168759233 shutdown_connections 2024-05-10T10:54:38.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.721+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/4168759233 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x562ae9884eb0 0x562ae9886320 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.721+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/4168759233 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986fff0 0x562ae9874cd0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.721+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/4168759233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986b890 0x562ae98773f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.721+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/4168759233 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986c1b0 0x562ae9874790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.721+0000 7f5adf7fe700 0 client.15009 ms_handle_reset on v2:172.21.15.184:6836/4239260328 2024-05-10T10:54:38.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.721+0000 7f5b10db8b80 1 -- 172.21.15.107:0/4168759233 >> 172.21.15.107:0/4168759233 conn(0x562ae97930b0 msgr2=0x562ae98703d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:38.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.721+0000 7f5b10db8b80 1 -- 172.21.15.107:0/4168759233 shutdown_connections 2024-05-10T10:54:38.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.721+0000 7f5b10db8b80 1 -- 172.21.15.107:0/4168759233 wait complete. 2024-05-10T10:54:38.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.721+0000 7f5b10db8b80 20 client.15009 trim_cache size 0 max 16384 2024-05-10T10:54:38.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.741+0000 7f5b10db8b80 1 Processor -- start 2024-05-10T10:54:38.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5b10db8b80 1 -- start start 2024-05-10T10:54:38.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5b10db8b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986b890 0x562ae9872300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:38.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5b10db8b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986c1b0 0x562ae985be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:38.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5b10db8b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986fff0 0x562ae985c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:38.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5b10db8b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562ae9884660 con 0x562ae986fff0 2024-05-10T10:54:38.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5b10db8b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562ae9884d30 con 0x562ae986c1b0 2024-05-10T10:54:38.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5b10db8b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562ae9885400 con 0x562ae986b890 2024-05-10T10:54:38.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5b04ac2700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986fff0 0x562ae985c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:38.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5b04ac2700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986fff0 0x562ae985c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34062/0 (socket says 172.21.15.107:34062) 2024-05-10T10:54:38.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5b04ac2700 1 -- 172.21.15.107:0/2394975421 learned_addr learned my addr 172.21.15.107:0/2394975421 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:38.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5afffff700 1 --2- 172.21.15.107:0/2394975421 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986b890 0x562ae9872300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:38.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5aff7fe700 1 --2- 172.21.15.107:0/2394975421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986c1b0 0x562ae985be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:38.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5b04ac2700 1 -- 172.21.15.107:0/2394975421 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986b890 msgr2=0x562ae9872300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5b04ac2700 1 --2- 172.21.15.107:0/2394975421 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986b890 0x562ae9872300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5b04ac2700 1 -- 172.21.15.107:0/2394975421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986c1b0 msgr2=0x562ae985be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5b04ac2700 1 --2- 172.21.15.107:0/2394975421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986c1b0 0x562ae985be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5b04ac2700 1 -- 172.21.15.107:0/2394975421 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ae985e7c0 con 0x562ae986fff0 2024-05-10T10:54:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5b04ac2700 1 --2- 172.21.15.107:0/2394975421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986fff0 0x562ae985c380 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5af8007b70 tx=0x7f5af8011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e6d0c85392bec0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5ae5ffb700 1 -- 172.21.15.107:0/2394975421 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af801a030 con 0x562ae986fff0 2024-05-10T10:54:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5ae5ffb700 1 -- 172.21.15.107:0/2394975421 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5af802f070 con 0x562ae986fff0 2024-05-10T10:54:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.742+0000 7f5ae5ffb700 1 -- 172.21.15.107:0/2394975421 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af802a480 con 0x562ae986fff0 2024-05-10T10:54:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.743+0000 7f5b10db8b80 1 -- 172.21.15.107:0/2394975421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986fff0 msgr2=0x562ae985c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.743+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/2394975421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986fff0 0x562ae985c380 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5af8007b70 tx=0x7f5af8011a30 comp rx=0 tx=0).stop 2024-05-10T10:54:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.743+0000 7f5b10db8b80 1 -- 172.21.15.107:0/2394975421 shutdown_connections 2024-05-10T10:54:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.743+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/2394975421 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986b890 0x562ae9872300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.743+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/2394975421 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986fff0 0x562ae985c380 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.743+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/2394975421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986c1b0 0x562ae985be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.743+0000 7f5b10db8b80 1 -- 172.21.15.107:0/2394975421 >> 172.21.15.107:0/2394975421 conn(0x562ae97930b0 msgr2=0x562ae9871bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.743+0000 7f5b10db8b80 1 -- 172.21.15.107:0/2394975421 shutdown_connections 2024-05-10T10:54:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.743+0000 7f5b10db8b80 1 -- 172.21.15.107:0/2394975421 wait complete. 2024-05-10T10:54:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.743+0000 7f5b10db8b80 1 -- start start 2024-05-10T10:54:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5b10db8b80 1 Processor -- start 2024-05-10T10:54:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5b10db8b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986b890 0x562ae98740d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5b10db8b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986c1b0 0x562ae9874610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5b10db8b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986fff0 0x562ae988bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5b10db8b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x562ae98861a0 con 0x562ae986c1b0 2024-05-10T10:54:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5b10db8b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562ae9885ad0 con 0x562ae986b890 2024-05-10T10:54:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5b10db8b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x562ae9886870 con 0x562ae986fff0 2024-05-10T10:54:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5b10db8b80 10 client.0 _ll_register_callbacks cb 0x562ae97518d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:54:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5aff7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986c1b0 0x562ae9874610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5aff7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986c1b0 0x562ae9874610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34074/0 (socket says 172.21.15.107:34074) 2024-05-10T10:54:38.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5aff7fe700 1 -- 172.21.15.107:0/263452665 learned_addr learned my addr 172.21.15.107:0/263452665 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5afffff700 1 --2- 172.21.15.107:0/263452665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986b890 0x562ae98740d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5b04ac2700 1 --2- 172.21.15.107:0/263452665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986fff0 0x562ae988bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5aff7fe700 1 -- 172.21.15.107:0/263452665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986fff0 msgr2=0x562ae988bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5aff7fe700 1 --2- 172.21.15.107:0/263452665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986fff0 0x562ae988bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5aff7fe700 1 -- 172.21.15.107:0/263452665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986b890 msgr2=0x562ae98740d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5aff7fe700 1 --2- 172.21.15.107:0/263452665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986b890 0x562ae98740d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5aff7fe700 1 -- 172.21.15.107:0/263452665 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ae988c2f0 con 0x562ae986c1b0 2024-05-10T10:54:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5afffff700 1 --2- 172.21.15.107:0/263452665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986b890 0x562ae98740d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:54:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5aff7fe700 1 --2- 172.21.15.107:0/263452665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986c1b0 0x562ae9874610 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x562ae98638a0 tx=0x7f5af4004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7bba11e1fbaf1b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.744+0000 7f5adf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:54:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.745+0000 7f5adf7fe700 1 -- 172.21.15.107:0/263452665 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af4026030 con 0x562ae986c1b0 2024-05-10T10:54:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.745+0000 7f5adf7fe700 1 -- 172.21.15.107:0/263452665 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f5af401b040 con 0x562ae986c1b0 2024-05-10T10:54:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.745+0000 7f5b10db8b80 1 -- 172.21.15.107:0/263452665 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5af802f070 con 0x562ae986c1b0 2024-05-10T10:54:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.745+0000 7f5adf7fe700 1 -- 172.21.15.107:0/263452665 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5af4005a50 con 0x562ae986c1b0 2024-05-10T10:54:38.751 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.745+0000 7f5b10db8b80 10 client.15015 fetch_fsmap learned FSMap version 26 2024-05-10T10:54:38.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.745+0000 7f5b10db8b80 1 -- 172.21.15.107:0/263452665 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562ae98f0990 con 0x562ae986c1b0 2024-05-10T10:54:38.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.745+0000 7f5adf7fe700 1 -- 172.21.15.107:0/263452665 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5af802f070 con 0x562ae986c1b0 2024-05-10T10:54:38.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.745+0000 7f5adf7fe700 1 -- 172.21.15.107:0/263452665 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f5af40062f0 con 0x562ae986c1b0 2024-05-10T10:54:38.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.745+0000 7f5b10db8b80 10 client.15015 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:54:38.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.745+0000 7f5b10db8b80 10 client.15015 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-10T10:54:38.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.745+0000 7f5b10db8b80 20 client.15015 populate_metadata read hostname 'smithi107' 2024-05-10T10:54:38.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.745+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/263452665 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x562ae98f55e0 0x562ae98f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:38.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.745+0000 7f5b10db8b80 4 client.15015 mds_command: new command op to 24449 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T10:54:38.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.745+0000 7f5b10db8b80 1 -- 172.21.15.107:0/263452665 --> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] -- command(tid 0: {"prefix": "status"}) -- 0x562ae97c71f0 con 0x562ae98f55e0 2024-05-10T10:54:38.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.746+0000 7f5afffff700 1 --2- 172.21.15.107:0/263452665 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x562ae98f55e0 0x562ae98f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:38.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.746+0000 7f5afffff700 1 --2- 172.21.15.107:0/263452665 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x562ae98f55e0 0x562ae98f42f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8fa71e548ad660d2 server_cookie=d0a6539bece0659b in_seq=0 out_seq=0 2024-05-10T10:54:38.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.746+0000 7f5adf7fe700 10 client.15015 ms_handle_connect on v2:172.21.15.184:6836/4239260328 2024-05-10T10:54:38.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.746+0000 7f5adf7fe700 1 -- 172.21.15.107:0/263452665 <== mds.1 v2:172.21.15.184:6836/4239260328 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562ae97c71f0 con 0x562ae98f55e0 2024-05-10T10:54:38.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.746+0000 7f5adf7fe700 10 client.15015 handle_command_reply: tid=0 2024-05-10T10:54:38.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.746+0000 7f5b10db8b80 1 client.15015 shutdown 2024-05-10T10:54:38.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.746+0000 7f5b10db8b80 1 -- 172.21.15.107:0/263452665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986c1b0 msgr2=0x562ae9874610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:38.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.746+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/263452665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986c1b0 0x562ae9874610 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x562ae98638a0 tx=0x7f5af4004860 comp rx=0 tx=0).stop 2024-05-10T10:54:38.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.746+0000 7f5b10db8b80 1 -- 172.21.15.107:0/263452665 shutdown_connections 2024-05-10T10:54:38.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.746+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/263452665 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x562ae98f55e0 0x562ae98f42f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.746+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/263452665 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x562ae986fff0 0x562ae988bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.746+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/263452665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562ae986b890 0x562ae98740d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.746+0000 7f5b10db8b80 1 --2- 172.21.15.107:0/263452665 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x562ae986c1b0 0x562ae9874610 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.746+0000 7f5b10db8b80 1 -- 172.21.15.107:0/263452665 >> 172.21.15.107:0/263452665 conn(0x562ae97930b0 msgr2=0x562ae985be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:38.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.746+0000 7f5adf7fe700 0 client.15015 ms_handle_reset on v2:172.21.15.184:6836/4239260328 2024-05-10T10:54:38.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.746+0000 7f5b10db8b80 1 -- 172.21.15.107:0/263452665 shutdown_connections 2024-05-10T10:54:38.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.746+0000 7f5b10db8b80 1 -- 172.21.15.107:0/263452665 wait complete. 2024-05-10T10:54:38.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.747+0000 7f5b10db8b80 20 client.15015 trim_cache size 0 max 16384 2024-05-10T10:54:38.754 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:54:38.754 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "0ba8a8e4-0eba-11ef-bc98-c7b262605968", 2024-05-10T10:54:38.754 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 1, 2024-05-10T10:54:38.754 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24449, 2024-05-10T10:54:38.754 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2024-05-10T10:54:38.754 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2024-05-10T10:54:38.754 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2024-05-10T10:54:38.754 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 128.96583539599999, 2024-05-10T10:54:38.754 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 26, 2024-05-10T10:54:38.754 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 82, 2024-05-10T10:54:38.754 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 80, 2024-05-10T10:54:38.755 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 171.11208171800001 2024-05-10T10:54:38.755 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:54:38.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.747+0000 7f5b06525700 1 -- 172.21.15.107:0/2741817622 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f5ae80b2880 msgr2=0x7f5ae80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:38.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.747+0000 7f5b06525700 1 --2- 172.21.15.107:0/2741817622 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f5ae80b2880 0x7f5ae80b4d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5b00078a80 tx=0x7f5af4009190 comp rx=0 tx=0).stop 2024-05-10T10:54:38.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.747+0000 7f5b06525700 1 -- 172.21.15.107:0/2741817622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b001023d0 msgr2=0x7f5b0019ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:38.755 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.747+0000 7f5b06525700 1 --2- 172.21.15.107:0/2741817622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b001023d0 0x7f5b0019ab20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5af0000c00 tx=0x7f5af0009f50 comp rx=0 tx=0).stop 2024-05-10T10:54:38.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.747+0000 7f5b06525700 1 -- 172.21.15.107:0/2741817622 shutdown_connections 2024-05-10T10:54:38.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.747+0000 7f5b06525700 1 --2- 172.21.15.107:0/2741817622 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f5ae80b2880 0x7f5ae80b4d40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.747+0000 7f5b06525700 1 --2- 172.21.15.107:0/2741817622 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5b00108450 0x7f5b001a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.747+0000 7f5b06525700 1 --2- 172.21.15.107:0/2741817622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5b001023d0 0x7f5b0019ab20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.747+0000 7f5b06525700 1 --2- 172.21.15.107:0/2741817622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b00102d90 0x7f5b0019b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:38.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.747+0000 7f5b06525700 1 -- 172.21.15.107:0/2741817622 >> 172.21.15.107:0/2741817622 conn(0x7f5b00078410 msgr2=0x7f5b00101060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:38.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.747+0000 7f5b06525700 1 -- 172.21.15.107:0/2741817622 shutdown_connections 2024-05-10T10:54:38.756 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:38.747+0000 7f5b06525700 1 -- 172.21.15.107:0/2741817622 wait complete. 2024-05-10T10:54:39.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:38 smithi184 ceph-mon[34585]: pgmap v357: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:39.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:38 smithi107 ceph-mon[30373]: pgmap v357: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:39.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:38 smithi196 ceph-mon[34872]: pgmap v357: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:39.422 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell mds.b status 2024-05-10T10:54:39.665 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:54:41.138 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:40 smithi107 ceph-mon[30373]: pgmap v358: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:54:41.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:40 smithi184 ceph-mon[34585]: pgmap v358: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:54:41.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:40 smithi196 ceph-mon[34872]: pgmap v358: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:54:41.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.375+0000 7fc6db943700 1 -- 172.21.15.107:0/1319929288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6d4108410 msgr2=0x7fc6d41087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:41.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.375+0000 7fc6db943700 1 --2- 172.21.15.107:0/1319929288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6d4108410 0x7fc6d41087f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4009990 tx=0x7fc6c4009ca0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.375+0000 7fc6db943700 1 -- 172.21.15.107:0/1319929288 shutdown_connections 2024-05-10T10:54:41.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.375+0000 7fc6db943700 1 --2- 172.21.15.107:0/1319929288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d4102d60 0x7fc6d410f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.375+0000 7fc6db943700 1 --2- 172.21.15.107:0/1319929288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6d4108410 0x7fc6d41087f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.375+0000 7fc6db943700 1 --2- 172.21.15.107:0/1319929288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d41023a0 0x7fc6d4102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.375+0000 7fc6db943700 1 -- 172.21.15.107:0/1319929288 >> 172.21.15.107:0/1319929288 conn(0x7fc6d4079350 msgr2=0x7fc6d4079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:41.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.375+0000 7fc6db943700 1 -- 172.21.15.107:0/1319929288 shutdown_connections 2024-05-10T10:54:41.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.376+0000 7fc6db943700 1 -- 172.21.15.107:0/1319929288 wait complete. 2024-05-10T10:54:41.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.376+0000 7fc6db943700 1 Processor -- start 2024-05-10T10:54:41.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.376+0000 7fc6db943700 1 -- start start 2024-05-10T10:54:41.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.376+0000 7fc6db943700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d41023a0 0x7fc6d419e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:41.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.376+0000 7fc6db943700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6d4102d60 0x7fc6d419ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:41.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.376+0000 7fc6db943700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d4108410 0x7fc6d41989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:41.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.376+0000 7fc6db943700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d4112690 con 0x7fc6d4102d60 2024-05-10T10:54:41.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.376+0000 7fc6db943700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d4112510 con 0x7fc6d4108410 2024-05-10T10:54:41.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.376+0000 7fc6db943700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d4112810 con 0x7fc6d41023a0 2024-05-10T10:54:41.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.376+0000 7fc6d8ede700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6d4102d60 0x7fc6d419ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:41.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.376+0000 7fc6d8ede700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6d4102d60 0x7fc6d419ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34102/0 (socket says 172.21.15.107:34102) 2024-05-10T10:54:41.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.376+0000 7fc6d8ede700 1 -- 172.21.15.107:0/3755669245 learned_addr learned my addr 172.21.15.107:0/3755669245 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:41.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.377+0000 7fc6d96df700 1 --2- 172.21.15.107:0/3755669245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d41023a0 0x7fc6d419e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:41.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.377+0000 7fc6d8ede700 1 -- 172.21.15.107:0/3755669245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d41023a0 msgr2=0x7fc6d419e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:41.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.377+0000 7fc6d8ede700 1 --2- 172.21.15.107:0/3755669245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d41023a0 0x7fc6d419e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.377+0000 7fc6d8ede700 1 -- 172.21.15.107:0/3755669245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d4108410 msgr2=0x7fc6d41989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:41.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.377+0000 7fc6d8ede700 1 --2- 172.21.15.107:0/3755669245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d4108410 0x7fc6d41989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.377+0000 7fc6d8ede700 1 -- 172.21.15.107:0/3755669245 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d4199110 con 0x7fc6d4102d60 2024-05-10T10:54:41.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.377+0000 7fc6d96df700 1 --2- 172.21.15.107:0/3755669245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d41023a0 0x7fc6d419e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:54:41.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.377+0000 7fc6d8ede700 1 --2- 172.21.15.107:0/3755669245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6d4102d60 0x7fc6d419ece0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000d980 tx=0x7fc6d000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:41.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.377+0000 7fc6ca7fc700 1 -- 172.21.15.107:0/3755669245 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0017070 con 0x7fc6d4102d60 2024-05-10T10:54:41.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.377+0000 7fc6ca7fc700 1 -- 172.21.15.107:0/3755669245 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc6d0004d00 con 0x7fc6d4102d60 2024-05-10T10:54:41.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.377+0000 7fc6db943700 1 -- 172.21.15.107:0/3755669245 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d4199400 con 0x7fc6d4102d60 2024-05-10T10:54:41.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.377+0000 7fc6ca7fc700 1 -- 172.21.15.107:0/3755669245 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0005500 con 0x7fc6d4102d60 2024-05-10T10:54:41.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.377+0000 7fc6db943700 1 -- 172.21.15.107:0/3755669245 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d406bc30 con 0x7fc6d4102d60 2024-05-10T10:54:41.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.380+0000 7fc6ca7fc700 1 -- 172.21.15.107:0/3755669245 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fc6d0009b40 con 0x7fc6d4102d60 2024-05-10T10:54:41.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.381+0000 7fc6ca7fc700 1 --2- 172.21.15.107:0/3755669245 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc6c00b2880 0x7fc6c00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:41.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.381+0000 7fc6d96df700 1 --2- 172.21.15.107:0/3755669245 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc6c00b2880 0x7fc6c00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:41.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.381+0000 7fc6ca7fc700 1 -- 172.21.15.107:0/3755669245 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fc6d00e22b0 con 0x7fc6d4102d60 2024-05-10T10:54:41.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.381+0000 7fc6d96df700 1 --2- 172.21.15.107:0/3755669245 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc6c00b2880 0x7fc6c00b4d40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4000c00 tx=0x7fc6c4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:41.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.381+0000 7fc6e61d6b80 1 Processor -- start 2024-05-10T10:54:41.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.381+0000 7fc6e61d6b80 1 -- start start 2024-05-10T10:54:41.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.381+0000 7fc6e61d6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40ac160 0x5651f40ac540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:41.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.381+0000 7fc6e61d6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40aca80 0x5651f40a67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:41.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.381+0000 7fc6e61d6b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40a6d00 0x5651f40a7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:41.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.381+0000 7fc6e61d6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5651f3ff88f0 con 0x5651f40aca80 2024-05-10T10:54:41.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.381+0000 7fc6e61d6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5651f3f5dd50 con 0x5651f40ac160 2024-05-10T10:54:41.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.381+0000 7fc6e61d6b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5651f3ff48b0 con 0x5651f40a6d00 2024-05-10T10:54:41.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.382+0000 7fc6d8ede700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40aca80 0x5651f40a67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:41.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.382+0000 7fc6d8ede700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40aca80 0x5651f40a67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34108/0 (socket says 172.21.15.107:34108) 2024-05-10T10:54:41.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.382+0000 7fc6d8ede700 1 -- 172.21.15.107:0/3248251919 learned_addr learned my addr 172.21.15.107:0/3248251919 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:41.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.382+0000 7fc6d9ee0700 1 --2- 172.21.15.107:0/3248251919 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40a6d00 0x5651f40a7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:41.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.382+0000 7fc6d96df700 1 --2- 172.21.15.107:0/3248251919 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40ac160 0x5651f40ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:41.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.382+0000 7fc6d8ede700 1 -- 172.21.15.107:0/3248251919 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40a6d00 msgr2=0x5651f40a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:41.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.382+0000 7fc6d8ede700 1 --2- 172.21.15.107:0/3248251919 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40a6d00 0x5651f40a7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.382+0000 7fc6d8ede700 1 -- 172.21.15.107:0/3248251919 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40ac160 msgr2=0x5651f40ac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:41.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.382+0000 7fc6d8ede700 1 --2- 172.21.15.107:0/3248251919 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40ac160 0x5651f40ac540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.382+0000 7fc6d8ede700 1 -- 172.21.15.107:0/3248251919 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651f3f45880 con 0x5651f40aca80 2024-05-10T10:54:41.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.382+0000 7fc6d8ede700 1 --2- 172.21.15.107:0/3248251919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40aca80 0x5651f40a67c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00a5950 tx=0x7fc6d00a9460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf62a0316a8b158 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:41.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.382+0000 7fc6bf7fe700 1 -- 172.21.15.107:0/3248251919 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d00a98d0 con 0x5651f40aca80 2024-05-10T10:54:41.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.382+0000 7fc6bf7fe700 1 -- 172.21.15.107:0/3248251919 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc6d00adc80 con 0x5651f40aca80 2024-05-10T10:54:41.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.382+0000 7fc6bf7fe700 1 -- 172.21.15.107:0/3248251919 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d00b22a0 con 0x5651f40aca80 2024-05-10T10:54:41.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.383+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/3248251919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40aca80 msgr2=0x5651f40a67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:41.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.383+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/3248251919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40aca80 0x5651f40a67c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00a5950 tx=0x7fc6d00a9460 comp rx=0 tx=0).stop 2024-05-10T10:54:41.388 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.383+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/3248251919 shutdown_connections 2024-05-10T10:54:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.383+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/3248251919 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40a6d00 0x5651f40a7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.383+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/3248251919 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40ac160 0x5651f40ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.383+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/3248251919 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40aca80 0x5651f40a67c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.383+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/3248251919 >> 172.21.15.107:0/3248251919 conn(0x5651f3fd2b20 msgr2=0x5651f40a1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.383+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/3248251919 shutdown_connections 2024-05-10T10:54:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.383+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/3248251919 wait complete. 2024-05-10T10:54:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.383+0000 7fc6e61d6b80 1 -- start start 2024-05-10T10:54:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.383+0000 7fc6e61d6b80 1 Processor -- start 2024-05-10T10:54:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6e61d6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40a6d00 0x5651f40b2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6e61d6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40ac160 0x5651f40afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6e61d6b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40aca80 0x5651f40b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6e61d6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5651f40b33a0 con 0x5651f40a6d00 2024-05-10T10:54:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6e61d6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5651f3fb1e80 con 0x5651f40ac160 2024-05-10T10:54:41.389 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6e61d6b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5651f40b3520 con 0x5651f40aca80 2024-05-10T10:54:41.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6e61d6b80 10 client.0 _ll_register_callbacks cb 0x5651f3f8c560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:54:41.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6d96df700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40a6d00 0x5651f40b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:41.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6d96df700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40a6d00 0x5651f40b2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34114/0 (socket says 172.21.15.107:34114) 2024-05-10T10:54:41.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6d96df700 1 -- 172.21.15.107:0/953413284 learned_addr learned my addr 172.21.15.107:0/953413284 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:41.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6d8ede700 1 --2- 172.21.15.107:0/953413284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40ac160 0x5651f40afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:41.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6d9ee0700 1 --2- 172.21.15.107:0/953413284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40aca80 0x5651f40b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:41.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6d96df700 1 -- 172.21.15.107:0/953413284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40aca80 msgr2=0x5651f40b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:41.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6d96df700 1 --2- 172.21.15.107:0/953413284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40aca80 0x5651f40b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6d96df700 1 -- 172.21.15.107:0/953413284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40ac160 msgr2=0x5651f40afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:41.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6d96df700 1 --2- 172.21.15.107:0/953413284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40ac160 0x5651f40afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6d96df700 1 -- 172.21.15.107:0/953413284 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651f3faf710 con 0x5651f40a6d00 2024-05-10T10:54:41.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6d9ee0700 1 --2- 172.21.15.107:0/953413284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40aca80 0x5651f40b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:54:41.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6d96df700 1 --2- 172.21.15.107:0/953413284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40a6d00 0x5651f40b2750 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4005070 tx=0x7fc6c4009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5616a1d277940ce server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:41.390 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6bcff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:54:41.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.384+0000 7fc6bcff9700 1 -- 172.21.15.107:0/953413284 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c400bbe0 con 0x5651f40a6d00 2024-05-10T10:54:41.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.385+0000 7fc6bcff9700 1 -- 172.21.15.107:0/953413284 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fc6c400bd80 con 0x5651f40a6d00 2024-05-10T10:54:41.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.385+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/953413284 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6d00adc80 con 0x5651f40a6d00 2024-05-10T10:54:41.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.385+0000 7fc6bcff9700 1 -- 172.21.15.107:0/953413284 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc6c400f460 con 0x5651f40a6d00 2024-05-10T10:54:41.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.385+0000 7fc6e61d6b80 10 client.15027 fetch_fsmap learned FSMap version 26 2024-05-10T10:54:41.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.385+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/953413284 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5651f40bdd00 con 0x5651f40a6d00 2024-05-10T10:54:41.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.385+0000 7fc6bcff9700 1 -- 172.21.15.107:0/953413284 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc6d00adc80 con 0x5651f40a6d00 2024-05-10T10:54:41.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.385+0000 7fc6bcff9700 1 -- 172.21.15.107:0/953413284 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc6c402d070 con 0x5651f40a6d00 2024-05-10T10:54:41.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.385+0000 7fc6e61d6b80 10 client.15027 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:54:41.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.385+0000 7fc6e61d6b80 10 client.15027 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T10:54:41.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.385+0000 7fc6e61d6b80 20 client.15027 populate_metadata read hostname 'smithi107' 2024-05-10T10:54:41.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.385+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/953413284 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5651f40c0320 0x5651f40c1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:41.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.385+0000 7fc6e61d6b80 4 client.15027 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:54:41.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.385+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/953413284 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651f40062d0 con 0x5651f40c0320 2024-05-10T10:54:41.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.385+0000 7fc6d8ede700 1 --2- 172.21.15.107:0/953413284 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5651f40c0320 0x5651f40c1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:41.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.386+0000 7fc6d8ede700 1 --2- 172.21.15.107:0/953413284 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5651f40c0320 0x5651f40c1790 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78cc57137ba2f0f server_cookie=18a6857fd67371f0 in_seq=0 out_seq=0 2024-05-10T10:54:41.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.386+0000 7fc6bcff9700 10 client.15027 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:54:41.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.387+0000 7fc6bcff9700 1 -- 172.21.15.107:0/953413284 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5651f40062d0 con 0x5651f40c0320 2024-05-10T10:54:41.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.387+0000 7fc6bcff9700 10 client.15027 handle_command_reply: tid=0 2024-05-10T10:54:41.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.387+0000 7fc6e61d6b80 1 client.15027 shutdown 2024-05-10T10:54:41.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.387+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/953413284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40a6d00 msgr2=0x5651f40b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:41.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.387+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/953413284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40a6d00 0x5651f40b2750 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4005070 tx=0x7fc6c4009ca0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.387+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/953413284 shutdown_connections 2024-05-10T10:54:41.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.387+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/953413284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40aca80 0x5651f40b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.387+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/953413284 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5651f40c0320 0x5651f40c1790 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.387+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/953413284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40a6d00 0x5651f40b2750 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.387+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/953413284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40ac160 0x5651f40afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.387+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/953413284 >> 172.21.15.107:0/953413284 conn(0x5651f3fd2b20 msgr2=0x5651f409bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:41.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.387+0000 7fc6bcff9700 0 client.15027 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:54:41.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.387+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/953413284 shutdown_connections 2024-05-10T10:54:41.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.387+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/953413284 wait complete. 2024-05-10T10:54:41.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.387+0000 7fc6e61d6b80 20 client.15027 trim_cache size 0 max 16384 2024-05-10T10:54:41.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.408+0000 7fc6e61d6b80 1 Processor -- start 2024-05-10T10:54:41.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.408+0000 7fc6e61d6b80 1 -- start start 2024-05-10T10:54:41.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.408+0000 7fc6e61d6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40a6d00 0x5651f40a67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:41.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.408+0000 7fc6e61d6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40ac160 0x5651f40b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:41.414 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.408+0000 7fc6e61d6b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40aca80 0x5651f409bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.408+0000 7fc6e61d6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5651f40bfad0 con 0x5651f40ac160 2024-05-10T10:54:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.408+0000 7fc6e61d6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5651f40c01a0 con 0x5651f40a6d00 2024-05-10T10:54:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.408+0000 7fc6e61d6b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5651f40c0870 con 0x5651f40aca80 2024-05-10T10:54:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.409+0000 7fc6d8ede700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40ac160 0x5651f40b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.409+0000 7fc6d8ede700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40ac160 0x5651f40b1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34124/0 (socket says 172.21.15.107:34124) 2024-05-10T10:54:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.409+0000 7fc6d8ede700 1 -- 172.21.15.107:0/1806885922 learned_addr learned my addr 172.21.15.107:0/1806885922 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.409+0000 7fc6d96df700 1 --2- 172.21.15.107:0/1806885922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40a6d00 0x5651f40a67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.409+0000 7fc6d8ede700 1 -- 172.21.15.107:0/1806885922 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40aca80 msgr2=0x5651f409bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.409+0000 7fc6d8ede700 1 --2- 172.21.15.107:0/1806885922 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40aca80 0x5651f409bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.409+0000 7fc6d8ede700 1 -- 172.21.15.107:0/1806885922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40a6d00 msgr2=0x5651f40a67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.409+0000 7fc6d8ede700 1 --2- 172.21.15.107:0/1806885922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40a6d00 0x5651f40a67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.409+0000 7fc6d8ede700 1 -- 172.21.15.107:0/1806885922 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651f40a2c90 con 0x5651f40ac160 2024-05-10T10:54:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.409+0000 7fc6d96df700 1 --2- 172.21.15.107:0/1806885922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40a6d00 0x5651f40a67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:54:41.415 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.409+0000 7fc6d8ede700 1 --2- 172.21.15.107:0/1806885922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40ac160 0x5651f40b1f60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00a95d0 tx=0x7fc6d00b2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26d1a5728078a7b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.409+0000 7fc6beffd700 1 -- 172.21.15.107:0/1806885922 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d00056a0 con 0x5651f40ac160 2024-05-10T10:54:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.409+0000 7fc6beffd700 1 -- 172.21.15.107:0/1806885922 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc6d00a98d0 con 0x5651f40ac160 2024-05-10T10:54:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.409+0000 7fc6beffd700 1 -- 172.21.15.107:0/1806885922 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d00b22a0 con 0x5651f40ac160 2024-05-10T10:54:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.410+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/1806885922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40ac160 msgr2=0x5651f40b1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.410+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/1806885922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40ac160 0x5651f40b1f60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00a95d0 tx=0x7fc6d00b2040 comp rx=0 tx=0).stop 2024-05-10T10:54:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.410+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/1806885922 shutdown_connections 2024-05-10T10:54:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.410+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/1806885922 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40aca80 0x5651f409bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.410+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/1806885922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40a6d00 0x5651f40a67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.410+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/1806885922 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40ac160 0x5651f40b1f60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.410+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/1806885922 >> 172.21.15.107:0/1806885922 conn(0x5651f3fd2b20 msgr2=0x5651f40ae3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.410+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/1806885922 shutdown_connections 2024-05-10T10:54:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.410+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/1806885922 wait complete. 2024-05-10T10:54:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.410+0000 7fc6e61d6b80 1 -- start start 2024-05-10T10:54:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.410+0000 7fc6e61d6b80 1 Processor -- start 2024-05-10T10:54:41.416 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6e61d6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40a6d00 0x5651f409adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6e61d6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40ac160 0x5651f409b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6e61d6b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40aca80 0x5651f40c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6e61d6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5651f40c1610 con 0x5651f40a6d00 2024-05-10T10:54:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6e61d6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5651f40c0f40 con 0x5651f40ac160 2024-05-10T10:54:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6e61d6b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5651f40c1ce0 con 0x5651f40aca80 2024-05-10T10:54:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6e61d6b80 10 client.0 _ll_register_callbacks cb 0x5651f3f8c560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:54:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6d96df700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40a6d00 0x5651f409adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6d96df700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40a6d00 0x5651f409adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34134/0 (socket says 172.21.15.107:34134) 2024-05-10T10:54:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6d96df700 1 -- 172.21.15.107:0/4141207133 learned_addr learned my addr 172.21.15.107:0/4141207133 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6d8ede700 1 --2- 172.21.15.107:0/4141207133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40ac160 0x5651f409b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6d9ee0700 1 --2- 172.21.15.107:0/4141207133 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40aca80 0x5651f40c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6d96df700 1 -- 172.21.15.107:0/4141207133 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40aca80 msgr2=0x5651f40c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6d96df700 1 --2- 172.21.15.107:0/4141207133 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40aca80 0x5651f40c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6d96df700 1 -- 172.21.15.107:0/4141207133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40ac160 msgr2=0x5651f409b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:54:41.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6d96df700 1 --2- 172.21.15.107:0/4141207133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40ac160 0x5651f409b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6d96df700 1 -- 172.21.15.107:0/4141207133 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651f40ca140 con 0x5651f40a6d00 2024-05-10T10:54:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6d96df700 1 --2- 172.21.15.107:0/4141207133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40a6d00 0x5651f409adc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc6c402f880 tx=0x7fc6c402f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d84e3ca88fbde8f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6bcff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:54:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6bcff9700 1 -- 172.21.15.107:0/4141207133 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c400bbe0 con 0x5651f40a6d00 2024-05-10T10:54:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6bcff9700 1 -- 172.21.15.107:0/4141207133 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fc6c400bd80 con 0x5651f40a6d00 2024-05-10T10:54:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.411+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/4141207133 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6d00a98d0 con 0x5651f40a6d00 2024-05-10T10:54:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.412+0000 7fc6bcff9700 1 -- 172.21.15.107:0/4141207133 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc6c400f600 con 0x5651f40a6d00 2024-05-10T10:54:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.412+0000 7fc6e61d6b80 10 client.15033 fetch_fsmap learned FSMap version 26 2024-05-10T10:54:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.412+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/4141207133 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5651f40cb380 con 0x5651f40a6d00 2024-05-10T10:54:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.412+0000 7fc6bcff9700 1 -- 172.21.15.107:0/4141207133 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc6d00a98d0 con 0x5651f40a6d00 2024-05-10T10:54:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.412+0000 7fc6bcff9700 1 -- 172.21.15.107:0/4141207133 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc6c402d030 con 0x5651f40a6d00 2024-05-10T10:54:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.412+0000 7fc6e61d6b80 10 client.15033 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:54:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.412+0000 7fc6e61d6b80 10 client.15033 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T10:54:41.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.412+0000 7fc6e61d6b80 20 client.15033 populate_metadata read hostname 'smithi107' 2024-05-10T10:54:41.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.412+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/4141207133 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5651f412fe70 0x5651f412eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:41.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.412+0000 7fc6e61d6b80 4 client.15033 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T10:54:41.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.412+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/4141207133 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "status"}) -- 0x5651f4000370 con 0x5651f412fe70 2024-05-10T10:54:41.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.412+0000 7fc6d8ede700 1 --2- 172.21.15.107:0/4141207133 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5651f412fe70 0x5651f412eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:41.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.413+0000 7fc6d8ede700 1 --2- 172.21.15.107:0/4141207133 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5651f412fe70 0x5651f412eb80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ad96f07a6aca483 server_cookie=78554365ea247129 in_seq=0 out_seq=0 2024-05-10T10:54:41.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.413+0000 7fc6bcff9700 10 client.15033 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:54:41.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.413+0000 7fc6bcff9700 1 -- 172.21.15.107:0/4141207133 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5651f4000370 con 0x5651f412fe70 2024-05-10T10:54:41.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.413+0000 7fc6bcff9700 10 client.15033 handle_command_reply: tid=0 2024-05-10T10:54:41.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.413+0000 7fc6e61d6b80 1 client.15033 shutdown 2024-05-10T10:54:41.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.413+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/4141207133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40a6d00 msgr2=0x5651f409adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:41.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.413+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/4141207133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40a6d00 0x5651f409adc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc6c402f880 tx=0x7fc6c402f6f0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.413+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/4141207133 shutdown_connections 2024-05-10T10:54:41.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.413+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/4141207133 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5651f40aca80 0x5651f40c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.413+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/4141207133 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5651f412fe70 0x5651f412eb80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.413+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/4141207133 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5651f40a6d00 0x5651f409adc0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.413+0000 7fc6bcff9700 0 client.15033 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:54:41.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.413+0000 7fc6e61d6b80 1 --2- 172.21.15.107:0/4141207133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5651f40ac160 0x5651f409b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.413+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/4141207133 >> 172.21.15.107:0/4141207133 conn(0x5651f3fd2b20 msgr2=0x5651f40ace60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:41.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.413+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/4141207133 shutdown_connections 2024-05-10T10:54:41.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.413+0000 7fc6e61d6b80 1 -- 172.21.15.107:0/4141207133 wait complete. 2024-05-10T10:54:41.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.413+0000 7fc6e61d6b80 20 client.15033 trim_cache size 0 max 16384 2024-05-10T10:54:41.420 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:54:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "0ba8a8e4-0eba-11ef-bc98-c7b262605968", 2024-05-10T10:54:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 0, 2024-05-10T10:54:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24482, 2024-05-10T10:54:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2024-05-10T10:54:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2024-05-10T10:54:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2024-05-10T10:54:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 143.73115608099999, 2024-05-10T10:54:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 26, 2024-05-10T10:54:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 82, 2024-05-10T10:54:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 80, 2024-05-10T10:54:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 159.29119327199999 2024-05-10T10:54:41.422 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:54:41.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.414+0000 7fc6db943700 1 -- 172.21.15.107:0/3755669245 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc6c00b2880 msgr2=0x7fc6c00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:41.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.414+0000 7fc6db943700 1 --2- 172.21.15.107:0/3755669245 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc6c00b2880 0x7fc6c00b4d40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4000c00 tx=0x7fc6c4005fb0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.414+0000 7fc6db943700 1 -- 172.21.15.107:0/3755669245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6d4102d60 msgr2=0x7fc6d419ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:41.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.414+0000 7fc6db943700 1 --2- 172.21.15.107:0/3755669245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6d4102d60 0x7fc6d419ece0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000d980 tx=0x7fc6d000dd40 comp rx=0 tx=0).stop 2024-05-10T10:54:41.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.414+0000 7fc6db943700 1 -- 172.21.15.107:0/3755669245 shutdown_connections 2024-05-10T10:54:41.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.414+0000 7fc6db943700 1 --2- 172.21.15.107:0/3755669245 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc6c00b2880 0x7fc6c00b4d40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.414+0000 7fc6db943700 1 --2- 172.21.15.107:0/3755669245 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6d41023a0 0x7fc6d419e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.414+0000 7fc6db943700 1 --2- 172.21.15.107:0/3755669245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6d4108410 0x7fc6d41989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.414+0000 7fc6db943700 1 --2- 172.21.15.107:0/3755669245 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc6d4102d60 0x7fc6d419ece0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:41.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.414+0000 7fc6db943700 1 -- 172.21.15.107:0/3755669245 >> 172.21.15.107:0/3755669245 conn(0x7fc6d4079350 msgr2=0x7fc6d4100ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:41.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.414+0000 7fc6db943700 1 -- 172.21.15.107:0/3755669245 shutdown_connections 2024-05-10T10:54:41.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:41.414+0000 7fc6db943700 1 -- 172.21.15.107:0/3755669245 wait complete. 2024-05-10T10:54:42.114 INFO:tasks.cephadm:Setup complete, yielding 2024-05-10T10:54:42.115 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-10T10:54:42.127 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi107.front.sepia.ceph.com 2024-05-10T10:54:42.127 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- bash -c 'ceph orch status' 2024-05-10T10:54:42.372 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:54:43.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:42 smithi184 ceph-mon[34585]: pgmap v359: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:54:43.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:42 smithi107 ceph-mon[30373]: pgmap v359: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:54:43.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:42 smithi196 ceph-mon[34872]: pgmap v359: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:54:44.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.022+0000 7f7dbf6be700 1 -- 172.21.15.107:0/993089758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db8104790 msgr2=0x7f7db8104bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:44.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.022+0000 7f7dbf6be700 1 --2- 172.21.15.107:0/993089758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db8104790 0x7f7db8104bf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009990 tx=0x7f7da8009ca0 comp rx=0 tx=0).stop 2024-05-10T10:54:44.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.022+0000 7f7dbf6be700 1 -- 172.21.15.107:0/993089758 shutdown_connections 2024-05-10T10:54:44.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.022+0000 7f7dbf6be700 1 --2- 172.21.15.107:0/993089758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7db8105130 0x7f7db810b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:44.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.022+0000 7f7dbf6be700 1 --2- 172.21.15.107:0/993089758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7db81017b0 0x7f7db8101bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:44.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.022+0000 7f7dbf6be700 1 --2- 172.21.15.107:0/993089758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db8104790 0x7f7db8104bf0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:44.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.022+0000 7f7dbf6be700 1 -- 172.21.15.107:0/993089758 >> 172.21.15.107:0/993089758 conn(0x7f7db80fd130 msgr2=0x7f7db80ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:44.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.022+0000 7f7dbf6be700 1 -- 172.21.15.107:0/993089758 shutdown_connections 2024-05-10T10:54:44.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.022+0000 7f7dbf6be700 1 -- 172.21.15.107:0/993089758 wait complete. 2024-05-10T10:54:44.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbf6be700 1 Processor -- start 2024-05-10T10:54:44.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbf6be700 1 -- start start 2024-05-10T10:54:44.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbf6be700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db81017b0 0x7f7db8199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:44.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbf6be700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7db8104790 0x7f7db8199d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:44.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbf6be700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7db8105130 0x7f7db81a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:44.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbf6be700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7db810f1b0 con 0x7f7db81017b0 2024-05-10T10:54:44.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbf6be700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7db810f030 con 0x7f7db8104790 2024-05-10T10:54:44.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbf6be700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7db810f330 con 0x7f7db8105130 2024-05-10T10:54:44.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbd45a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db81017b0 0x7f7db8199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:44.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbd45a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db81017b0 0x7f7db8199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:34156/0 (socket says 172.21.15.107:34156) 2024-05-10T10:54:44.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbd45a700 1 -- 172.21.15.107:0/3831435029 learned_addr learned my addr 172.21.15.107:0/3831435029 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:44.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbcc59700 1 --2- 172.21.15.107:0/3831435029 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7db8104790 0x7f7db8199d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:44.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbdc5b700 1 --2- 172.21.15.107:0/3831435029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7db8105130 0x7f7db81a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:44.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbd45a700 1 -- 172.21.15.107:0/3831435029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7db8105130 msgr2=0x7f7db81a0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:44.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbd45a700 1 --2- 172.21.15.107:0/3831435029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7db8105130 0x7f7db81a0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:44.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbd45a700 1 -- 172.21.15.107:0/3831435029 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7db8104790 msgr2=0x7f7db8199d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:44.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbd45a700 1 --2- 172.21.15.107:0/3831435029 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7db8104790 0x7f7db8199d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:44.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbd45a700 1 -- 172.21.15.107:0/3831435029 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db81a14b0 con 0x7f7db81017b0 2024-05-10T10:54:44.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbcc59700 1 --2- 172.21.15.107:0/3831435029 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7db8104790 0x7f7db8199d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:54:44.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbd45a700 1 --2- 172.21.15.107:0/3831435029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db81017b0 0x7f7db8199850 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7db000b9f0 tx=0x7f7db000bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:44.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dae7fc700 1 -- 172.21.15.107:0/3831435029 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db0019070 con 0x7f7db81017b0 2024-05-10T10:54:44.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dae7fc700 1 -- 172.21.15.107:0/3831435029 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7db0014440 con 0x7f7db81017b0 2024-05-10T10:54:44.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.023+0000 7f7dbf6be700 1 -- 172.21.15.107:0/3831435029 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db81a17a0 con 0x7f7db81017b0 2024-05-10T10:54:44.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.024+0000 7f7dae7fc700 1 -- 172.21.15.107:0/3831435029 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db00125a0 con 0x7f7db81017b0 2024-05-10T10:54:44.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.024+0000 7f7dbf6be700 1 -- 172.21.15.107:0/3831435029 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db81a1db0 con 0x7f7db81017b0 2024-05-10T10:54:44.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.024+0000 7f7dbf6be700 1 -- 172.21.15.107:0/3831435029 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7db806a190 con 0x7f7db81017b0 2024-05-10T10:54:44.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.026+0000 7f7dae7fc700 1 -- 172.21.15.107:0/3831435029 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f7db001c070 con 0x7f7db81017b0 2024-05-10T10:54:44.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.026+0000 7f7dae7fc700 1 --2- 172.21.15.107:0/3831435029 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7da40b2900 0x7f7da40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:44.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.026+0000 7f7dbcc59700 1 --2- 172.21.15.107:0/3831435029 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7da40b2900 0x7f7da40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:44.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.027+0000 7f7dae7fc700 1 -- 172.21.15.107:0/3831435029 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f7db00e19c0 con 0x7f7db81017b0 2024-05-10T10:54:44.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.027+0000 7f7dbcc59700 1 --2- 172.21.15.107:0/3831435029 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7da40b2900 0x7f7da40b4dc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7da800b5c0 tx=0x7f7da8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:44.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.030+0000 7f7dae7fc700 1 -- 172.21.15.107:0/3831435029 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f7db00a9780 con 0x7f7db81017b0 2024-05-10T10:54:44.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.252+0000 7f7dbf6be700 1 -- 172.21.15.107:0/3831435029 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f7db80638e0 con 0x7f7da40b2900 2024-05-10T10:54:44.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.253+0000 7f7dae7fc700 1 -- 172.21.15.107:0/3831435029 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f7db80638e0 con 0x7f7da40b2900 2024-05-10T10:54:44.253 INFO:teuthology.orchestra.run.smithi107.stdout:Backend: cephadm 2024-05-10T10:54:44.253 INFO:teuthology.orchestra.run.smithi107.stdout:Available: Yes 2024-05-10T10:54:44.253 INFO:teuthology.orchestra.run.smithi107.stdout:Paused: No 2024-05-10T10:54:44.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.255+0000 7f7dbf6be700 1 -- 172.21.15.107:0/3831435029 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7da40b2900 msgr2=0x7f7da40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:44.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.255+0000 7f7dbf6be700 1 --2- 172.21.15.107:0/3831435029 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7da40b2900 0x7f7da40b4dc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7da800b5c0 tx=0x7f7da8005fd0 comp rx=0 tx=0).stop 2024-05-10T10:54:44.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.255+0000 7f7dbf6be700 1 -- 172.21.15.107:0/3831435029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db81017b0 msgr2=0x7f7db8199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:44.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.255+0000 7f7dbf6be700 1 --2- 172.21.15.107:0/3831435029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db81017b0 0x7f7db8199850 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7db000b9f0 tx=0x7f7db000bdb0 comp rx=0 tx=0).stop 2024-05-10T10:54:44.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.255+0000 7f7dbf6be700 1 -- 172.21.15.107:0/3831435029 shutdown_connections 2024-05-10T10:54:44.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.255+0000 7f7dbf6be700 1 --2- 172.21.15.107:0/3831435029 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7da40b2900 0x7f7da40b4dc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:44.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.255+0000 7f7dbf6be700 1 --2- 172.21.15.107:0/3831435029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7db8105130 0x7f7db81a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:44.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.255+0000 7f7dbf6be700 1 --2- 172.21.15.107:0/3831435029 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7db81017b0 0x7f7db8199850 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:44.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.255+0000 7f7dbf6be700 1 --2- 172.21.15.107:0/3831435029 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7db8104790 0x7f7db8199d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:44.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.255+0000 7f7dbf6be700 1 -- 172.21.15.107:0/3831435029 >> 172.21.15.107:0/3831435029 conn(0x7f7db80fd130 msgr2=0x7f7db8107b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:44.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.255+0000 7f7dbf6be700 1 -- 172.21.15.107:0/3831435029 shutdown_connections 2024-05-10T10:54:44.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:44.255+0000 7f7dbf6be700 1 -- 172.21.15.107:0/3831435029 wait complete. 2024-05-10T10:54:44.919 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-10T10:54:45.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:44 smithi184 ceph-mon[34585]: pgmap v360: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:45.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:44 smithi184 ceph-mon[34585]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:54:45.160 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:54:45.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:44 smithi107 ceph-mon[30373]: pgmap v360: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:45.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:44 smithi107 ceph-mon[30373]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:54:45.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:44 smithi196 ceph-mon[34872]: pgmap v360: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:45.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:44 smithi196 ceph-mon[34872]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:54:46.866 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.863+0000 7f8d30b97700 1 -- 172.21.15.107:0/2099373201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d2c102400 msgr2=0x7f8d2c102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:46.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.863+0000 7f8d30b97700 1 --2- 172.21.15.107:0/2099373201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d2c102400 0x7f8d2c102820 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8d200099c0 tx=0x7f8d20009cd0 comp rx=0 tx=0).stop 2024-05-10T10:54:46.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.863+0000 7f8d30b97700 1 -- 172.21.15.107:0/2099373201 shutdown_connections 2024-05-10T10:54:46.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.863+0000 7f8d30b97700 1 --2- 172.21.15.107:0/2099373201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d2c103fa0 0x7f8d2c10a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:46.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.863+0000 7f8d30b97700 1 --2- 172.21.15.107:0/2099373201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d2c102400 0x7f8d2c102820 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:46.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.863+0000 7f8d30b97700 1 --2- 172.21.15.107:0/2099373201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d2c103600 0x7f8d2c103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:46.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.863+0000 7f8d30b97700 1 -- 172.21.15.107:0/2099373201 >> 172.21.15.107:0/2099373201 conn(0x7f8d2c0fd9a0 msgr2=0x7f8d2c0ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:46.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.863+0000 7f8d30b97700 1 -- 172.21.15.107:0/2099373201 shutdown_connections 2024-05-10T10:54:46.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.863+0000 7f8d30b97700 1 -- 172.21.15.107:0/2099373201 wait complete. 2024-05-10T10:54:46.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d30b97700 1 Processor -- start 2024-05-10T10:54:46.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d30b97700 1 -- start start 2024-05-10T10:54:46.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d30b97700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d2c102400 0x7f8d2c06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:46.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d30b97700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d2c103600 0x7f8d2c19e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:46.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d30b97700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d2c103fa0 0x7f8d2c1a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:46.867 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d30b97700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c10e030 con 0x7f8d2c102400 2024-05-10T10:54:46.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d30b97700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c10deb0 con 0x7f8d2c103fa0 2024-05-10T10:54:46.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d30b97700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c10e1b0 con 0x7f8d2c103600 2024-05-10T10:54:46.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d2a59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d2c102400 0x7f8d2c06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:46.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d2a59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d2c102400 0x7f8d2c06bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43332/0 (socket says 172.21.15.107:43332) 2024-05-10T10:54:46.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d2a59c700 1 -- 172.21.15.107:0/3039959215 learned_addr learned my addr 172.21.15.107:0/3039959215 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:46.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d29d9b700 1 --2- 172.21.15.107:0/3039959215 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d2c103600 0x7f8d2c19e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:46.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d2ad9d700 1 --2- 172.21.15.107:0/3039959215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d2c103fa0 0x7f8d2c1a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:46.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d2a59c700 1 -- 172.21.15.107:0/3039959215 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d2c103600 msgr2=0x7f8d2c19e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:46.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d2a59c700 1 --2- 172.21.15.107:0/3039959215 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d2c103600 0x7f8d2c19e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:46.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d2a59c700 1 -- 172.21.15.107:0/3039959215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d2c103fa0 msgr2=0x7f8d2c1a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:46.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d2a59c700 1 --2- 172.21.15.107:0/3039959215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d2c103fa0 0x7f8d2c1a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:46.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d2a59c700 1 -- 172.21.15.107:0/3039959215 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2c1a1390 con 0x7f8d2c102400 2024-05-10T10:54:46.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d29d9b700 1 --2- 172.21.15.107:0/3039959215 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d2c103600 0x7f8d2c19e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:54:46.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.864+0000 7f8d2ad9d700 1 --2- 172.21.15.107:0/3039959215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d2c103fa0 0x7f8d2c1a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:54:46.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.865+0000 7f8d2a59c700 1 --2- 172.21.15.107:0/3039959215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d2c102400 0x7f8d2c06bce0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8d2000b580 tx=0x7f8d20003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:46.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.865+0000 7f8d1b7fe700 1 -- 172.21.15.107:0/3039959215 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20027070 con 0x7f8d2c102400 2024-05-10T10:54:46.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.865+0000 7f8d1b7fe700 1 -- 172.21.15.107:0/3039959215 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8d20022470 con 0x7f8d2c102400 2024-05-10T10:54:46.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.865+0000 7f8d30b97700 1 -- 172.21.15.107:0/3039959215 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d2c1a1620 con 0x7f8d2c102400 2024-05-10T10:54:46.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.865+0000 7f8d1b7fe700 1 -- 172.21.15.107:0/3039959215 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2000f6c0 con 0x7f8d2c102400 2024-05-10T10:54:46.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.865+0000 7f8d30b97700 1 -- 172.21.15.107:0/3039959215 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d2c1a1b00 con 0x7f8d2c102400 2024-05-10T10:54:46.869 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.866+0000 7f8d30b97700 1 -- 172.21.15.107:0/3039959215 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d2c06a190 con 0x7f8d2c102400 2024-05-10T10:54:46.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.867+0000 7f8d1b7fe700 1 -- 172.21.15.107:0/3039959215 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f8d2002a070 con 0x7f8d2c102400 2024-05-10T10:54:46.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.868+0000 7f8d1b7fe700 1 --2- 172.21.15.107:0/3039959215 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8d140b2880 0x7f8d140b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:46.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.868+0000 7f8d29d9b700 1 --2- 172.21.15.107:0/3039959215 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8d140b2880 0x7f8d140b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:46.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.868+0000 7f8d1b7fe700 1 -- 172.21.15.107:0/3039959215 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f8d200e34a0 con 0x7f8d2c102400 2024-05-10T10:54:46.870 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.868+0000 7f8d29d9b700 1 --2- 172.21.15.107:0/3039959215 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8d140b2880 0x7f8d140b4d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c005fd0 tx=0x7f8d1c005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:46.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:46.871+0000 7f8d1b7fe700 1 -- 172.21.15.107:0/3039959215 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8d20013070 con 0x7f8d2c102400 2024-05-10T10:54:47.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:47.086+0000 7f8d30b97700 1 -- 172.21.15.107:0/3039959215 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8d2c0639a0 con 0x7f8d140b2880 2024-05-10T10:54:47.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:47.099+0000 7f8d1b7fe700 1 -- 172.21.15.107:0/3039959215 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f8d2c0639a0 con 0x7f8d140b2880 2024-05-10T10:54:47.099 INFO:teuthology.orchestra.run.smithi107.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-10T10:54:47.100 INFO:teuthology.orchestra.run.smithi107.stdout:mds.a smithi107 running (2m) 19s ago 2m 19.9M - 19.0.0-3449-gd39fa088 ee5e4f21ef58 0cb620bb952d 2024-05-10T10:54:47.100 INFO:teuthology.orchestra.run.smithi107.stdout:mds.b smithi184 running (2m) 20s ago 2m 27.4M - 19.0.0-3449-gd39fa088 ee5e4f21ef58 c3a0475128d6 2024-05-10T10:54:47.100 INFO:teuthology.orchestra.run.smithi107.stdout:mds.c smithi196 running (3m) 20s ago 3m 20.3M - 19.0.0-3449-gd39fa088 ee5e4f21ef58 e6c2d4962e75 2024-05-10T10:54:47.100 INFO:teuthology.orchestra.run.smithi107.stdout:mds.d smithi107 running (3m) 19s ago 3m 14.7M - 19.0.0-3449-gd39fa088 ee5e4f21ef58 81890e334935 2024-05-10T10:54:47.100 INFO:teuthology.orchestra.run.smithi107.stdout:mds.e smithi184 running (3m) 20s ago 3m 22.4M - 19.0.0-3449-gd39fa088 ee5e4f21ef58 80f267116908 2024-05-10T10:54:47.100 INFO:teuthology.orchestra.run.smithi107.stdout:mds.f smithi196 running (3m) 20s ago 3m 21.3M - 19.0.0-3449-gd39fa088 ee5e4f21ef58 6dba30ac6ec5 2024-05-10T10:54:47.100 INFO:teuthology.orchestra.run.smithi107.stdout:mds.g smithi107 running (2m) 19s ago 2m 21.4M - 19.0.0-3449-gd39fa088 ee5e4f21ef58 3687aec89039 2024-05-10T10:54:47.100 INFO:teuthology.orchestra.run.smithi107.stdout:mds.h smithi184 running (2m) 20s ago 2m 19.7M - 19.0.0-3449-gd39fa088 ee5e4f21ef58 06982656a9f6 2024-05-10T10:54:47.100 INFO:teuthology.orchestra.run.smithi107.stdout:mds.i smithi196 running (2m) 20s ago 2m 20.0M - 19.0.0-3449-gd39fa088 ee5e4f21ef58 3e5cf6aa9a30 2024-05-10T10:54:47.100 INFO:teuthology.orchestra.run.smithi107.stdout:mds.j smithi107 running (3m) 19s ago 3m 15.2M - 19.0.0-3449-gd39fa088 ee5e4f21ef58 900920d0ceec 2024-05-10T10:54:47.100 INFO:teuthology.orchestra.run.smithi107.stdout:mds.k smithi184 running (3m) 20s ago 3m 20.0M - 19.0.0-3449-gd39fa088 ee5e4f21ef58 ff95ca875577 2024-05-10T10:54:47.100 INFO:teuthology.orchestra.run.smithi107.stdout:mds.l smithi196 running (3m) 20s ago 3m 21.3M - 19.0.0-3449-gd39fa088 ee5e4f21ef58 586970b08991 2024-05-10T10:54:47.100 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.x smithi107 *:9283,8765 running (10m) 19s ago 10m 530M - 19.0.0-3449-gd39fa088 ee5e4f21ef58 7d5fa1700673 2024-05-10T10:54:47.101 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.y smithi184 *:8443,8765 running (8m) 20s ago 8m 467M - 19.0.0-3449-gd39fa088 ee5e4f21ef58 a48a616a3765 2024-05-10T10:54:47.101 INFO:teuthology.orchestra.run.smithi107.stdout:mgr.z smithi196 *:8443,8765 running (8m) 20s ago 8m 466M - 19.0.0-3449-gd39fa088 ee5e4f21ef58 eda6c7673d35 2024-05-10T10:54:47.101 INFO:teuthology.orchestra.run.smithi107.stdout:mon.a smithi107 running (10m) 19s ago 10m 56.4M 2048M 19.0.0-3449-gd39fa088 ee5e4f21ef58 69577f9caecb 2024-05-10T10:54:47.101 INFO:teuthology.orchestra.run.smithi107.stdout:mon.b smithi184 running (8m) 20s ago 8m 40.1M 2048M 19.0.0-3449-gd39fa088 ee5e4f21ef58 fbb3f76a98f1 2024-05-10T10:54:47.101 INFO:teuthology.orchestra.run.smithi107.stdout:mon.c smithi196 running (8m) 20s ago 8m 41.3M 2048M 19.0.0-3449-gd39fa088 ee5e4f21ef58 f3ec729d9d06 2024-05-10T10:54:47.101 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 smithi107 running (8m) 19s ago 8m 59.5M 4272M 19.0.0-3449-gd39fa088 ee5e4f21ef58 07bc68e33822 2024-05-10T10:54:47.101 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 smithi184 running (7m) 20s ago 7m 50.1M 4272M 19.0.0-3449-gd39fa088 ee5e4f21ef58 8a956c60fe47 2024-05-10T10:54:47.101 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 smithi196 running (7m) 20s ago 7m 51.3M 4272M 19.0.0-3449-gd39fa088 ee5e4f21ef58 906214e9a96e 2024-05-10T10:54:47.101 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 smithi107 running (6m) 19s ago 6m 48.8M 4272M 19.0.0-3449-gd39fa088 ee5e4f21ef58 3ab695621f8e 2024-05-10T10:54:47.101 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 smithi184 running (6m) 20s ago 6m 54.9M 4272M 19.0.0-3449-gd39fa088 ee5e4f21ef58 ec2f58381e90 2024-05-10T10:54:47.101 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 smithi196 running (6m) 20s ago 6m 58.5M 4272M 19.0.0-3449-gd39fa088 ee5e4f21ef58 c09902da73e8 2024-05-10T10:54:47.101 INFO:teuthology.orchestra.run.smithi107.stdout:osd.6 smithi107 running (5m) 19s ago 5m 46.0M 4272M 19.0.0-3449-gd39fa088 ee5e4f21ef58 be69aae6e7b8 2024-05-10T10:54:47.101 INFO:teuthology.orchestra.run.smithi107.stdout:osd.7 smithi184 running (5m) 20s ago 5m 47.4M 4272M 19.0.0-3449-gd39fa088 ee5e4f21ef58 3a4f3d1d0fa1 2024-05-10T10:54:47.101 INFO:teuthology.orchestra.run.smithi107.stdout:osd.8 smithi196 running (4m) 20s ago 4m 46.7M 4272M 19.0.0-3449-gd39fa088 ee5e4f21ef58 0c3bdda7ab0b 2024-05-10T10:54:47.102 INFO:teuthology.orchestra.run.smithi107.stdout:osd.9 smithi107 running (4m) 19s ago 4m 54.0M 4272M 19.0.0-3449-gd39fa088 ee5e4f21ef58 843dd78f920a 2024-05-10T10:54:47.102 INFO:teuthology.orchestra.run.smithi107.stdout:osd.10 smithi184 running (4m) 20s ago 4m 58.6M 4272M 19.0.0-3449-gd39fa088 ee5e4f21ef58 7d0475d8c8a1 2024-05-10T10:54:47.102 INFO:teuthology.orchestra.run.smithi107.stdout:osd.11 smithi196 running (3m) 20s ago 3m 45.1M 4272M 19.0.0-3449-gd39fa088 ee5e4f21ef58 439b905f56a2 2024-05-10T10:54:47.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:47.101+0000 7f8d30b97700 1 -- 172.21.15.107:0/3039959215 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8d140b2880 msgr2=0x7f8d140b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:47.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:47.101+0000 7f8d30b97700 1 --2- 172.21.15.107:0/3039959215 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8d140b2880 0x7f8d140b4d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c005fd0 tx=0x7f8d1c005e30 comp rx=0 tx=0).stop 2024-05-10T10:54:47.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:47.101+0000 7f8d30b97700 1 -- 172.21.15.107:0/3039959215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d2c102400 msgr2=0x7f8d2c06bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:47.102 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:47.101+0000 7f8d30b97700 1 --2- 172.21.15.107:0/3039959215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d2c102400 0x7f8d2c06bce0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8d2000b580 tx=0x7f8d20003730 comp rx=0 tx=0).stop 2024-05-10T10:54:47.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:47.101+0000 7f8d30b97700 1 -- 172.21.15.107:0/3039959215 shutdown_connections 2024-05-10T10:54:47.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:47.101+0000 7f8d30b97700 1 --2- 172.21.15.107:0/3039959215 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8d140b2880 0x7f8d140b4d40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:47.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:47.101+0000 7f8d30b97700 1 --2- 172.21.15.107:0/3039959215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d2c103fa0 0x7f8d2c1a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:47.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:47.101+0000 7f8d30b97700 1 --2- 172.21.15.107:0/3039959215 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d2c102400 0x7f8d2c06bce0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:47.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:47.101+0000 7f8d30b97700 1 --2- 172.21.15.107:0/3039959215 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d2c103600 0x7f8d2c19e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:47.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:47.101+0000 7f8d30b97700 1 -- 172.21.15.107:0/3039959215 >> 172.21.15.107:0/3039959215 conn(0x7f8d2c0fd9a0 msgr2=0x7f8d2c106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:47.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:47.101+0000 7f8d30b97700 1 -- 172.21.15.107:0/3039959215 shutdown_connections 2024-05-10T10:54:47.103 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:47.101+0000 7f8d30b97700 1 -- 172.21.15.107:0/3039959215 wait complete. 2024-05-10T10:54:47.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:46 smithi184 ceph-mon[34585]: pgmap v361: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:54:47.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:46 smithi107 ceph-mon[30373]: pgmap v361: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:54:47.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:46 smithi196 ceph-mon[34872]: pgmap v361: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:54:47.796 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-10T10:54:48.043 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:54:48.165 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:47 smithi107 ceph-mon[30373]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:54:48.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:47 smithi196 ceph-mon[34872]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:54:48.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:47 smithi184 ceph-mon[34585]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:54:49.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:48 smithi107 ceph-mon[30373]: pgmap v362: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:49.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:48 smithi196 ceph-mon[34872]: pgmap v362: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:49.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:48 smithi184 ceph-mon[34585]: pgmap v362: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:49.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.762+0000 7fb440c57700 1 -- 172.21.15.107:0/2928162468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb43c103600 msgr2=0x7fb43c103a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:49.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.762+0000 7fb440c57700 1 --2- 172.21.15.107:0/2928162468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb43c103600 0x7fb43c103a60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0099c0 tx=0x7fb42c009cd0 comp rx=0 tx=0).stop 2024-05-10T10:54:49.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.762+0000 7fb440c57700 1 -- 172.21.15.107:0/2928162468 shutdown_connections 2024-05-10T10:54:49.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.762+0000 7fb440c57700 1 --2- 172.21.15.107:0/2928162468 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb43c103fa0 0x7fb43c10a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:49.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.762+0000 7fb440c57700 1 --2- 172.21.15.107:0/2928162468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb43c102400 0x7fb43c102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:49.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.762+0000 7fb440c57700 1 --2- 172.21.15.107:0/2928162468 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb43c103600 0x7fb43c103a60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:49.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.762+0000 7fb440c57700 1 -- 172.21.15.107:0/2928162468 >> 172.21.15.107:0/2928162468 conn(0x7fb43c0fd9a0 msgr2=0x7fb43c0ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:49.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.762+0000 7fb440c57700 1 -- 172.21.15.107:0/2928162468 shutdown_connections 2024-05-10T10:54:49.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.762+0000 7fb440c57700 1 -- 172.21.15.107:0/2928162468 wait complete. 2024-05-10T10:54:49.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.763+0000 7fb440c57700 1 Processor -- start 2024-05-10T10:54:49.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.763+0000 7fb440c57700 1 -- start start 2024-05-10T10:54:49.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.763+0000 7fb440c57700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb43c102400 0x7fb43c106460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:49.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.763+0000 7fb440c57700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb43c103600 0x7fb43c104ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:49.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.763+0000 7fb440c57700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb43c103fa0 0x7fb43c104ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:49.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.763+0000 7fb440c57700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c10e030 con 0x7fb43c102400 2024-05-10T10:54:49.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.763+0000 7fb440c57700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c10deb0 con 0x7fb43c103fa0 2024-05-10T10:54:49.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.763+0000 7fb440c57700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c10e1b0 con 0x7fb43c103600 2024-05-10T10:54:49.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.763+0000 7fb43a59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb43c102400 0x7fb43c106460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:49.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.763+0000 7fb43a59c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb43c102400 0x7fb43c106460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43344/0 (socket says 172.21.15.107:43344) 2024-05-10T10:54:49.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.763+0000 7fb43a59c700 1 -- 172.21.15.107:0/3661083574 learned_addr learned my addr 172.21.15.107:0/3661083574 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:49.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.763+0000 7fb43ad9d700 1 --2- 172.21.15.107:0/3661083574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb43c103fa0 0x7fb43c104ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.763+0000 7fb439d9b700 1 --2- 172.21.15.107:0/3661083574 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb43c103600 0x7fb43c104ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.763+0000 7fb43a59c700 1 -- 172.21.15.107:0/3661083574 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb43c103600 msgr2=0x7fb43c104ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.763+0000 7fb43a59c700 1 --2- 172.21.15.107:0/3661083574 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb43c103600 0x7fb43c104ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.763+0000 7fb43a59c700 1 -- 172.21.15.107:0/3661083574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb43c103fa0 msgr2=0x7fb43c104ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.763+0000 7fb43a59c700 1 --2- 172.21.15.107:0/3661083574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb43c103fa0 0x7fb43c104ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.763+0000 7fb43a59c700 1 -- 172.21.15.107:0/3661083574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43c1058a0 con 0x7fb43c102400 2024-05-10T10:54:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.764+0000 7fb43a59c700 1 --2- 172.21.15.107:0/3661083574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb43c102400 0x7fb43c106460 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb43000d980 tx=0x7fb43000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.764+0000 7fb42b7fe700 1 -- 172.21.15.107:0/3661083574 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb430017030 con 0x7fb43c102400 2024-05-10T10:54:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.764+0000 7fb440c57700 1 -- 172.21.15.107:0/3661083574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43c1a3930 con 0x7fb43c102400 2024-05-10T10:54:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.764+0000 7fb42b7fe700 1 -- 172.21.15.107:0/3661083574 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb4300044f0 con 0x7fb43c102400 2024-05-10T10:54:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.764+0000 7fb42b7fe700 1 -- 172.21.15.107:0/3661083574 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb430003aa0 con 0x7fb43c102400 2024-05-10T10:54:49.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.764+0000 7fb440c57700 1 -- 172.21.15.107:0/3661083574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43c1a3e40 con 0x7fb43c102400 2024-05-10T10:54:49.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.765+0000 7fb440c57700 1 -- 172.21.15.107:0/3661083574 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb43c06a190 con 0x7fb43c102400 2024-05-10T10:54:49.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.766+0000 7fb42b7fe700 1 -- 172.21.15.107:0/3661083574 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fb43001a070 con 0x7fb43c102400 2024-05-10T10:54:49.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.767+0000 7fb42b7fe700 1 --2- 172.21.15.107:0/3661083574 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4240b2880 0x7fb4240b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:49.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.767+0000 7fb439d9b700 1 --2- 172.21.15.107:0/3661083574 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4240b2880 0x7fb4240b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:49.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.767+0000 7fb42b7fe700 1 -- 172.21.15.107:0/3661083574 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fb4300e1e50 con 0x7fb43c102400 2024-05-10T10:54:49.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.767+0000 7fb439d9b700 1 --2- 172.21.15.107:0/3661083574 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4240b2880 0x7fb4240b4d40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb42c003910 tx=0x7fb42c005c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:49.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.770+0000 7fb42b7fe700 1 -- 172.21.15.107:0/3661083574 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb4300a9c10 con 0x7fb43c102400 2024-05-10T10:54:49.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.987+0000 7fb440c57700 1 -- 172.21.15.107:0/3661083574 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fb43c06b890 con 0x7fb4240b2880 2024-05-10T10:54:49.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.993+0000 7fb42b7fe700 1 -- 172.21.15.107:0/3661083574 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fb43c06b890 con 0x7fb4240b2880 2024-05-10T10:54:49.993 INFO:teuthology.orchestra.run.smithi107.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-10T10:54:49.993 INFO:teuthology.orchestra.run.smithi107.stdout:mds.all 12/12 23s ago 3m smithi107=a;smithi107=d;smithi107=g;smithi107=j;smithi184=b;smithi184=e;smithi184=h;smithi184=k;smithi196=c;smithi196=f;smithi196=i;smithi196=l;count:12 2024-05-10T10:54:49.994 INFO:teuthology.orchestra.run.smithi107.stdout:mgr 3/3 23s ago 8m smithi107=x;smithi184=y;smithi196=z;count:3 2024-05-10T10:54:49.994 INFO:teuthology.orchestra.run.smithi107.stdout:mon 3/3 23s ago 9m smithi107:172.21.15.107=a;smithi184:172.21.15.184=b;smithi196:172.21.15.196=c;count:3 2024-05-10T10:54:49.994 INFO:teuthology.orchestra.run.smithi107.stdout:osd 12 23s ago - 2024-05-10T10:54:49.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.995+0000 7fb440c57700 1 -- 172.21.15.107:0/3661083574 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4240b2880 msgr2=0x7fb4240b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:49.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.995+0000 7fb440c57700 1 --2- 172.21.15.107:0/3661083574 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4240b2880 0x7fb4240b4d40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb42c003910 tx=0x7fb42c005c00 comp rx=0 tx=0).stop 2024-05-10T10:54:49.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.995+0000 7fb440c57700 1 -- 172.21.15.107:0/3661083574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb43c102400 msgr2=0x7fb43c106460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:49.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.995+0000 7fb440c57700 1 --2- 172.21.15.107:0/3661083574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb43c102400 0x7fb43c106460 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb43000d980 tx=0x7fb43000dc90 comp rx=0 tx=0).stop 2024-05-10T10:54:49.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.995+0000 7fb440c57700 1 -- 172.21.15.107:0/3661083574 shutdown_connections 2024-05-10T10:54:49.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.995+0000 7fb440c57700 1 --2- 172.21.15.107:0/3661083574 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4240b2880 0x7fb4240b4d40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:49.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.995+0000 7fb440c57700 1 --2- 172.21.15.107:0/3661083574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb43c103fa0 0x7fb43c104ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:49.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.995+0000 7fb440c57700 1 --2- 172.21.15.107:0/3661083574 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb43c102400 0x7fb43c106460 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:49.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.995+0000 7fb440c57700 1 --2- 172.21.15.107:0/3661083574 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb43c103600 0x7fb43c104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:49.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.995+0000 7fb440c57700 1 -- 172.21.15.107:0/3661083574 >> 172.21.15.107:0/3661083574 conn(0x7fb43c0fd9a0 msgr2=0x7fb43c06b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:49.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.995+0000 7fb440c57700 1 -- 172.21.15.107:0/3661083574 shutdown_connections 2024-05-10T10:54:49.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:49.995+0000 7fb440c57700 1 -- 172.21.15.107:0/3661083574 wait complete. 2024-05-10T10:54:50.616 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-10T10:54:50.860 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:54:51.151 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:50 smithi107 ceph-mon[30373]: pgmap v363: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:54:51.151 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:50 smithi107 ceph-mon[30373]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:54:51.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:50 smithi196 ceph-mon[34872]: pgmap v363: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:54:51.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:50 smithi196 ceph-mon[34872]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:54:51.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:50 smithi184 ceph-mon[34585]: pgmap v363: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:54:51.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:50 smithi184 ceph-mon[34585]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:54:52.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.500+0000 7ff4983d6700 1 -- 172.21.15.107:0/3384811057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff490101df0 msgr2=0x7ff490102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:52.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.500+0000 7ff4983d6700 1 --2- 172.21.15.107:0/3384811057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff490101df0 0x7ff490102210 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009990 tx=0x7ff48c009ca0 comp rx=0 tx=0).stop 2024-05-10T10:54:52.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.501+0000 7ff4983d6700 1 -- 172.21.15.107:0/3384811057 shutdown_connections 2024-05-10T10:54:52.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.501+0000 7ff4983d6700 1 --2- 172.21.15.107:0/3384811057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff490103110 0x7ff490103590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:52.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.501+0000 7ff4983d6700 1 --2- 172.21.15.107:0/3384811057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff490101df0 0x7ff490102210 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:52.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.501+0000 7ff4983d6700 1 --2- 172.21.15.107:0/3384811057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff490102750 0x7ff490102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:52.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.501+0000 7ff4983d6700 1 -- 172.21.15.107:0/3384811057 >> 172.21.15.107:0/3384811057 conn(0x7ff4900fd990 msgr2=0x7ff4900ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:52.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.501+0000 7ff4983d6700 1 -- 172.21.15.107:0/3384811057 shutdown_connections 2024-05-10T10:54:52.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.501+0000 7ff4983d6700 1 -- 172.21.15.107:0/3384811057 wait complete. 2024-05-10T10:54:52.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.501+0000 7ff4983d6700 1 Processor -- start 2024-05-10T10:54:52.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.501+0000 7ff4983d6700 1 -- start start 2024-05-10T10:54:52.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.501+0000 7ff4983d6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff490101df0 0x7ff49019b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:52.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.501+0000 7ff4983d6700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff490102750 0x7ff49019be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:52.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.501+0000 7ff4983d6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff490103110 0x7ff4901a2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:52.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.501+0000 7ff4983d6700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff490111280 con 0x7ff490101df0 2024-05-10T10:54:52.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.501+0000 7ff4983d6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff490111100 con 0x7ff490103110 2024-05-10T10:54:52.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.501+0000 7ff4983d6700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff490111400 con 0x7ff490102750 2024-05-10T10:54:52.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.502+0000 7ff496172700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff490101df0 0x7ff49019b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:52.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.502+0000 7ff496172700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff490101df0 0x7ff49019b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43374/0 (socket says 172.21.15.107:43374) 2024-05-10T10:54:52.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.502+0000 7ff496172700 1 -- 172.21.15.107:0/1584290514 learned_addr learned my addr 172.21.15.107:0/1584290514 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:52.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.502+0000 7ff495971700 1 --2- 172.21.15.107:0/1584290514 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff490102750 0x7ff49019be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:52.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.502+0000 7ff496172700 1 -- 172.21.15.107:0/1584290514 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff490102750 msgr2=0x7ff49019be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:52.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.502+0000 7ff496172700 1 --2- 172.21.15.107:0/1584290514 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff490102750 0x7ff49019be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:52.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.502+0000 7ff496172700 1 -- 172.21.15.107:0/1584290514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff490103110 msgr2=0x7ff4901a2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:52.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.502+0000 7ff496973700 1 --2- 172.21.15.107:0/1584290514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff490103110 0x7ff4901a2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:52.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.502+0000 7ff496172700 1 --2- 172.21.15.107:0/1584290514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff490103110 0x7ff4901a2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:52.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.502+0000 7ff496172700 1 -- 172.21.15.107:0/1584290514 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4901a3570 con 0x7ff490101df0 2024-05-10T10:54:52.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.502+0000 7ff496172700 1 --2- 172.21.15.107:0/1584290514 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff490101df0 0x7ff49019b910 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0059d0 tx=0x7ff48c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:52.505 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.502+0000 7ff4877fe700 1 -- 172.21.15.107:0/1584290514 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c027070 con 0x7ff490101df0 2024-05-10T10:54:52.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.502+0000 7ff4877fe700 1 -- 172.21.15.107:0/1584290514 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff48c004150 con 0x7ff490101df0 2024-05-10T10:54:52.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.502+0000 7ff4983d6700 1 -- 172.21.15.107:0/1584290514 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4901a3800 con 0x7ff490101df0 2024-05-10T10:54:52.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.502+0000 7ff4877fe700 1 -- 172.21.15.107:0/1584290514 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c022e40 con 0x7ff490101df0 2024-05-10T10:54:52.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.502+0000 7ff4983d6700 1 -- 172.21.15.107:0/1584290514 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4901a3c50 con 0x7ff490101df0 2024-05-10T10:54:52.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.503+0000 7ff4983d6700 1 -- 172.21.15.107:0/1584290514 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff49006a190 con 0x7ff490101df0 2024-05-10T10:54:52.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.505+0000 7ff4877fe700 1 -- 172.21.15.107:0/1584290514 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7ff48c02a070 con 0x7ff490101df0 2024-05-10T10:54:52.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.505+0000 7ff4877fe700 1 --2- 172.21.15.107:0/1584290514 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff47c0b2880 0x7ff47c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:52.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.505+0000 7ff495971700 1 --2- 172.21.15.107:0/1584290514 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff47c0b2880 0x7ff47c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:52.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.506+0000 7ff4877fe700 1 -- 172.21.15.107:0/1584290514 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7ff48c0e31d0 con 0x7ff490101df0 2024-05-10T10:54:52.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.506+0000 7ff495971700 1 --2- 172.21.15.107:0/1584290514 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff47c0b2880 0x7ff47c0b4d40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff480005950 tx=0x7ff48000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:52.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.509+0000 7ff4877fe700 1 -- 172.21.15.107:0/1584290514 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff48c013070 con 0x7ff490101df0 2024-05-10T10:54:52.722 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.722+0000 7ff4983d6700 1 -- 172.21.15.107:0/1584290514 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7ff4900638e0 con 0x7ff47c0b2880 2024-05-10T10:54:52.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.723+0000 7ff4877fe700 1 -- 172.21.15.107:0/1584290514 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7ff4900638e0 con 0x7ff47c0b2880 2024-05-10T10:54:52.724 INFO:teuthology.orchestra.run.smithi107.stdout:HOST ADDR LABELS STATUS 2024-05-10T10:54:52.724 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107 172.21.15.107 2024-05-10T10:54:52.724 INFO:teuthology.orchestra.run.smithi107.stdout:smithi184 172.21.15.184 2024-05-10T10:54:52.724 INFO:teuthology.orchestra.run.smithi107.stdout:smithi196 172.21.15.196 2024-05-10T10:54:52.724 INFO:teuthology.orchestra.run.smithi107.stdout:3 hosts in cluster 2024-05-10T10:54:52.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.725+0000 7ff4983d6700 1 -- 172.21.15.107:0/1584290514 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff47c0b2880 msgr2=0x7ff47c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:52.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.725+0000 7ff4983d6700 1 --2- 172.21.15.107:0/1584290514 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff47c0b2880 0x7ff47c0b4d40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff480005950 tx=0x7ff48000a300 comp rx=0 tx=0).stop 2024-05-10T10:54:52.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.725+0000 7ff4983d6700 1 -- 172.21.15.107:0/1584290514 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff490101df0 msgr2=0x7ff49019b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:52.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.725+0000 7ff4983d6700 1 --2- 172.21.15.107:0/1584290514 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff490101df0 0x7ff49019b910 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0059d0 tx=0x7ff48c0047b0 comp rx=0 tx=0).stop 2024-05-10T10:54:52.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.725+0000 7ff4983d6700 1 -- 172.21.15.107:0/1584290514 shutdown_connections 2024-05-10T10:54:52.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.725+0000 7ff4983d6700 1 --2- 172.21.15.107:0/1584290514 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff47c0b2880 0x7ff47c0b4d40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:52.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.725+0000 7ff4983d6700 1 --2- 172.21.15.107:0/1584290514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff490103110 0x7ff4901a2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:52.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.725+0000 7ff4983d6700 1 --2- 172.21.15.107:0/1584290514 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff490101df0 0x7ff49019b910 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:52.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.725+0000 7ff4983d6700 1 --2- 172.21.15.107:0/1584290514 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff490102750 0x7ff49019be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:52.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.725+0000 7ff4983d6700 1 -- 172.21.15.107:0/1584290514 >> 172.21.15.107:0/1584290514 conn(0x7ff4900fd990 msgr2=0x7ff4900ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:52.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.726+0000 7ff4983d6700 1 -- 172.21.15.107:0/1584290514 shutdown_connections 2024-05-10T10:54:52.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:52.726+0000 7ff4983d6700 1 -- 172.21.15.107:0/1584290514 wait complete. 2024-05-10T10:54:53.102 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:52 smithi107 ceph-mon[30373]: pgmap v364: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:54:53.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:52 smithi196 ceph-mon[34872]: pgmap v364: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:54:53.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:52 smithi184 ceph-mon[34585]: pgmap v364: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:54:53.430 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-10T10:54:53.683 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:54:53.972 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:53 smithi107 ceph-mon[30373]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:54:54.290 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:53 smithi184 ceph-mon[34585]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:54:54.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:53 smithi196 ceph-mon[34872]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:54:54.955 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:54 smithi107 ceph-mon[30373]: pgmap v365: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:55.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:54 smithi196 ceph-mon[34872]: pgmap v365: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:55.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.324+0000 7f73c0167700 1 -- 172.21.15.107:0/1466958645 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b81046f0 msgr2=0x7f73b8104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:55.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.324+0000 7f73c0167700 1 --2- 172.21.15.107:0/1466958645 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b81046f0 0x7f73b8104b50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f73a80099c0 tx=0x7f73a8009cd0 comp rx=0 tx=0).stop 2024-05-10T10:54:55.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.324+0000 7f73c0167700 1 -- 172.21.15.107:0/1466958645 shutdown_connections 2024-05-10T10:54:55.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.324+0000 7f73c0167700 1 --2- 172.21.15.107:0/1466958645 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73b8105090 0x7f73b810b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:55.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.324+0000 7f73c0167700 1 --2- 172.21.15.107:0/1466958645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73b81034f0 0x7f73b8103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:55.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.324+0000 7f73c0167700 1 --2- 172.21.15.107:0/1466958645 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b81046f0 0x7f73b8104b50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:55.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.324+0000 7f73c0167700 1 -- 172.21.15.107:0/1466958645 >> 172.21.15.107:0/1466958645 conn(0x7f73b80fea90 msgr2=0x7f73b8100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:55.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.324+0000 7f73c0167700 1 -- 172.21.15.107:0/1466958645 shutdown_connections 2024-05-10T10:54:55.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.324+0000 7f73c0167700 1 -- 172.21.15.107:0/1466958645 wait complete. 2024-05-10T10:54:55.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.325+0000 7f73c0167700 1 Processor -- start 2024-05-10T10:54:55.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.325+0000 7f73c0167700 1 -- start start 2024-05-10T10:54:55.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.325+0000 7f73c0167700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b81034f0 0x7f73b81997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:55.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.325+0000 7f73c0167700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73b81046f0 0x7f73b8199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:55.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.325+0000 7f73c0167700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73b8105090 0x7f73b81a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:55.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.325+0000 7f73c0167700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f73b810f140 con 0x7f73b81034f0 2024-05-10T10:54:55.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.325+0000 7f73c0167700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f73b810efc0 con 0x7f73b81046f0 2024-05-10T10:54:55.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.325+0000 7f73c0167700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f73b810f2c0 con 0x7f73b8105090 2024-05-10T10:54:55.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.325+0000 7f73bdf03700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b81034f0 0x7f73b81997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:55.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.325+0000 7f73bdf03700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b81034f0 0x7f73b81997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:43390/0 (socket says 172.21.15.107:43390) 2024-05-10T10:54:55.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.325+0000 7f73bdf03700 1 -- 172.21.15.107:0/4220188494 learned_addr learned my addr 172.21.15.107:0/4220188494 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:55.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.326+0000 7f73be704700 1 --2- 172.21.15.107:0/4220188494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73b8105090 0x7f73b81a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:55.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.326+0000 7f73bd702700 1 --2- 172.21.15.107:0/4220188494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73b81046f0 0x7f73b8199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:55.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.326+0000 7f73bdf03700 1 -- 172.21.15.107:0/4220188494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73b8105090 msgr2=0x7f73b81a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:55.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.326+0000 7f73bdf03700 1 --2- 172.21.15.107:0/4220188494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73b8105090 0x7f73b81a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:55.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.326+0000 7f73bdf03700 1 -- 172.21.15.107:0/4220188494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73b81046f0 msgr2=0x7f73b8199cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:55.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.326+0000 7f73bdf03700 1 --2- 172.21.15.107:0/4220188494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73b81046f0 0x7f73b8199cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:55.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.326+0000 7f73bdf03700 1 -- 172.21.15.107:0/4220188494 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b81a1410 con 0x7f73b81034f0 2024-05-10T10:54:55.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.326+0000 7f73be704700 1 --2- 172.21.15.107:0/4220188494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73b8105090 0x7f73b81a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:54:55.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.326+0000 7f73bdf03700 1 --2- 172.21.15.107:0/4220188494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b81034f0 0x7f73b81997b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f73b400b530 tx=0x7f73b400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:55.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.326+0000 7f73aeffd700 1 -- 172.21.15.107:0/4220188494 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b4015020 con 0x7f73b81034f0 2024-05-10T10:54:55.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.326+0000 7f73aeffd700 1 -- 172.21.15.107:0/4220188494 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f73b4011d00 con 0x7f73b81034f0 2024-05-10T10:54:55.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.326+0000 7f73c0167700 1 -- 172.21.15.107:0/4220188494 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b81a1700 con 0x7f73b81034f0 2024-05-10T10:54:55.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.326+0000 7f73aeffd700 1 -- 172.21.15.107:0/4220188494 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b4010e10 con 0x7f73b81034f0 2024-05-10T10:54:55.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.326+0000 7f73c0167700 1 -- 172.21.15.107:0/4220188494 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b81a1c40 con 0x7f73b81034f0 2024-05-10T10:54:55.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.327+0000 7f73c0167700 1 -- 172.21.15.107:0/4220188494 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73b806a190 con 0x7f73b81034f0 2024-05-10T10:54:55.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.328+0000 7f73aeffd700 1 -- 172.21.15.107:0/4220188494 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f73b4018020 con 0x7f73b81034f0 2024-05-10T10:54:55.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.329+0000 7f73aeffd700 1 --2- 172.21.15.107:0/4220188494 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f73a40b2880 0x7f73a40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:55.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.329+0000 7f73bd702700 1 --2- 172.21.15.107:0/4220188494 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f73a40b2880 0x7f73a40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:55.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.329+0000 7f73aeffd700 1 -- 172.21.15.107:0/4220188494 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f73b40e1f20 con 0x7f73b81034f0 2024-05-10T10:54:55.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.329+0000 7f73bd702700 1 --2- 172.21.15.107:0/4220188494 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f73a40b2880 0x7f73a40b4d40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f73a8000c00 tx=0x7f73a8005c60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:55.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.332+0000 7f73aeffd700 1 -- 172.21.15.107:0/4220188494 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f73b401f020 con 0x7f73b81034f0 2024-05-10T10:54:55.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:54 smithi184 ceph-mon[34585]: pgmap v365: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:55.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.545+0000 7f73c0167700 1 -- 172.21.15.107:0/4220188494 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f73b80638e0 con 0x7f73a40b2880 2024-05-10T10:54:55.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.547+0000 7f73aeffd700 1 -- 172.21.15.107:0/4220188494 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f73b80638e0 con 0x7f73a40b2880 2024-05-10T10:54:55.548 INFO:teuthology.orchestra.run.smithi107.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-10T10:54:55.548 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NK400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-05-10T10:54:55.548 INFO:teuthology.orchestra.run.smithi107.stdout:smithi184 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT626500CE400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-05-10T10:54:55.548 INFO:teuthology.orchestra.run.smithi107.stdout:smithi196 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6246000Z400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-05-10T10:54:55.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.549+0000 7f73c0167700 1 -- 172.21.15.107:0/4220188494 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f73a40b2880 msgr2=0x7f73a40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:55.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.549+0000 7f73c0167700 1 --2- 172.21.15.107:0/4220188494 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f73a40b2880 0x7f73a40b4d40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f73a8000c00 tx=0x7f73a8005c60 comp rx=0 tx=0).stop 2024-05-10T10:54:55.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.549+0000 7f73c0167700 1 -- 172.21.15.107:0/4220188494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b81034f0 msgr2=0x7f73b81997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:55.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.549+0000 7f73c0167700 1 --2- 172.21.15.107:0/4220188494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b81034f0 0x7f73b81997b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f73b400b530 tx=0x7f73b400b8f0 comp rx=0 tx=0).stop 2024-05-10T10:54:55.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.549+0000 7f73c0167700 1 -- 172.21.15.107:0/4220188494 shutdown_connections 2024-05-10T10:54:55.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.549+0000 7f73c0167700 1 --2- 172.21.15.107:0/4220188494 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f73a40b2880 0x7f73a40b4d40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:55.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.549+0000 7f73c0167700 1 --2- 172.21.15.107:0/4220188494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f73b8105090 0x7f73b81a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:55.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.549+0000 7f73c0167700 1 --2- 172.21.15.107:0/4220188494 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f73b81034f0 0x7f73b81997b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:55.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.549+0000 7f73c0167700 1 --2- 172.21.15.107:0/4220188494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73b81046f0 0x7f73b8199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:55.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.549+0000 7f73c0167700 1 -- 172.21.15.107:0/4220188494 >> 172.21.15.107:0/4220188494 conn(0x7f73b80fea90 msgr2=0x7f73b81079f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:55.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.549+0000 7f73c0167700 1 -- 172.21.15.107:0/4220188494 shutdown_connections 2024-05-10T10:54:55.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:55.549+0000 7f73c0167700 1 -- 172.21.15.107:0/4220188494 wait complete. 2024-05-10T10:54:56.272 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-10T10:54:56.284 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi107.front.sepia.ceph.com 2024-05-10T10:54:56.284 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-10T10:54:56.529 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:54:57.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:56 smithi107 ceph-mon[30373]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:54:57.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:56 smithi107 ceph-mon[30373]: pgmap v366: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:54:57.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:56 smithi196 ceph-mon[34872]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:54:57.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:56 smithi196 ceph-mon[34872]: pgmap v366: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:54:57.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:56 smithi184 ceph-mon[34585]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:54:57.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:56 smithi184 ceph-mon[34585]: pgmap v366: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:54:58.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.254+0000 7efdfba42700 1 -- 172.21.15.107:0/4164652994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdf4103600 msgr2=0x7efdf4103a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.254+0000 7efdfba42700 1 --2- 172.21.15.107:0/4164652994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdf4103600 0x7efdf4103a60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efde40099c0 tx=0x7efde4009cd0 comp rx=0 tx=0).stop 2024-05-10T10:54:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.254+0000 7efdfba42700 1 -- 172.21.15.107:0/4164652994 shutdown_connections 2024-05-10T10:54:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.254+0000 7efdfba42700 1 --2- 172.21.15.107:0/4164652994 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efdf4102400 0x7efdf4102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.254+0000 7efdfba42700 1 --2- 172.21.15.107:0/4164652994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdf4103fa0 0x7efdf410a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.254+0000 7efdfba42700 1 --2- 172.21.15.107:0/4164652994 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdf4103600 0x7efdf4103a60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.254+0000 7efdfba42700 1 -- 172.21.15.107:0/4164652994 >> 172.21.15.107:0/4164652994 conn(0x7efdf40fd9a0 msgr2=0x7efdf40ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.254+0000 7efdfba42700 1 -- 172.21.15.107:0/4164652994 shutdown_connections 2024-05-10T10:54:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.254+0000 7efdfba42700 1 -- 172.21.15.107:0/4164652994 wait complete. 2024-05-10T10:54:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.254+0000 7efdfba42700 1 Processor -- start 2024-05-10T10:54:58.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdfba42700 1 -- start start 2024-05-10T10:54:58.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdfba42700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdf4102400 0x7efdf4106340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:58.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdfba42700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdf4103600 0x7efdf41049e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:58.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdfba42700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efdf4103fa0 0x7efdf4104f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:58.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdfba42700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efdf410e030 con 0x7efdf4102400 2024-05-10T10:54:58.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdfba42700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efdf410deb0 con 0x7efdf4103600 2024-05-10T10:54:58.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdfba42700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7efdf410e1b0 con 0x7efdf4103fa0 2024-05-10T10:54:58.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdf97de700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdf4102400 0x7efdf4106340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:58.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdf97de700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdf4102400 0x7efdf4106340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54412/0 (socket says 172.21.15.107:54412) 2024-05-10T10:54:58.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdf97de700 1 -- 172.21.15.107:0/3574118667 learned_addr learned my addr 172.21.15.107:0/3574118667 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:54:58.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdf8fdd700 1 --2- 172.21.15.107:0/3574118667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdf4103600 0x7efdf41049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:58.258 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdf9fdf700 1 --2- 172.21.15.107:0/3574118667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efdf4103fa0 0x7efdf4104f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:58.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdf97de700 1 -- 172.21.15.107:0/3574118667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efdf4103fa0 msgr2=0x7efdf4104f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:58.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdf97de700 1 --2- 172.21.15.107:0/3574118667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efdf4103fa0 0x7efdf4104f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:58.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdf97de700 1 -- 172.21.15.107:0/3574118667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdf4103600 msgr2=0x7efdf41049e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:58.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdf97de700 1 --2- 172.21.15.107:0/3574118667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdf4103600 0x7efdf41049e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:58.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdf97de700 1 -- 172.21.15.107:0/3574118667 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf41057f0 con 0x7efdf4102400 2024-05-10T10:54:58.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdf8fdd700 1 --2- 172.21.15.107:0/3574118667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdf4103600 0x7efdf41049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:54:58.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdf97de700 1 --2- 172.21.15.107:0/3574118667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdf4102400 0x7efdf4106340 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efdf000c990 tx=0x7efdf000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:58.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdea7fc700 1 -- 172.21.15.107:0/3574118667 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf0007b00 con 0x7efdf4102400 2024-05-10T10:54:58.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdfba42700 1 -- 172.21.15.107:0/3574118667 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf41a3830 con 0x7efdf4102400 2024-05-10T10:54:58.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.255+0000 7efdea7fc700 1 -- 172.21.15.107:0/3574118667 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7efdf0007ca0 con 0x7efdf4102400 2024-05-10T10:54:58.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.256+0000 7efdea7fc700 1 -- 172.21.15.107:0/3574118667 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf00186f0 con 0x7efdf4102400 2024-05-10T10:54:58.259 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.256+0000 7efdfba42700 1 -- 172.21.15.107:0/3574118667 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf41a3d40 con 0x7efdf4102400 2024-05-10T10:54:58.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.256+0000 7efdfba42700 1 -- 172.21.15.107:0/3574118667 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdf406a190 con 0x7efdf4102400 2024-05-10T10:54:58.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.258+0000 7efdea7fc700 1 -- 172.21.15.107:0/3574118667 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7efdf0018890 con 0x7efdf4102400 2024-05-10T10:54:58.260 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.258+0000 7efdea7fc700 1 --2- 172.21.15.107:0/3574118667 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7efde00b2880 0x7efde00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:54:58.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.259+0000 7efdf8fdd700 1 --2- 172.21.15.107:0/3574118667 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7efde00b2880 0x7efde00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:54:58.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.259+0000 7efdea7fc700 1 -- 172.21.15.107:0/3574118667 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7efdf00e2360 con 0x7efdf4102400 2024-05-10T10:54:58.261 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.259+0000 7efdf8fdd700 1 --2- 172.21.15.107:0/3574118667 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7efde00b2880 0x7efde00b4d40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efde4000c00 tx=0x7efde4005c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:54:58.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.262+0000 7efdea7fc700 1 -- 172.21.15.107:0/3574118667 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7efdf0014030 con 0x7efdf4102400 2024-05-10T10:54:58.508 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.508+0000 7efdfba42700 1 -- 172.21.15.107:0/3574118667 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7efdf41a4160 con 0x7efdf4102400 2024-05-10T10:54:58.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.508+0000 7efdea7fc700 1 -- 172.21.15.107:0/3574118667 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+3104 (secure 0 0 0) 0x7efdf00aa120 con 0x7efdf4102400 2024-05-10T10:54:58.509 INFO:teuthology.orchestra.run.smithi107.stdout:e26 2024-05-10T10:54:58.509 INFO:teuthology.orchestra.run.smithi107.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-10T10:54:58.509 INFO:teuthology.orchestra.run.smithi107.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-10T10:54:58.509 INFO:teuthology.orchestra.run.smithi107.stdout:legacy client fscid: 1 2024-05-10T10:54:58.509 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:54:58.509 INFO:teuthology.orchestra.run.smithi107.stdout:Filesystem 'cephfs' (1) 2024-05-10T10:54:58.509 INFO:teuthology.orchestra.run.smithi107.stdout:fs_name cephfs 2024-05-10T10:54:58.509 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 26 2024-05-10T10:54:58.509 INFO:teuthology.orchestra.run.smithi107.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-10T10:54:58.509 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-05-10T10:52:17.367732+0000 2024-05-10T10:54:58.510 INFO:teuthology.orchestra.run.smithi107.stdout:modified 2024-05-10T10:52:35.666052+0000 2024-05-10T10:54:58.510 INFO:teuthology.orchestra.run.smithi107.stdout:tableserver 0 2024-05-10T10:54:58.510 INFO:teuthology.orchestra.run.smithi107.stdout:root 0 2024-05-10T10:54:58.510 INFO:teuthology.orchestra.run.smithi107.stdout:session_timeout 300 2024-05-10T10:54:58.510 INFO:teuthology.orchestra.run.smithi107.stdout:session_autoclose 300 2024-05-10T10:54:58.510 INFO:teuthology.orchestra.run.smithi107.stdout:max_file_size 1099511627776 2024-05-10T10:54:58.510 INFO:teuthology.orchestra.run.smithi107.stdout:max_xattr_size 65536 2024-05-10T10:54:58.510 INFO:teuthology.orchestra.run.smithi107.stdout:required_client_features {} 2024-05-10T10:54:58.510 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure 0 2024-05-10T10:54:58.510 INFO:teuthology.orchestra.run.smithi107.stdout:last_failure_osd_epoch 0 2024-05-10T10:54:58.510 INFO:teuthology.orchestra.run.smithi107.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-10T10:54:58.510 INFO:teuthology.orchestra.run.smithi107.stdout:max_mds 5 2024-05-10T10:54:58.511 INFO:teuthology.orchestra.run.smithi107.stdout:in 0,1,2,3,4 2024-05-10T10:54:58.511 INFO:teuthology.orchestra.run.smithi107.stdout:up {0=24482,1=24449,2=24442,3=24431,4=24430} 2024-05-10T10:54:58.511 INFO:teuthology.orchestra.run.smithi107.stdout:failed 2024-05-10T10:54:58.511 INFO:teuthology.orchestra.run.smithi107.stdout:damaged 2024-05-10T10:54:58.511 INFO:teuthology.orchestra.run.smithi107.stdout:stopped 2024-05-10T10:54:58.511 INFO:teuthology.orchestra.run.smithi107.stdout:data_pools [3] 2024-05-10T10:54:58.511 INFO:teuthology.orchestra.run.smithi107.stdout:metadata_pool 2 2024-05-10T10:54:58.511 INFO:teuthology.orchestra.run.smithi107.stdout:inline_data disabled 2024-05-10T10:54:58.511 INFO:teuthology.orchestra.run.smithi107.stdout:balancer 2024-05-10T10:54:58.511 INFO:teuthology.orchestra.run.smithi107.stdout:bal_rank_mask -1 2024-05-10T10:54:58.511 INFO:teuthology.orchestra.run.smithi107.stdout:standby_count_wanted 0 2024-05-10T10:54:58.511 INFO:teuthology.orchestra.run.smithi107.stdout:qdb_cluster leader: 24482 members: 24449,24442,24482,24431,24430 2024-05-10T10:54:58.511 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b{0:24482} state up:active seq 5 addr [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] compat {c=[1],r=[1],i=[1fff]}] 2024-05-10T10:54:58.512 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.f{0:24418} state up:standby-replay seq 1 addr [v2:172.21.15.196:6834/3609693196,v1:172.21.15.196:6835/3609693196] compat {c=[1],r=[1],i=[1fff]}] 2024-05-10T10:54:58.512 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.h{1:24449} state up:active seq 12 addr [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] compat {c=[1],r=[1],i=[1fff]}] 2024-05-10T10:54:58.512 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.k{1:24404} state up:standby-replay seq 1 addr [v2:172.21.15.184:6832/3101071828,v1:172.21.15.184:6833/3101071828] compat {c=[1],r=[1],i=[1fff]}] 2024-05-10T10:54:58.512 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.i{2:24442} state up:active seq 12 addr [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] compat {c=[1],r=[1],i=[1fff]}] 2024-05-10T10:54:58.512 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.l{2:24394} state up:standby-replay seq 1 addr [v2:172.21.15.196:6832/2603001203,v1:172.21.15.196:6833/2603001203] compat {c=[1],r=[1],i=[1fff]}] 2024-05-10T10:54:58.512 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.e{3:24431} state up:active seq 15 addr [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] compat {c=[1],r=[1],i=[1fff]}] 2024-05-10T10:54:58.512 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a{3:14604} state up:standby-replay seq 1 addr [v2:172.21.15.107:6840/2332963094,v1:172.21.15.107:6841/2332963094] compat {c=[1],r=[1],i=[1fff]}] 2024-05-10T10:54:58.512 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c{4:24430} state up:active seq 13 addr [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] compat {c=[1],r=[1],i=[1fff]}] 2024-05-10T10:54:58.512 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.g{4:14592} state up:standby-replay seq 1 addr [v2:172.21.15.107:6838/1923447762,v1:172.21.15.107:6839/1923447762] compat {c=[1],r=[1],i=[1fff]}] 2024-05-10T10:54:58.512 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:54:58.512 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:54:58.512 INFO:teuthology.orchestra.run.smithi107.stdout:Standby daemons: 2024-05-10T10:54:58.512 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:54:58.512 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.j{-1:14532} state up:standby seq 1 addr [v2:172.21.15.107:6834/3020825331,v1:172.21.15.107:6835/3020825331] compat {c=[1],r=[1],i=[1fff]}] 2024-05-10T10:54:58.513 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d{-1:14538} state up:standby seq 1 addr [v2:172.21.15.107:6836/1680863375,v1:172.21.15.107:6837/1680863375] compat {c=[1],r=[1],i=[1fff]}] 2024-05-10T10:54:58.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.510+0000 7efdfba42700 1 -- 172.21.15.107:0/3574118667 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7efde00b2880 msgr2=0x7efde00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:58.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.510+0000 7efdfba42700 1 --2- 172.21.15.107:0/3574118667 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7efde00b2880 0x7efde00b4d40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efde4000c00 tx=0x7efde4005c00 comp rx=0 tx=0).stop 2024-05-10T10:54:58.513 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.510+0000 7efdfba42700 1 -- 172.21.15.107:0/3574118667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdf4102400 msgr2=0x7efdf4106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:54:58.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.510+0000 7efdfba42700 1 --2- 172.21.15.107:0/3574118667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdf4102400 0x7efdf4106340 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efdf000c990 tx=0x7efdf000cd50 comp rx=0 tx=0).stop 2024-05-10T10:54:58.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.510+0000 7efdfba42700 1 -- 172.21.15.107:0/3574118667 shutdown_connections 2024-05-10T10:54:58.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.510+0000 7efdfba42700 1 --2- 172.21.15.107:0/3574118667 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7efde00b2880 0x7efde00b4d40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:58.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.510+0000 7efdfba42700 1 --2- 172.21.15.107:0/3574118667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efdf4103fa0 0x7efdf4104f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:58.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.510+0000 7efdfba42700 1 --2- 172.21.15.107:0/3574118667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efdf4102400 0x7efdf4106340 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:58.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.510+0000 7efdfba42700 1 --2- 172.21.15.107:0/3574118667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdf4103600 0x7efdf41049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:54:58.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.510+0000 7efdfba42700 1 -- 172.21.15.107:0/3574118667 >> 172.21.15.107:0/3574118667 conn(0x7efdf40fd9a0 msgr2=0x7efdf40ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:54:58.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.510+0000 7efdfba42700 1 -- 172.21.15.107:0/3574118667 shutdown_connections 2024-05-10T10:54:58.514 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:54:58.510+0000 7efdfba42700 1 -- 172.21.15.107:0/3574118667 wait complete. 2024-05-10T10:54:58.514 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 26 2024-05-10T10:54:59.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:58 smithi107 ceph-mon[30373]: pgmap v367: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:59.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:54:58 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3574118667' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-10T10:54:59.211 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-10T10:54:59.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:58 smithi196 ceph-mon[34872]: pgmap v367: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:59.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:54:58 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3574118667' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-10T10:54:59.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:58 smithi184 ceph-mon[34585]: pgmap v367: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:54:59.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:54:58 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3574118667' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-10T10:54:59.454 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:01.026 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:00 smithi107 ceph-mon[30373]: pgmap v368: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:55:01.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.230+0000 7ff3db476700 1 -- 172.21.15.107:0/219930452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3d4101d80 msgr2=0x7ff3d41041b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:01.232 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.230+0000 7ff3db476700 1 --2- 172.21.15.107:0/219930452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3d4101d80 0x7ff3d41041b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0009990 tx=0x7ff3d0009ca0 comp rx=0 tx=0).stop 2024-05-10T10:55:01.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.230+0000 7ff3db476700 1 -- 172.21.15.107:0/219930452 shutdown_connections 2024-05-10T10:55:01.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.230+0000 7ff3db476700 1 --2- 172.21.15.107:0/219930452 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3d41070c0 0x7ff3d4107540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:01.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.230+0000 7ff3db476700 1 --2- 172.21.15.107:0/219930452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3d4101d80 0x7ff3d41041b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:01.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.230+0000 7ff3db476700 1 --2- 172.21.15.107:0/219930452 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3d41046f0 0x7ff3d4106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:01.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.230+0000 7ff3db476700 1 -- 172.21.15.107:0/219930452 >> 172.21.15.107:0/219930452 conn(0x7ff3d40fd9c0 msgr2=0x7ff3d40ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:01.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.230+0000 7ff3db476700 1 -- 172.21.15.107:0/219930452 shutdown_connections 2024-05-10T10:55:01.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.230+0000 7ff3db476700 1 -- 172.21.15.107:0/219930452 wait complete. 2024-05-10T10:55:01.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.230+0000 7ff3db476700 1 Processor -- start 2024-05-10T10:55:01.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.230+0000 7ff3db476700 1 -- start start 2024-05-10T10:55:01.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3db476700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3d4101d80 0x7ff3d419fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:01.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3db476700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3d41046f0 0x7ff3d41a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:01.233 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3db476700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3d41070c0 0x7ff3d41a7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:01.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3db476700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d41156b0 con 0x7ff3d4101d80 2024-05-10T10:55:01.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3db476700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d4115530 con 0x7ff3d41070c0 2024-05-10T10:55:01.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3db476700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d4115830 con 0x7ff3d41046f0 2024-05-10T10:55:01.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3d9212700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3d4101d80 0x7ff3d419fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:01.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3d9212700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3d4101d80 0x7ff3d419fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54428/0 (socket says 172.21.15.107:54428) 2024-05-10T10:55:01.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3d9212700 1 -- 172.21.15.107:0/571086089 learned_addr learned my addr 172.21.15.107:0/571086089 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:01.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3d8a11700 1 --2- 172.21.15.107:0/571086089 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3d41046f0 0x7ff3d41a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:01.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3d9a13700 1 --2- 172.21.15.107:0/571086089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3d41070c0 0x7ff3d41a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:01.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3d9212700 1 -- 172.21.15.107:0/571086089 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3d41046f0 msgr2=0x7ff3d41a02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:01.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3d9212700 1 --2- 172.21.15.107:0/571086089 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3d41046f0 0x7ff3d41a02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:01.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3d9212700 1 -- 172.21.15.107:0/571086089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3d41070c0 msgr2=0x7ff3d41a7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:01.234 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3d9212700 1 --2- 172.21.15.107:0/571086089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3d41070c0 0x7ff3d41a7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:01.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3d9212700 1 -- 172.21.15.107:0/571086089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d41a7960 con 0x7ff3d4101d80 2024-05-10T10:55:01.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3d9212700 1 --2- 172.21.15.107:0/571086089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3d4101d80 0x7ff3d419fdb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0006010 tx=0x7ff3d00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:01.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3ca7fc700 1 -- 172.21.15.107:0/571086089 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d0027070 con 0x7ff3d4101d80 2024-05-10T10:55:01.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3db476700 1 -- 172.21.15.107:0/571086089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d41a7bf0 con 0x7ff3d4101d80 2024-05-10T10:55:01.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3ca7fc700 1 -- 172.21.15.107:0/571086089 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff3d0022470 con 0x7ff3d4101d80 2024-05-10T10:55:01.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3ca7fc700 1 -- 172.21.15.107:0/571086089 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d000f6c0 con 0x7ff3d4101d80 2024-05-10T10:55:01.235 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.231+0000 7ff3db476700 1 -- 172.21.15.107:0/571086089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d41a8150 con 0x7ff3d4101d80 2024-05-10T10:55:01.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.232+0000 7ff3db476700 1 -- 172.21.15.107:0/571086089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3d406a190 con 0x7ff3d4101d80 2024-05-10T10:55:01.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.234+0000 7ff3ca7fc700 1 -- 172.21.15.107:0/571086089 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7ff3d002a070 con 0x7ff3d4101d80 2024-05-10T10:55:01.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.234+0000 7ff3ca7fc700 1 --2- 172.21.15.107:0/571086089 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff3c00b2880 0x7ff3c00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:01.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.235+0000 7ff3d8a11700 1 --2- 172.21.15.107:0/571086089 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff3c00b2880 0x7ff3c00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:01.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.235+0000 7ff3ca7fc700 1 -- 172.21.15.107:0/571086089 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7ff3d00e3120 con 0x7ff3d4101d80 2024-05-10T10:55:01.236 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.235+0000 7ff3d8a11700 1 --2- 172.21.15.107:0/571086089 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff3c00b2880 0x7ff3c00b4d40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4006fd0 tx=0x7ff3c4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:01.238 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.238+0000 7ff3ca7fc700 1 -- 172.21.15.107:0/571086089 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff3d0013070 con 0x7ff3d4101d80 2024-05-10T10:55:01.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:00 smithi196 ceph-mon[34872]: pgmap v368: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:55:01.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:00 smithi184 ceph-mon[34585]: pgmap v368: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:55:01.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.442+0000 7ff3db476700 1 -- 172.21.15.107:0/571086089 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7ff3d402e5e0 con 0x7ff3d4101d80 2024-05-10T10:55:01.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.443+0000 7ff3ca7fc700 1 -- 172.21.15.107:0/571086089 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v82) ==== 56+0+5257 (secure 0 0 0) 0x7ff3d00aaf70 con 0x7ff3d4101d80 2024-05-10T10:55:01.443 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 82 2024-05-10T10:55:01.443 INFO:teuthology.orchestra.run.smithi107.stdout:fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T10:55:01.443 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-05-10T10:44:13.064379+0000 2024-05-10T10:55:01.444 INFO:teuthology.orchestra.run.smithi107.stdout:modified 2024-05-10T10:53:08.899432+0000 2024-05-10T10:55:01.444 INFO:teuthology.orchestra.run.smithi107.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-10T10:55:01.444 INFO:teuthology.orchestra.run.smithi107.stdout:crush_version 26 2024-05-10T10:55:01.444 INFO:teuthology.orchestra.run.smithi107.stdout:full_ratio 0.95 2024-05-10T10:55:01.444 INFO:teuthology.orchestra.run.smithi107.stdout:backfillfull_ratio 0.9 2024-05-10T10:55:01.444 INFO:teuthology.orchestra.run.smithi107.stdout:nearfull_ratio 0.85 2024-05-10T10:55:01.444 INFO:teuthology.orchestra.run.smithi107.stdout:require_min_compat_client luminous 2024-05-10T10:55:01.444 INFO:teuthology.orchestra.run.smithi107.stdout:min_compat_client luminous 2024-05-10T10:55:01.444 INFO:teuthology.orchestra.run.smithi107.stdout:require_osd_release squid 2024-05-10T10:55:01.444 INFO:teuthology.orchestra.run.smithi107.stdout:stretch_mode_enabled false 2024-05-10T10:55:01.444 INFO:teuthology.orchestra.run.smithi107.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-10T10:55:01.444 INFO:teuthology.orchestra.run.smithi107.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-05-10T10:55:01.444 INFO:teuthology.orchestra.run.smithi107.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-05-10T10:55:01.444 INFO:teuthology.orchestra.run.smithi107.stdout:max_osd 12 2024-05-10T10:55:01.445 INFO:teuthology.orchestra.run.smithi107.stdout:osd.0 up in weight 1 up_from 8 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6802/4213004004,v1:172.21.15.107:6803/4213004004] [v2:172.21.15.107:6804/4213004004,v1:172.21.15.107:6805/4213004004] exists,up 503f960c-a74b-4979-9bf9-42c90a2885a2 2024-05-10T10:55:01.445 INFO:teuthology.orchestra.run.smithi107.stdout:osd.1 up in weight 1 up_from 13 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6800/3242825160,v1:172.21.15.184:6801/3242825160] [v2:172.21.15.184:6802/3242825160,v1:172.21.15.184:6803/3242825160] exists,up f0f89167-1aa1-40a1-b122-c7f203c587d8 2024-05-10T10:55:01.445 INFO:teuthology.orchestra.run.smithi107.stdout:osd.2 up in weight 1 up_from 18 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6800/137473043,v1:172.21.15.196:6801/137473043] [v2:172.21.15.196:6802/137473043,v1:172.21.15.196:6803/137473043] exists,up 7588b9be-b935-450a-944f-3feca69c029c 2024-05-10T10:55:01.445 INFO:teuthology.orchestra.run.smithi107.stdout:osd.3 up in weight 1 up_from 25 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6810/1995642021,v1:172.21.15.107:6811/1995642021] [v2:172.21.15.107:6812/1995642021,v1:172.21.15.107:6813/1995642021] exists,up 589ec3bb-884a-4441-a9d2-1f34ab372cc4 2024-05-10T10:55:01.445 INFO:teuthology.orchestra.run.smithi107.stdout:osd.4 up in weight 1 up_from 31 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6808/271550329,v1:172.21.15.184:6809/271550329] [v2:172.21.15.184:6810/271550329,v1:172.21.15.184:6811/271550329] exists,up b72cdb50-492b-4406-8f21-37e4b2cf5a89 2024-05-10T10:55:01.445 INFO:teuthology.orchestra.run.smithi107.stdout:osd.5 up in weight 1 up_from 37 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6808/3681130435,v1:172.21.15.196:6809/3681130435] [v2:172.21.15.196:6810/3681130435,v1:172.21.15.196:6811/3681130435] exists,up 05b6ad82-9153-44df-ae64-50c82d304429 2024-05-10T10:55:01.445 INFO:teuthology.orchestra.run.smithi107.stdout:osd.6 up in weight 1 up_from 43 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6818/4223253757,v1:172.21.15.107:6819/4223253757] [v2:172.21.15.107:6820/4223253757,v1:172.21.15.107:6821/4223253757] exists,up bceadd7a-20bf-4482-aaab-46a2539cf37c 2024-05-10T10:55:01.445 INFO:teuthology.orchestra.run.smithi107.stdout:osd.7 up in weight 1 up_from 48 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6816/2850715284,v1:172.21.15.184:6817/2850715284] [v2:172.21.15.184:6818/2850715284,v1:172.21.15.184:6819/2850715284] exists,up 0d9243a6-0e16-4677-a0b0-010be4162148 2024-05-10T10:55:01.445 INFO:teuthology.orchestra.run.smithi107.stdout:osd.8 up in weight 1 up_from 54 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6816/504426486,v1:172.21.15.196:6817/504426486] [v2:172.21.15.196:6818/504426486,v1:172.21.15.196:6819/504426486] exists,up 24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed 2024-05-10T10:55:01.445 INFO:teuthology.orchestra.run.smithi107.stdout:osd.9 up in weight 1 up_from 60 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6826/1533051760,v1:172.21.15.107:6827/1533051760] [v2:172.21.15.107:6828/1533051760,v1:172.21.15.107:6829/1533051760] exists,up 8bcb03ec-1342-4679-9343-fcefd28dd69b 2024-05-10T10:55:01.445 INFO:teuthology.orchestra.run.smithi107.stdout:osd.10 up in weight 1 up_from 66 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6824/1387541139,v1:172.21.15.184:6825/1387541139] [v2:172.21.15.184:6826/1387541139,v1:172.21.15.184:6827/1387541139] exists,up 78374015-aa7f-4288-b5ae-be64a5182bf0 2024-05-10T10:55:01.445 INFO:teuthology.orchestra.run.smithi107.stdout:osd.11 up in weight 1 up_from 72 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.196:6824/3861964533,v1:172.21.15.196:6825/3861964533] [v2:172.21.15.196:6826/3861964533,v1:172.21.15.196:6827/3861964533] exists,up 4aeb2b1a-f35e-44ea-be64-f60c31a096e0 2024-05-10T10:55:01.446 INFO:teuthology.orchestra.run.smithi107.stdout:pg_upmap_items 2.4 [2,11] 2024-05-10T10:55:01.446 INFO:teuthology.orchestra.run.smithi107.stdout:pg_upmap_items 2.6 [8,11] 2024-05-10T10:55:01.446 INFO:teuthology.orchestra.run.smithi107.stdout:pg_upmap_items 3.6 [4,6] 2024-05-10T10:55:01.446 INFO:teuthology.orchestra.run.smithi107.stdout:pg_upmap_items 3.11 [5,9] 2024-05-10T10:55:01.446 INFO:teuthology.orchestra.run.smithi107.stdout:pg_upmap_items 3.1e [3,9] 2024-05-10T10:55:01.446 INFO:teuthology.orchestra.run.smithi107.stdout:pg_upmap_items 3.24 [4,9] 2024-05-10T10:55:01.446 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:0/3518338734 expires 2024-05-11T10:45:07.518714+0000 2024-05-10T10:55:01.446 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:6801/892499090 expires 2024-05-11T10:45:07.518714+0000 2024-05-10T10:55:01.446 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:0/4092342993 expires 2024-05-11T10:45:07.518714+0000 2024-05-10T10:55:01.446 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:6800/892499090 expires 2024-05-11T10:45:07.518714+0000 2024-05-10T10:55:01.447 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:6801/1956906497 expires 2024-05-11T10:44:40.339608+0000 2024-05-10T10:55:01.447 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:6800/1956906497 expires 2024-05-11T10:44:40.339608+0000 2024-05-10T10:55:01.447 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:0/3761740075 expires 2024-05-11T10:45:07.518714+0000 2024-05-10T10:55:01.447 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:0/2215024983 expires 2024-05-11T10:44:40.339608+0000 2024-05-10T10:55:01.447 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:0/2124974715 expires 2024-05-11T10:44:40.339608+0000 2024-05-10T10:55:01.447 INFO:teuthology.orchestra.run.smithi107.stdout:blocklist 172.21.15.107:0/3361930986 expires 2024-05-11T10:44:40.339608+0000 2024-05-10T10:55:01.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.445+0000 7ff3db476700 1 -- 172.21.15.107:0/571086089 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff3c00b2880 msgr2=0x7ff3c00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:01.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.445+0000 7ff3db476700 1 --2- 172.21.15.107:0/571086089 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff3c00b2880 0x7ff3c00b4d40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4006fd0 tx=0x7ff3c4008040 comp rx=0 tx=0).stop 2024-05-10T10:55:01.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.445+0000 7ff3db476700 1 -- 172.21.15.107:0/571086089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3d4101d80 msgr2=0x7ff3d419fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:01.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.445+0000 7ff3db476700 1 --2- 172.21.15.107:0/571086089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3d4101d80 0x7ff3d419fdb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0006010 tx=0x7ff3d00047b0 comp rx=0 tx=0).stop 2024-05-10T10:55:01.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.445+0000 7ff3db476700 1 -- 172.21.15.107:0/571086089 shutdown_connections 2024-05-10T10:55:01.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.445+0000 7ff3db476700 1 --2- 172.21.15.107:0/571086089 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff3c00b2880 0x7ff3c00b4d40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:01.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.445+0000 7ff3db476700 1 --2- 172.21.15.107:0/571086089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff3d41070c0 0x7ff3d41a7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:01.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.445+0000 7ff3db476700 1 --2- 172.21.15.107:0/571086089 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff3d4101d80 0x7ff3d419fdb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:01.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.445+0000 7ff3db476700 1 --2- 172.21.15.107:0/571086089 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3d41046f0 0x7ff3d41a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:01.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.445+0000 7ff3db476700 1 -- 172.21.15.107:0/571086089 >> 172.21.15.107:0/571086089 conn(0x7ff3d40fd9c0 msgr2=0x7ff3d41054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:01.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.445+0000 7ff3db476700 1 -- 172.21.15.107:0/571086089 shutdown_connections 2024-05-10T10:55:01.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:01.445+0000 7ff3db476700 1 -- 172.21.15.107:0/571086089 wait complete. 2024-05-10T10:55:02.115 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:01 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/571086089' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-10T10:55:02.142 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-10T10:55:02.154 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:55:02.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:01 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/571086089' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-10T10:55:02.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:01 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/571086089' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-10T10:55:02.397 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:03.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:02 smithi107 ceph-mon[30373]: pgmap v369: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:55:03.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:02 smithi196 ceph-mon[34872]: pgmap v369: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:55:03.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:02 smithi184 ceph-mon[34585]: pgmap v369: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:55:04.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.060+0000 7f3b73649700 1 -- 172.21.15.107:0/2487622016 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b6c108410 msgr2=0x7f3b6c1087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:04.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.060+0000 7f3b73649700 1 --2- 172.21.15.107:0/2487622016 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b6c108410 0x7f3b6c1087f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c009990 tx=0x7f3b5c009ca0 comp rx=0 tx=0).stop 2024-05-10T10:55:04.061 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.060+0000 7f3b73649700 1 -- 172.21.15.107:0/2487622016 shutdown_connections 2024-05-10T10:55:04.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.060+0000 7f3b73649700 1 --2- 172.21.15.107:0/2487622016 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b6c102d60 0x7f3b6c10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:04.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.060+0000 7f3b73649700 1 --2- 172.21.15.107:0/2487622016 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b6c108410 0x7f3b6c1087f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:04.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.060+0000 7f3b73649700 1 --2- 172.21.15.107:0/2487622016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b6c1023a0 0x7f3b6c102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:04.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.060+0000 7f3b73649700 1 -- 172.21.15.107:0/2487622016 >> 172.21.15.107:0/2487622016 conn(0x7f3b6c079350 msgr2=0x7f3b6c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:04.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.060+0000 7f3b73649700 1 -- 172.21.15.107:0/2487622016 shutdown_connections 2024-05-10T10:55:04.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.061+0000 7f3b73649700 1 -- 172.21.15.107:0/2487622016 wait complete. 2024-05-10T10:55:04.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.061+0000 7f3b73649700 1 Processor -- start 2024-05-10T10:55:04.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.061+0000 7f3b73649700 1 -- start start 2024-05-10T10:55:04.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.061+0000 7f3b73649700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b6c1023a0 0x7f3b6c104080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:04.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.061+0000 7f3b73649700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b6c102d60 0x7f3b6c1045c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:04.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.061+0000 7f3b73649700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b6c108410 0x7f3b6c104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:04.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.061+0000 7f3b73649700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c112720 con 0x7f3b6c108410 2024-05-10T10:55:04.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.061+0000 7f3b73649700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c1125a0 con 0x7f3b6c102d60 2024-05-10T10:55:04.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.061+0000 7f3b73649700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c1128a0 con 0x7f3b6c1023a0 2024-05-10T10:55:04.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.061+0000 7f3b71be6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b6c108410 0x7f3b6c104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:04.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.061+0000 7f3b71be6700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b6c108410 0x7f3b6c104b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54438/0 (socket says 172.21.15.107:54438) 2024-05-10T10:55:04.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.061+0000 7f3b71be6700 1 -- 172.21.15.107:0/3457235743 learned_addr learned my addr 172.21.15.107:0/3457235743 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:04.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.061+0000 7f3b713e5700 1 --2- 172.21.15.107:0/3457235743 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b6c1023a0 0x7f3b6c104080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:04.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.062+0000 7f3b70be4700 1 --2- 172.21.15.107:0/3457235743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b6c102d60 0x7f3b6c1045c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:04.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.062+0000 7f3b71be6700 1 -- 172.21.15.107:0/3457235743 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b6c1023a0 msgr2=0x7f3b6c104080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:04.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.062+0000 7f3b71be6700 1 --2- 172.21.15.107:0/3457235743 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b6c1023a0 0x7f3b6c104080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:04.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.062+0000 7f3b71be6700 1 -- 172.21.15.107:0/3457235743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b6c102d60 msgr2=0x7f3b6c1045c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:04.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.062+0000 7f3b71be6700 1 --2- 172.21.15.107:0/3457235743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b6c102d60 0x7f3b6c1045c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:04.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.062+0000 7f3b71be6700 1 -- 172.21.15.107:0/3457235743 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6c1a81c0 con 0x7f3b6c108410 2024-05-10T10:55:04.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.062+0000 7f3b70be4700 1 --2- 172.21.15.107:0/3457235743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b6c102d60 0x7f3b6c1045c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:55:04.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.062+0000 7f3b71be6700 1 --2- 172.21.15.107:0/3457235743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b6c108410 0x7f3b6c104b00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400ada0 tx=0x7f3b6400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:04.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.062+0000 7f3b627fc700 1 -- 172.21.15.107:0/3457235743 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b64017020 con 0x7f3b6c108410 2024-05-10T10:55:04.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.062+0000 7f3b627fc700 1 -- 172.21.15.107:0/3457235743 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3b6400ce50 con 0x7f3b6c108410 2024-05-10T10:55:04.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.062+0000 7f3b627fc700 1 -- 172.21.15.107:0/3457235743 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b640053b0 con 0x7f3b6c108410 2024-05-10T10:55:04.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.062+0000 7f3b73649700 1 -- 172.21.15.107:0/3457235743 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b6c1a84b0 con 0x7f3b6c108410 2024-05-10T10:55:04.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.062+0000 7f3b73649700 1 -- 172.21.15.107:0/3457235743 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b6c1a89f0 con 0x7f3b6c108410 2024-05-10T10:55:04.069 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.063+0000 7f3b73649700 1 -- 172.21.15.107:0/3457235743 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b6c06a190 con 0x7f3b6c108410 2024-05-10T10:55:04.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.065+0000 7f3b627fc700 1 -- 172.21.15.107:0/3457235743 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f3b6400c980 con 0x7f3b6c108410 2024-05-10T10:55:04.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.065+0000 7f3b627fc700 1 --2- 172.21.15.107:0/3457235743 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f3b580b2880 0x7f3b580b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:04.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.065+0000 7f3b713e5700 1 --2- 172.21.15.107:0/3457235743 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f3b580b2880 0x7f3b580b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:04.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.065+0000 7f3b627fc700 1 -- 172.21.15.107:0/3457235743 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f3b640e1e10 con 0x7f3b6c108410 2024-05-10T10:55:04.070 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.066+0000 7f3b713e5700 1 --2- 172.21.15.107:0/3457235743 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f3b580b2880 0x7f3b580b4d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00b5c0 tx=0x7f3b5c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:04.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.069+0000 7f3b627fc700 1 -- 172.21.15.107:0/3457235743 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f3b64021020 con 0x7f3b6c108410 2024-05-10T10:55:04.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.325+0000 7f3b73649700 1 -- 172.21.15.107:0/3457235743 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b6c1a8d10 con 0x7f3b6c108410 2024-05-10T10:55:04.326 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.325+0000 7f3b627fc700 1 -- 172.21.15.107:0/3457235743 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11951 (secure 0 0 0) 0x7f3b6400cc70 con 0x7f3b6c108410 2024-05-10T10:55:04.326 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:55:04.327 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T10:52:17.367732+0000","modified":"2024-05-10T10:52:35.666052+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24482,"mds_1":24449,"mds_2":24442,"mds_3":24431,"mds_4":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/2332963094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":2332963094},{"type":"v1","addr":"172.21.15.107:6841","nonce":2332963094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.184:6839/16501252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":16501252},{"type":"v1","addr":"172.21.15.184:6839","nonce":16501252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24449,24442,24482,24431,24430]},"id":1}]} 2024-05-10T10:55:04.328 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.328+0000 7f3b73649700 1 -- 172.21.15.107:0/3457235743 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f3b580b2880 msgr2=0x7f3b580b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:04.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.328+0000 7f3b73649700 1 --2- 172.21.15.107:0/3457235743 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f3b580b2880 0x7f3b580b4d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00b5c0 tx=0x7f3b5c005960 comp rx=0 tx=0).stop 2024-05-10T10:55:04.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.328+0000 7f3b73649700 1 -- 172.21.15.107:0/3457235743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b6c108410 msgr2=0x7f3b6c104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:04.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.328+0000 7f3b73649700 1 --2- 172.21.15.107:0/3457235743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b6c108410 0x7f3b6c104b00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400ada0 tx=0x7f3b6400c330 comp rx=0 tx=0).stop 2024-05-10T10:55:04.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.328+0000 7f3b73649700 1 -- 172.21.15.107:0/3457235743 shutdown_connections 2024-05-10T10:55:04.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.328+0000 7f3b73649700 1 --2- 172.21.15.107:0/3457235743 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f3b580b2880 0x7f3b580b4d40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:04.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.328+0000 7f3b73649700 1 --2- 172.21.15.107:0/3457235743 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3b6c1023a0 0x7f3b6c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:04.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.328+0000 7f3b73649700 1 --2- 172.21.15.107:0/3457235743 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3b6c108410 0x7f3b6c104b00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:04.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.328+0000 7f3b73649700 1 --2- 172.21.15.107:0/3457235743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b6c102d60 0x7f3b6c1045c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:04.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.328+0000 7f3b73649700 1 -- 172.21.15.107:0/3457235743 >> 172.21.15.107:0/3457235743 conn(0x7f3b6c079350 msgr2=0x7f3b6c101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:04.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.328+0000 7f3b73649700 1 -- 172.21.15.107:0/3457235743 shutdown_connections 2024-05-10T10:55:04.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:04.328+0000 7f3b73649700 1 -- 172.21.15.107:0/3457235743 wait complete. 2024-05-10T10:55:04.330 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 26 2024-05-10T10:55:04.957 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:55:05.200 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:05.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:04 smithi196 ceph-mon[34872]: pgmap v370: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:55:05.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:04 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3457235743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:55:05.321 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:04 smithi107 ceph-mon[30373]: pgmap v370: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:55:05.321 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:04 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3457235743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:55:05.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:04 smithi184 ceph-mon[34585]: pgmap v370: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:55:05.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:04 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3457235743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:55:06.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.951+0000 7fea1677a700 1 -- 172.21.15.107:0/3671868530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea10101eb0 msgr2=0x7fea10102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:06.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.951+0000 7fea1677a700 1 --2- 172.21.15.107:0/3671868530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea10101eb0 0x7fea10102330 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80099c0 tx=0x7fe9f8009cd0 comp rx=0 tx=0).stop 2024-05-10T10:55:06.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.951+0000 7fea1677a700 1 -- 172.21.15.107:0/3671868530 shutdown_connections 2024-05-10T10:55:06.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.951+0000 7fea1677a700 1 --2- 172.21.15.107:0/3671868530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fea10107b80 0x7fea10107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:06.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.951+0000 7fea1677a700 1 --2- 172.21.15.107:0/3671868530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea10102870 0x7fea1010e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:06.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.951+0000 7fea1677a700 1 --2- 172.21.15.107:0/3671868530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea10101eb0 0x7fea10102330 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:06.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.951+0000 7fea1677a700 1 -- 172.21.15.107:0/3671868530 >> 172.21.15.107:0/3671868530 conn(0x7fea100785a0 msgr2=0x7fea100ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:06.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.951+0000 7fea1677a700 1 -- 172.21.15.107:0/3671868530 shutdown_connections 2024-05-10T10:55:06.952 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.951+0000 7fea1677a700 1 -- 172.21.15.107:0/3671868530 wait complete. 2024-05-10T10:55:06.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.951+0000 7fea1677a700 1 Processor -- start 2024-05-10T10:55:06.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea1677a700 1 -- start start 2024-05-10T10:55:06.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea1677a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea10101eb0 0x7fea1019f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:06.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea1677a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fea10102870 0x7fea1019fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:06.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea1677a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea10107b80 0x7fea10199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:06.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea1677a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fea101115c0 con 0x7fea10101eb0 2024-05-10T10:55:06.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea1677a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fea10111440 con 0x7fea10107b80 2024-05-10T10:55:06.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea1677a700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fea10111740 con 0x7fea10102870 2024-05-10T10:55:06.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea0ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea10101eb0 0x7fea1019f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:06.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea0ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea10101eb0 0x7fea1019f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48900/0 (socket says 172.21.15.107:48900) 2024-05-10T10:55:06.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea0ffff700 1 -- 172.21.15.107:0/1291043910 learned_addr learned my addr 172.21.15.107:0/1291043910 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:06.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea07fff700 1 --2- 172.21.15.107:0/1291043910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fea10102870 0x7fea1019fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:06.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea14d17700 1 --2- 172.21.15.107:0/1291043910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea10107b80 0x7fea10199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:06.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea0ffff700 1 -- 172.21.15.107:0/1291043910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fea10102870 msgr2=0x7fea1019fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:06.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea0ffff700 1 --2- 172.21.15.107:0/1291043910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fea10102870 0x7fea1019fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:06.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea0ffff700 1 -- 172.21.15.107:0/1291043910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea10107b80 msgr2=0x7fea10199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:06.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea0ffff700 1 --2- 172.21.15.107:0/1291043910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea10107b80 0x7fea10199ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:06.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea0ffff700 1 -- 172.21.15.107:0/1291043910 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1019a240 con 0x7fea10101eb0 2024-05-10T10:55:06.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea0ffff700 1 --2- 172.21.15.107:0/1291043910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea10101eb0 0x7fea1019f8d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fea0000ddf0 tx=0x7fea0000a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:06.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea0dffb700 1 -- 172.21.15.107:0/1291043910 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0000de20 con 0x7fea10101eb0 2024-05-10T10:55:06.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea1677a700 1 -- 172.21.15.107:0/1291043910 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea1019a530 con 0x7fea10101eb0 2024-05-10T10:55:06.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea0dffb700 1 -- 172.21.15.107:0/1291043910 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fea00004d00 con 0x7fea10101eb0 2024-05-10T10:55:06.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.952+0000 7fea0dffb700 1 -- 172.21.15.107:0/1291043910 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0000e6b0 con 0x7fea10101eb0 2024-05-10T10:55:06.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.953+0000 7fea1677a700 1 -- 172.21.15.107:0/1291043910 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea101a67a0 con 0x7fea10101eb0 2024-05-10T10:55:06.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.953+0000 7fea1677a700 1 -- 172.21.15.107:0/1291043910 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea10103210 con 0x7fea10101eb0 2024-05-10T10:55:06.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.955+0000 7fea0dffb700 1 -- 172.21.15.107:0/1291043910 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fea00004750 con 0x7fea10101eb0 2024-05-10T10:55:06.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.955+0000 7fea0dffb700 1 --2- 172.21.15.107:0/1291043910 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe9fc0b2880 0x7fe9fc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:06.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.956+0000 7fea07fff700 1 --2- 172.21.15.107:0/1291043910 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe9fc0b2880 0x7fe9fc0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:06.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.956+0000 7fea0dffb700 1 -- 172.21.15.107:0/1291043910 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fea000e2510 con 0x7fea10101eb0 2024-05-10T10:55:06.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.956+0000 7fea07fff700 1 --2- 172.21.15.107:0/1291043910 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe9fc0b2880 0x7fe9fc0b4d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8009990 tx=0x7fe9f80096b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:06.959 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:06.959+0000 7fea0dffb700 1 -- 172.21.15.107:0/1291043910 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fea000aa2d0 con 0x7fea10101eb0 2024-05-10T10:55:07.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:06 smithi107 ceph-mon[30373]: pgmap v371: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:55:07.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:07.207+0000 7fea1677a700 1 -- 172.21.15.107:0/1291043910 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea1019aff0 con 0x7fea10101eb0 2024-05-10T10:55:07.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:07.207+0000 7fea0dffb700 1 -- 172.21.15.107:0/1291043910 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11951 (secure 0 0 0) 0x7fea1019aff0 con 0x7fea10101eb0 2024-05-10T10:55:07.208 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:55:07.208 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T10:52:17.367732+0000","modified":"2024-05-10T10:52:35.666052+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24482,"mds_1":24449,"mds_2":24442,"mds_3":24431,"mds_4":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/2332963094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":2332963094},{"type":"v1","addr":"172.21.15.107:6841","nonce":2332963094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.184:6839/16501252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":16501252},{"type":"v1","addr":"172.21.15.184:6839","nonce":16501252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24449,24442,24482,24431,24430]},"id":1}]} 2024-05-10T10:55:07.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:07.210+0000 7fea1677a700 1 -- 172.21.15.107:0/1291043910 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe9fc0b2880 msgr2=0x7fe9fc0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:07.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:07.210+0000 7fea1677a700 1 --2- 172.21.15.107:0/1291043910 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe9fc0b2880 0x7fe9fc0b4d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8009990 tx=0x7fe9f80096b0 comp rx=0 tx=0).stop 2024-05-10T10:55:07.210 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:07.210+0000 7fea1677a700 1 -- 172.21.15.107:0/1291043910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea10101eb0 msgr2=0x7fea1019f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:07.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:07.210+0000 7fea1677a700 1 --2- 172.21.15.107:0/1291043910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea10101eb0 0x7fea1019f8d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fea0000ddf0 tx=0x7fea0000a530 comp rx=0 tx=0).stop 2024-05-10T10:55:07.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:07.210+0000 7fea1677a700 1 -- 172.21.15.107:0/1291043910 shutdown_connections 2024-05-10T10:55:07.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:07.210+0000 7fea1677a700 1 --2- 172.21.15.107:0/1291043910 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe9fc0b2880 0x7fe9fc0b4d40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:07.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:07.210+0000 7fea1677a700 1 --2- 172.21.15.107:0/1291043910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea10107b80 0x7fea10199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:07.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:07.210+0000 7fea1677a700 1 --2- 172.21.15.107:0/1291043910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea10101eb0 0x7fea1019f8d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:07.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:07.210+0000 7fea1677a700 1 --2- 172.21.15.107:0/1291043910 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fea10102870 0x7fea1019fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:07.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:07.210+0000 7fea1677a700 1 -- 172.21.15.107:0/1291043910 >> 172.21.15.107:0/1291043910 conn(0x7fea100785a0 msgr2=0x7fea100fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:07.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:07.210+0000 7fea1677a700 1 -- 172.21.15.107:0/1291043910 shutdown_connections 2024-05-10T10:55:07.211 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:07.210+0000 7fea1677a700 1 -- 172.21.15.107:0/1291043910 wait complete. 2024-05-10T10:55:07.211 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 26 2024-05-10T10:55:07.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:06 smithi196 ceph-mon[34872]: pgmap v371: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:55:07.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:06 smithi184 ceph-mon[34585]: pgmap v371: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:55:07.900 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-10T10:55:08.150 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:08.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:07 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1291043910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:55:08.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:07 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1291043910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:55:08.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:07 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1291043910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:55:09.268 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:08 smithi107 ceph-mon[30373]: pgmap v372: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:55:09.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:08 smithi196 ceph-mon[34872]: pgmap v372: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:55:09.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:08 smithi184 ceph-mon[34585]: pgmap v372: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:55:09.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.823+0000 7f3962c78700 1 -- 172.21.15.107:0/2673360157 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f395c104100 msgr2=0x7f395c108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:09.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.823+0000 7f3962c78700 1 --2- 172.21.15.107:0/2673360157 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f395c104100 0x7f395c108120 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f39480099c0 tx=0x7f3948009cd0 comp rx=0 tx=0).stop 2024-05-10T10:55:09.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.823+0000 7f3962c78700 1 -- 172.21.15.107:0/2673360157 shutdown_connections 2024-05-10T10:55:09.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.823+0000 7f3962c78700 1 --2- 172.21.15.107:0/2673360157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f395c108850 0x7f395c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:09.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.823+0000 7f3962c78700 1 --2- 172.21.15.107:0/2673360157 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f395c103750 0x7f395c103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:09.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.823+0000 7f3962c78700 1 --2- 172.21.15.107:0/2673360157 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f395c104100 0x7f395c108120 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:09.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.823+0000 7f3962c78700 1 -- 172.21.15.107:0/2673360157 >> 172.21.15.107:0/2673360157 conn(0x7f395c07a600 msgr2=0x7f395c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:09.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.823+0000 7f3962c78700 1 -- 172.21.15.107:0/2673360157 shutdown_connections 2024-05-10T10:55:09.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.823+0000 7f3962c78700 1 -- 172.21.15.107:0/2673360157 wait complete. 2024-05-10T10:55:09.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.823+0000 7f3962c78700 1 Processor -- start 2024-05-10T10:55:09.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.823+0000 7f3962c78700 1 -- start start 2024-05-10T10:55:09.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f3962c78700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f395c103750 0x7f395c19f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:09.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f3962c78700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f395c104100 0x7f395c19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:09.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f3962c78700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f395c108850 0x7f395c199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:09.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f3962c78700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f395c113770 con 0x7f395c103750 2024-05-10T10:55:09.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f3962c78700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f395c1135f0 con 0x7f395c108850 2024-05-10T10:55:09.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f3962c78700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f395c1138f0 con 0x7f395c104100 2024-05-10T10:55:09.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f3960a14700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f395c103750 0x7f395c19f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:09.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f3960a14700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f395c103750 0x7f395c19f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48918/0 (socket says 172.21.15.107:48918) 2024-05-10T10:55:09.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f3960a14700 1 -- 172.21.15.107:0/3138957675 learned_addr learned my addr 172.21.15.107:0/3138957675 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:09.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f3961215700 1 --2- 172.21.15.107:0/3138957675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f395c108850 0x7f395c199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:09.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f395bfff700 1 --2- 172.21.15.107:0/3138957675 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f395c104100 0x7f395c19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:09.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f3960a14700 1 -- 172.21.15.107:0/3138957675 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f395c104100 msgr2=0x7f395c19fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:09.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f3960a14700 1 --2- 172.21.15.107:0/3138957675 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f395c104100 0x7f395c19fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:09.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f3960a14700 1 -- 172.21.15.107:0/3138957675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f395c108850 msgr2=0x7f395c199a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:09.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f3960a14700 1 --2- 172.21.15.107:0/3138957675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f395c108850 0x7f395c199a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:09.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f3960a14700 1 -- 172.21.15.107:0/3138957675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395c19a1b0 con 0x7f395c103750 2024-05-10T10:55:09.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f3960a14700 1 --2- 172.21.15.107:0/3138957675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f395c103750 0x7f395c19f890 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f395000c920 tx=0x7f395000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:09.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f3959ffb700 1 -- 172.21.15.107:0/3138957675 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3950007b00 con 0x7f395c103750 2024-05-10T10:55:09.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f3962c78700 1 -- 172.21.15.107:0/3138957675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f395c19a4a0 con 0x7f395c103750 2024-05-10T10:55:09.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.824+0000 7f3959ffb700 1 -- 172.21.15.107:0/3138957675 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3950004d00 con 0x7f395c103750 2024-05-10T10:55:09.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.825+0000 7f3959ffb700 1 -- 172.21.15.107:0/3138957675 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395000f450 con 0x7f395c103750 2024-05-10T10:55:09.828 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.825+0000 7f3962c78700 1 -- 172.21.15.107:0/3138957675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f395c1a6760 con 0x7f395c103750 2024-05-10T10:55:09.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.826+0000 7f3962c78700 1 -- 172.21.15.107:0/3138957675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f395c06a190 con 0x7f395c103750 2024-05-10T10:55:09.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.827+0000 7f3959ffb700 1 -- 172.21.15.107:0/3138957675 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f3950007ca0 con 0x7f395c103750 2024-05-10T10:55:09.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.828+0000 7f3959ffb700 1 --2- 172.21.15.107:0/3138957675 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f394c0b2880 0x7f394c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:09.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.828+0000 7f395bfff700 1 --2- 172.21.15.107:0/3138957675 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f394c0b2880 0x7f394c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:09.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.828+0000 7f3959ffb700 1 -- 172.21.15.107:0/3138957675 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f39500e2150 con 0x7f395c103750 2024-05-10T10:55:09.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.828+0000 7f395bfff700 1 --2- 172.21.15.107:0/3138957675 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f394c0b2880 0x7f394c0b4d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3948006010 tx=0x7f3948000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:09.833 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:09.833+0000 7f3959ffb700 1 -- 172.21.15.107:0/3138957675 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f3950014030 con 0x7f395c103750 2024-05-10T10:55:10.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:10.043+0000 7f3962c78700 1 -- 172.21.15.107:0/3138957675 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f395c19afb0 con 0x7f395c103750 2024-05-10T10:55:10.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:10.044+0000 7f3959ffb700 1 -- 172.21.15.107:0/3138957675 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22560 (secure 0 0 0) 0x7f395c19afb0 con 0x7f395c103750 2024-05-10T10:55:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:55:10.045 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":82,"fsid":"0ba8a8e4-0eba-11ef-bc98-c7b262605968","created":"2024-05-10T10:44:13.064379+0000","modified":"2024-05-10T10:53:08.899432+0000","last_up_change":"2024-05-10T10:51:12.979718+0000","last_in_change":"2024-05-10T10:50:53.297651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T10:47:31.600062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T10:52:10.705022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T10:52:14.377732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"503f960c-a74b-4979-9bf9-42c90a2885a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6803","nonce":4213004004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6805","nonce":4213004004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6809","nonce":4213004004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6807","nonce":4213004004}]},"public_addr":"172.21.15.107:6803/4213004004","cluster_addr":"172.21.15.107:6805/4213004004","heartbeat_back_addr":"172.21.15.107:6809/4213004004","heartbeat_front_addr":"172.21.15.107:6807/4213004004","state":["exists","up"]},{"osd":1,"uuid":"f0f89167-1aa1-40a1-b122-c7f203c587d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6801","nonce":3242825160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6803","nonce":3242825160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6807","nonce":3242825160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6805","nonce":3242825160}]},"public_addr":"172.21.15.184:6801/3242825160","cluster_addr":"172.21.15.184:6803/3242825160","heartbeat_back_addr":"172.21.15.184:6807/3242825160","heartbeat_front_addr":"172.21.15.184:6805/3242825160","state":["exists","up"]},{"osd":2,"uuid":"7588b9be-b935-450a-944f-3feca69c029c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6801","nonce":137473043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6803","nonce":137473043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6807","nonce":137473043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6805","nonce":137473043}]},"public_addr":"172.21.15.196:6801/137473043","cluster_addr":"172.21.15.196:6803/137473043","heartbeat_back_addr":"172.21.15.196:6807/137473043","heartbeat_front_addr":"172.21.15.196:6805/137473043","state":["exists","up"]},{"osd":3,"uuid":"589ec3bb-884a-4441-a9d2-1f34ab372cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6811","nonce":1995642021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6813","nonce":1995642021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6817","nonce":1995642021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6815","nonce":1995642021}]},"public_addr":"172.21.15.107:6811/1995642021","cluster_addr":"172.21.15.107:6813/1995642021","heartbeat_back_addr":"172.21.15.107:6817/1995642021","heartbeat_front_addr":"172.21.15.107:6815/1995642021","state":["exists","up"]},{"osd":4,"uuid":"b72cdb50-492b-4406-8f21-37e4b2cf5a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6809","nonce":271550329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6811","nonce":271550329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6815","nonce":271550329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6813","nonce":271550329}]},"public_addr":"172.21.15.184:6809/271550329","cluster_addr":"172.21.15.184:6811/271550329","heartbeat_back_addr":"172.21.15.184:6815/271550329","heartbeat_front_addr":"172.21.15.184:6813/271550329","state":["exists","up"]},{"osd":5,"uuid":"05b6ad82-9153-44df-ae64-50c82d304429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6809","nonce":3681130435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6811","nonce":3681130435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6815","nonce":3681130435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6813","nonce":3681130435}]},"public_addr":"172.21.15.196:6809/3681130435","cluster_addr":"172.21.15.196:6811/3681130435","heartbeat_back_addr":"172.21.15.196:6815/3681130435","heartbeat_front_addr":"172.21.15.196:6813/3681130435","state":["exists","up"]},{"osd":6,"uuid":"bceadd7a-20bf-4482-aaab-46a2539cf37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6819","nonce":4223253757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6821","nonce":4223253757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6825","nonce":4223253757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6823","nonce":4223253757}]},"public_addr":"172.21.15.107:6819/4223253757","cluster_addr":"172.21.15.107:6821/4223253757","heartbeat_back_addr":"172.21.15.107:6825/4223253757","heartbeat_front_addr":"172.21.15.107:6823/4223253757","state":["exists","up"]},{"osd":7,"uuid":"0d9243a6-0e16-4677-a0b0-010be4162148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6817","nonce":2850715284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6819","nonce":2850715284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6823","nonce":2850715284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6821","nonce":2850715284}]},"public_addr":"172.21.15.184:6817/2850715284","cluster_addr":"172.21.15.184:6819/2850715284","heartbeat_back_addr":"172.21.15.184:6823/2850715284","heartbeat_front_addr":"172.21.15.184:6821/2850715284","state":["exists","up"]},{"osd":8,"uuid":"24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6817","nonce":504426486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6819","nonce":504426486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6823","nonce":504426486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6821","nonce":504426486}]},"public_addr":"172.21.15.196:6817/504426486","cluster_addr":"172.21.15.196:6819/504426486","heartbeat_back_addr":"172.21.15.196:6823/504426486","heartbeat_front_addr":"172.21.15.196:6821/504426486","state":["exists","up"]},{"osd":9,"uuid":"8bcb03ec-1342-4679-9343-fcefd28dd69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6827","nonce":1533051760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6829","nonce":1533051760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6833","nonce":1533051760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6831","nonce":1533051760}]},"public_addr":"172.21.15.107:6827/1533051760","cluster_addr":"172.21.15.107:6829/1533051760","heartbeat_back_addr":"172.21.15.107:6833/1533051760","heartbeat_front_addr":"172.21.15.107:6831/1533051760","state":["exists","up"]},{"osd":10,"uuid":"78374015-aa7f-4288-b5ae-be64a5182bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6825","nonce":1387541139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6827","nonce":1387541139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6831","nonce":1387541139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6829","nonce":1387541139}]},"public_addr":"172.21.15.184:6825/1387541139","cluster_addr":"172.21.15.184:6827/1387541139","heartbeat_back_addr":"172.21.15.184:6831/1387541139","heartbeat_front_addr":"172.21.15.184:6829/1387541139","state":["exists","up"]},{"osd":11,"uuid":"4aeb2b1a-f35e-44ea-be64-f60c31a096e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6825","nonce":3861964533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6827","nonce":3861964533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6831","nonce":3861964533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6829","nonce":3861964533}]},"public_addr":"172.21.15.196:6825/3861964533","cluster_addr":"172.21.15.196:6827/3861964533","heartbeat_back_addr":"172.21.15.196:6831/3861964533","heartbeat_front_addr":"172.21.15.196:6829/3861964533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:46:42.110232+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:06.232727+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:29.623425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:53.466546+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:17.927564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:41.913454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:06.610629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:31.048807+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:54.922097+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:20.727547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:46.072303+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:51:11.022775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:0/3518338734":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/4092342993":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6800/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:6800/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3761740075":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/2215024983":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/2124974715":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3361930986":"2024-05-11T10:44:40.339608+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T10:55:10.047 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:10.047+0000 7f3962c78700 1 -- 172.21.15.107:0/3138957675 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f394c0b2880 msgr2=0x7f394c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:10.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:10.047+0000 7f3962c78700 1 --2- 172.21.15.107:0/3138957675 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f394c0b2880 0x7f394c0b4d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3948006010 tx=0x7f3948000bc0 comp rx=0 tx=0).stop 2024-05-10T10:55:10.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:10.047+0000 7f3962c78700 1 -- 172.21.15.107:0/3138957675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f395c103750 msgr2=0x7f395c19f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:10.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:10.047+0000 7f3962c78700 1 --2- 172.21.15.107:0/3138957675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f395c103750 0x7f395c19f890 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f395000c920 tx=0x7f395000cce0 comp rx=0 tx=0).stop 2024-05-10T10:55:10.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:10.047+0000 7f3962c78700 1 -- 172.21.15.107:0/3138957675 shutdown_connections 2024-05-10T10:55:10.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:10.047+0000 7f3962c78700 1 --2- 172.21.15.107:0/3138957675 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f394c0b2880 0x7f394c0b4d40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:10.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:10.047+0000 7f3962c78700 1 --2- 172.21.15.107:0/3138957675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f395c108850 0x7f395c199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:10.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:10.047+0000 7f3962c78700 1 --2- 172.21.15.107:0/3138957675 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f395c103750 0x7f395c19f890 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:10.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:10.047+0000 7f3962c78700 1 --2- 172.21.15.107:0/3138957675 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f395c104100 0x7f395c19fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:10.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:10.047+0000 7f3962c78700 1 -- 172.21.15.107:0/3138957675 >> 172.21.15.107:0/3138957675 conn(0x7f395c07a600 msgr2=0x7f395c1015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:10.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:10.047+0000 7f3962c78700 1 -- 172.21.15.107:0/3138957675 shutdown_connections 2024-05-10T10:55:10.048 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:10.047+0000 7f3962c78700 1 -- 172.21.15.107:0/3138957675 wait complete. 2024-05-10T10:55:10.738 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-10T10:52:17.367732+0000', 'modified': '2024-05-10T10:52:35.666052+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24482, 'mds_1': 24449, 'mds_2': 24442, 'mds_3': 24431, 'mds_4': 24430}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14592': {'gid': 14592, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.107:6839/1923447762', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6838', 'nonce': 1923447762}, {'type': 'v1', 'addr': '172.21.15.107:6839', 'nonce': 1923447762}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14604': {'gid': 14604, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.107:6841/2332963094', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6840', 'nonce': 2332963094}, {'type': 'v1', 'addr': '172.21.15.107:6841', 'nonce': 2332963094}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.196:6833/2603001203', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6832', 'nonce': 2603001203}, {'type': 'v1', 'addr': '172.21.15.196:6833', 'nonce': 2603001203}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24404': {'gid': 24404, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6833/3101071828', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6832', 'nonce': 3101071828}, {'type': 'v1', 'addr': '172.21.15.184:6833', 'nonce': 3101071828}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24418': {'gid': 24418, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.196:6835/3609693196', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6834', 'nonce': 3609693196}, {'type': 'v1', 'addr': '172.21.15.196:6835', 'nonce': 3609693196}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'c', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.196:6837/3628757645', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6836', 'nonce': 3628757645}, {'type': 'v1', 'addr': '172.21.15.196:6837', 'nonce': 3628757645}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'e', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.184:6835/872203477', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 872203477}, {'type': 'v1', 'addr': '172.21.15.184:6835', 'nonce': 872203477}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.196:6839/4142119667', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6838', 'nonce': 4142119667}, {'type': 'v1', 'addr': '172.21.15.196:6839', 'nonce': 4142119667}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.184:6837/4239260328', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6836', 'nonce': 4239260328}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 4239260328}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.184:6839/16501252', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6838', 'nonce': 16501252}, {'type': 'v1', 'addr': '172.21.15.184:6839', 'nonce': 16501252}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24482, 'qdb_cluster': [24449, 24442, 24482, 24431, 24430]} 2024-05-10T10:55:10.738 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-10T10:55:10.738 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell mds.c status 2024-05-10T10:55:10.991 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:11.113 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:10 smithi107 ceph-mon[30373]: pgmap v373: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:55:11.113 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:10 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3138957675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:55:11.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:10 smithi196 ceph-mon[34872]: pgmap v373: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:55:11.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:10 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3138957675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:55:11.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:10 smithi184 ceph-mon[34585]: pgmap v373: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:55:11.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:10 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3138957675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:55:12.672 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.671+0000 7fbd7e3cf700 1 -- 172.21.15.107:0/1482045339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd78104100 msgr2=0x7fbd78108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.671+0000 7fbd7e3cf700 1 --2- 172.21.15.107:0/1482045339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd78104100 0x7fbd78108120 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0099c0 tx=0x7fbd6c009cd0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.671+0000 7fbd7e3cf700 1 -- 172.21.15.107:0/1482045339 shutdown_connections 2024-05-10T10:55:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.671+0000 7fbd7e3cf700 1 --2- 172.21.15.107:0/1482045339 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd78108850 0x7fbd781103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.671+0000 7fbd7e3cf700 1 --2- 172.21.15.107:0/1482045339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd78103750 0x7fbd78103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.671+0000 7fbd7e3cf700 1 --2- 172.21.15.107:0/1482045339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd78104100 0x7fbd78108120 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.671+0000 7fbd7e3cf700 1 -- 172.21.15.107:0/1482045339 >> 172.21.15.107:0/1482045339 conn(0x7fbd7807a600 msgr2=0x7fbd7807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.672+0000 7fbd7e3cf700 1 -- 172.21.15.107:0/1482045339 shutdown_connections 2024-05-10T10:55:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.672+0000 7fbd7e3cf700 1 -- 172.21.15.107:0/1482045339 wait complete. 2024-05-10T10:55:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.672+0000 7fbd7e3cf700 1 Processor -- start 2024-05-10T10:55:12.673 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.672+0000 7fbd7e3cf700 1 -- start start 2024-05-10T10:55:12.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.672+0000 7fbd7e3cf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd78103750 0x7fbd7819f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:12.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd7e3cf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd78104100 0x7fbd7819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:12.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd7e3cf700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd78108850 0x7fbd78199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:12.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd7e3cf700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbd78113770 con 0x7fbd78103750 2024-05-10T10:55:12.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd7e3cf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbd781135f0 con 0x7fbd78104100 2024-05-10T10:55:12.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd7e3cf700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbd781138f0 con 0x7fbd78108850 2024-05-10T10:55:12.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd77fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd78103750 0x7fbd7819f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:12.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd77fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd78103750 0x7fbd7819f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48936/0 (socket says 172.21.15.107:48936) 2024-05-10T10:55:12.675 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd77fff700 1 -- 172.21.15.107:0/535241315 learned_addr learned my addr 172.21.15.107:0/535241315 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:12.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd7c96c700 1 --2- 172.21.15.107:0/535241315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd78108850 0x7fbd78199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:12.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd77fff700 1 -- 172.21.15.107:0/535241315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd78108850 msgr2=0x7fbd78199a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:12.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd77fff700 1 --2- 172.21.15.107:0/535241315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd78108850 0x7fbd78199a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd77fff700 1 -- 172.21.15.107:0/535241315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd78104100 msgr2=0x7fbd7819fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:12.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd777fe700 1 --2- 172.21.15.107:0/535241315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd78104100 0x7fbd7819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:12.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd77fff700 1 --2- 172.21.15.107:0/535241315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd78104100 0x7fbd7819fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd77fff700 1 -- 172.21.15.107:0/535241315 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7819a1b0 con 0x7fbd78103750 2024-05-10T10:55:12.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd77fff700 1 --2- 172.21.15.107:0/535241315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd78103750 0x7fbd7819f840 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800c9b0 tx=0x7fbd6800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:12.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd757fa700 1 -- 172.21.15.107:0/535241315 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd68007b00 con 0x7fbd78103750 2024-05-10T10:55:12.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd7e3cf700 1 -- 172.21.15.107:0/535241315 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd7819a4a0 con 0x7fbd78103750 2024-05-10T10:55:12.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd757fa700 1 -- 172.21.15.107:0/535241315 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbd68007ca0 con 0x7fbd78103750 2024-05-10T10:55:12.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd757fa700 1 -- 172.21.15.107:0/535241315 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd680187c0 con 0x7fbd78103750 2024-05-10T10:55:12.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.673+0000 7fbd7e3cf700 1 -- 172.21.15.107:0/535241315 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd781a6710 con 0x7fbd78103750 2024-05-10T10:55:12.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.676+0000 7fbd757fa700 1 -- 172.21.15.107:0/535241315 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fbd6800f450 con 0x7fbd78103750 2024-05-10T10:55:12.677 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.676+0000 7fbd757fa700 1 --2- 172.21.15.107:0/535241315 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbd600b2880 0x7fbd600b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:12.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.677+0000 7fbd777fe700 1 --2- 172.21.15.107:0/535241315 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbd600b2880 0x7fbd600b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:12.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.677+0000 7fbd757fa700 1 -- 172.21.15.107:0/535241315 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fbd680e2250 con 0x7fbd78103750 2024-05-10T10:55:12.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.677+0000 7fbd777fe700 1 --2- 172.21.15.107:0/535241315 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbd600b2880 0x7fbd600b4d40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c006010 tx=0x7fbd6c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:12.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.677+0000 7fbd88c62b80 1 Processor -- start 2024-05-10T10:55:12.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.677+0000 7fbd88c62b80 1 -- start start 2024-05-10T10:55:12.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.677+0000 7fbd88c62b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a995890 0x55a95a995c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:12.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.677+0000 7fbd88c62b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 0x55a95a999ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:12.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.677+0000 7fbd88c62b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 0x55a95a99a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:12.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.677+0000 7fbd88c62b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a95a8e3810 con 0x55a95a999ff0 2024-05-10T10:55:12.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.677+0000 7fbd88c62b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a95a882770 con 0x55a95a9961b0 2024-05-10T10:55:12.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.677+0000 7fbd88c62b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a95a8df7d0 con 0x55a95a995890 2024-05-10T10:55:12.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.678+0000 7fbd7c96c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 0x55a95a99a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:12.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.678+0000 7fbd7c96c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 0x55a95a99a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48950/0 (socket says 172.21.15.107:48950) 2024-05-10T10:55:12.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.678+0000 7fbd7c96c700 1 -- 172.21.15.107:0/1923057077 learned_addr learned my addr 172.21.15.107:0/1923057077 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:12.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.678+0000 7fbd777fe700 1 --2- 172.21.15.107:0/1923057077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 0x55a95a999ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:12.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.678+0000 7fbd77fff700 1 --2- 172.21.15.107:0/1923057077 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a995890 0x55a95a995c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:12.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.678+0000 7fbd7c96c700 1 -- 172.21.15.107:0/1923057077 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a995890 msgr2=0x55a95a995c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:12.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.678+0000 7fbd7c96c700 1 --2- 172.21.15.107:0/1923057077 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a995890 0x55a95a995c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.678+0000 7fbd7c96c700 1 -- 172.21.15.107:0/1923057077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 msgr2=0x55a95a999ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:12.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.678+0000 7fbd7c96c700 1 --2- 172.21.15.107:0/1923057077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 0x55a95a999ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.678+0000 7fbd7c96c700 1 -- 172.21.15.107:0/1923057077 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a95a830880 con 0x55a95a999ff0 2024-05-10T10:55:12.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.678+0000 7fbd77fff700 1 --2- 172.21.15.107:0/1923057077 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a995890 0x55a95a995c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:55:12.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.678+0000 7fbd7c96c700 1 --2- 172.21.15.107:0/1923057077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 0x55a95a99a450 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009d20 tx=0x7fbd700077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecdc26d91f99395 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:12.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.678+0000 7fbd5e7fc700 1 -- 172.21.15.107:0/1923057077 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd70004bb0 con 0x55a95a999ff0 2024-05-10T10:55:12.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.678+0000 7fbd5e7fc700 1 -- 172.21.15.107:0/1923057077 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbd70004d50 con 0x55a95a999ff0 2024-05-10T10:55:12.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.679+0000 7fbd5e7fc700 1 -- 172.21.15.107:0/1923057077 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd70014670 con 0x55a95a999ff0 2024-05-10T10:55:12.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.679+0000 7fbd88c62b80 1 -- 172.21.15.107:0/1923057077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 msgr2=0x55a95a99a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:12.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.679+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/1923057077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 0x55a95a99a450 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009d20 tx=0x7fbd700077e0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.679+0000 7fbd88c62b80 1 -- 172.21.15.107:0/1923057077 shutdown_connections 2024-05-10T10:55:12.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.679+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/1923057077 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a995890 0x55a95a995c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.679+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/1923057077 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 0x55a95a99a450 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.679+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/1923057077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 0x55a95a999ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.679+0000 7fbd88c62b80 1 -- 172.21.15.107:0/1923057077 >> 172.21.15.107:0/1923057077 conn(0x55a95a8bd0b0 msgr2=0x55a95a98bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:12.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.679+0000 7fbd88c62b80 1 -- 172.21.15.107:0/1923057077 shutdown_connections 2024-05-10T10:55:12.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.679+0000 7fbd88c62b80 1 -- 172.21.15.107:0/1923057077 wait complete. 2024-05-10T10:55:12.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.680+0000 7fbd88c62b80 1 -- start start 2024-05-10T10:55:12.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.680+0000 7fbd88c62b80 1 Processor -- start 2024-05-10T10:55:12.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.680+0000 7fbd88c62b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a995890 0x55a95a9a1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:12.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.680+0000 7fbd88c62b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 0x55a95a99e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:12.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.680+0000 7fbd88c62b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a999ff0 0x55a95a99ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:12.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.680+0000 7fbd88c62b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a95a9a2200 con 0x55a95a995890 2024-05-10T10:55:12.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.680+0000 7fbd88c62b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a95a849be0 con 0x55a95a9961b0 2024-05-10T10:55:12.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.680+0000 7fbd88c62b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a95a9a2380 con 0x55a95a999ff0 2024-05-10T10:55:12.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.680+0000 7fbd88c62b80 10 client.0 _ll_register_callbacks cb 0x55a95a87b8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:55:12.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.680+0000 7fbd77fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a995890 0x55a95a9a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:12.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.680+0000 7fbd77fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a995890 0x55a95a9a1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48956/0 (socket says 172.21.15.107:48956) 2024-05-10T10:55:12.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.680+0000 7fbd77fff700 1 -- 172.21.15.107:0/3195449689 learned_addr learned my addr 172.21.15.107:0/3195449689 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:12.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.680+0000 7fbd7c96c700 1 --2- 172.21.15.107:0/3195449689 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a999ff0 0x55a95a99ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:12.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.681+0000 7fbd777fe700 1 --2- 172.21.15.107:0/3195449689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 0x55a95a99e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:12.686 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.681+0000 7fbd77fff700 1 -- 172.21.15.107:0/3195449689 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a999ff0 msgr2=0x55a95a99ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:12.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.681+0000 7fbd77fff700 1 --2- 172.21.15.107:0/3195449689 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a999ff0 0x55a95a99ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.681+0000 7fbd77fff700 1 -- 172.21.15.107:0/3195449689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 msgr2=0x55a95a99e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:12.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.681+0000 7fbd77fff700 1 --2- 172.21.15.107:0/3195449689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 0x55a95a99e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.681+0000 7fbd77fff700 1 -- 172.21.15.107:0/3195449689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a95a87f640 con 0x55a95a995890 2024-05-10T10:55:12.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.681+0000 7fbd77fff700 1 --2- 172.21.15.107:0/3195449689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a995890 0x55a95a9a1430 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbd680a6b80 tx=0x7fbd680b21f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61b4d3d5c6e3863 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:12.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.681+0000 7fbd577fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:55:12.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.681+0000 7fbd577fe700 1 -- 172.21.15.107:0/3195449689 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd680adcc0 con 0x55a95a995890 2024-05-10T10:55:12.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.681+0000 7fbd577fe700 1 -- 172.21.15.107:0/3195449689 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fbd680a5f00 con 0x55a95a995890 2024-05-10T10:55:12.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.681+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3195449689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd70004d50 con 0x55a95a995890 2024-05-10T10:55:12.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.681+0000 7fbd577fe700 1 -- 172.21.15.107:0/3195449689 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbd680b2770 con 0x55a95a995890 2024-05-10T10:55:12.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.681+0000 7fbd88c62b80 10 client.15105 fetch_fsmap learned FSMap version 26 2024-05-10T10:55:12.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.681+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3195449689 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a95a9aca80 con 0x55a95a995890 2024-05-10T10:55:12.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.681+0000 7fbd577fe700 1 -- 172.21.15.107:0/3195449689 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbd70004d50 con 0x55a95a995890 2024-05-10T10:55:12.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.681+0000 7fbd577fe700 1 -- 172.21.15.107:0/3195449689 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fbd680b22e0 con 0x55a95a995890 2024-05-10T10:55:12.687 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.682+0000 7fbd88c62b80 10 client.15105 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:55:12.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.682+0000 7fbd88c62b80 10 client.15105 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T10:55:12.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.682+0000 7fbd88c62b80 20 client.15105 populate_metadata read hostname 'smithi107' 2024-05-10T10:55:12.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.682+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/3195449689 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55a95a9af000 0x55a95a9b0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:12.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.682+0000 7fbd88c62b80 4 client.15105 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:55:12.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.682+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3195449689 --> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a95a95d600 con 0x55a95a9af000 2024-05-10T10:55:12.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.682+0000 7fbd777fe700 1 --2- 172.21.15.107:0/3195449689 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55a95a9af000 0x55a95a9b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:12.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.682+0000 7fbd577fe700 10 client.15105 ms_handle_connect on v2:172.21.15.196:6836/3628757645 2024-05-10T10:55:12.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.682+0000 7fbd777fe700 1 --2- 172.21.15.107:0/3195449689 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55a95a9af000 0x55a95a9b0470 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=42f7b01f9aba52e5 server_cookie=1c55603d60eda8fe in_seq=0 out_seq=0 2024-05-10T10:55:12.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.683+0000 7fbd577fe700 1 -- 172.21.15.107:0/3195449689 <== mds.4 v2:172.21.15.196:6836/3628757645 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a95a95d600 con 0x55a95a9af000 2024-05-10T10:55:12.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.683+0000 7fbd577fe700 10 client.15105 handle_command_reply: tid=0 2024-05-10T10:55:12.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.683+0000 7fbd88c62b80 1 client.15105 shutdown 2024-05-10T10:55:12.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.683+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3195449689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a995890 msgr2=0x55a95a9a1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:12.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.683+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/3195449689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a995890 0x55a95a9a1430 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbd680a6b80 tx=0x7fbd680b21f0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.683+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3195449689 shutdown_connections 2024-05-10T10:55:12.688 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.683+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/3195449689 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55a95a9af000 0x55a95a9b0470 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.683+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/3195449689 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a999ff0 0x55a95a99ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.683+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/3195449689 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a995890 0x55a95a9a1430 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.683+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/3195449689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 0x55a95a99e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.683+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3195449689 >> 172.21.15.107:0/3195449689 conn(0x55a95a8bd0b0 msgr2=0x55a95a9866d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:12.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.683+0000 7fbd577fe700 0 client.15105 ms_handle_reset on v2:172.21.15.196:6836/3628757645 2024-05-10T10:55:12.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.683+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3195449689 shutdown_connections 2024-05-10T10:55:12.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.683+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3195449689 wait complete. 2024-05-10T10:55:12.689 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.683+0000 7fbd88c62b80 20 client.15105 trim_cache size 0 max 16384 2024-05-10T10:55:12.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.704+0000 7fbd88c62b80 1 Processor -- start 2024-05-10T10:55:12.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.704+0000 7fbd88c62b80 1 -- start start 2024-05-10T10:55:12.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.704+0000 7fbd88c62b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a995890 0x55a95a99c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:12.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.704+0000 7fbd88c62b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 0x55a95a99a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:12.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.704+0000 7fbd88c62b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 0x55a95a99a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.704+0000 7fbd88c62b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a95a9ae7b0 con 0x55a95a999ff0 2024-05-10T10:55:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.704+0000 7fbd88c62b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a95a9aee80 con 0x55a95a9961b0 2024-05-10T10:55:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.704+0000 7fbd88c62b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a95a9af550 con 0x55a95a995890 2024-05-10T10:55:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.704+0000 7fbd7c96c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 0x55a95a99a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.704+0000 7fbd7c96c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 0x55a95a99a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48966/0 (socket says 172.21.15.107:48966) 2024-05-10T10:55:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.704+0000 7fbd7c96c700 1 -- 172.21.15.107:0/3623167097 learned_addr learned my addr 172.21.15.107:0/3623167097 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.704+0000 7fbd77fff700 1 --2- 172.21.15.107:0/3623167097 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a995890 0x55a95a99c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.704+0000 7fbd777fe700 1 --2- 172.21.15.107:0/3623167097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 0x55a95a99a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.704+0000 7fbd7c96c700 1 -- 172.21.15.107:0/3623167097 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a995890 msgr2=0x55a95a99c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.704+0000 7fbd7c96c700 1 --2- 172.21.15.107:0/3623167097 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a995890 0x55a95a99c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.706 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.704+0000 7fbd7c96c700 1 -- 172.21.15.107:0/3623167097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 msgr2=0x55a95a99a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:12.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.704+0000 7fbd7c96c700 1 --2- 172.21.15.107:0/3623167097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 0x55a95a99a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.704+0000 7fbd7c96c700 1 -- 172.21.15.107:0/3623167097 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a95a9a1b70 con 0x55a95a999ff0 2024-05-10T10:55:12.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.704+0000 7fbd777fe700 1 --2- 172.21.15.107:0/3623167097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 0x55a95a99a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:55:12.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.705+0000 7fbd7c96c700 1 --2- 172.21.15.107:0/3623167097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 0x55a95a99a910 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbd700092f0 tx=0x7fbd700095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ead208ad5bb505 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:12.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.705+0000 7fbd5dffb700 1 -- 172.21.15.107:0/3623167097 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7001e420 con 0x55a95a999ff0 2024-05-10T10:55:12.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.705+0000 7fbd5dffb700 1 -- 172.21.15.107:0/3623167097 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbd7001ea90 con 0x55a95a999ff0 2024-05-10T10:55:12.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.705+0000 7fbd5dffb700 1 -- 172.21.15.107:0/3623167097 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd700149e0 con 0x55a95a999ff0 2024-05-10T10:55:12.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.706+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3623167097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 msgr2=0x55a95a99a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:12.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.706+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/3623167097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 0x55a95a99a910 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbd700092f0 tx=0x7fbd700095e0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.706+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3623167097 shutdown_connections 2024-05-10T10:55:12.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.706+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/3623167097 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a995890 0x55a95a99c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.706+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/3623167097 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 0x55a95a99a910 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.706+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/3623167097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 0x55a95a99a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.706+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3623167097 >> 172.21.15.107:0/3623167097 conn(0x55a95a8bd0b0 msgr2=0x55a95a99d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:12.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.706+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3623167097 shutdown_connections 2024-05-10T10:55:12.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.706+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3623167097 wait complete. 2024-05-10T10:55:12.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.706+0000 7fbd88c62b80 1 -- start start 2024-05-10T10:55:12.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.706+0000 7fbd88c62b80 1 Processor -- start 2024-05-10T10:55:12.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd88c62b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a995890 0x55a95a9b9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:12.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd88c62b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 0x55a95a997280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:12.712 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd88c62b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 0x55a95a9979c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:12.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd88c62b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55a95a9b02f0 con 0x55a95a999ff0 2024-05-10T10:55:12.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd88c62b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a95a9afc20 con 0x55a95a9961b0 2024-05-10T10:55:12.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd88c62b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55a95a9b09c0 con 0x55a95a995890 2024-05-10T10:55:12.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd88c62b80 10 client.0 _ll_register_callbacks cb 0x55a95a87b8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:55:12.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd7c96c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 0x55a95a9979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:12.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd7c96c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 0x55a95a9979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48970/0 (socket says 172.21.15.107:48970) 2024-05-10T10:55:12.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd7c96c700 1 -- 172.21.15.107:0/3067277182 learned_addr learned my addr 172.21.15.107:0/3067277182 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:12.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd77fff700 1 --2- 172.21.15.107:0/3067277182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a995890 0x55a95a9b9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:12.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd777fe700 1 --2- 172.21.15.107:0/3067277182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 0x55a95a997280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:12.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd7c96c700 1 -- 172.21.15.107:0/3067277182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a995890 msgr2=0x55a95a9b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:12.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd7c96c700 1 --2- 172.21.15.107:0/3067277182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a995890 0x55a95a9b9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd7c96c700 1 -- 172.21.15.107:0/3067277182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 msgr2=0x55a95a997280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:12.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd7c96c700 1 --2- 172.21.15.107:0/3067277182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 0x55a95a997280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd7c96c700 1 -- 172.21.15.107:0/3067277182 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a95a9887c0 con 0x55a95a999ff0 2024-05-10T10:55:12.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd7c96c700 1 --2- 172.21.15.107:0/3067277182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 0x55a95a9979c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbd7001e650 tx=0x7fbd7001e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbe4f9e07c39b07 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:12.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd577fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:55:12.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.707+0000 7fbd577fe700 1 -- 172.21.15.107:0/3067277182 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd70014410 con 0x55a95a999ff0 2024-05-10T10:55:12.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.708+0000 7fbd577fe700 1 -- 172.21.15.107:0/3067277182 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fbd700145b0 con 0x55a95a999ff0 2024-05-10T10:55:12.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.708+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3067277182 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd7001ea90 con 0x55a95a999ff0 2024-05-10T10:55:12.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.708+0000 7fbd577fe700 1 -- 172.21.15.107:0/3067277182 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbd700147b0 con 0x55a95a999ff0 2024-05-10T10:55:12.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.708+0000 7fbd88c62b80 10 client.15111 fetch_fsmap learned FSMap version 26 2024-05-10T10:55:12.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.708+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3067277182 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a95aa1a470 con 0x55a95a999ff0 2024-05-10T10:55:12.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.708+0000 7fbd577fe700 1 -- 172.21.15.107:0/3067277182 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbd7001ea90 con 0x55a95a999ff0 2024-05-10T10:55:12.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.708+0000 7fbd577fe700 1 -- 172.21.15.107:0/3067277182 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fbd7003cb90 con 0x55a95a999ff0 2024-05-10T10:55:12.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.708+0000 7fbd88c62b80 10 client.15111 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:55:12.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.708+0000 7fbd88c62b80 10 client.15111 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T10:55:12.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.708+0000 7fbd88c62b80 20 client.15111 populate_metadata read hostname 'smithi107' 2024-05-10T10:55:12.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.708+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/3067277182 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55a95aa1e7d0 0x55a95aa1d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:12.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.708+0000 7fbd88c62b80 4 client.15111 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T10:55:12.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.708+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3067277182 --> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] -- command(tid 0: {"prefix": "status"}) -- 0x55a95a8f11f0 con 0x55a95aa1e7d0 2024-05-10T10:55:12.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.709+0000 7fbd77fff700 1 --2- 172.21.15.107:0/3067277182 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55a95aa1e7d0 0x55a95aa1d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:12.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.709+0000 7fbd77fff700 1 --2- 172.21.15.107:0/3067277182 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55a95aa1e7d0 0x55a95aa1d4e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=898f6d1328489923 server_cookie=82c2ed0a8ba73635 in_seq=0 out_seq=0 2024-05-10T10:55:12.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.709+0000 7fbd577fe700 10 client.15111 ms_handle_connect on v2:172.21.15.196:6836/3628757645 2024-05-10T10:55:12.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.709+0000 7fbd577fe700 1 -- 172.21.15.107:0/3067277182 <== mds.4 v2:172.21.15.196:6836/3628757645 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a95a8f11f0 con 0x55a95aa1e7d0 2024-05-10T10:55:12.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.709+0000 7fbd577fe700 10 client.15111 handle_command_reply: tid=0 2024-05-10T10:55:12.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.709+0000 7fbd88c62b80 1 client.15111 shutdown 2024-05-10T10:55:12.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.709+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3067277182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 msgr2=0x55a95a9979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:12.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.709+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/3067277182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 0x55a95a9979c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbd7001e650 tx=0x7fbd7001e680 comp rx=0 tx=0).stop 2024-05-10T10:55:12.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.709+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3067277182 shutdown_connections 2024-05-10T10:55:12.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.709+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/3067277182 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55a95aa1e7d0 0x55a95aa1d4e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.709+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/3067277182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55a95a995890 0x55a95a9b9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.709+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/3067277182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55a95a999ff0 0x55a95a9979c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.709+0000 7fbd88c62b80 1 --2- 172.21.15.107:0/3067277182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a95a9961b0 0x55a95a997280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.709+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3067277182 >> 172.21.15.107:0/3067277182 conn(0x55a95a8bd0b0 msgr2=0x55a95a9866d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:12.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.709+0000 7fbd577fe700 0 client.15111 ms_handle_reset on v2:172.21.15.196:6836/3628757645 2024-05-10T10:55:12.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.710+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3067277182 shutdown_connections 2024-05-10T10:55:12.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.710+0000 7fbd88c62b80 1 -- 172.21.15.107:0/3067277182 wait complete. 2024-05-10T10:55:12.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.710+0000 7fbd88c62b80 20 client.15111 trim_cache size 0 max 16384 2024-05-10T10:55:12.716 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:55:12.716 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "0ba8a8e4-0eba-11ef-bc98-c7b262605968", 2024-05-10T10:55:12.716 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 4, 2024-05-10T10:55:12.716 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24430, 2024-05-10T10:55:12.717 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2024-05-10T10:55:12.717 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2024-05-10T10:55:12.717 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2024-05-10T10:55:12.717 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 159.90548641000001, 2024-05-10T10:55:12.717 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 26, 2024-05-10T10:55:12.717 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 82, 2024-05-10T10:55:12.717 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 80, 2024-05-10T10:55:12.717 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 207.89206319600001 2024-05-10T10:55:12.717 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:55:12.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.710+0000 7fbd7e3cf700 1 -- 172.21.15.107:0/535241315 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbd600b2880 msgr2=0x7fbd600b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:12.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.710+0000 7fbd7e3cf700 1 --2- 172.21.15.107:0/535241315 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbd600b2880 0x7fbd600b4d40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c006010 tx=0x7fbd6c000bc0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.710+0000 7fbd7e3cf700 1 -- 172.21.15.107:0/535241315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd78103750 msgr2=0x7fbd7819f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:12.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.710+0000 7fbd7e3cf700 1 --2- 172.21.15.107:0/535241315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd78103750 0x7fbd7819f840 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800c9b0 tx=0x7fbd6800cd70 comp rx=0 tx=0).stop 2024-05-10T10:55:12.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.710+0000 7fbd7e3cf700 1 -- 172.21.15.107:0/535241315 shutdown_connections 2024-05-10T10:55:12.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.710+0000 7fbd7e3cf700 1 --2- 172.21.15.107:0/535241315 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbd600b2880 0x7fbd600b4d40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.710+0000 7fbd7e3cf700 1 --2- 172.21.15.107:0/535241315 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd78108850 0x7fbd78199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.710+0000 7fbd7e3cf700 1 --2- 172.21.15.107:0/535241315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd78103750 0x7fbd7819f840 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.710+0000 7fbd7e3cf700 1 --2- 172.21.15.107:0/535241315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd78104100 0x7fbd7819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:12.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.710+0000 7fbd7e3cf700 1 -- 172.21.15.107:0/535241315 >> 172.21.15.107:0/535241315 conn(0x7fbd7807a600 msgr2=0x7fbd781014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:12.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.710+0000 7fbd7e3cf700 1 -- 172.21.15.107:0/535241315 shutdown_connections 2024-05-10T10:55:12.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:12.710+0000 7fbd7e3cf700 1 -- 172.21.15.107:0/535241315 wait complete. 2024-05-10T10:55:13.162 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:12 smithi107 ceph-mon[30373]: pgmap v374: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:55:13.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:12 smithi196 ceph-mon[34872]: pgmap v374: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:55:13.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:12 smithi184 ceph-mon[34585]: pgmap v374: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:55:13.424 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell mds.e status 2024-05-10T10:55:13.664 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:15.258 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:14 smithi107 ceph-mon[30373]: pgmap v375: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:55:15.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:14 smithi196 ceph-mon[34872]: pgmap v375: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:55:15.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:14 smithi184 ceph-mon[34585]: pgmap v375: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:55:15.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.527+0000 7f68c85a8700 1 -- 172.21.15.107:0/142844015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c0109520 msgr2=0x7f68c0109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:15.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.527+0000 7f68c85a8700 1 --2- 172.21.15.107:0/142844015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c0109520 0x7f68c0109900 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009990 tx=0x7f68bc009ca0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.527+0000 7f68c85a8700 1 -- 172.21.15.107:0/142844015 shutdown_connections 2024-05-10T10:55:15.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.527+0000 7f68c85a8700 1 --2- 172.21.15.107:0/142844015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68c0102450 0x7f68c0110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.527+0000 7f68c85a8700 1 --2- 172.21.15.107:0/142844015 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c0109520 0x7f68c0109900 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.527+0000 7f68c85a8700 1 --2- 172.21.15.107:0/142844015 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68c0101a90 0x7f68c0101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.527+0000 7f68c85a8700 1 -- 172.21.15.107:0/142844015 >> 172.21.15.107:0/142844015 conn(0x7f68c0078a10 msgr2=0x7f68c00ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:15.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.527+0000 7f68c85a8700 1 -- 172.21.15.107:0/142844015 shutdown_connections 2024-05-10T10:55:15.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.527+0000 7f68c85a8700 1 -- 172.21.15.107:0/142844015 wait complete. 2024-05-10T10:55:15.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.527+0000 7f68c85a8700 1 Processor -- start 2024-05-10T10:55:15.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.527+0000 7f68c85a8700 1 -- start start 2024-05-10T10:55:15.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.528+0000 7f68c85a8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68c0101a90 0x7f68c0199d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:15.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.528+0000 7f68c85a8700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68c0102450 0x7f68c019a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:15.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.528+0000 7f68c85a8700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c0109520 0x7f68c019e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:15.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.528+0000 7f68c85a8700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f68c0113870 con 0x7f68c0109520 2024-05-10T10:55:15.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.528+0000 7f68c85a8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f68c01136f0 con 0x7f68c0101a90 2024-05-10T10:55:15.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.528+0000 7f68c85a8700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f68c01139f0 con 0x7f68c0102450 2024-05-10T10:55:15.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.528+0000 7f68c6b45700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c0109520 0x7f68c019e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.528+0000 7f68c6b45700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c0109520 0x7f68c019e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48984/0 (socket says 172.21.15.107:48984) 2024-05-10T10:55:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.528+0000 7f68c6b45700 1 -- 172.21.15.107:0/2624443716 learned_addr learned my addr 172.21.15.107:0/2624443716 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.528+0000 7f68c5b43700 1 --2- 172.21.15.107:0/2624443716 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68c0102450 0x7f68c019a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.528+0000 7f68c6344700 1 --2- 172.21.15.107:0/2624443716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68c0101a90 0x7f68c0199d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.528+0000 7f68c6b45700 1 -- 172.21.15.107:0/2624443716 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68c0102450 msgr2=0x7f68c019a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.528+0000 7f68c6b45700 1 --2- 172.21.15.107:0/2624443716 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68c0102450 0x7f68c019a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.528+0000 7f68c6b45700 1 -- 172.21.15.107:0/2624443716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68c0101a90 msgr2=0x7f68c0199d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.528+0000 7f68c6b45700 1 --2- 172.21.15.107:0/2624443716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68c0101a90 0x7f68c0199d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.528+0000 7f68c6b45700 1 -- 172.21.15.107:0/2624443716 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c019ed90 con 0x7f68c0109520 2024-05-10T10:55:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.528+0000 7f68c6b45700 1 --2- 172.21.15.107:0/2624443716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c0109520 0x7f68c019e650 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f68b800b970 tx=0x7f68b800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.528+0000 7f68b77fe700 1 -- 172.21.15.107:0/2624443716 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b800d860 con 0x7f68c0109520 2024-05-10T10:55:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.529+0000 7f68b77fe700 1 -- 172.21.15.107:0/2624443716 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f68b800e430 con 0x7f68c0109520 2024-05-10T10:55:15.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.529+0000 7f68c85a8700 1 -- 172.21.15.107:0/2624443716 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c019f080 con 0x7f68c0109520 2024-05-10T10:55:15.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.529+0000 7f68b77fe700 1 -- 172.21.15.107:0/2624443716 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b8017660 con 0x7f68c0109520 2024-05-10T10:55:15.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.529+0000 7f68c85a8700 1 -- 172.21.15.107:0/2624443716 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c01a6900 con 0x7f68c0109520 2024-05-10T10:55:15.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.531+0000 7f68b77fe700 1 -- 172.21.15.107:0/2624443716 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f68b800e5e0 con 0x7f68c0109520 2024-05-10T10:55:15.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.532+0000 7f68b77fe700 1 --2- 172.21.15.107:0/2624443716 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f68ac0b2880 0x7f68ac0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:15.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.532+0000 7f68c6344700 1 --2- 172.21.15.107:0/2624443716 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f68ac0b2880 0x7f68ac0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:15.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.532+0000 7f68b77fe700 1 -- 172.21.15.107:0/2624443716 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f68b80e1e00 con 0x7f68c0109520 2024-05-10T10:55:15.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.532+0000 7f68c6344700 1 --2- 172.21.15.107:0/2624443716 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f68ac0b2880 0x7f68ac0b4d40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00b5c0 tx=0x7f68bc005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:15.533 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.532+0000 7f68d2e3bb80 1 Processor -- start 2024-05-10T10:55:15.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.533+0000 7f68d2e3bb80 1 -- start start 2024-05-10T10:55:15.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.533+0000 7f68d2e3bb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53d9890 0x5625a53d9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:15.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.533+0000 7f68d2e3bb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53da1b0 0x5625a53ddab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:15.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.533+0000 7f68d2e3bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53ddff0 0x5625a53de430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:15.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.533+0000 7f68d2e3bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5625a5327810 con 0x5625a53ddff0 2024-05-10T10:55:15.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.533+0000 7f68d2e3bb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5625a52c6770 con 0x5625a53da1b0 2024-05-10T10:55:15.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.533+0000 7f68d2e3bb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5625a53237d0 con 0x5625a53d9890 2024-05-10T10:55:15.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.533+0000 7f68c6b45700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53ddff0 0x5625a53de430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:15.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.533+0000 7f68c6b45700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53ddff0 0x5625a53de430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48994/0 (socket says 172.21.15.107:48994) 2024-05-10T10:55:15.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.533+0000 7f68c6b45700 1 -- 172.21.15.107:0/1276431171 learned_addr learned my addr 172.21.15.107:0/1276431171 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:15.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.533+0000 7f68c5b43700 1 --2- 172.21.15.107:0/1276431171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53da1b0 0x5625a53ddab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:15.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.533+0000 7f68c6344700 1 --2- 172.21.15.107:0/1276431171 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53d9890 0x5625a53d9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:15.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.533+0000 7f68c6b45700 1 -- 172.21.15.107:0/1276431171 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53d9890 msgr2=0x5625a53d9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:15.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.533+0000 7f68c6b45700 1 --2- 172.21.15.107:0/1276431171 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53d9890 0x5625a53d9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.533+0000 7f68c6b45700 1 -- 172.21.15.107:0/1276431171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53da1b0 msgr2=0x5625a53ddab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:15.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.533+0000 7f68c6b45700 1 --2- 172.21.15.107:0/1276431171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53da1b0 0x5625a53ddab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.533+0000 7f68c6b45700 1 -- 172.21.15.107:0/1276431171 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625a5274880 con 0x5625a53ddff0 2024-05-10T10:55:15.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.533+0000 7f68c5b43700 1 --2- 172.21.15.107:0/1276431171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53da1b0 0x5625a53ddab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:55:15.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.533+0000 7f68c6b45700 1 --2- 172.21.15.107:0/1276431171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53ddff0 0x5625a53de430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f68b80a9120 tx=0x7f68b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635f02cbd7e69f7f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:15.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.534+0000 7f68b4ff9700 1 -- 172.21.15.107:0/1276431171 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b80b2280 con 0x5625a53ddff0 2024-05-10T10:55:15.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.534+0000 7f68b4ff9700 1 -- 172.21.15.107:0/1276431171 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f68b800e970 con 0x5625a53ddff0 2024-05-10T10:55:15.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.534+0000 7f68b4ff9700 1 -- 172.21.15.107:0/1276431171 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b80b0b50 con 0x5625a53ddff0 2024-05-10T10:55:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.534+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/1276431171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53ddff0 msgr2=0x5625a53de430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.534+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/1276431171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53ddff0 0x5625a53de430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f68b80a9120 tx=0x7f68b8004ad0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.534+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/1276431171 shutdown_connections 2024-05-10T10:55:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.534+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/1276431171 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53d9890 0x5625a53d9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.534+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/1276431171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53ddff0 0x5625a53de430 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.534+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/1276431171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53da1b0 0x5625a53ddab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.534+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/1276431171 >> 172.21.15.107:0/1276431171 conn(0x5625a53010b0 msgr2=0x5625a53cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.535+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/1276431171 shutdown_connections 2024-05-10T10:55:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.535+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/1276431171 wait complete. 2024-05-10T10:55:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.535+0000 7f68d2e3bb80 1 -- start start 2024-05-10T10:55:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.535+0000 7f68d2e3bb80 1 Processor -- start 2024-05-10T10:55:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.535+0000 7f68d2e3bb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53d9890 0x5625a53e5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.535+0000 7f68d2e3bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53da1b0 0x5625a53e27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:15.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.535+0000 7f68d2e3bb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53ddff0 0x5625a53e2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:15.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.535+0000 7f68d2e3bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5625a53e6220 con 0x5625a53da1b0 2024-05-10T10:55:15.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.535+0000 7f68d2e3bb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5625a528dbe0 con 0x5625a53ddff0 2024-05-10T10:55:15.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.535+0000 7f68d2e3bb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5625a53e63a0 con 0x5625a53d9890 2024-05-10T10:55:15.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.535+0000 7f68d2e3bb80 10 client.0 _ll_register_callbacks cb 0x5625a52bf8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:55:15.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.535+0000 7f68c5b43700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53da1b0 0x5625a53e27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:15.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.535+0000 7f68c5b43700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53da1b0 0x5625a53e27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48996/0 (socket says 172.21.15.107:48996) 2024-05-10T10:55:15.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.535+0000 7f68c5b43700 1 -- 172.21.15.107:0/3628402588 learned_addr learned my addr 172.21.15.107:0/3628402588 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:15.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.535+0000 7f68c6344700 1 --2- 172.21.15.107:0/3628402588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53d9890 0x5625a53e5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:15.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.536+0000 7f68c6b45700 1 --2- 172.21.15.107:0/3628402588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53ddff0 0x5625a53e2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:15.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.536+0000 7f68c5b43700 1 -- 172.21.15.107:0/3628402588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53d9890 msgr2=0x5625a53e5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:15.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.536+0000 7f68c5b43700 1 --2- 172.21.15.107:0/3628402588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53d9890 0x5625a53e5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.536+0000 7f68c5b43700 1 -- 172.21.15.107:0/3628402588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53ddff0 msgr2=0x5625a53e2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:15.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.536+0000 7f68c5b43700 1 --2- 172.21.15.107:0/3628402588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53ddff0 0x5625a53e2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.540 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.536+0000 7f68c5b43700 1 -- 172.21.15.107:0/3628402588 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625a52c3640 con 0x5625a53da1b0 2024-05-10T10:55:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.536+0000 7f68c6b45700 1 --2- 172.21.15.107:0/3628402588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53ddff0 0x5625a53e2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:55:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.536+0000 7f68c5b43700 1 --2- 172.21.15.107:0/3628402588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53da1b0 0x5625a53e27e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f68b00104a0 tx=0x7f68b00107b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc19ee3c24a0fea server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.536+0000 7f68a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:55:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.536+0000 7f68a9ffb700 1 -- 172.21.15.107:0/3628402588 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b0018070 con 0x5625a53da1b0 2024-05-10T10:55:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.536+0000 7f68a9ffb700 1 -- 172.21.15.107:0/3628402588 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f68b0014800 con 0x5625a53da1b0 2024-05-10T10:55:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.536+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/3628402588 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68b800e970 con 0x5625a53da1b0 2024-05-10T10:55:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.536+0000 7f68a9ffb700 1 -- 172.21.15.107:0/3628402588 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f68b0024050 con 0x5625a53da1b0 2024-05-10T10:55:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.536+0000 7f68d2e3bb80 10 client.15123 fetch_fsmap learned FSMap version 26 2024-05-10T10:55:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.536+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/3628402588 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5625a53f0a10 con 0x5625a53da1b0 2024-05-10T10:55:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.536+0000 7f68a9ffb700 1 -- 172.21.15.107:0/3628402588 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f68b800e970 con 0x5625a53da1b0 2024-05-10T10:55:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.536+0000 7f68a9ffb700 1 -- 172.21.15.107:0/3628402588 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f68b001c9e0 con 0x5625a53da1b0 2024-05-10T10:55:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.536+0000 7f68d2e3bb80 10 client.15123 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:55:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.537+0000 7f68d2e3bb80 10 client.15123 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-10T10:55:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.537+0000 7f68d2e3bb80 20 client.15123 populate_metadata read hostname 'smithi107' 2024-05-10T10:55:15.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.537+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/3628402588 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x5625a53f3060 0x5625a53f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:15.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.537+0000 7f68d2e3bb80 4 client.15123 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:55:15.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.537+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/3628402588 --> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625a53a1600 con 0x5625a53f3060 2024-05-10T10:55:15.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.537+0000 7f68c6344700 1 --2- 172.21.15.107:0/3628402588 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x5625a53f3060 0x5625a53f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:15.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.537+0000 7f68a9ffb700 10 client.15123 ms_handle_connect on v2:172.21.15.184:6834/872203477 2024-05-10T10:55:15.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.537+0000 7f68c6344700 1 --2- 172.21.15.107:0/3628402588 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x5625a53f3060 0x5625a53f44d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d0ae19d5698f1ec2 server_cookie=dde77871178e596b in_seq=0 out_seq=0 2024-05-10T10:55:15.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.538+0000 7f68a9ffb700 1 -- 172.21.15.107:0/3628402588 <== mds.3 v2:172.21.15.184:6834/872203477 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5625a53a1600 con 0x5625a53f3060 2024-05-10T10:55:15.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.538+0000 7f68a9ffb700 10 client.15123 handle_command_reply: tid=0 2024-05-10T10:55:15.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.538+0000 7f68d2e3bb80 1 client.15123 shutdown 2024-05-10T10:55:15.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.538+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/3628402588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53da1b0 msgr2=0x5625a53e27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:15.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.538+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/3628402588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53da1b0 0x5625a53e27e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f68b00104a0 tx=0x7f68b00107b0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.538+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/3628402588 shutdown_connections 2024-05-10T10:55:15.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.538+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/3628402588 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x5625a53f3060 0x5625a53f44d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.538+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/3628402588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53d9890 0x5625a53e5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.538+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/3628402588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53ddff0 0x5625a53e2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.538+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/3628402588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53da1b0 0x5625a53e27e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.538+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/3628402588 >> 172.21.15.107:0/3628402588 conn(0x5625a53010b0 msgr2=0x5625a53ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:15.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.538+0000 7f68a9ffb700 0 client.15123 ms_handle_reset on v2:172.21.15.184:6834/872203477 2024-05-10T10:55:15.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.539+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/3628402588 shutdown_connections 2024-05-10T10:55:15.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.539+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/3628402588 wait complete. 2024-05-10T10:55:15.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.539+0000 7f68d2e3bb80 20 client.15123 trim_cache size 0 max 16384 2024-05-10T10:55:15.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.559+0000 7f68d2e3bb80 1 Processor -- start 2024-05-10T10:55:15.564 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.559+0000 7f68d2e3bb80 1 -- start start 2024-05-10T10:55:15.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.559+0000 7f68d2e3bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53d9890 0x5625a53de990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:15.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.559+0000 7f68d2e3bb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53da1b0 0x5625a53deed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:15.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.559+0000 7f68d2e3bb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53ddff0 0x5625a53e10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:15.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.559+0000 7f68d2e3bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5625a53f2810 con 0x5625a53d9890 2024-05-10T10:55:15.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.559+0000 7f68d2e3bb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5625a53f2ee0 con 0x5625a53ddff0 2024-05-10T10:55:15.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.559+0000 7f68d2e3bb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5625a53f35b0 con 0x5625a53da1b0 2024-05-10T10:55:15.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.559+0000 7f68c6344700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53d9890 0x5625a53de990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:15.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.560+0000 7f68c6344700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53d9890 0x5625a53de990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48998/0 (socket says 172.21.15.107:48998) 2024-05-10T10:55:15.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.560+0000 7f68c6344700 1 -- 172.21.15.107:0/2775013667 learned_addr learned my addr 172.21.15.107:0/2775013667 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:15.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.560+0000 7f68c6b45700 1 --2- 172.21.15.107:0/2775013667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53ddff0 0x5625a53e10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:15.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.560+0000 7f68c5b43700 1 --2- 172.21.15.107:0/2775013667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53da1b0 0x5625a53deed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:15.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.560+0000 7f68c6344700 1 -- 172.21.15.107:0/2775013667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53da1b0 msgr2=0x5625a53deed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:15.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.560+0000 7f68c6344700 1 --2- 172.21.15.107:0/2775013667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53da1b0 0x5625a53deed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.565 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.560+0000 7f68c6344700 1 -- 172.21.15.107:0/2775013667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53ddff0 msgr2=0x5625a53e10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:15.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.560+0000 7f68c6344700 1 --2- 172.21.15.107:0/2775013667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53ddff0 0x5625a53e10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.560+0000 7f68c6344700 1 -- 172.21.15.107:0/2775013667 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625a53e6350 con 0x5625a53d9890 2024-05-10T10:55:15.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.560+0000 7f68c6b45700 1 --2- 172.21.15.107:0/2775013667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53ddff0 0x5625a53e10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:55:15.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.560+0000 7f68c6344700 1 --2- 172.21.15.107:0/2775013667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53d9890 0x5625a53de990 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f68bc000c00 tx=0x7f68bc023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d886303b435fb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:15.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.560+0000 7f68abfff700 1 -- 172.21.15.107:0/2775013667 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc00f7e0 con 0x5625a53d9890 2024-05-10T10:55:15.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.560+0000 7f68abfff700 1 -- 172.21.15.107:0/2775013667 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f68bc03a070 con 0x5625a53d9890 2024-05-10T10:55:15.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.560+0000 7f68abfff700 1 -- 172.21.15.107:0/2775013667 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc033c90 con 0x5625a53d9890 2024-05-10T10:55:15.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.561+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/2775013667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53d9890 msgr2=0x5625a53de990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:15.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.561+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/2775013667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53d9890 0x5625a53de990 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f68bc000c00 tx=0x7f68bc023000 comp rx=0 tx=0).stop 2024-05-10T10:55:15.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.561+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/2775013667 shutdown_connections 2024-05-10T10:55:15.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.561+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/2775013667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53ddff0 0x5625a53e10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.561+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/2775013667 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53d9890 0x5625a53de990 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.566 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.561+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/2775013667 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53da1b0 0x5625a53deed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.561+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/2775013667 >> 172.21.15.107:0/2775013667 conn(0x5625a53010b0 msgr2=0x5625a53e5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.561+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/2775013667 shutdown_connections 2024-05-10T10:55:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.561+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/2775013667 wait complete. 2024-05-10T10:55:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.561+0000 7f68d2e3bb80 1 -- start start 2024-05-10T10:55:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.561+0000 7f68d2e3bb80 1 Processor -- start 2024-05-10T10:55:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.561+0000 7f68d2e3bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53d9890 0x5625a53fdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.561+0000 7f68d2e3bb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53da1b0 0x5625a53e2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.561+0000 7f68d2e3bb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53ddff0 0x5625a53e25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.561+0000 7f68d2e3bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5625a53f4350 con 0x5625a53d9890 2024-05-10T10:55:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.561+0000 7f68d2e3bb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5625a53f3c80 con 0x5625a53da1b0 2024-05-10T10:55:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.561+0000 7f68d2e3bb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5625a53f4a20 con 0x5625a53ddff0 2024-05-10T10:55:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.561+0000 7f68d2e3bb80 10 client.0 _ll_register_callbacks cb 0x5625a52bf8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:55:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.562+0000 7f68c6344700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53d9890 0x5625a53fdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.562+0000 7f68c6344700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53d9890 0x5625a53fdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49000/0 (socket says 172.21.15.107:49000) 2024-05-10T10:55:15.567 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.562+0000 7f68c6344700 1 -- 172.21.15.107:0/3612796964 learned_addr learned my addr 172.21.15.107:0/3612796964 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.562+0000 7f68c6b45700 1 --2- 172.21.15.107:0/3612796964 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53ddff0 0x5625a53e25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.562+0000 7f68c5b43700 1 --2- 172.21.15.107:0/3612796964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53da1b0 0x5625a53e2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.562+0000 7f68c6344700 1 -- 172.21.15.107:0/3612796964 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53ddff0 msgr2=0x5625a53e25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.562+0000 7f68c6344700 1 --2- 172.21.15.107:0/3612796964 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53ddff0 0x5625a53e25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.562+0000 7f68c6344700 1 -- 172.21.15.107:0/3612796964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53da1b0 msgr2=0x5625a53e2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.562+0000 7f68c6344700 1 --2- 172.21.15.107:0/3612796964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53da1b0 0x5625a53e2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.562+0000 7f68c6344700 1 -- 172.21.15.107:0/3612796964 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625a53e2c40 con 0x5625a53d9890 2024-05-10T10:55:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.562+0000 7f68c6344700 1 --2- 172.21.15.107:0/3612796964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53d9890 0x5625a53fdcc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0337d0 tx=0x7f68bc0334c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f181be2533f65b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.562+0000 7f68a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:55:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.562+0000 7f68a9ffb700 1 -- 172.21.15.107:0/3612796964 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc00f7e0 con 0x5625a53d9890 2024-05-10T10:55:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.562+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/3612796964 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68bc03a070 con 0x5625a53d9890 2024-05-10T10:55:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.562+0000 7f68a9ffb700 1 -- 172.21.15.107:0/3612796964 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f68bc00f980 con 0x5625a53d9890 2024-05-10T10:55:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.562+0000 7f68a9ffb700 1 -- 172.21.15.107:0/3612796964 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f68bc00fb80 con 0x5625a53d9890 2024-05-10T10:55:15.568 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.562+0000 7f68d2e3bb80 10 client.15129 fetch_fsmap learned FSMap version 26 2024-05-10T10:55:15.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.562+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/3612796964 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5625a545e4d0 con 0x5625a53d9890 2024-05-10T10:55:15.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.562+0000 7f68a9ffb700 1 -- 172.21.15.107:0/3612796964 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f68bc03a070 con 0x5625a53d9890 2024-05-10T10:55:15.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.563+0000 7f68a9ffb700 1 -- 172.21.15.107:0/3612796964 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f68bc03e410 con 0x5625a53d9890 2024-05-10T10:55:15.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.563+0000 7f68d2e3bb80 10 client.15129 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:55:15.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.563+0000 7f68d2e3bb80 10 client.15129 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-10T10:55:15.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.563+0000 7f68d2e3bb80 20 client.15129 populate_metadata read hostname 'smithi107' 2024-05-10T10:55:15.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.563+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/3612796964 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x5625a54629e0 0x5625a54616f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:15.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.563+0000 7f68d2e3bb80 4 client.15129 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T10:55:15.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.563+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/3612796964 --> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] -- command(tid 0: {"prefix": "status"}) -- 0x5625a53351f0 con 0x5625a54629e0 2024-05-10T10:55:15.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.563+0000 7f68c5b43700 1 --2- 172.21.15.107:0/3612796964 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x5625a54629e0 0x5625a54616f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:15.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.563+0000 7f68a9ffb700 10 client.15129 ms_handle_connect on v2:172.21.15.184:6834/872203477 2024-05-10T10:55:15.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.563+0000 7f68c5b43700 1 --2- 172.21.15.107:0/3612796964 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x5625a54629e0 0x5625a54616f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=23858ba89b123ff1 server_cookie=5286415f8e441f5a in_seq=0 out_seq=0 2024-05-10T10:55:15.569 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.563+0000 7f68a9ffb700 1 -- 172.21.15.107:0/3612796964 <== mds.3 v2:172.21.15.184:6834/872203477 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5625a53351f0 con 0x5625a54629e0 2024-05-10T10:55:15.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.563+0000 7f68a9ffb700 10 client.15129 handle_command_reply: tid=0 2024-05-10T10:55:15.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.563+0000 7f68d2e3bb80 1 client.15129 shutdown 2024-05-10T10:55:15.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/3612796964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53d9890 msgr2=0x5625a53fdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:15.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/3612796964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53d9890 0x5625a53fdcc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0337d0 tx=0x7f68bc0334c0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/3612796964 shutdown_connections 2024-05-10T10:55:15.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/3612796964 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x5625a54629e0 0x5625a54616f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/3612796964 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5625a53ddff0 0x5625a53e25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/3612796964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5625a53d9890 0x5625a53fdcc0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68a9ffb700 0 client.15129 ms_handle_reset on v2:172.21.15.184:6834/872203477 2024-05-10T10:55:15.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68d2e3bb80 1 --2- 172.21.15.107:0/3612796964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5625a53da1b0 0x5625a53e2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/3612796964 >> 172.21.15.107:0/3612796964 conn(0x5625a53010b0 msgr2=0x5625a53de990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:15.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/3612796964 shutdown_connections 2024-05-10T10:55:15.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68d2e3bb80 1 -- 172.21.15.107:0/3612796964 wait complete. 2024-05-10T10:55:15.570 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68d2e3bb80 20 client.15129 trim_cache size 0 max 16384 2024-05-10T10:55:15.571 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:55:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "0ba8a8e4-0eba-11ef-bc98-c7b262605968", 2024-05-10T10:55:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 3, 2024-05-10T10:55:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24431, 2024-05-10T10:55:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2024-05-10T10:55:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2024-05-10T10:55:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2024-05-10T10:55:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 163.76613933199999, 2024-05-10T10:55:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 26, 2024-05-10T10:55:15.571 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 82, 2024-05-10T10:55:15.572 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 80, 2024-05-10T10:55:15.572 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 216.0658933 2024-05-10T10:55:15.572 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:55:15.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68c85a8700 1 -- 172.21.15.107:0/2624443716 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f68ac0b2880 msgr2=0x7f68ac0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:15.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68c85a8700 1 --2- 172.21.15.107:0/2624443716 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f68ac0b2880 0x7f68ac0b4d40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00b5c0 tx=0x7f68bc005960 comp rx=0 tx=0).stop 2024-05-10T10:55:15.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68c85a8700 1 -- 172.21.15.107:0/2624443716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c0109520 msgr2=0x7f68c019e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:15.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68c85a8700 1 --2- 172.21.15.107:0/2624443716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c0109520 0x7f68c019e650 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f68b800b970 tx=0x7f68b800bc80 comp rx=0 tx=0).stop 2024-05-10T10:55:15.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68c85a8700 1 -- 172.21.15.107:0/2624443716 shutdown_connections 2024-05-10T10:55:15.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68c85a8700 1 --2- 172.21.15.107:0/2624443716 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f68ac0b2880 0x7f68ac0b4d40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68c85a8700 1 --2- 172.21.15.107:0/2624443716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f68c0109520 0x7f68c019e650 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68c85a8700 1 --2- 172.21.15.107:0/2624443716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68c0101a90 0x7f68c0199d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68c85a8700 1 --2- 172.21.15.107:0/2624443716 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f68c0102450 0x7f68c019a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:15.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68c85a8700 1 -- 172.21.15.107:0/2624443716 >> 172.21.15.107:0/2624443716 conn(0x7f68c0078a10 msgr2=0x7f68c0100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:15.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.564+0000 7f68c85a8700 1 -- 172.21.15.107:0/2624443716 shutdown_connections 2024-05-10T10:55:15.573 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:15.565+0000 7f68c85a8700 1 -- 172.21.15.107:0/2624443716 wait complete. 2024-05-10T10:55:16.388 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell mds.i status 2024-05-10T10:55:16.634 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:17.008 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:16 smithi107 ceph-mon[30373]: pgmap v376: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:55:17.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:16 smithi196 ceph-mon[34872]: pgmap v376: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:55:17.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:16 smithi184 ceph-mon[34585]: pgmap v376: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:55:18.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.377+0000 7fd23cc22700 1 -- 172.21.15.107:0/711605381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd23806bb40 msgr2=0x7fd238110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:18.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.377+0000 7fd23cc22700 1 --2- 172.21.15.107:0/711605381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd23806bb40 0x7fd238110330 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd23000b0a0 tx=0x7fd23000b3b0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.377+0000 7fd23cc22700 1 -- 172.21.15.107:0/711605381 shutdown_connections 2024-05-10T10:55:18.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.377+0000 7fd23cc22700 1 --2- 172.21.15.107:0/711605381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd23806bb40 0x7fd238110330 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.377+0000 7fd23cc22700 1 --2- 172.21.15.107:0/711605381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd238109510 0x7fd2381098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.377+0000 7fd23cc22700 1 --2- 172.21.15.107:0/711605381 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd23806b180 0x7fd23806b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.377+0000 7fd23cc22700 1 -- 172.21.15.107:0/711605381 >> 172.21.15.107:0/711605381 conn(0x7fd238079350 msgr2=0x7fd238079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:18.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.377+0000 7fd23cc22700 1 -- 172.21.15.107:0/711605381 shutdown_connections 2024-05-10T10:55:18.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.377+0000 7fd23cc22700 1 -- 172.21.15.107:0/711605381 wait complete. 2024-05-10T10:55:18.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.378+0000 7fd23cc22700 1 Processor -- start 2024-05-10T10:55:18.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.378+0000 7fd23cc22700 1 -- start start 2024-05-10T10:55:18.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.378+0000 7fd23cc22700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd23806b180 0x7fd23819f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:18.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.378+0000 7fd23cc22700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd23806bb40 0x7fd23819fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:18.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.378+0000 7fd23cc22700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd238109510 0x7fd238199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:18.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.378+0000 7fd23cc22700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd238113830 con 0x7fd238109510 2024-05-10T10:55:18.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.378+0000 7fd23cc22700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd2381136b0 con 0x7fd23806bb40 2024-05-10T10:55:18.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.378+0000 7fd23cc22700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd2381139b0 con 0x7fd23806b180 2024-05-10T10:55:18.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.378+0000 7fd236d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd238109510 0x7fd238199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:18.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.378+0000 7fd236d9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd238109510 0x7fd238199a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41584/0 (socket says 172.21.15.107:41584) 2024-05-10T10:55:18.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.378+0000 7fd236d9d700 1 -- 172.21.15.107:0/1364364568 learned_addr learned my addr 172.21.15.107:0/1364364568 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:18.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.378+0000 7fd22dd9b700 1 --2- 172.21.15.107:0/1364364568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd23806bb40 0x7fd23819fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:18.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.378+0000 7fd23659c700 1 --2- 172.21.15.107:0/1364364568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd23806b180 0x7fd23819f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:18.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.379+0000 7fd236d9d700 1 -- 172.21.15.107:0/1364364568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd23806b180 msgr2=0x7fd23819f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:18.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.379+0000 7fd236d9d700 1 --2- 172.21.15.107:0/1364364568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd23806b180 0x7fd23819f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.379+0000 7fd236d9d700 1 -- 172.21.15.107:0/1364364568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd23806bb40 msgr2=0x7fd23819fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:18.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.379+0000 7fd236d9d700 1 --2- 172.21.15.107:0/1364364568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd23806bb40 0x7fd23819fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.379+0000 7fd236d9d700 1 -- 172.21.15.107:0/1364364568 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23819a190 con 0x7fd238109510 2024-05-10T10:55:18.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.379+0000 7fd22dd9b700 1 --2- 172.21.15.107:0/1364364568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd23806bb40 0x7fd23819fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:55:18.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.379+0000 7fd23659c700 1 --2- 172.21.15.107:0/1364364568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd23806b180 0x7fd23819f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:55:18.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.379+0000 7fd236d9d700 1 --2- 172.21.15.107:0/1364364568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd238109510 0x7fd238199a30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd23000b070 tx=0x7fd230007ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:18.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.379+0000 7fd22ffff700 1 -- 172.21.15.107:0/1364364568 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd230022070 con 0x7fd238109510 2024-05-10T10:55:18.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.379+0000 7fd23cc22700 1 -- 172.21.15.107:0/1364364568 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd23819a420 con 0x7fd238109510 2024-05-10T10:55:18.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.379+0000 7fd22ffff700 1 -- 172.21.15.107:0/1364364568 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd230003c00 con 0x7fd238109510 2024-05-10T10:55:18.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.379+0000 7fd22ffff700 1 -- 172.21.15.107:0/1364364568 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23001d9e0 con 0x7fd238109510 2024-05-10T10:55:18.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.379+0000 7fd23cc22700 1 -- 172.21.15.107:0/1364364568 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2381a6740 con 0x7fd238109510 2024-05-10T10:55:18.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.382+0000 7fd22ffff700 1 -- 172.21.15.107:0/1364364568 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fd2300056c0 con 0x7fd238109510 2024-05-10T10:55:18.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.382+0000 7fd22ffff700 1 --2- 172.21.15.107:0/1364364568 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd2240b2880 0x7fd2240b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:18.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.382+0000 7fd23659c700 1 --2- 172.21.15.107:0/1364364568 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd2240b2880 0x7fd2240b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:18.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.382+0000 7fd22ffff700 1 -- 172.21.15.107:0/1364364568 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fd23000f020 con 0x7fd238109510 2024-05-10T10:55:18.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.383+0000 7fd23659c700 1 --2- 172.21.15.107:0/1364364568 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd2240b2880 0x7fd2240b4d40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd23819ab70 tx=0x7fd22800a680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:18.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.383+0000 7fd2474b5b80 1 Processor -- start 2024-05-10T10:55:18.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.383+0000 7fd2474b5b80 1 -- start start 2024-05-10T10:55:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.383+0000 7fd2474b5b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbdd160 0x55fdcdbdd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.383+0000 7fd2474b5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdda80 0x55fdcdbd77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.383+0000 7fd2474b5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbd7d00 0x55fdcdbd8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.383+0000 7fd2474b5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fdcdb298f0 con 0x55fdcdbdda80 2024-05-10T10:55:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.383+0000 7fd2474b5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fdcda8ed50 con 0x55fdcdbd7d00 2024-05-10T10:55:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.383+0000 7fd2474b5b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55fdcdb258b0 con 0x55fdcdbdd160 2024-05-10T10:55:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.383+0000 7fd22dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdda80 0x55fdcdbd77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.383+0000 7fd22dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdda80 0x55fdcdbd77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41588/0 (socket says 172.21.15.107:41588) 2024-05-10T10:55:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.383+0000 7fd22dd9b700 1 -- 172.21.15.107:0/551734108 learned_addr learned my addr 172.21.15.107:0/551734108 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.383+0000 7fd236d9d700 1 --2- 172.21.15.107:0/551734108 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbd7d00 0x55fdcdbd8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.384+0000 7fd23659c700 1 --2- 172.21.15.107:0/551734108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbdd160 0x55fdcdbdd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.384+0000 7fd22dd9b700 1 -- 172.21.15.107:0/551734108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbdd160 msgr2=0x55fdcdbdd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:18.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.384+0000 7fd22dd9b700 1 --2- 172.21.15.107:0/551734108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbdd160 0x55fdcdbdd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.384+0000 7fd22dd9b700 1 -- 172.21.15.107:0/551734108 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbd7d00 msgr2=0x55fdcdbd8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:18.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.384+0000 7fd22dd9b700 1 --2- 172.21.15.107:0/551734108 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbd7d00 0x55fdcdbd8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.384+0000 7fd22dd9b700 1 -- 172.21.15.107:0/551734108 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdcda76880 con 0x55fdcdbdda80 2024-05-10T10:55:18.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.384+0000 7fd23659c700 1 --2- 172.21.15.107:0/551734108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbdd160 0x55fdcdbdd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:55:18.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.384+0000 7fd22dd9b700 1 --2- 172.21.15.107:0/551734108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdda80 0x55fdcdbd77c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd220007870 tx=0x7fd220007b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da14931b113cc6fd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:18.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.384+0000 7fd22cd99700 1 -- 172.21.15.107:0/551734108 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22000d670 con 0x55fdcdbdda80 2024-05-10T10:55:18.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.384+0000 7fd22cd99700 1 -- 172.21.15.107:0/551734108 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd220018070 con 0x55fdcdbdda80 2024-05-10T10:55:18.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.384+0000 7fd22cd99700 1 -- 172.21.15.107:0/551734108 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd220013c30 con 0x55fdcdbdda80 2024-05-10T10:55:18.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.385+0000 7fd2474b5b80 1 -- 172.21.15.107:0/551734108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdda80 msgr2=0x55fdcdbd77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:18.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.385+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/551734108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdda80 0x55fdcdbd77c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd220007870 tx=0x7fd220007b80 comp rx=0 tx=0).stop 2024-05-10T10:55:18.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.385+0000 7fd2474b5b80 1 -- 172.21.15.107:0/551734108 shutdown_connections 2024-05-10T10:55:18.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.385+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/551734108 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbdd160 0x55fdcdbdd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.386 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.385+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/551734108 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbd7d00 0x55fdcdbd8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.385+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/551734108 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdda80 0x55fdcdbd77c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.385+0000 7fd2474b5b80 1 -- 172.21.15.107:0/551734108 >> 172.21.15.107:0/551734108 conn(0x55fdcdb03b20 msgr2=0x55fdcdbd2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:18.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.385+0000 7fd2474b5b80 1 -- 172.21.15.107:0/551734108 shutdown_connections 2024-05-10T10:55:18.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.385+0000 7fd2474b5b80 1 -- 172.21.15.107:0/551734108 wait complete. 2024-05-10T10:55:18.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.385+0000 7fd2474b5b80 1 -- start start 2024-05-10T10:55:18.387 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.385+0000 7fd2474b5b80 1 Processor -- start 2024-05-10T10:55:18.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd2474b5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbd7d00 0x55fdcdbe3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:18.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd2474b5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbdd160 0x55fdcdbe0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:18.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd2474b5b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbdda80 0x55fdcdbe1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:18.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd2474b5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fdcdbe4400 con 0x55fdcdbd7d00 2024-05-10T10:55:18.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd2474b5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fdcdae2e80 con 0x55fdcdbdd160 2024-05-10T10:55:18.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd2474b5b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55fdcdbe4580 con 0x55fdcdbdda80 2024-05-10T10:55:18.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd2474b5b80 10 client.0 _ll_register_callbacks cb 0x55fdcdabd560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:55:18.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd23659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbd7d00 0x55fdcdbe3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:18.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd23659c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbd7d00 0x55fdcdbe3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41602/0 (socket says 172.21.15.107:41602) 2024-05-10T10:55:18.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd23659c700 1 -- 172.21.15.107:0/1997414518 learned_addr learned my addr 172.21.15.107:0/1997414518 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:18.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd22dd9b700 1 --2- 172.21.15.107:0/1997414518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbdd160 0x55fdcdbe0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:18.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd236d9d700 1 --2- 172.21.15.107:0/1997414518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbdda80 0x55fdcdbe1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:18.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd23659c700 1 -- 172.21.15.107:0/1997414518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbdda80 msgr2=0x55fdcdbe1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:18.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd23659c700 1 --2- 172.21.15.107:0/1997414518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbdda80 0x55fdcdbe1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd23659c700 1 -- 172.21.15.107:0/1997414518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbdd160 msgr2=0x55fdcdbe0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:18.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd23659c700 1 --2- 172.21.15.107:0/1997414518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbdd160 0x55fdcdbe0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd23659c700 1 -- 172.21.15.107:0/1997414518 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdcdae0710 con 0x55fdcdbd7d00 2024-05-10T10:55:18.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd23659c700 1 --2- 172.21.15.107:0/1997414518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbd7d00 0x55fdcdbe3750 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd2280109c0 tx=0x7fd228004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d87a577f2e3a339 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:18.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd21dffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:55:18.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd21dffb700 1 -- 172.21.15.107:0/1997414518 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22800fa50 con 0x55fdcdbd7d00 2024-05-10T10:55:18.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd2474b5b80 1 -- 172.21.15.107:0/1997414518 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd220018070 con 0x55fdcdbd7d00 2024-05-10T10:55:18.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.386+0000 7fd21dffb700 1 -- 172.21.15.107:0/1997414518 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fd22800fbf0 con 0x55fdcdbd7d00 2024-05-10T10:55:18.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.387+0000 7fd21dffb700 1 -- 172.21.15.107:0/1997414518 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd22800fe30 con 0x55fdcdbd7d00 2024-05-10T10:55:18.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.387+0000 7fd2474b5b80 10 client.15141 fetch_fsmap learned FSMap version 26 2024-05-10T10:55:18.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.387+0000 7fd2474b5b80 1 -- 172.21.15.107:0/1997414518 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fdcdbeece0 con 0x55fdcdbd7d00 2024-05-10T10:55:18.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.387+0000 7fd21dffb700 1 -- 172.21.15.107:0/1997414518 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd220018070 con 0x55fdcdbd7d00 2024-05-10T10:55:18.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.387+0000 7fd21dffb700 1 -- 172.21.15.107:0/1997414518 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fd228005520 con 0x55fdcdbd7d00 2024-05-10T10:55:18.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.387+0000 7fd2474b5b80 10 client.15141 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:55:18.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.387+0000 7fd2474b5b80 10 client.15141 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-10T10:55:18.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.387+0000 7fd2474b5b80 20 client.15141 populate_metadata read hostname 'smithi107' 2024-05-10T10:55:18.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.387+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/1997414518 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x55fdcdbf1380 0x55fdcdbf27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:18.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.387+0000 7fd2474b5b80 4 client.15141 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:55:18.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.387+0000 7fd2474b5b80 1 -- 172.21.15.107:0/1997414518 --> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdcdb372d0 con 0x55fdcdbf1380 2024-05-10T10:55:18.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.387+0000 7fd22dd9b700 1 --2- 172.21.15.107:0/1997414518 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x55fdcdbf1380 0x55fdcdbf27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:18.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.388+0000 7fd21dffb700 10 client.15141 ms_handle_connect on v2:172.21.15.196:6838/4142119667 2024-05-10T10:55:18.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.388+0000 7fd22dd9b700 1 --2- 172.21.15.107:0/1997414518 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x55fdcdbf1380 0x55fdcdbf27f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=47dc5ee38a432892 server_cookie=b6a574e476a78017 in_seq=0 out_seq=0 2024-05-10T10:55:18.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.389+0000 7fd21dffb700 1 -- 172.21.15.107:0/1997414518 <== mds.2 v2:172.21.15.196:6838/4142119667 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fdcdb372d0 con 0x55fdcdbf1380 2024-05-10T10:55:18.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.389+0000 7fd21dffb700 10 client.15141 handle_command_reply: tid=0 2024-05-10T10:55:18.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.389+0000 7fd2474b5b80 1 client.15141 shutdown 2024-05-10T10:55:18.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.389+0000 7fd2474b5b80 1 -- 172.21.15.107:0/1997414518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbd7d00 msgr2=0x55fdcdbe3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:18.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.389+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/1997414518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbd7d00 0x55fdcdbe3750 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd2280109c0 tx=0x7fd228004750 comp rx=0 tx=0).stop 2024-05-10T10:55:18.393 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.389+0000 7fd2474b5b80 1 -- 172.21.15.107:0/1997414518 shutdown_connections 2024-05-10T10:55:18.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.389+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/1997414518 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x55fdcdbf1380 0x55fdcdbf27f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.389+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/1997414518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbdda80 0x55fdcdbe1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.389+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/1997414518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbd7d00 0x55fdcdbe3750 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.389+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/1997414518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbdd160 0x55fdcdbe0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.389+0000 7fd2474b5b80 1 -- 172.21.15.107:0/1997414518 >> 172.21.15.107:0/1997414518 conn(0x55fdcdb03b20 msgr2=0x55fdcdbccae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:18.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.389+0000 7fd21dffb700 0 client.15141 ms_handle_reset on v2:172.21.15.196:6838/4142119667 2024-05-10T10:55:18.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.389+0000 7fd2474b5b80 1 -- 172.21.15.107:0/1997414518 shutdown_connections 2024-05-10T10:55:18.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.389+0000 7fd2474b5b80 1 -- 172.21.15.107:0/1997414518 wait complete. 2024-05-10T10:55:18.394 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.389+0000 7fd2474b5b80 20 client.15141 trim_cache size 0 max 16384 2024-05-10T10:55:18.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.413+0000 7fd2474b5b80 1 Processor -- start 2024-05-10T10:55:18.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.413+0000 7fd2474b5b80 1 -- start start 2024-05-10T10:55:18.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.413+0000 7fd2474b5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbd7d00 0x55fdcdbd77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:18.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.413+0000 7fd2474b5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdd160 0x55fdcdbccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:18.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.413+0000 7fd2474b5b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbdda80 0x55fdcdbdde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:18.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.413+0000 7fd2474b5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fdcdbf0b30 con 0x55fdcdbdd160 2024-05-10T10:55:18.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.413+0000 7fd2474b5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fdcdbf1200 con 0x55fdcdbd7d00 2024-05-10T10:55:18.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.413+0000 7fd2474b5b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55fdcdbf18d0 con 0x55fdcdbdda80 2024-05-10T10:55:18.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.413+0000 7fd22dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdd160 0x55fdcdbccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:18.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.413+0000 7fd22dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdd160 0x55fdcdbccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41606/0 (socket says 172.21.15.107:41606) 2024-05-10T10:55:18.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.413+0000 7fd22dd9b700 1 -- 172.21.15.107:0/1974002085 learned_addr learned my addr 172.21.15.107:0/1974002085 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:18.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.413+0000 7fd236d9d700 1 --2- 172.21.15.107:0/1974002085 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbdda80 0x55fdcdbdde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:18.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.413+0000 7fd23659c700 1 --2- 172.21.15.107:0/1974002085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbd7d00 0x55fdcdbd77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:18.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.414+0000 7fd22dd9b700 1 -- 172.21.15.107:0/1974002085 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbdda80 msgr2=0x55fdcdbdde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:18.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.414+0000 7fd22dd9b700 1 --2- 172.21.15.107:0/1974002085 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbdda80 0x55fdcdbdde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.414+0000 7fd22dd9b700 1 -- 172.21.15.107:0/1974002085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbd7d00 msgr2=0x55fdcdbd77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:18.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.414+0000 7fd22dd9b700 1 --2- 172.21.15.107:0/1974002085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbd7d00 0x55fdcdbd77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.414+0000 7fd22dd9b700 1 -- 172.21.15.107:0/1974002085 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdcdbd2e20 con 0x55fdcdbdd160 2024-05-10T10:55:18.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.414+0000 7fd236d9d700 1 --2- 172.21.15.107:0/1974002085 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbdda80 0x55fdcdbdde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:55:18.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.414+0000 7fd22dd9b700 1 --2- 172.21.15.107:0/1974002085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdd160 0x55fdcdbccbf0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd220007f80 tx=0x7fd22000f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3016a034fa8622f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:18.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.414+0000 7fd21ffff700 1 -- 172.21.15.107:0/1974002085 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22002c070 con 0x55fdcdbdd160 2024-05-10T10:55:18.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.414+0000 7fd21ffff700 1 -- 172.21.15.107:0/1974002085 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd220018040 con 0x55fdcdbdd160 2024-05-10T10:55:18.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.414+0000 7fd21ffff700 1 -- 172.21.15.107:0/1974002085 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22000d8d0 con 0x55fdcdbdd160 2024-05-10T10:55:18.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.414+0000 7fd2474b5b80 1 -- 172.21.15.107:0/1974002085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdd160 msgr2=0x55fdcdbccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:18.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.414+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/1974002085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdd160 0x55fdcdbccbf0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd220007f80 tx=0x7fd22000f040 comp rx=0 tx=0).stop 2024-05-10T10:55:18.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd2474b5b80 1 -- 172.21.15.107:0/1974002085 shutdown_connections 2024-05-10T10:55:18.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/1974002085 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbdda80 0x55fdcdbdde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/1974002085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbd7d00 0x55fdcdbd77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/1974002085 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdd160 0x55fdcdbccbf0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd2474b5b80 1 -- 172.21.15.107:0/1974002085 >> 172.21.15.107:0/1974002085 conn(0x55fdcdb03b20 msgr2=0x55fdcdbdf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:18.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd2474b5b80 1 -- 172.21.15.107:0/1974002085 shutdown_connections 2024-05-10T10:55:18.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd2474b5b80 1 -- 172.21.15.107:0/1974002085 wait complete. 2024-05-10T10:55:18.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd2474b5b80 1 -- start start 2024-05-10T10:55:18.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd2474b5b80 1 Processor -- start 2024-05-10T10:55:18.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd2474b5b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbd7d00 0x55fdcdbcc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:18.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd2474b5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdd160 0x55fdcdbcc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:18.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd2474b5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbdda80 0x55fdcdc5f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:18.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd2474b5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fdcdbf2670 con 0x55fdcdbdd160 2024-05-10T10:55:18.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd2474b5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fdcdbf1fa0 con 0x55fdcdbdda80 2024-05-10T10:55:18.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd2474b5b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55fdcdbf2d40 con 0x55fdcdbd7d00 2024-05-10T10:55:18.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd2474b5b80 10 client.0 _ll_register_callbacks cb 0x55fdcdabd560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:55:18.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd22dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdd160 0x55fdcdbcc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:18.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd22dd9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdd160 0x55fdcdbcc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41620/0 (socket says 172.21.15.107:41620) 2024-05-10T10:55:18.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd22dd9b700 1 -- 172.21.15.107:0/393583083 learned_addr learned my addr 172.21.15.107:0/393583083 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:18.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd23659c700 1 --2- 172.21.15.107:0/393583083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbd7d00 0x55fdcdbcc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:18.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.415+0000 7fd236d9d700 1 --2- 172.21.15.107:0/393583083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbdda80 0x55fdcdc5f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:18.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.416+0000 7fd22dd9b700 1 -- 172.21.15.107:0/393583083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbd7d00 msgr2=0x55fdcdbcc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:18.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.416+0000 7fd22dd9b700 1 --2- 172.21.15.107:0/393583083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbd7d00 0x55fdcdbcc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.416+0000 7fd22dd9b700 1 -- 172.21.15.107:0/393583083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbdda80 msgr2=0x55fdcdc5f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:18.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.416+0000 7fd22dd9b700 1 --2- 172.21.15.107:0/393583083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbdda80 0x55fdcdc5f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.416+0000 7fd22dd9b700 1 -- 172.21.15.107:0/393583083 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdcdbdd790 con 0x55fdcdbdd160 2024-05-10T10:55:18.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.416+0000 7fd236d9d700 1 --2- 172.21.15.107:0/393583083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbdda80 0x55fdcdc5f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:55:18.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.416+0000 7fd22dd9b700 1 --2- 172.21.15.107:0/393583083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdd160 0x55fdcdbcc8e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd220007630 tx=0x7fd220006fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17081b734e64632a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:18.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.416+0000 7fd21dffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:55:18.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.416+0000 7fd21dffb700 1 -- 172.21.15.107:0/393583083 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22002c050 con 0x55fdcdbdd160 2024-05-10T10:55:18.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.416+0000 7fd21dffb700 1 -- 172.21.15.107:0/393583083 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fd220026670 con 0x55fdcdbdd160 2024-05-10T10:55:18.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.416+0000 7fd2474b5b80 1 -- 172.21.15.107:0/393583083 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd220018040 con 0x55fdcdbdd160 2024-05-10T10:55:18.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.416+0000 7fd21dffb700 1 -- 172.21.15.107:0/393583083 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd220026870 con 0x55fdcdbdd160 2024-05-10T10:55:18.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.416+0000 7fd2474b5b80 10 client.15147 fetch_fsmap learned FSMap version 26 2024-05-10T10:55:18.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.416+0000 7fd2474b5b80 1 -- 172.21.15.107:0/393583083 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fdcdbcec30 con 0x55fdcdbdd160 2024-05-10T10:55:18.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.416+0000 7fd21dffb700 1 -- 172.21.15.107:0/393583083 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd220018040 con 0x55fdcdbdd160 2024-05-10T10:55:18.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.416+0000 7fd21dffb700 1 -- 172.21.15.107:0/393583083 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fd220038030 con 0x55fdcdbdd160 2024-05-10T10:55:18.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.417+0000 7fd2474b5b80 10 client.15147 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:55:18.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.417+0000 7fd2474b5b80 10 client.15147 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-10T10:55:18.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.417+0000 7fd2474b5b80 20 client.15147 populate_metadata read hostname 'smithi107' 2024-05-10T10:55:18.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.417+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/393583083 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x55fdcdc65170 0x55fdcdc63e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:18.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.417+0000 7fd2474b5b80 4 client.15147 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T10:55:18.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.417+0000 7fd2474b5b80 1 -- 172.21.15.107:0/393583083 --> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] -- command(tid 0: {"prefix": "status"}) -- 0x55fdcdb31370 con 0x55fdcdc65170 2024-05-10T10:55:18.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.417+0000 7fd23659c700 1 --2- 172.21.15.107:0/393583083 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x55fdcdc65170 0x55fdcdc63e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:18.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.417+0000 7fd21dffb700 10 client.15147 ms_handle_connect on v2:172.21.15.196:6838/4142119667 2024-05-10T10:55:18.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.417+0000 7fd23659c700 1 --2- 172.21.15.107:0/393583083 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x55fdcdc65170 0x55fdcdc63e80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1307f8351451337e server_cookie=901fdf49f87d111 in_seq=0 out_seq=0 2024-05-10T10:55:18.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.417+0000 7fd21dffb700 1 -- 172.21.15.107:0/393583083 <== mds.2 v2:172.21.15.196:6838/4142119667 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55fdcdb31370 con 0x55fdcdc65170 2024-05-10T10:55:18.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.417+0000 7fd21dffb700 10 client.15147 handle_command_reply: tid=0 2024-05-10T10:55:18.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.417+0000 7fd2474b5b80 1 client.15147 shutdown 2024-05-10T10:55:18.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.417+0000 7fd2474b5b80 1 -- 172.21.15.107:0/393583083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdd160 msgr2=0x55fdcdbcc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:18.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.417+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/393583083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdd160 0x55fdcdbcc8e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd220007630 tx=0x7fd220006fd0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd2474b5b80 1 -- 172.21.15.107:0/393583083 shutdown_connections 2024-05-10T10:55:18.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/393583083 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x55fdcdc65170 0x55fdcdc63e80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/393583083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fdcdbd7d00 0x55fdcdbcc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/393583083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdcdbdda80 0x55fdcdc5f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd2474b5b80 1 --2- 172.21.15.107:0/393583083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fdcdbdd160 0x55fdcdbcc8e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd2474b5b80 1 -- 172.21.15.107:0/393583083 >> 172.21.15.107:0/393583083 conn(0x55fdcdb03b20 msgr2=0x55fdcdbdefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:18.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd21dffb700 0 client.15147 ms_handle_reset on v2:172.21.15.196:6838/4142119667 2024-05-10T10:55:18.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd2474b5b80 1 -- 172.21.15.107:0/393583083 shutdown_connections 2024-05-10T10:55:18.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd2474b5b80 1 -- 172.21.15.107:0/393583083 wait complete. 2024-05-10T10:55:18.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd2474b5b80 20 client.15147 trim_cache size 0 max 16384 2024-05-10T10:55:18.424 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:55:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "0ba8a8e4-0eba-11ef-bc98-c7b262605968", 2024-05-10T10:55:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 2, 2024-05-10T10:55:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24442, 2024-05-10T10:55:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2024-05-10T10:55:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2024-05-10T10:55:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2024-05-10T10:55:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 167.62720638900001, 2024-05-10T10:55:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 26, 2024-05-10T10:55:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 82, 2024-05-10T10:55:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 80, 2024-05-10T10:55:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 208.066067726 2024-05-10T10:55:18.425 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:55:18.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd23cc22700 1 -- 172.21.15.107:0/1364364568 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd2240b2880 msgr2=0x7fd2240b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:18.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd23cc22700 1 --2- 172.21.15.107:0/1364364568 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd2240b2880 0x7fd2240b4d40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd23819ab70 tx=0x7fd22800a680 comp rx=0 tx=0).stop 2024-05-10T10:55:18.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd23cc22700 1 -- 172.21.15.107:0/1364364568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd238109510 msgr2=0x7fd238199a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:18.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd23cc22700 1 --2- 172.21.15.107:0/1364364568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd238109510 0x7fd238199a30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd23000b070 tx=0x7fd230007ac0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd23cc22700 1 -- 172.21.15.107:0/1364364568 shutdown_connections 2024-05-10T10:55:18.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd23cc22700 1 --2- 172.21.15.107:0/1364364568 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd2240b2880 0x7fd2240b4d40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd23cc22700 1 --2- 172.21.15.107:0/1364364568 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd23806b180 0x7fd23819f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd23cc22700 1 --2- 172.21.15.107:0/1364364568 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd238109510 0x7fd238199a30 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd23cc22700 1 --2- 172.21.15.107:0/1364364568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd23806bb40 0x7fd23819fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:18.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd23cc22700 1 -- 172.21.15.107:0/1364364568 >> 172.21.15.107:0/1364364568 conn(0x7fd238079350 msgr2=0x7fd238100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:18.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd23cc22700 1 -- 172.21.15.107:0/1364364568 shutdown_connections 2024-05-10T10:55:18.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:18.418+0000 7fd23cc22700 1 -- 172.21.15.107:0/1364364568 wait complete. 2024-05-10T10:55:19.136 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:18 smithi107 ceph-mon[30373]: pgmap v377: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:55:19.164 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell mds.h status 2024-05-10T10:55:19.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:18 smithi196 ceph-mon[34872]: pgmap v377: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:55:19.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:18 smithi184 ceph-mon[34585]: pgmap v377: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:55:19.406 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:21.102 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:20 smithi107 ceph-mon[30373]: pgmap v378: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:55:21.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:20 smithi196 ceph-mon[34872]: pgmap v378: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:55:21.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.357+0000 7f4bc27ab700 1 -- 172.21.15.107:0/1360290257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bbc108850 msgr2=0x7f4bbc1103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:21.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.357+0000 7f4bc27ab700 1 --2- 172.21.15.107:0/1360290257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bbc108850 0x7f4bbc1103d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400b0d0 tx=0x7f4bb400b3e0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.357+0000 7f4bc27ab700 1 -- 172.21.15.107:0/1360290257 shutdown_connections 2024-05-10T10:55:21.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.357+0000 7f4bc27ab700 1 --2- 172.21.15.107:0/1360290257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bbc103750 0x7f4bbc103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.357+0000 7f4bc27ab700 1 --2- 172.21.15.107:0/1360290257 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bbc108850 0x7f4bbc1103d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.357+0000 7f4bc27ab700 1 --2- 172.21.15.107:0/1360290257 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bbc104100 0x7f4bbc108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.357+0000 7f4bc27ab700 1 -- 172.21.15.107:0/1360290257 >> 172.21.15.107:0/1360290257 conn(0x7f4bbc07a600 msgr2=0x7f4bbc07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:21.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.357+0000 7f4bc27ab700 1 -- 172.21.15.107:0/1360290257 shutdown_connections 2024-05-10T10:55:21.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.357+0000 7f4bc27ab700 1 -- 172.21.15.107:0/1360290257 wait complete. 2024-05-10T10:55:21.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.358+0000 7f4bc27ab700 1 Processor -- start 2024-05-10T10:55:21.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.358+0000 7f4bc27ab700 1 -- start start 2024-05-10T10:55:21.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.358+0000 7f4bc27ab700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bbc103750 0x7f4bbc1a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:21.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.358+0000 7f4bc27ab700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bbc104100 0x7f4bbc1a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:21.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.358+0000 7f4bc27ab700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bbc108850 0x7f4bbc10f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:21.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.358+0000 7f4bc27ab700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc113750 con 0x7f4bbc104100 2024-05-10T10:55:21.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.358+0000 7f4bc27ab700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc1135d0 con 0x7f4bbc108850 2024-05-10T10:55:21.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.358+0000 7f4bc27ab700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc1138d0 con 0x7f4bbc103750 2024-05-10T10:55:21.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.358+0000 7f4bb3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bbc104100 0x7f4bbc1a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:21.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.358+0000 7f4bb3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bbc104100 0x7f4bbc1a6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41630/0 (socket says 172.21.15.107:41630) 2024-05-10T10:55:21.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.358+0000 7f4bb3fff700 1 -- 172.21.15.107:0/2927441834 learned_addr learned my addr 172.21.15.107:0/2927441834 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:21.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.358+0000 7f4bbbfff700 1 --2- 172.21.15.107:0/2927441834 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bbc103750 0x7f4bbc1a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:21.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.358+0000 7f4bc0d48700 1 --2- 172.21.15.107:0/2927441834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bbc108850 0x7f4bbc10f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:21.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.358+0000 7f4bb3fff700 1 -- 172.21.15.107:0/2927441834 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bbc103750 msgr2=0x7f4bbc1a5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:21.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.358+0000 7f4bb3fff700 1 --2- 172.21.15.107:0/2927441834 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bbc103750 0x7f4bbc1a5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.358+0000 7f4bb3fff700 1 -- 172.21.15.107:0/2927441834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bbc108850 msgr2=0x7f4bbc10f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:21.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.358+0000 7f4bb3fff700 1 --2- 172.21.15.107:0/2927441834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bbc108850 0x7f4bbc10f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.358+0000 7f4bb3fff700 1 -- 172.21.15.107:0/2927441834 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bbc10fd20 con 0x7f4bbc104100 2024-05-10T10:55:21.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.359+0000 7f4bb3fff700 1 --2- 172.21.15.107:0/2927441834 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bbc104100 0x7f4bbc1a6390 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400d950 tx=0x7f4ba400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:21.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.359+0000 7f4bb9ffb700 1 -- 172.21.15.107:0/2927441834 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4016070 con 0x7f4bbc104100 2024-05-10T10:55:21.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.359+0000 7f4bc27ab700 1 -- 172.21.15.107:0/2927441834 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bbc110010 con 0x7f4bbc104100 2024-05-10T10:55:21.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.359+0000 7f4bb9ffb700 1 -- 172.21.15.107:0/2927441834 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ba4009e10 con 0x7f4bbc104100 2024-05-10T10:55:21.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.359+0000 7f4bb9ffb700 1 -- 172.21.15.107:0/2927441834 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba400f620 con 0x7f4bbc104100 2024-05-10T10:55:21.362 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.359+0000 7f4bc27ab700 1 -- 172.21.15.107:0/2927441834 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bbc1ace80 con 0x7f4bbc104100 2024-05-10T10:55:21.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.361+0000 7f4bb9ffb700 1 -- 172.21.15.107:0/2927441834 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f4ba4019070 con 0x7f4bbc104100 2024-05-10T10:55:21.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.362+0000 7f4bb9ffb700 1 --2- 172.21.15.107:0/2927441834 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4ba80b2880 0x7f4ba80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:21.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.362+0000 7f4bbbfff700 1 --2- 172.21.15.107:0/2927441834 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4ba80b2880 0x7f4ba80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:21.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.362+0000 7f4bb9ffb700 1 -- 172.21.15.107:0/2927441834 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f4ba40e1cf0 con 0x7f4bbc104100 2024-05-10T10:55:21.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.362+0000 7f4bbbfff700 1 --2- 172.21.15.107:0/2927441834 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4ba80b2880 0x7f4ba80b4d40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4bac005950 tx=0x7f4bac00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:21.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bcd03eb80 1 Processor -- start 2024-05-10T10:55:21.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bcd03eb80 1 -- start start 2024-05-10T10:55:21.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bcd03eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8480 0x560919df8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:21.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bcd03eb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8da0 0x560919dfc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:21.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bcd03eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919dfcc30 0x560919dfd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:21.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bcd03eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560919d4a810 con 0x560919df8480 2024-05-10T10:55:21.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bcd03eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560919ce9770 con 0x560919dfcc30 2024-05-10T10:55:21.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bcd03eb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560919d467d0 con 0x560919df8da0 2024-05-10T10:55:21.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bbbfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8480 0x560919df8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:21.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bbbfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8480 0x560919df8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41636/0 (socket says 172.21.15.107:41636) 2024-05-10T10:55:21.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bbbfff700 1 -- 172.21.15.107:0/4207618371 learned_addr learned my addr 172.21.15.107:0/4207618371 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:21.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bb3fff700 1 --2- 172.21.15.107:0/4207618371 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8da0 0x560919dfc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:21.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bc0d48700 1 --2- 172.21.15.107:0/4207618371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919dfcc30 0x560919dfd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:21.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bbbfff700 1 -- 172.21.15.107:0/4207618371 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8da0 msgr2=0x560919dfc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:21.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bbbfff700 1 --2- 172.21.15.107:0/4207618371 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8da0 0x560919dfc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bbbfff700 1 -- 172.21.15.107:0/4207618371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919dfcc30 msgr2=0x560919dfd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:21.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bbbfff700 1 --2- 172.21.15.107:0/4207618371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919dfcc30 0x560919dfd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bbbfff700 1 -- 172.21.15.107:0/4207618371 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560919c97880 con 0x560919df8480 2024-05-10T10:55:21.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bc0d48700 1 --2- 172.21.15.107:0/4207618371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919dfcc30 0x560919dfd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:55:21.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bbbfff700 1 --2- 172.21.15.107:0/4207618371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8480 0x560919df8860 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00fde0 tx=0x7f4bac012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405d7f30f31dde23 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:21.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.363+0000 7f4bb27fc700 1 -- 172.21.15.107:0/4207618371 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac016070 con 0x560919df8480 2024-05-10T10:55:21.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.364+0000 7f4bb27fc700 1 -- 172.21.15.107:0/4207618371 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4bac010d90 con 0x560919df8480 2024-05-10T10:55:21.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.364+0000 7f4bb27fc700 1 -- 172.21.15.107:0/4207618371 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac01b420 con 0x560919df8480 2024-05-10T10:55:21.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.364+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/4207618371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8480 msgr2=0x560919df8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:21.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.364+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/4207618371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8480 0x560919df8860 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00fde0 tx=0x7f4bac012000 comp rx=0 tx=0).stop 2024-05-10T10:55:21.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.364+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/4207618371 shutdown_connections 2024-05-10T10:55:21.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.364+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/4207618371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919dfcc30 0x560919dfd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.364+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/4207618371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8480 0x560919df8860 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.364+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/4207618371 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8da0 0x560919dfc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.364+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/4207618371 >> 172.21.15.107:0/4207618371 conn(0x560919d240b0 msgr2=0x560919df2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:21.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.364+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/4207618371 shutdown_connections 2024-05-10T10:55:21.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.364+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/4207618371 wait complete. 2024-05-10T10:55:21.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.365+0000 7f4bcd03eb80 1 -- start start 2024-05-10T10:55:21.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.365+0000 7f4bcd03eb80 1 Processor -- start 2024-05-10T10:55:21.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.365+0000 7f4bcd03eb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8480 0x560919e04010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:21.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.365+0000 7f4bcd03eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8da0 0x560919e013b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:21.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.365+0000 7f4bcd03eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919dfcc30 0x560919e018f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:21.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.365+0000 7f4bcd03eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560919e04e40 con 0x560919df8da0 2024-05-10T10:55:21.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.365+0000 7f4bcd03eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560919cb0be0 con 0x560919dfcc30 2024-05-10T10:55:21.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.365+0000 7f4bcd03eb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560919e04fc0 con 0x560919df8480 2024-05-10T10:55:21.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.365+0000 7f4bcd03eb80 10 client.0 _ll_register_callbacks cb 0x560919ce28d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:55:21.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.365+0000 7f4bb3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8da0 0x560919e013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:21.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.365+0000 7f4bb3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8da0 0x560919e013b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41642/0 (socket says 172.21.15.107:41642) 2024-05-10T10:55:21.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.365+0000 7f4bb3fff700 1 -- 172.21.15.107:0/1869974149 learned_addr learned my addr 172.21.15.107:0/1869974149 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:21.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4bbbfff700 1 --2- 172.21.15.107:0/1869974149 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8480 0x560919e04010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:21.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4bc0d48700 1 --2- 172.21.15.107:0/1869974149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919dfcc30 0x560919e018f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:21.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4bb3fff700 1 -- 172.21.15.107:0/1869974149 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8480 msgr2=0x560919e04010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:21.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4bb3fff700 1 --2- 172.21.15.107:0/1869974149 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8480 0x560919e04010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4bb3fff700 1 -- 172.21.15.107:0/1869974149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919dfcc30 msgr2=0x560919e018f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:21.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4bb3fff700 1 --2- 172.21.15.107:0/1869974149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919dfcc30 0x560919e018f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4bb3fff700 1 -- 172.21.15.107:0/1869974149 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560919ce6640 con 0x560919df8da0 2024-05-10T10:55:21.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4bbbfff700 1 --2- 172.21.15.107:0/1869974149 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8480 0x560919e04010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:55:21.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4bc0d48700 1 --2- 172.21.15.107:0/1869974149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919dfcc30 0x560919e018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:55:21.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4bb3fff700 1 --2- 172.21.15.107:0/1869974149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8da0 0x560919e013b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40a5430 tx=0x7f4ba4010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d682368d23915847 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:21.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4b9b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:55:21.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4b9b7fe700 1 -- 172.21.15.107:0/1869974149 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4020070 con 0x560919df8da0 2024-05-10T10:55:21.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4b9b7fe700 1 -- 172.21.15.107:0/1869974149 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f4ba40a9820 con 0x560919df8da0 2024-05-10T10:55:21.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/1869974149 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bac010d90 con 0x560919df8da0 2024-05-10T10:55:21.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4b9b7fe700 1 -- 172.21.15.107:0/1869974149 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4ba406ae60 con 0x560919df8da0 2024-05-10T10:55:21.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4bcd03eb80 10 client.15159 fetch_fsmap learned FSMap version 26 2024-05-10T10:55:21.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/1869974149 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560919e0f6a0 con 0x560919df8da0 2024-05-10T10:55:21.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4b9b7fe700 1 -- 172.21.15.107:0/1869974149 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4bac010d90 con 0x560919df8da0 2024-05-10T10:55:21.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4b9b7fe700 1 -- 172.21.15.107:0/1869974149 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f4ba4009940 con 0x560919df8da0 2024-05-10T10:55:21.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.366+0000 7f4bcd03eb80 10 client.15159 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:55:21.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.367+0000 7f4bcd03eb80 10 client.15159 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-10T10:55:21.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.367+0000 7f4bcd03eb80 20 client.15159 populate_metadata read hostname 'smithi107' 2024-05-10T10:55:21.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.367+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/1869974149 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x560919e11ce0 0x560919e13150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:21.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.367+0000 7f4bcd03eb80 4 client.15159 mds_command: new command op to 24449 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:55:21.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.367+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/1869974149 --> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560919dc4600 con 0x560919e11ce0 2024-05-10T10:55:21.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.367+0000 7f4bbbfff700 1 --2- 172.21.15.107:0/1869974149 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x560919e11ce0 0x560919e13150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:21.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.367+0000 7f4bbbfff700 1 --2- 172.21.15.107:0/1869974149 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x560919e11ce0 0x560919e13150 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2e72bbca23435955 server_cookie=e2ec35b877c8abbc in_seq=0 out_seq=0 2024-05-10T10:55:21.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.367+0000 7f4b9b7fe700 10 client.15159 ms_handle_connect on v2:172.21.15.184:6836/4239260328 2024-05-10T10:55:21.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.368+0000 7f4b9b7fe700 1 -- 172.21.15.107:0/1869974149 <== mds.1 v2:172.21.15.184:6836/4239260328 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560919dc4600 con 0x560919e11ce0 2024-05-10T10:55:21.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.368+0000 7f4b9b7fe700 10 client.15159 handle_command_reply: tid=0 2024-05-10T10:55:21.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.368+0000 7f4bcd03eb80 1 client.15159 shutdown 2024-05-10T10:55:21.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.368+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/1869974149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8da0 msgr2=0x560919e013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:21.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.368+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/1869974149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8da0 0x560919e013b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40a5430 tx=0x7f4ba4010990 comp rx=0 tx=0).stop 2024-05-10T10:55:21.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.368+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/1869974149 shutdown_connections 2024-05-10T10:55:21.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.368+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/1869974149 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x560919e11ce0 0x560919e13150 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.368+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/1869974149 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8480 0x560919e04010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.368+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/1869974149 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919dfcc30 0x560919e018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.368+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/1869974149 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8da0 0x560919e013b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.368+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/1869974149 >> 172.21.15.107:0/1869974149 conn(0x560919d240b0 msgr2=0x560919ded6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:21.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.369+0000 7f4b9b7fe700 0 client.15159 ms_handle_reset on v2:172.21.15.184:6836/4239260328 2024-05-10T10:55:21.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.369+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/1869974149 shutdown_connections 2024-05-10T10:55:21.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.369+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/1869974149 wait complete. 2024-05-10T10:55:21.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.369+0000 7f4bcd03eb80 20 client.15159 trim_cache size 0 max 16384 2024-05-10T10:55:21.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:20 smithi184 ceph-mon[34585]: pgmap v378: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:55:21.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.389+0000 7f4bcd03eb80 1 Processor -- start 2024-05-10T10:55:21.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.389+0000 7f4bcd03eb80 1 -- start start 2024-05-10T10:55:21.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.389+0000 7f4bcd03eb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8480 0x560919dff020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:21.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.389+0000 7f4bcd03eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919df8da0 0x560919dfa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:21.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.389+0000 7f4bcd03eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919dfcc30 0x560919dfaae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:21.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.389+0000 7f4bcd03eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560919e11490 con 0x560919dfcc30 2024-05-10T10:55:21.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.389+0000 7f4bcd03eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560919e11b60 con 0x560919df8da0 2024-05-10T10:55:21.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.389+0000 7f4bcd03eb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560919e12230 con 0x560919df8480 2024-05-10T10:55:21.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.389+0000 7f4bbbfff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8480 0x560919dff020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:21.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.389+0000 7f4bbbfff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8480 0x560919dff020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.107:47492/0 (socket says 172.21.15.107:47492) 2024-05-10T10:55:21.391 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.389+0000 7f4bbbfff700 1 -- 172.21.15.107:0/2184953459 learned_addr learned my addr 172.21.15.107:0/2184953459 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:21.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.390+0000 7f4bb3fff700 1 --2- 172.21.15.107:0/2184953459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919df8da0 0x560919dfa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:21.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.390+0000 7f4bc0d48700 1 --2- 172.21.15.107:0/2184953459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919dfcc30 0x560919dfaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:21.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.390+0000 7f4bbbfff700 1 -- 172.21.15.107:0/2184953459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919df8da0 msgr2=0x560919dfa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:21.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.390+0000 7f4bbbfff700 1 --2- 172.21.15.107:0/2184953459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919df8da0 0x560919dfa5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.390+0000 7f4bbbfff700 1 -- 172.21.15.107:0/2184953459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919dfcc30 msgr2=0x560919dfaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:21.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.390+0000 7f4bbbfff700 1 --2- 172.21.15.107:0/2184953459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919dfcc30 0x560919dfaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.390+0000 7f4bbbfff700 1 -- 172.21.15.107:0/2184953459 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560919dfb020 con 0x560919df8480 2024-05-10T10:55:21.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.390+0000 7f4bc0d48700 1 --2- 172.21.15.107:0/2184953459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919dfcc30 0x560919dfaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:55:21.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.390+0000 7f4bbbfff700 1 --2- 172.21.15.107:0/2184953459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8480 0x560919dff020 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4bac010710 tx=0x7f4bac005d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=627b2a6dfe523b0f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:21.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.390+0000 7f4bb1ffb700 1 -- 172.21.15.107:0/2184953459 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac025670 con 0x560919df8480 2024-05-10T10:55:21.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.390+0000 7f4bb1ffb700 1 -- 172.21.15.107:0/2184953459 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4bac034070 con 0x560919df8480 2024-05-10T10:55:21.392 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.390+0000 7f4bb1ffb700 1 -- 172.21.15.107:0/2184953459 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0054d0 con 0x560919df8480 2024-05-10T10:55:21.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.391+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/2184953459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8480 msgr2=0x560919dff020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:21.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.391+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/2184953459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8480 0x560919dff020 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4bac010710 tx=0x7f4bac005d90 comp rx=0 tx=0).stop 2024-05-10T10:55:21.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.391+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/2184953459 shutdown_connections 2024-05-10T10:55:21.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.391+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/2184953459 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8480 0x560919dff020 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.391+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/2184953459 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919dfcc30 0x560919dfaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.391+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/2184953459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919df8da0 0x560919dfa5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.391+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/2184953459 >> 172.21.15.107:0/2184953459 conn(0x560919d240b0 msgr2=0x560919dffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:21.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.391+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/2184953459 shutdown_connections 2024-05-10T10:55:21.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.391+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/2184953459 wait complete. 2024-05-10T10:55:21.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.391+0000 7f4bcd03eb80 1 -- start start 2024-05-10T10:55:21.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.391+0000 7f4bcd03eb80 1 Processor -- start 2024-05-10T10:55:21.396 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4bcd03eb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8480 0x560919e1c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:21.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4bcd03eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8da0 0x560919df96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:21.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4bcd03eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919dfcc30 0x560919df9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:21.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4bcd03eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560919e12fd0 con 0x560919df8da0 2024-05-10T10:55:21.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4bcd03eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560919e12900 con 0x560919dfcc30 2024-05-10T10:55:21.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4bcd03eb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560919e136a0 con 0x560919df8480 2024-05-10T10:55:21.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4bcd03eb80 10 client.0 _ll_register_callbacks cb 0x560919ce28d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:55:21.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4bb3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8da0 0x560919df96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:21.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4bb3fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8da0 0x560919df96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41656/0 (socket says 172.21.15.107:41656) 2024-05-10T10:55:21.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4bb3fff700 1 -- 172.21.15.107:0/1793611393 learned_addr learned my addr 172.21.15.107:0/1793611393 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:21.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4bc0d48700 1 --2- 172.21.15.107:0/1793611393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919dfcc30 0x560919df9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:21.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4bbbfff700 1 --2- 172.21.15.107:0/1793611393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8480 0x560919e1c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:21.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4bb3fff700 1 -- 172.21.15.107:0/1793611393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8480 msgr2=0x560919e1c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:21.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4bb3fff700 1 --2- 172.21.15.107:0/1793611393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8480 0x560919e1c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4bb3fff700 1 -- 172.21.15.107:0/1793611393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919dfcc30 msgr2=0x560919df9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:21.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4bb3fff700 1 --2- 172.21.15.107:0/1793611393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919dfcc30 0x560919df9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4bb3fff700 1 -- 172.21.15.107:0/1793611393 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560919dfa150 con 0x560919df8da0 2024-05-10T10:55:21.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4bb3fff700 1 --2- 172.21.15.107:0/1793611393 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8da0 0x560919df96a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40a6620 tx=0x7f4ba4010b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76661d457a80c848 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:21.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4b9b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:55:21.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4b9b7fe700 1 -- 172.21.15.107:0/1793611393 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4020070 con 0x560919df8da0 2024-05-10T10:55:21.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4b9b7fe700 1 -- 172.21.15.107:0/1793611393 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f4ba40a59a0 con 0x560919df8da0 2024-05-10T10:55:21.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.392+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/1793611393 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4bac034070 con 0x560919df8da0 2024-05-10T10:55:21.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.393+0000 7f4b9b7fe700 1 -- 172.21.15.107:0/1793611393 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4ba4088050 con 0x560919df8da0 2024-05-10T10:55:21.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.393+0000 7f4bcd03eb80 10 client.15165 fetch_fsmap learned FSMap version 26 2024-05-10T10:55:21.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.393+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/1793611393 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560919e1c400 con 0x560919df8da0 2024-05-10T10:55:21.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.393+0000 7f4b9b7fe700 1 -- 172.21.15.107:0/1793611393 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4bac034070 con 0x560919df8da0 2024-05-10T10:55:21.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.393+0000 7f4b9b7fe700 1 -- 172.21.15.107:0/1793611393 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f4ba40a4d20 con 0x560919df8da0 2024-05-10T10:55:21.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.393+0000 7f4bcd03eb80 10 client.15165 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:55:21.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.393+0000 7f4bcd03eb80 10 client.15165 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-10T10:55:21.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.393+0000 7f4bcd03eb80 20 client.15165 populate_metadata read hostname 'smithi107' 2024-05-10T10:55:21.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.393+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/1793611393 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x560919e81ac0 0x560919e807d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:21.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.393+0000 7f4bcd03eb80 4 client.15165 mds_command: new command op to 24449 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T10:55:21.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.393+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/1793611393 --> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] -- command(tid 0: {"prefix": "status"}) -- 0x560919d581f0 con 0x560919e81ac0 2024-05-10T10:55:21.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.393+0000 7f4bbbfff700 1 --2- 172.21.15.107:0/1793611393 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x560919e81ac0 0x560919e807d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:21.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.393+0000 7f4b9b7fe700 10 client.15165 ms_handle_connect on v2:172.21.15.184:6836/4239260328 2024-05-10T10:55:21.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.393+0000 7f4bbbfff700 1 --2- 172.21.15.107:0/1793611393 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x560919e81ac0 0x560919e807d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=34902c44f854d429 server_cookie=649dfe7d6ee7783b in_seq=0 out_seq=0 2024-05-10T10:55:21.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.394+0000 7f4b9b7fe700 1 -- 172.21.15.107:0/1793611393 <== mds.1 v2:172.21.15.184:6836/4239260328 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x560919d581f0 con 0x560919e81ac0 2024-05-10T10:55:21.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.394+0000 7f4b9b7fe700 10 client.15165 handle_command_reply: tid=0 2024-05-10T10:55:21.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.394+0000 7f4bcd03eb80 1 client.15165 shutdown 2024-05-10T10:55:21.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.394+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/1793611393 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8da0 msgr2=0x560919df96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:21.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.394+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/1793611393 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8da0 0x560919df96a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40a6620 tx=0x7f4ba4010b30 comp rx=0 tx=0).stop 2024-05-10T10:55:21.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.394+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/1793611393 shutdown_connections 2024-05-10T10:55:21.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.394+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/1793611393 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x560919e81ac0 0x560919e807d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.394+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/1793611393 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560919df8480 0x560919e1c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.394+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/1793611393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560919dfcc30 0x560919df9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.394+0000 7f4bcd03eb80 1 --2- 172.21.15.107:0/1793611393 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560919df8da0 0x560919df96a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.394+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/1793611393 >> 172.21.15.107:0/1793611393 conn(0x560919d240b0 msgr2=0x560919ded6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:21.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.394+0000 7f4b9b7fe700 0 client.15165 ms_handle_reset on v2:172.21.15.184:6836/4239260328 2024-05-10T10:55:21.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.394+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/1793611393 shutdown_connections 2024-05-10T10:55:21.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.394+0000 7f4bcd03eb80 1 -- 172.21.15.107:0/1793611393 wait complete. 2024-05-10T10:55:21.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.394+0000 7f4bcd03eb80 20 client.15165 trim_cache size 0 max 16384 2024-05-10T10:55:21.400 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:55:21.401 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "0ba8a8e4-0eba-11ef-bc98-c7b262605968", 2024-05-10T10:55:21.401 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 1, 2024-05-10T10:55:21.401 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24449, 2024-05-10T10:55:21.401 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2024-05-10T10:55:21.401 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2024-05-10T10:55:21.401 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2024-05-10T10:55:21.401 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 171.61337668600001, 2024-05-10T10:55:21.401 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 26, 2024-05-10T10:55:21.401 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 82, 2024-05-10T10:55:21.401 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 80, 2024-05-10T10:55:21.402 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 213.759621893 2024-05-10T10:55:21.402 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:55:21.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.395+0000 7f4bc27ab700 1 -- 172.21.15.107:0/2927441834 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4ba80b2880 msgr2=0x7f4ba80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:21.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.395+0000 7f4bc27ab700 1 --2- 172.21.15.107:0/2927441834 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4ba80b2880 0x7f4ba80b4d40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4bac005950 tx=0x7f4bac00a300 comp rx=0 tx=0).stop 2024-05-10T10:55:21.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.395+0000 7f4bc27ab700 1 -- 172.21.15.107:0/2927441834 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bbc104100 msgr2=0x7f4bbc1a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:21.402 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.395+0000 7f4bc27ab700 1 --2- 172.21.15.107:0/2927441834 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bbc104100 0x7f4bbc1a6390 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400d950 tx=0x7f4ba400dc60 comp rx=0 tx=0).stop 2024-05-10T10:55:21.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.395+0000 7f4bc27ab700 1 -- 172.21.15.107:0/2927441834 shutdown_connections 2024-05-10T10:55:21.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.395+0000 7f4bc27ab700 1 --2- 172.21.15.107:0/2927441834 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4ba80b2880 0x7f4ba80b4d40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.395+0000 7f4bc27ab700 1 --2- 172.21.15.107:0/2927441834 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4bbc103750 0x7f4bbc1a5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.395+0000 7f4bc27ab700 1 --2- 172.21.15.107:0/2927441834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4bbc108850 0x7f4bbc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.395+0000 7f4bc27ab700 1 --2- 172.21.15.107:0/2927441834 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4bbc104100 0x7f4bbc1a6390 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:21.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.395+0000 7f4bc27ab700 1 -- 172.21.15.107:0/2927441834 >> 172.21.15.107:0/2927441834 conn(0x7f4bbc07a600 msgr2=0x7f4bbc101360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:21.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.395+0000 7f4bc27ab700 1 -- 172.21.15.107:0/2927441834 shutdown_connections 2024-05-10T10:55:21.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:21.395+0000 7f4bc27ab700 1 -- 172.21.15.107:0/2927441834 wait complete. 2024-05-10T10:55:22.238 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell mds.b status 2024-05-10T10:55:22.479 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:23.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:22 smithi107 ceph-mon[30373]: pgmap v379: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-10T10:55:23.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:22 smithi196 ceph-mon[34872]: pgmap v379: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-10T10:55:23.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:22 smithi184 ceph-mon[34585]: pgmap v379: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-10T10:55:24.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.275+0000 7f7ac5862700 1 -- 172.21.15.107:0/3718953573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ac01023a0 msgr2=0x7f7ac0102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:24.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.275+0000 7f7ac5862700 1 --2- 172.21.15.107:0/3718953573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ac01023a0 0x7f7ac0102820 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009990 tx=0x7f7aa8009ca0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.275+0000 7f7ac5862700 1 -- 172.21.15.107:0/3718953573 shutdown_connections 2024-05-10T10:55:24.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.275+0000 7f7ac5862700 1 --2- 172.21.15.107:0/3718953573 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ac0102d60 0x7f7ac010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.275+0000 7f7ac5862700 1 --2- 172.21.15.107:0/3718953573 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ac0108410 0x7f7ac01087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.275+0000 7f7ac5862700 1 --2- 172.21.15.107:0/3718953573 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ac01023a0 0x7f7ac0102820 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.275+0000 7f7ac5862700 1 -- 172.21.15.107:0/3718953573 >> 172.21.15.107:0/3718953573 conn(0x7f7ac0079350 msgr2=0x7f7ac0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:24.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.275+0000 7f7ac5862700 1 -- 172.21.15.107:0/3718953573 shutdown_connections 2024-05-10T10:55:24.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.275+0000 7f7ac5862700 1 -- 172.21.15.107:0/3718953573 wait complete. 2024-05-10T10:55:24.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.276+0000 7f7ac5862700 1 Processor -- start 2024-05-10T10:55:24.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.276+0000 7f7ac5862700 1 -- start start 2024-05-10T10:55:24.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.276+0000 7f7ac5862700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ac01023a0 0x7f7ac019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:24.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.276+0000 7f7ac5862700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ac0102d60 0x7f7ac019c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:24.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.276+0000 7f7ac5862700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ac0108410 0x7f7ac01a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:24.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.276+0000 7f7ac5862700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac01126a0 con 0x7f7ac01023a0 2024-05-10T10:55:24.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.276+0000 7f7ac5862700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac0112520 con 0x7f7ac0108410 2024-05-10T10:55:24.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.276+0000 7f7ac5862700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac0112820 con 0x7f7ac0102d60 2024-05-10T10:55:24.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.276+0000 7f7abeffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ac01023a0 0x7f7ac019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:24.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.276+0000 7f7abeffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ac01023a0 0x7f7ac019be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41668/0 (socket says 172.21.15.107:41668) 2024-05-10T10:55:24.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.276+0000 7f7abeffd700 1 -- 172.21.15.107:0/1476977317 learned_addr learned my addr 172.21.15.107:0/1476977317 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:24.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.276+0000 7f7abf7fe700 1 --2- 172.21.15.107:0/1476977317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ac0108410 0x7f7ac01a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:24.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.277+0000 7f7ab67fc700 1 --2- 172.21.15.107:0/1476977317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ac0102d60 0x7f7ac019c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:24.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.277+0000 7f7abeffd700 1 -- 172.21.15.107:0/1476977317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ac0102d60 msgr2=0x7f7ac019c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:24.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.277+0000 7f7abeffd700 1 --2- 172.21.15.107:0/1476977317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ac0102d60 0x7f7ac019c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.277+0000 7f7abeffd700 1 -- 172.21.15.107:0/1476977317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ac0108410 msgr2=0x7f7ac01a06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:24.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.277+0000 7f7abeffd700 1 --2- 172.21.15.107:0/1476977317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ac0108410 0x7f7ac01a06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.277+0000 7f7abeffd700 1 -- 172.21.15.107:0/1476977317 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac01a0e20 con 0x7f7ac01023a0 2024-05-10T10:55:24.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.277+0000 7f7ab67fc700 1 --2- 172.21.15.107:0/1476977317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ac0102d60 0x7f7ac019c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:55:24.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.277+0000 7f7abeffd700 1 --2- 172.21.15.107:0/1476977317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ac01023a0 0x7f7ac019be10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000d980 tx=0x7f7ab000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:24.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.277+0000 7f7ac4860700 1 -- 172.21.15.107:0/1476977317 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0016070 con 0x7f7ac01023a0 2024-05-10T10:55:24.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.277+0000 7f7ac5862700 1 -- 172.21.15.107:0/1476977317 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac01a1110 con 0x7f7ac01023a0 2024-05-10T10:55:24.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.277+0000 7f7ac4860700 1 -- 172.21.15.107:0/1476977317 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7ab0004d00 con 0x7f7ac01023a0 2024-05-10T10:55:24.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.277+0000 7f7ac4860700 1 -- 172.21.15.107:0/1476977317 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0005610 con 0x7f7ac01023a0 2024-05-10T10:55:24.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.277+0000 7f7ac5862700 1 -- 172.21.15.107:0/1476977317 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac01a8990 con 0x7f7ac01023a0 2024-05-10T10:55:24.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.279+0000 7f7ac4860700 1 -- 172.21.15.107:0/1476977317 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f7ab0004750 con 0x7f7ac01023a0 2024-05-10T10:55:24.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.280+0000 7f7ac4860700 1 --2- 172.21.15.107:0/1476977317 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7aac0b2880 0x7f7aac0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:24.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.280+0000 7f7ab67fc700 1 --2- 172.21.15.107:0/1476977317 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7aac0b2880 0x7f7aac0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:24.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.280+0000 7f7ac4860700 1 -- 172.21.15.107:0/1476977317 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f7ab00e1ec0 con 0x7f7ac01023a0 2024-05-10T10:55:24.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.280+0000 7f7ab67fc700 1 --2- 172.21.15.107:0/1476977317 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7aac0b2880 0x7f7aac0b4d40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800b2e0 tx=0x7f7aa8005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:24.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7ad00f5b80 1 Processor -- start 2024-05-10T10:55:24.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7ad00f5b80 1 -- start start 2024-05-10T10:55:24.283 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7ad00f5b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af68480 0x561a4af68860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7ad00f5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68da0 0x561a4af6c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7ad00f5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af6cc30 0x561a4af6d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7ad00f5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561a4aeba810 con 0x561a4af68da0 2024-05-10T10:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7ad00f5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561a4ae59770 con 0x561a4af6cc30 2024-05-10T10:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7ad00f5b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x561a4aeb67d0 con 0x561a4af68480 2024-05-10T10:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7ab67fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68da0 0x561a4af6c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7ab67fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68da0 0x561a4af6c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41680/0 (socket says 172.21.15.107:41680) 2024-05-10T10:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7ab67fc700 1 -- 172.21.15.107:0/909273723 learned_addr learned my addr 172.21.15.107:0/909273723 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7abf7fe700 1 --2- 172.21.15.107:0/909273723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af6cc30 0x561a4af6d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7abeffd700 1 --2- 172.21.15.107:0/909273723 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af68480 0x561a4af68860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7ab67fc700 1 -- 172.21.15.107:0/909273723 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af68480 msgr2=0x561a4af68860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7ab67fc700 1 --2- 172.21.15.107:0/909273723 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af68480 0x561a4af68860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7ab67fc700 1 -- 172.21.15.107:0/909273723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af6cc30 msgr2=0x561a4af6d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7ab67fc700 1 --2- 172.21.15.107:0/909273723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af6cc30 0x561a4af6d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7ab67fc700 1 -- 172.21.15.107:0/909273723 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a4ae07880 con 0x561a4af68da0 2024-05-10T10:55:24.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7abeffd700 1 --2- 172.21.15.107:0/909273723 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af68480 0x561a4af68860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:55:24.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.281+0000 7f7ab67fc700 1 --2- 172.21.15.107:0/909273723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68da0 0x561a4af6c6a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8015000 tx=0x7f7aa801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd179926dc349d23 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:24.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.282+0000 7f7ab5ffb700 1 -- 172.21.15.107:0/909273723 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa800f9a0 con 0x561a4af68da0 2024-05-10T10:55:24.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.282+0000 7f7ab5ffb700 1 -- 172.21.15.107:0/909273723 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7aa8005520 con 0x561a4af68da0 2024-05-10T10:55:24.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.282+0000 7f7ab5ffb700 1 -- 172.21.15.107:0/909273723 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8004c60 con 0x561a4af68da0 2024-05-10T10:55:24.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.282+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/909273723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68da0 msgr2=0x561a4af6c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:24.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.282+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/909273723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68da0 0x561a4af6c6a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8015000 tx=0x7f7aa801d000 comp rx=0 tx=0).stop 2024-05-10T10:55:24.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.282+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/909273723 shutdown_connections 2024-05-10T10:55:24.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.282+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/909273723 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af68480 0x561a4af68860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.282+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/909273723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af6cc30 0x561a4af6d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.282+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/909273723 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68da0 0x561a4af6c6a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.282+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/909273723 >> 172.21.15.107:0/909273723 conn(0x561a4ae940b0 msgr2=0x561a4af62c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:24.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.282+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/909273723 shutdown_connections 2024-05-10T10:55:24.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.282+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/909273723 wait complete. 2024-05-10T10:55:24.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.283+0000 7f7ad00f5b80 1 -- start start 2024-05-10T10:55:24.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.283+0000 7f7ad00f5b80 1 Processor -- start 2024-05-10T10:55:24.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.283+0000 7f7ad00f5b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af68480 0x561a4af74020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:24.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.283+0000 7f7ad00f5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af68da0 0x561a4af713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:24.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.283+0000 7f7ad00f5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af6cc30 0x561a4af71900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:24.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.283+0000 7f7ad00f5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561a4af74de0 con 0x561a4af6cc30 2024-05-10T10:55:24.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.283+0000 7f7ad00f5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561a4ae20be0 con 0x561a4af68da0 2024-05-10T10:55:24.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.283+0000 7f7ad00f5b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x561a4af74f60 con 0x561a4af68480 2024-05-10T10:55:24.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.283+0000 7f7ad00f5b80 10 client.0 _ll_register_callbacks cb 0x561a4ae528d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:55:24.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.283+0000 7f7abf7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af6cc30 0x561a4af71900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:24.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.283+0000 7f7abf7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af6cc30 0x561a4af71900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41692/0 (socket says 172.21.15.107:41692) 2024-05-10T10:55:24.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.283+0000 7f7abf7fe700 1 -- 172.21.15.107:0/3597651603 learned_addr learned my addr 172.21.15.107:0/3597651603 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:24.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.284+0000 7f7abeffd700 1 --2- 172.21.15.107:0/3597651603 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af68480 0x561a4af74020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:24.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.284+0000 7f7ab67fc700 1 --2- 172.21.15.107:0/3597651603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af68da0 0x561a4af713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:24.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.284+0000 7f7abf7fe700 1 -- 172.21.15.107:0/3597651603 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af68480 msgr2=0x561a4af74020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:24.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.284+0000 7f7abf7fe700 1 --2- 172.21.15.107:0/3597651603 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af68480 0x561a4af74020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.284+0000 7f7abf7fe700 1 -- 172.21.15.107:0/3597651603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af68da0 msgr2=0x561a4af713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:24.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.284+0000 7f7abf7fe700 1 --2- 172.21.15.107:0/3597651603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af68da0 0x561a4af713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.284+0000 7f7abf7fe700 1 -- 172.21.15.107:0/3597651603 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a4ae56640 con 0x561a4af6cc30 2024-05-10T10:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.284+0000 7f7ab67fc700 1 --2- 172.21.15.107:0/3597651603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af68da0 0x561a4af713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.284+0000 7f7abf7fe700 1 --2- 172.21.15.107:0/3597651603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af6cc30 0x561a4af71900 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8007be0 tx=0x7f7ab8007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199995d27e106242 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.284+0000 7f7a9effd700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.284+0000 7f7a9effd700 1 -- 172.21.15.107:0/3597651603 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab801c070 con 0x561a4af6cc30 2024-05-10T10:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.284+0000 7f7a9effd700 1 -- 172.21.15.107:0/3597651603 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f7ab8013b30 con 0x561a4af6cc30 2024-05-10T10:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.284+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/3597651603 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7aa8005520 con 0x561a4af6cc30 2024-05-10T10:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.284+0000 7f7a9effd700 1 -- 172.21.15.107:0/3597651603 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7ab8013d30 con 0x561a4af6cc30 2024-05-10T10:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.284+0000 7f7ad00f5b80 10 client.15177 fetch_fsmap learned FSMap version 26 2024-05-10T10:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.284+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/3597651603 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561a4af7f580 con 0x561a4af6cc30 2024-05-10T10:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.284+0000 7f7a9effd700 1 -- 172.21.15.107:0/3597651603 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7aa8005520 con 0x561a4af6cc30 2024-05-10T10:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.285+0000 7f7a9effd700 1 -- 172.21.15.107:0/3597651603 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f7ab8016bd0 con 0x561a4af6cc30 2024-05-10T10:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.285+0000 7f7ad00f5b80 10 client.15177 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.285+0000 7f7ad00f5b80 10 client.15177 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T10:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.285+0000 7f7ad00f5b80 20 client.15177 populate_metadata read hostname 'smithi107' 2024-05-10T10:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.285+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/3597651603 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561a4af81c10 0x561a4af83080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:24.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.285+0000 7f7ad00f5b80 4 client.15177 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:55:24.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.285+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/3597651603 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a4af34600 con 0x561a4af81c10 2024-05-10T10:55:24.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.285+0000 7f7abeffd700 1 --2- 172.21.15.107:0/3597651603 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561a4af81c10 0x561a4af83080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:24.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.285+0000 7f7abeffd700 1 --2- 172.21.15.107:0/3597651603 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561a4af81c10 0x561a4af83080 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9841b8f224a5f552 server_cookie=430788803b0b543 in_seq=0 out_seq=0 2024-05-10T10:55:24.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.285+0000 7f7a9effd700 10 client.15177 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:55:24.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.286+0000 7f7a9effd700 1 -- 172.21.15.107:0/3597651603 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561a4af34600 con 0x561a4af81c10 2024-05-10T10:55:24.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.286+0000 7f7a9effd700 10 client.15177 handle_command_reply: tid=0 2024-05-10T10:55:24.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.286+0000 7f7ad00f5b80 1 client.15177 shutdown 2024-05-10T10:55:24.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.286+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/3597651603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af6cc30 msgr2=0x561a4af71900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:24.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.286+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/3597651603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af6cc30 0x561a4af71900 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8007be0 tx=0x7f7ab8007cc0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.286+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/3597651603 shutdown_connections 2024-05-10T10:55:24.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.286+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/3597651603 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af68480 0x561a4af74020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.286+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/3597651603 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561a4af81c10 0x561a4af83080 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.286+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/3597651603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af6cc30 0x561a4af71900 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.286+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/3597651603 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af68da0 0x561a4af713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.286+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/3597651603 >> 172.21.15.107:0/3597651603 conn(0x561a4ae940b0 msgr2=0x561a4af5d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:24.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.286+0000 7f7a9effd700 0 client.15177 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:55:24.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.286+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/3597651603 shutdown_connections 2024-05-10T10:55:24.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.286+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/3597651603 wait complete. 2024-05-10T10:55:24.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.287+0000 7f7ad00f5b80 20 client.15177 trim_cache size 0 max 16384 2024-05-10T10:55:24.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.308+0000 7f7ad00f5b80 1 Processor -- start 2024-05-10T10:55:24.312 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.308+0000 7f7ad00f5b80 1 -- start start 2024-05-10T10:55:24.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.308+0000 7f7ad00f5b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af68480 0x561a4af6f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:24.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.308+0000 7f7ad00f5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68da0 0x561a4af5d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:24.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.308+0000 7f7ad00f5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af6cc30 0x561a4af6a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:24.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.308+0000 7f7ad00f5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561a4af813c0 con 0x561a4af68da0 2024-05-10T10:55:24.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.308+0000 7f7ad00f5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561a4af81a90 con 0x561a4af6cc30 2024-05-10T10:55:24.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.308+0000 7f7ad00f5b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x561a4af82160 con 0x561a4af68480 2024-05-10T10:55:24.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.308+0000 7f7ab67fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68da0 0x561a4af5d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:24.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.308+0000 7f7ab67fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68da0 0x561a4af5d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41706/0 (socket says 172.21.15.107:41706) 2024-05-10T10:55:24.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.308+0000 7f7ab67fc700 1 -- 172.21.15.107:0/2831745440 learned_addr learned my addr 172.21.15.107:0/2831745440 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:24.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.309+0000 7f7ab67fc700 1 -- 172.21.15.107:0/2831745440 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af68480 msgr2=0x561a4af6f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:24.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.309+0000 7f7ab67fc700 1 --2- 172.21.15.107:0/2831745440 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af68480 0x561a4af6f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.309+0000 7f7ab67fc700 1 -- 172.21.15.107:0/2831745440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af6cc30 msgr2=0x561a4af6a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:24.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.309+0000 7f7ab67fc700 1 --2- 172.21.15.107:0/2831745440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af6cc30 0x561a4af6a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.309+0000 7f7ab67fc700 1 -- 172.21.15.107:0/2831745440 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a4af644d0 con 0x561a4af68da0 2024-05-10T10:55:24.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.309+0000 7f7ab67fc700 1 --2- 172.21.15.107:0/2831745440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68da0 0x561a4af5d550 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800f7f0 tx=0x7f7aa800bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6cf4782c986321c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:24.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.309+0000 7f7ab57fa700 1 -- 172.21.15.107:0/2831745440 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8036070 con 0x561a4af68da0 2024-05-10T10:55:24.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.309+0000 7f7ab57fa700 1 -- 172.21.15.107:0/2831745440 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7aa8010e20 con 0x561a4af68da0 2024-05-10T10:55:24.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.309+0000 7f7ab57fa700 1 -- 172.21.15.107:0/2831745440 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa802f430 con 0x561a4af68da0 2024-05-10T10:55:24.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.310+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/2831745440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68da0 msgr2=0x561a4af5d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:24.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.310+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/2831745440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68da0 0x561a4af5d550 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800f7f0 tx=0x7f7aa800bba0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.310+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/2831745440 shutdown_connections 2024-05-10T10:55:24.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.310+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/2831745440 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af68480 0x561a4af6f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.310+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/2831745440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af6cc30 0x561a4af6a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.310+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/2831745440 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68da0 0x561a4af5d550 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.310+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/2831745440 >> 172.21.15.107:0/2831745440 conn(0x561a4ae940b0 msgr2=0x561a4af5ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:24.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.310+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/2831745440 shutdown_connections 2024-05-10T10:55:24.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.310+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/2831745440 wait complete. 2024-05-10T10:55:24.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.310+0000 7f7ad00f5b80 1 -- start start 2024-05-10T10:55:24.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.310+0000 7f7ad00f5b80 1 Processor -- start 2024-05-10T10:55:24.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7ad00f5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68480 0x561a4af8c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:24.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7ad00f5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af68da0 0x561a4af85a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:24.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7ad00f5b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af6cc30 0x561a4af85fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:24.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7ad00f5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561a4af82f00 con 0x561a4af68480 2024-05-10T10:55:24.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7ad00f5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561a4af82830 con 0x561a4af68da0 2024-05-10T10:55:24.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7ad00f5b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x561a4af835d0 con 0x561a4af6cc30 2024-05-10T10:55:24.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7ad00f5b80 10 client.0 _ll_register_callbacks cb 0x561a4ae528d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:55:24.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7abeffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68480 0x561a4af8c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:24.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7abeffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68480 0x561a4af8c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:41710/0 (socket says 172.21.15.107:41710) 2024-05-10T10:55:24.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7abeffd700 1 -- 172.21.15.107:0/593304382 learned_addr learned my addr 172.21.15.107:0/593304382 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:24.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7ab67fc700 1 --2- 172.21.15.107:0/593304382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af68da0 0x561a4af85a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:24.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7abf7fe700 1 --2- 172.21.15.107:0/593304382 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af6cc30 0x561a4af85fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:24.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7abeffd700 1 -- 172.21.15.107:0/593304382 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af6cc30 msgr2=0x561a4af85fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:24.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7abeffd700 1 --2- 172.21.15.107:0/593304382 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af6cc30 0x561a4af85fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7abeffd700 1 -- 172.21.15.107:0/593304382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af68da0 msgr2=0x561a4af85a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:24.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7abeffd700 1 --2- 172.21.15.107:0/593304382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af68da0 0x561a4af85a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7abeffd700 1 -- 172.21.15.107:0/593304382 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a4af86500 con 0x561a4af68480 2024-05-10T10:55:24.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7ab67fc700 1 --2- 172.21.15.107:0/593304382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af68da0 0x561a4af85a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:55:24.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7abeffd700 1 --2- 172.21.15.107:0/593304382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68480 0x561a4af8c6d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00a5600 tx=0x7f7ab00a9090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f483f400365995 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:24.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7a9effd700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:55:24.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7a9effd700 1 -- 172.21.15.107:0/593304382 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00c2020 con 0x561a4af68480 2024-05-10T10:55:24.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7a9effd700 1 -- 172.21.15.107:0/593304382 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f7ab0004a40 con 0x561a4af68480 2024-05-10T10:55:24.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.311+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/593304382 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7aa8010e20 con 0x561a4af68480 2024-05-10T10:55:24.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.312+0000 7f7a9effd700 1 -- 172.21.15.107:0/593304382 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7ab0004eb0 con 0x561a4af68480 2024-05-10T10:55:24.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.312+0000 7f7ad00f5b80 10 client.15183 fetch_fsmap learned FSMap version 26 2024-05-10T10:55:24.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.312+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/593304382 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561a4af8afc0 con 0x561a4af68480 2024-05-10T10:55:24.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.312+0000 7f7a9effd700 1 -- 172.21.15.107:0/593304382 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7aa8010e20 con 0x561a4af68480 2024-05-10T10:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.312+0000 7f7a9effd700 1 -- 172.21.15.107:0/593304382 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f7ab000fc40 con 0x561a4af68480 2024-05-10T10:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.312+0000 7f7ad00f5b80 10 client.15183 fetch_fsmap finished waiting for FSMap version 26 2024-05-10T10:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.312+0000 7f7ad00f5b80 10 client.15183 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T10:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.312+0000 7f7ad00f5b80 20 client.15183 populate_metadata read hostname 'smithi107' 2024-05-10T10:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.313+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/593304382 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561a4aff1a00 0x561a4aff0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.313+0000 7f7ad00f5b80 4 client.15183 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T10:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.313+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/593304382 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "status"}) -- 0x561a4aec81f0 con 0x561a4aff1a00 2024-05-10T10:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.313+0000 7f7ab67fc700 1 --2- 172.21.15.107:0/593304382 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561a4aff1a00 0x561a4aff0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.313+0000 7f7a9effd700 10 client.15183 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.313+0000 7f7ab67fc700 1 --2- 172.21.15.107:0/593304382 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561a4aff1a00 0x561a4aff0710 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa61abeddb3a4fc3 server_cookie=9d22a96428b5d147 in_seq=0 out_seq=0 2024-05-10T10:55:24.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.313+0000 7f7a9effd700 1 -- 172.21.15.107:0/593304382 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x561a4aec81f0 con 0x561a4aff1a00 2024-05-10T10:55:24.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.313+0000 7f7a9effd700 10 client.15183 handle_command_reply: tid=0 2024-05-10T10:55:24.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.313+0000 7f7ad00f5b80 1 client.15183 shutdown 2024-05-10T10:55:24.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.314+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/593304382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68480 msgr2=0x561a4af8c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:24.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.314+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/593304382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68480 0x561a4af8c6d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00a5600 tx=0x7f7ab00a9090 comp rx=0 tx=0).stop 2024-05-10T10:55:24.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.314+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/593304382 shutdown_connections 2024-05-10T10:55:24.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.314+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/593304382 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561a4af6cc30 0x561a4af85fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.314+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/593304382 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561a4aff1a00 0x561a4aff0710 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.314+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/593304382 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561a4af68480 0x561a4af8c6d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.314+0000 7f7ad00f5b80 1 --2- 172.21.15.107:0/593304382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a4af68da0 0x561a4af85a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.314+0000 7f7a9effd700 0 client.15183 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:55:24.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.314+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/593304382 >> 172.21.15.107:0/593304382 conn(0x561a4ae940b0 msgr2=0x561a4af701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:24.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.314+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/593304382 shutdown_connections 2024-05-10T10:55:24.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.314+0000 7f7ad00f5b80 1 -- 172.21.15.107:0/593304382 wait complete. 2024-05-10T10:55:24.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.314+0000 7f7ad00f5b80 20 client.15183 trim_cache size 0 max 16384 2024-05-10T10:55:24.321 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:55:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "0ba8a8e4-0eba-11ef-bc98-c7b262605968", 2024-05-10T10:55:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 0, 2024-05-10T10:55:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24482, 2024-05-10T10:55:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2024-05-10T10:55:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2024-05-10T10:55:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2024-05-10T10:55:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 186.631743527, 2024-05-10T10:55:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 26, 2024-05-10T10:55:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 82, 2024-05-10T10:55:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 80, 2024-05-10T10:55:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 202.191780427 2024-05-10T10:55:24.322 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:55:24.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.315+0000 7f7ac5862700 1 -- 172.21.15.107:0/1476977317 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7aac0b2880 msgr2=0x7f7aac0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:24.322 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.315+0000 7f7ac5862700 1 --2- 172.21.15.107:0/1476977317 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7aac0b2880 0x7f7aac0b4d40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800b2e0 tx=0x7f7aa8005e80 comp rx=0 tx=0).stop 2024-05-10T10:55:24.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.315+0000 7f7ac5862700 1 -- 172.21.15.107:0/1476977317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ac01023a0 msgr2=0x7f7ac019be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:24.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.315+0000 7f7ac5862700 1 --2- 172.21.15.107:0/1476977317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ac01023a0 0x7f7ac019be10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000d980 tx=0x7f7ab000dc90 comp rx=0 tx=0).stop 2024-05-10T10:55:24.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.315+0000 7f7ac5862700 1 -- 172.21.15.107:0/1476977317 shutdown_connections 2024-05-10T10:55:24.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.315+0000 7f7ac5862700 1 --2- 172.21.15.107:0/1476977317 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7aac0b2880 0x7f7aac0b4d40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.315+0000 7f7ac5862700 1 --2- 172.21.15.107:0/1476977317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ac0108410 0x7f7ac01a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.315+0000 7f7ac5862700 1 --2- 172.21.15.107:0/1476977317 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7ac01023a0 0x7f7ac019be10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.315+0000 7f7ac5862700 1 --2- 172.21.15.107:0/1476977317 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7ac0102d60 0x7f7ac019c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:24.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.315+0000 7f7ac5862700 1 -- 172.21.15.107:0/1476977317 >> 172.21.15.107:0/1476977317 conn(0x7f7ac0079350 msgr2=0x7f7ac006b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:24.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.315+0000 7f7ac5862700 1 -- 172.21.15.107:0/1476977317 shutdown_connections 2024-05-10T10:55:24.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:24.315+0000 7f7ac5862700 1 -- 172.21.15.107:0/1476977317 wait complete. 2024-05-10T10:55:24.971 INFO:teuthology.run_tasks:Running task sequential... 2024-05-10T10:55:24.981 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-10T10:55:24.981 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-10T10:55:24.982 INFO:teuthology.task.print:Enabling mgr modules 2024-05-10T10:55:24.982 INFO:teuthology.run_tasks:Running task kclient... 2024-05-10T10:55:25.035 INFO:tasks.kclient:Mounting kernel clients... 2024-05-10T10:55:25.035 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-10T10:55:25.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T10:55:25.036 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-05-10T10:55:25.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T10:55:25.053 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-05-10T10:55:25.121 INFO:teuthology.orchestra.run.smithi107.stderr:Cannot find device "ceph-brx" 2024-05-10T10:55:25.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T10:55:25.123 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'rbytes': False, 'syntax': 'v2', 'mount_subvol_num': 1} 2024-05-10T10:55:25.123 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T10:55:25.123 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T10:55:25.124 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs ls 2024-05-10T10:55:25.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:24 smithi196 ceph-mon[34872]: pgmap v380: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-05-10T10:55:25.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:24 smithi184 ceph-mon[34585]: pgmap v380: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-05-10T10:55:25.410 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:25.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:24 smithi107 ceph-mon[30373]: pgmap v380: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-05-10T10:55:27.118 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:26 smithi107 ceph-mon[30373]: pgmap v381: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-05-10T10:55:27.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.119+0000 7fb8e6a0c700 1 -- 172.21.15.107:0/2561454177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e0101c50 msgr2=0x7fb8e0102030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:27.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.119+0000 7fb8e6a0c700 1 --2- 172.21.15.107:0/2561454177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e0101c50 0x7fb8e0102030 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00099c0 tx=0x7fb8d0009cd0 comp rx=0 tx=0).stop 2024-05-10T10:55:27.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.119+0000 7fb8e6a0c700 1 -- 172.21.15.107:0/2561454177 shutdown_connections 2024-05-10T10:55:27.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.119+0000 7fb8e6a0c700 1 --2- 172.21.15.107:0/2561454177 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8e0108890 0x7fb8e0110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:27.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.119+0000 7fb8e6a0c700 1 --2- 172.21.15.107:0/2561454177 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e0101c50 0x7fb8e0102030 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:27.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.119+0000 7fb8e6a0c700 1 --2- 172.21.15.107:0/2561454177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8e0102600 0x7fb8e0108160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:27.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.119+0000 7fb8e6a0c700 1 -- 172.21.15.107:0/2561454177 >> 172.21.15.107:0/2561454177 conn(0x7fb8e00789a0 msgr2=0x7fb8e00ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:27.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.119+0000 7fb8e6a0c700 1 -- 172.21.15.107:0/2561454177 shutdown_connections 2024-05-10T10:55:27.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.119+0000 7fb8e6a0c700 1 -- 172.21.15.107:0/2561454177 wait complete. 2024-05-10T10:55:27.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.119+0000 7fb8e6a0c700 1 Processor -- start 2024-05-10T10:55:27.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.119+0000 7fb8e6a0c700 1 -- start start 2024-05-10T10:55:27.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.120+0000 7fb8e6a0c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8e0101c50 0x7fb8e0102bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:27.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.120+0000 7fb8e6a0c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e0102600 0x7fb8e0103110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:27.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.120+0000 7fb8e6a0c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8e0108890 0x7fb8e0103650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:27.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.120+0000 7fb8e6a0c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e0113810 con 0x7fb8e0102600 2024-05-10T10:55:27.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.120+0000 7fb8e6a0c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e0113690 con 0x7fb8e0108890 2024-05-10T10:55:27.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.120+0000 7fb8e6a0c700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e0113990 con 0x7fb8e0101c50 2024-05-10T10:55:27.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.120+0000 7fb8df7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e0102600 0x7fb8e0103110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:27.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.120+0000 7fb8df7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e0102600 0x7fb8e0103110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37984/0 (socket says 172.21.15.107:37984) 2024-05-10T10:55:27.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.120+0000 7fb8df7fe700 1 -- 172.21.15.107:0/260756403 learned_addr learned my addr 172.21.15.107:0/260756403 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:27.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.120+0000 7fb8e4fa9700 1 --2- 172.21.15.107:0/260756403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8e0108890 0x7fb8e0103650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:27.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.120+0000 7fb8dffff700 1 --2- 172.21.15.107:0/260756403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8e0101c50 0x7fb8e0102bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:27.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.120+0000 7fb8df7fe700 1 -- 172.21.15.107:0/260756403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8e0101c50 msgr2=0x7fb8e0102bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:27.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.120+0000 7fb8df7fe700 1 --2- 172.21.15.107:0/260756403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8e0101c50 0x7fb8e0102bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:27.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.120+0000 7fb8df7fe700 1 -- 172.21.15.107:0/260756403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8e0108890 msgr2=0x7fb8e0103650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:27.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.120+0000 7fb8df7fe700 1 --2- 172.21.15.107:0/260756403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8e0108890 0x7fb8e0103650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:27.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.120+0000 7fb8df7fe700 1 -- 172.21.15.107:0/260756403 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e01a8180 con 0x7fb8e0102600 2024-05-10T10:55:27.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.120+0000 7fb8dffff700 1 --2- 172.21.15.107:0/260756403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8e0101c50 0x7fb8e0102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:55:27.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.120+0000 7fb8e4fa9700 1 --2- 172.21.15.107:0/260756403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8e0108890 0x7fb8e0103650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:55:27.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.120+0000 7fb8df7fe700 1 --2- 172.21.15.107:0/260756403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e0102600 0x7fb8e0103110 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb8d400d950 tx=0x7fb8d400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:27.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.121+0000 7fb8dd7fa700 1 -- 172.21.15.107:0/260756403 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4016070 con 0x7fb8e0102600 2024-05-10T10:55:27.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.121+0000 7fb8e6a0c700 1 -- 172.21.15.107:0/260756403 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e01a8470 con 0x7fb8e0102600 2024-05-10T10:55:27.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.121+0000 7fb8dd7fa700 1 -- 172.21.15.107:0/260756403 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb8d4009b40 con 0x7fb8e0102600 2024-05-10T10:55:27.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.121+0000 7fb8dd7fa700 1 -- 172.21.15.107:0/260756403 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d400f620 con 0x7fb8e0102600 2024-05-10T10:55:27.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.121+0000 7fb8e6a0c700 1 -- 172.21.15.107:0/260756403 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e01a8a00 con 0x7fb8e0102600 2024-05-10T10:55:27.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.122+0000 7fb8e6a0c700 1 -- 172.21.15.107:0/260756403 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e010bad0 con 0x7fb8e0102600 2024-05-10T10:55:27.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.123+0000 7fb8dd7fa700 1 -- 172.21.15.107:0/260756403 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fb8d4019070 con 0x7fb8e0102600 2024-05-10T10:55:27.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.124+0000 7fb8dd7fa700 1 --2- 172.21.15.107:0/260756403 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb8c80b2880 0x7fb8c80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:27.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.124+0000 7fb8dffff700 1 --2- 172.21.15.107:0/260756403 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb8c80b2880 0x7fb8c80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:27.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.124+0000 7fb8dd7fa700 1 -- 172.21.15.107:0/260756403 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fb8d40e2210 con 0x7fb8e0102600 2024-05-10T10:55:27.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.124+0000 7fb8dffff700 1 --2- 172.21.15.107:0/260756403 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb8c80b2880 0x7fb8c80b4d40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0006010 tx=0x7fb8d0009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:27.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.127+0000 7fb8dd7fa700 1 -- 172.21.15.107:0/260756403 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb8d40a9fd0 con 0x7fb8e0102600 2024-05-10T10:55:27.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:26 smithi196 ceph-mon[34872]: pgmap v381: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-05-10T10:55:27.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.381+0000 7fb8e6a0c700 1 -- 172.21.15.107:0/260756403 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb8e01040b0 con 0x7fb8e0102600 2024-05-10T10:55:27.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.381+0000 7fb8dd7fa700 1 -- 172.21.15.107:0/260756403 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7fb8d40a98d0 con 0x7fb8e0102600 2024-05-10T10:55:27.382 INFO:teuthology.orchestra.run.smithi107.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-10T10:55:27.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.383+0000 7fb8e6a0c700 1 -- 172.21.15.107:0/260756403 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb8c80b2880 msgr2=0x7fb8c80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:27.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.383+0000 7fb8e6a0c700 1 --2- 172.21.15.107:0/260756403 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb8c80b2880 0x7fb8c80b4d40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0006010 tx=0x7fb8d0009f10 comp rx=0 tx=0).stop 2024-05-10T10:55:27.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.383+0000 7fb8e6a0c700 1 -- 172.21.15.107:0/260756403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e0102600 msgr2=0x7fb8e0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:27.384 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.383+0000 7fb8e6a0c700 1 --2- 172.21.15.107:0/260756403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e0102600 0x7fb8e0103110 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb8d400d950 tx=0x7fb8d400dd10 comp rx=0 tx=0).stop 2024-05-10T10:55:27.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.384+0000 7fb8e6a0c700 1 -- 172.21.15.107:0/260756403 shutdown_connections 2024-05-10T10:55:27.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.384+0000 7fb8e6a0c700 1 --2- 172.21.15.107:0/260756403 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb8c80b2880 0x7fb8c80b4d40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:27.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.384+0000 7fb8e6a0c700 1 --2- 172.21.15.107:0/260756403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb8e0101c50 0x7fb8e0102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:27.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.384+0000 7fb8e6a0c700 1 --2- 172.21.15.107:0/260756403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8e0108890 0x7fb8e0103650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:27.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.384+0000 7fb8e6a0c700 1 --2- 172.21.15.107:0/260756403 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb8e0102600 0x7fb8e0103110 secure :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb8d400d950 tx=0x7fb8d400dd10 comp rx=0 tx=0).stop 2024-05-10T10:55:27.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.384+0000 7fb8e6a0c700 1 -- 172.21.15.107:0/260756403 >> 172.21.15.107:0/260756403 conn(0x7fb8e00789a0 msgr2=0x7fb8e0106fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:27.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.384+0000 7fb8e6a0c700 1 -- 172.21.15.107:0/260756403 shutdown_connections 2024-05-10T10:55:27.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:27.384+0000 7fb8e6a0c700 1 -- 172.21.15.107:0/260756403 wait complete. 2024-05-10T10:55:27.388 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:26 smithi184 ceph-mon[34585]: pgmap v381: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2024-05-10T10:55:28.017 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T10:55:28.017 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T10:55:28.017 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi107.front.sepia.ceph.com 2024-05-10T10:55:28.017 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T10:55:28.017 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T10:55:28.017 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T10:55:28.017 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T10:55:28.017 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T10:55:28.017 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T10:55:28.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T10:55:28.018 DEBUG:teuthology.orchestra.run.smithi107:> ip addr 2024-05-10T10:55:28.035 INFO:teuthology.orchestra.run.smithi107.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T10:55:28.035 INFO:teuthology.orchestra.run.smithi107.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T10:55:28.035 INFO:teuthology.orchestra.run.smithi107.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T10:55:28.035 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-10T10:55:28.035 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 ::1/128 scope host 2024-05-10T10:55:28.035 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-10T10:55:28.035 INFO:teuthology.orchestra.run.smithi107.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T10:55:28.035 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0a brd ff:ff:ff:ff:ff:ff 2024-05-10T10:55:28.035 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f0 2024-05-10T10:55:28.035 INFO:teuthology.orchestra.run.smithi107.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T10:55:28.035 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:d8:a2:0b brd ff:ff:ff:ff:ff:ff 2024-05-10T10:55:28.035 INFO:teuthology.orchestra.run.smithi107.stdout: altname enp7s0f1 2024-05-10T10:55:28.036 INFO:teuthology.orchestra.run.smithi107.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T10:55:28.036 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:ea brd ff:ff:ff:ff:ff:ff 2024-05-10T10:55:28.036 INFO:teuthology.orchestra.run.smithi107.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T10:55:28.036 INFO:teuthology.orchestra.run.smithi107.stdout: link/ether 0c:c4:7a:8f:47:eb brd ff:ff:ff:ff:ff:ff 2024-05-10T10:55:28.036 INFO:teuthology.orchestra.run.smithi107.stdout: inet 172.21.15.107/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-10T10:55:28.036 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft 42017sec preferred_lft 42017sec 2024-05-10T10:55:28.036 INFO:teuthology.orchestra.run.smithi107.stdout: inet6 fe80::ec4:7aff:fe8f:47eb/64 scope link 2024-05-10T10:55:28.036 INFO:teuthology.orchestra.run.smithi107.stdout: valid_lft forever preferred_lft forever 2024-05-10T10:55:28.036 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-10T10:55:28.037 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T10:55:28.037 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-10T10:55:28.037 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add name ceph-brx type bridge 2024-05-10T10:55:28.037 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr flush dev ceph-brx 2024-05-10T10:55:28.037 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set ceph-brx up 2024-05-10T10:55:28.037 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-10T10:55:28.037 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-10T10:55:28.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T10:55:28.215 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:27 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/260756403' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-10T10:55:28.226 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T10:55:28.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T10:55:28.233 DEBUG:teuthology.orchestra.run.smithi107:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T10:55:28.257 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-05-10T10:55:28.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T10:55:28.259 DEBUG:teuthology.orchestra.run.smithi107:> route 2024-05-10T10:55:28.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:27 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/260756403' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-10T10:55:28.334 INFO:teuthology.orchestra.run.smithi107.stdout:Kernel IP routing table 2024-05-10T10:55:28.334 INFO:teuthology.orchestra.run.smithi107.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T10:55:28.334 INFO:teuthology.orchestra.run.smithi107.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T10:55:28.334 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T10:55:28.334 INFO:teuthology.orchestra.run.smithi107.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T10:55:28.335 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T10:55:28.335 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-10T10:55:28.335 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T10:55:28.335 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T10:55:28.335 DEBUG:teuthology.orchestra.run.smithi107:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T10:55:28.335 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-10T10:55:28.388 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:27 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/260756403' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-10T10:55:28.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T10:55:28.635 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T10:55:28.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T10:55:28.641 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-05-10T10:55:28.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T10:55:28.658 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list-id 2024-05-10T10:55:28.713 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T10:55:28.713 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-10T10:55:28.713 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T10:55:28.713 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-10T10:55:28.713 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-10T10:55:28.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T10:55:28.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T10:55:28.832 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-10T10:55:28.832 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T10:55:28.832 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-10T10:55:28.832 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-10T10:55:28.832 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-10T10:55:28.832 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-10T10:55:28.832 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-10T10:55:28.832 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-10T10:55:28.832 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-10T10:55:28.880 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T10:55:28.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T10:55:28.953 DEBUG:teuthology.orchestra.run.smithi107:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-10T10:55:28.953 DEBUG:teuthology.orchestra.run.smithi107:> set -e 2024-05-10T10:55:28.954 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set brx.0 up 2024-05-10T10:55:28.954 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link set dev brx.0 master ceph-brx 2024-05-10T10:55:28.954 DEBUG:teuthology.orchestra.run.smithi107:> ') 2024-05-10T10:55:29.004 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T10:55:29.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T10:55:29.033 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T10:55:29.033 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T10:55:29.062 INFO:teuthology.orchestra.run.smithi107.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T10:55:29.063 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T10:55:29.063 DEBUG:teuthology.orchestra.run.smithi107:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T10:55:29.119 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-05-10T10:55:29.119 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-05-10T10:55:29.119 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/2fd36ad3-1e0d-47af-93cf-f6f84d4f04b1 2024-05-10T10:55:29.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T10:55:29.119 DEBUG:teuthology.orchestra.run.smithi107:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/2fd36ad3-1e0d-47af-93cf-f6f84d4f04b1 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-05-10T10:55:29.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:28 smithi107 ceph-mon[30373]: pgmap v382: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-05-10T10:55:29.227 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-05-10T10:55:29.227 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-05-10T10:55:29.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:28 smithi196 ceph-mon[34872]: pgmap v382: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-05-10T10:55:29.354 INFO:teuthology.orchestra.run.smithi107.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-05-10T10:55:29.354 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-05-10T10:55:29.355 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: resolved to: "172.21.15.107:3300,172.21.15.184:3300,172.21.15.196:3300" 2024-05-10T10:55:29.355 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: trying mount with new device syntax: 0@0ba8a8e4-0eba-11ef-bc98-c7b262605968.cephfs=/volumes/qa/sv_1/2fd36ad3-1e0d-47af-93cf-f6f84d4f04b1 2024-05-10T10:55:29.355 INFO:teuthology.orchestra.run.smithi107.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.107:3300/172.21.15.184:3300/172.21.15.196:3300" will pass to kernel 2024-05-10T10:55:29.355 INFO:teuthology.orchestra.run.smithi107.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-10T10:55:29.355 INFO:teuthology.orchestra.run.smithi107.stdout: You just mounted a file system that supports labels which does not 2024-05-10T10:55:29.355 INFO:teuthology.orchestra.run.smithi107.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-10T10:55:29.355 INFO:teuthology.orchestra.run.smithi107.stdout: applications will generate AVC messages and not be allowed access to 2024-05-10T10:55:29.355 INFO:teuthology.orchestra.run.smithi107.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-10T10:55:29.357 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T10:55:29.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T10:55:29.357 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T10:55:29.388 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:28 smithi184 ceph-mon[34585]: pgmap v382: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-05-10T10:55:29.424 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T10:55:29.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T10:55:29.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T10:55:29.525 INFO:teuthology.orchestra.run.smithi107.stdout:client24812 2024-05-10T10:55:29.526 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T10:55:29.526 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T10:55:29.542 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T10:55:29.632 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T10:55:29.634 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T10:55:29.640 INFO:teuthology.orchestra.run.smithi107.stdout:client24812 2024-05-10T10:55:29.640 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T10:55:29.691 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-10T10:55:29.693 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T10:55:29.699 INFO:teuthology.orchestra.run.smithi107.stdout:client24812 2024-05-10T10:55:29.700 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968.client24812/status') 2024-05-10T10:55:29.750 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-10T10:55:29.761 INFO:teuthology.orchestra.run.smithi107.stdout:instance: client.24812 (3)172.21.15.107:0/4028690086 2024-05-10T10:55:29.761 INFO:teuthology.orchestra.run.smithi107.stdout:blocklisted: false 2024-05-10T10:55:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:0+1 records in 2024-05-10T10:55:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:0+1 records out 2024-05-10T10:55:29.761 INFO:teuthology.orchestra.run.smithi107.stderr:72 bytes copied, 2.364e-05 s, 3.0 MB/s 2024-05-10T10:55:29.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-10T10:55:29.768 INFO:teuthology.run_tasks:Running task exec... 2024-05-10T10:55:29.779 INFO:teuthology.task.exec:Executing custom commands... 2024-05-10T10:55:29.779 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi107.front.sepia.ceph.com 2024-05-10T10:55:29.779 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-05-10T10:55:29.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.882+0000 7fbff0baf640 1 -- 172.21.15.107:0/1926738230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfec102b00 msgr2=0x7fbfec102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:29.883 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.882+0000 7fbff0baf640 1 --2- 172.21.15.107:0/1926738230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfec102b00 0x7fbfec102f80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4009900 tx=0x7fbfd402a410 comp rx=0 tx=0).stop 2024-05-10T10:55:29.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.883+0000 7fbff0baf640 1 -- 172.21.15.107:0/1926738230 shutdown_connections 2024-05-10T10:55:29.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.883+0000 7fbff0baf640 1 --2- 172.21.15.107:0/1926738230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfec1034c0 0x7fbfec109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:29.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.883+0000 7fbff0baf640 1 --2- 172.21.15.107:0/1926738230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfec102b00 0x7fbfec102f80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:29.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.883+0000 7fbff0baf640 1 --2- 172.21.15.107:0/1926738230 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbfec101910 0x7fbfec101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:29.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.883+0000 7fbff0baf640 1 -- 172.21.15.107:0/1926738230 >> 172.21.15.107:0/1926738230 conn(0x7fbfec0fce80 msgr2=0x7fbfec0ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:29.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.883+0000 7fbff0baf640 1 -- 172.21.15.107:0/1926738230 shutdown_connections 2024-05-10T10:55:29.884 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.883+0000 7fbff0baf640 1 -- 172.21.15.107:0/1926738230 wait complete. 2024-05-10T10:55:29.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.883+0000 7fbff0baf640 1 Processor -- start 2024-05-10T10:55:29.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.883+0000 7fbff0baf640 1 -- start start 2024-05-10T10:55:29.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.884+0000 7fbff0baf640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbfec101910 0x7fbfec06abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:29.886 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.884+0000 7fbff0baf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfec102b00 0x7fbfec19da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:29.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.884+0000 7fbff0baf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfec1034c0 0x7fbfec1a0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:29.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.884+0000 7fbff0baf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec10d570 con 0x7fbfec102b00 2024-05-10T10:55:29.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.884+0000 7fbff0baf640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec10d3f0 con 0x7fbfec1034c0 2024-05-10T10:55:29.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.884+0000 7fbff0baf640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbfec10d6f0 con 0x7fbfec101910 2024-05-10T10:55:29.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.884+0000 7fbfe3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfec102b00 0x7fbfec19da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:29.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.884+0000 7fbfe3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfec102b00 0x7fbfec19da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37998/0 (socket says 172.21.15.107:37998) 2024-05-10T10:55:29.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.884+0000 7fbfe3fff640 1 -- 172.21.15.107:0/3764494794 learned_addr learned my addr 172.21.15.107:0/3764494794 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:29.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.884+0000 7fbfead9d640 1 --2- 172.21.15.107:0/3764494794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfec1034c0 0x7fbfec1a0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:29.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.884+0000 7fbfea59c640 1 --2- 172.21.15.107:0/3764494794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbfec101910 0x7fbfec06abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:29.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.884+0000 7fbfe3fff640 1 -- 172.21.15.107:0/3764494794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbfec101910 msgr2=0x7fbfec06abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:29.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.884+0000 7fbfe3fff640 1 --2- 172.21.15.107:0/3764494794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbfec101910 0x7fbfec06abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:29.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.884+0000 7fbfe3fff640 1 -- 172.21.15.107:0/3764494794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfec1034c0 msgr2=0x7fbfec1a0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:29.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.884+0000 7fbfe3fff640 1 --2- 172.21.15.107:0/3764494794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfec1034c0 0x7fbfec1a0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:29.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.884+0000 7fbfe3fff640 1 -- 172.21.15.107:0/3764494794 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfec1a0940 con 0x7fbfec102b00 2024-05-10T10:55:29.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.884+0000 7fbfead9d640 1 --2- 172.21.15.107:0/3764494794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfec1034c0 0x7fbfec1a0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:55:29.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.884+0000 7fbfe3fff640 1 --2- 172.21.15.107:0/3764494794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfec102b00 0x7fbfec19da10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4005940 tx=0x7fbfd40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:29.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.884+0000 7fbfe37fe640 1 -- 172.21.15.107:0/3764494794 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd403f030 con 0x7fbfec102b00 2024-05-10T10:55:29.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.885+0000 7fbfe37fe640 1 -- 172.21.15.107:0/3764494794 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbfd4003cd0 con 0x7fbfec102b00 2024-05-10T10:55:29.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.885+0000 7fbff0baf640 1 -- 172.21.15.107:0/3764494794 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfec1a0b70 con 0x7fbfec102b00 2024-05-10T10:55:29.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.885+0000 7fbfe37fe640 1 -- 172.21.15.107:0/3764494794 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd4035070 con 0x7fbfec102b00 2024-05-10T10:55:29.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.885+0000 7fbff0baf640 1 -- 172.21.15.107:0/3764494794 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfec1a1060 con 0x7fbfec102b00 2024-05-10T10:55:29.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.886+0000 7fbff0baf640 1 -- 172.21.15.107:0/3764494794 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfec108c30 con 0x7fbfec102b00 2024-05-10T10:55:29.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.887+0000 7fbfe37fe640 1 -- 172.21.15.107:0/3764494794 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7fbfd4042030 con 0x7fbfec102b00 2024-05-10T10:55:29.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.888+0000 7fbfe37fe640 1 --2- 172.21.15.107:0/3764494794 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbfd80b28a0 0x7fbfd80b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:29.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.888+0000 7fbfe37fe640 1 -- 172.21.15.107:0/3764494794 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fbfd4102940 con 0x7fbfec102b00 2024-05-10T10:55:29.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.888+0000 7fbfea59c640 1 --2- 172.21.15.107:0/3764494794 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbfd80b28a0 0x7fbfd80b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:29.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.888+0000 7fbfea59c640 1 --2- 172.21.15.107:0/3764494794 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbfd80b28a0 0x7fbfd80b4d60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbfec102960 tx=0x7fbfdc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:29.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:29.891+0000 7fbfe37fe640 1 -- 172.21.15.107:0/3764494794 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fbfd40ca700 con 0x7fbfec102b00 2024-05-10T10:55:30.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:30.124+0000 7fbff0baf640 1 -- 172.21.15.107:0/3764494794 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fbfec02db50 con 0x7fbfec102b00 2024-05-10T10:55:30.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:55:30.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:55:30.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:29 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:55:30.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:55:30.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:55:30.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:29 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:55:30.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:55:30.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:55:30.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:29 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:55:30.975 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:30.975+0000 7fbfe37fe640 1 -- 172.21.15.107:0/3764494794 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7fbfd40ca000 con 0x7fbfec102b00 2024-05-10T10:55:30.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:30.977+0000 7fbff0baf640 1 -- 172.21.15.107:0/3764494794 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbfd80b28a0 msgr2=0x7fbfd80b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:30.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:30.977+0000 7fbff0baf640 1 --2- 172.21.15.107:0/3764494794 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbfd80b28a0 0x7fbfd80b4d60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbfec102960 tx=0x7fbfdc005f90 comp rx=0 tx=0).stop 2024-05-10T10:55:30.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:30.977+0000 7fbff0baf640 1 -- 172.21.15.107:0/3764494794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfec102b00 msgr2=0x7fbfec19da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:30.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:30.977+0000 7fbff0baf640 1 --2- 172.21.15.107:0/3764494794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfec102b00 0x7fbfec19da10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4005940 tx=0x7fbfd40042f0 comp rx=0 tx=0).stop 2024-05-10T10:55:30.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:30.977+0000 7fbff0baf640 1 -- 172.21.15.107:0/3764494794 shutdown_connections 2024-05-10T10:55:30.978 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:30.977+0000 7fbff0baf640 1 --2- 172.21.15.107:0/3764494794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfec1034c0 0x7fbfec1a0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:30.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:30.977+0000 7fbff0baf640 1 --2- 172.21.15.107:0/3764494794 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbfd80b28a0 0x7fbfd80b4d60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:30.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:30.977+0000 7fbff0baf640 1 --2- 172.21.15.107:0/3764494794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbfec102b00 0x7fbfec19da10 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:30.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:30.977+0000 7fbff0baf640 1 --2- 172.21.15.107:0/3764494794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbfec101910 0x7fbfec06abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:30.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:30.977+0000 7fbff0baf640 1 -- 172.21.15.107:0/3764494794 >> 172.21.15.107:0/3764494794 conn(0x7fbfec0fce80 msgr2=0x7fbfec105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:30.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:30.977+0000 7fbff0baf640 1 -- 172.21.15.107:0/3764494794 shutdown_connections 2024-05-10T10:55:30.979 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:30.977+0000 7fbff0baf640 1 -- 172.21.15.107:0/3764494794 wait complete. 2024-05-10T10:55:30.990 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-05-10T10:55:31.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.094+0000 7f4ea7a20640 1 -- 172.21.15.107:0/1980674096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ea01010b0 msgr2=0x7f4ea01014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:31.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.094+0000 7f4ea7a20640 1 --2- 172.21.15.107:0/1980674096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ea01010b0 0x7f4ea01014d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009900 tx=0x7f4e9c02a410 comp rx=0 tx=0).stop 2024-05-10T10:55:31.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.094+0000 7f4ea7a20640 1 -- 172.21.15.107:0/1980674096 shutdown_connections 2024-05-10T10:55:31.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.094+0000 7f4ea7a20640 1 --2- 172.21.15.107:0/1980674096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ea0102c60 0x7f4ea01094f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:31.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.094+0000 7f4ea7a20640 1 --2- 172.21.15.107:0/1980674096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ea01022a0 0x7f4ea0102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:31.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.094+0000 7f4ea7a20640 1 --2- 172.21.15.107:0/1980674096 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ea01010b0 0x7f4ea01014d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:31.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.094+0000 7f4ea7a20640 1 -- 172.21.15.107:0/1980674096 >> 172.21.15.107:0/1980674096 conn(0x7f4ea00fc620 msgr2=0x7f4ea00fea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:31.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.094+0000 7f4ea7a20640 1 -- 172.21.15.107:0/1980674096 shutdown_connections 2024-05-10T10:55:31.097 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.094+0000 7f4ea7a20640 1 -- 172.21.15.107:0/1980674096 wait complete. 2024-05-10T10:55:31.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.095+0000 7f4ea7a20640 1 Processor -- start 2024-05-10T10:55:31.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.095+0000 7f4ea7a20640 1 -- start start 2024-05-10T10:55:31.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.095+0000 7f4ea7a20640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ea01010b0 0x7f4ea0198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:31.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.095+0000 7f4ea7a20640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ea01022a0 0x7f4ea0199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:31.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.095+0000 7f4ea7a20640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ea0102c60 0x7f4ea01a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:31.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.095+0000 7f4ea7a20640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea010d590 con 0x7f4ea01022a0 2024-05-10T10:55:31.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.095+0000 7f4ea7a20640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea010d410 con 0x7f4ea01010b0 2024-05-10T10:55:31.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.095+0000 7f4ea7a20640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea010d710 con 0x7f4ea0102c60 2024-05-10T10:55:31.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.095+0000 7f4ea4fbb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ea01022a0 0x7f4ea0199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:31.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.095+0000 7f4ea4fbb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ea01022a0 0x7f4ea0199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38010/0 (socket says 172.21.15.107:38010) 2024-05-10T10:55:31.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.095+0000 7f4ea4fbb640 1 -- 172.21.15.107:0/4209552283 learned_addr learned my addr 172.21.15.107:0/4209552283 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:31.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.095+0000 7f4ea57bc640 1 --2- 172.21.15.107:0/4209552283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ea01010b0 0x7f4ea0198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:31.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.095+0000 7f4ea5fbd640 1 --2- 172.21.15.107:0/4209552283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ea0102c60 0x7f4ea01a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:31.098 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.095+0000 7f4ea4fbb640 1 -- 172.21.15.107:0/4209552283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ea0102c60 msgr2=0x7f4ea01a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:31.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.095+0000 7f4ea4fbb640 1 --2- 172.21.15.107:0/4209552283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ea0102c60 0x7f4ea01a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:31.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.095+0000 7f4ea4fbb640 1 -- 172.21.15.107:0/4209552283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ea01010b0 msgr2=0x7f4ea0198cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:31.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.095+0000 7f4ea4fbb640 1 --2- 172.21.15.107:0/4209552283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ea01010b0 0x7f4ea0198cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:31.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.095+0000 7f4ea4fbb640 1 -- 172.21.15.107:0/4209552283 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea01a0900 con 0x7f4ea01022a0 2024-05-10T10:55:31.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.095+0000 7f4ea4fbb640 1 --2- 172.21.15.107:0/4209552283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ea01022a0 0x7f4ea0199200 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000d770 tx=0x7f4e9000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:31.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.096+0000 7f4e967fc640 1 -- 172.21.15.107:0/4209552283 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90017070 con 0x7f4ea01022a0 2024-05-10T10:55:31.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.096+0000 7f4ea7a20640 1 -- 172.21.15.107:0/4209552283 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea01a0bf0 con 0x7f4ea01022a0 2024-05-10T10:55:31.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.096+0000 7f4e967fc640 1 -- 172.21.15.107:0/4209552283 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4e900054f0 con 0x7f4ea01022a0 2024-05-10T10:55:31.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.096+0000 7f4e967fc640 1 -- 172.21.15.107:0/4209552283 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90004de0 con 0x7f4ea01022a0 2024-05-10T10:55:31.099 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.096+0000 7f4ea7a20640 1 -- 172.21.15.107:0/4209552283 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea01a10f0 con 0x7f4ea01022a0 2024-05-10T10:55:31.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.097+0000 7f4ea7a20640 1 -- 172.21.15.107:0/4209552283 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ea01a12c0 con 0x7f4ea01022a0 2024-05-10T10:55:31.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.098+0000 7f4e967fc640 1 -- 172.21.15.107:0/4209552283 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 18) ==== 149653+0+0 (secure 0 0 0) 0x7f4e90004f80 con 0x7f4ea01022a0 2024-05-10T10:55:31.100 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.099+0000 7f4e967fc640 1 --2- 172.21.15.107:0/4209552283 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4e8c0b28a0 0x7f4e8c0b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:31.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.099+0000 7f4ea57bc640 1 --2- 172.21.15.107:0/4209552283 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4e8c0b28a0 0x7f4e8c0b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:31.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.099+0000 7f4e967fc640 1 -- 172.21.15.107:0/4209552283 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f4e900e1cf0 con 0x7f4ea01022a0 2024-05-10T10:55:31.101 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.099+0000 7f4ea57bc640 1 --2- 172.21.15.107:0/4209552283 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4e8c0b28a0 0x7f4e8c0b4d60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009230 tx=0x7f4e9c031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:31.104 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.103+0000 7f4e967fc640 1 -- 172.21.15.107:0/4209552283 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4e900e6070 con 0x7f4ea01022a0 2024-05-10T10:55:31.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:30 smithi196 ceph-mon[34872]: pgmap v383: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-05-10T10:55:31.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:30 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3764494794' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-10T10:55:31.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:30 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:55:31.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:30 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:55:31.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:30 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:55:31.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.313+0000 7f4ea7a20640 1 -- 172.21.15.107:0/4209552283 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f4ea00fe780 con 0x7f4e8c0b28a0 2024-05-10T10:55:31.319 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:30 smithi107 ceph-mon[30373]: pgmap v383: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-05-10T10:55:31.319 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:30 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3764494794' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-10T10:55:31.319 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:30 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:55:31.320 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:30 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:55:31.320 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:30 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:55:31.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.334+0000 7f4e967fc640 1 -- 172.21.15.107:0/4209552283 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f4ea00fe780 con 0x7f4e8c0b28a0 2024-05-10T10:55:31.335 INFO:teuthology.orchestra.run.smithi107.stdout:{} 2024-05-10T10:55:31.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.336+0000 7f4ea7a20640 1 -- 172.21.15.107:0/4209552283 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4e8c0b28a0 msgr2=0x7f4e8c0b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:31.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.336+0000 7f4ea7a20640 1 --2- 172.21.15.107:0/4209552283 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4e8c0b28a0 0x7f4e8c0b4d60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009230 tx=0x7f4e9c031510 comp rx=0 tx=0).stop 2024-05-10T10:55:31.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.336+0000 7f4ea7a20640 1 -- 172.21.15.107:0/4209552283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ea01022a0 msgr2=0x7f4ea0199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:31.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.336+0000 7f4ea7a20640 1 --2- 172.21.15.107:0/4209552283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ea01022a0 0x7f4ea0199200 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000d770 tx=0x7f4e9000dc30 comp rx=0 tx=0).stop 2024-05-10T10:55:31.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.336+0000 7f4ea7a20640 1 -- 172.21.15.107:0/4209552283 shutdown_connections 2024-05-10T10:55:31.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.336+0000 7f4ea7a20640 1 --2- 172.21.15.107:0/4209552283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ea0102c60 0x7f4ea01a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:31.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.336+0000 7f4ea7a20640 1 --2- 172.21.15.107:0/4209552283 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4e8c0b28a0 0x7f4e8c0b4d60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:31.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.336+0000 7f4ea7a20640 1 --2- 172.21.15.107:0/4209552283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4ea01022a0 0x7f4ea0199200 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:31.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.336+0000 7f4ea7a20640 1 --2- 172.21.15.107:0/4209552283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ea01010b0 0x7f4ea0198cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:31.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.336+0000 7f4ea7a20640 1 -- 172.21.15.107:0/4209552283 >> 172.21.15.107:0/4209552283 conn(0x7f4ea00fc620 msgr2=0x7f4ea00fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:31.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.336+0000 7f4ea7a20640 1 -- 172.21.15.107:0/4209552283 shutdown_connections 2024-05-10T10:55:31.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:31.336+0000 7f4ea7a20640 1 -- 172.21.15.107:0/4209552283 wait complete. 2024-05-10T10:55:31.347 INFO:teuthology.run_tasks:Running task check-counter... 2024-05-10T10:55:31.362 INFO:teuthology.run_tasks:Running task background_exec... 2024-05-10T10:55:31.394 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi107.front.sepia.ceph.com 2024-05-10T10:55:31.395 DEBUG:teuthology.orchestra.run.smithi107:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-05-10T10:55:31.396 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:30 smithi184 ceph-mon[34585]: pgmap v383: 97 pgs: 97 active+clean; 647 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-05-10T10:55:31.396 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:30 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3764494794' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-10T10:55:31.396 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:30 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:55:31.396 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:30 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:55:31.396 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:30 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:55:31.397 INFO:teuthology.run_tasks:Running task quiescer... 2024-05-10T10:55:31.439 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-10T10:55:31.439 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-10T10:55:31.674 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:55:31 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:55:31.318+0000 7f6393803700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-10T10:55:31.675 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:55:31 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:55:31.318+0000 7f6393803700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-10T10:55:31.675 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:55:31 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:55:31.318+0000 7f6393803700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-10T10:55:31.675 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:55:31 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:55:31.318+0000 7f6393803700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-10T10:55:31.675 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 10:55:31 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T10:55:31.318+0000 7f6393803700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-10T10:55:31.680 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:32.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:31 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3764494794' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-10T10:55:32.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:31 smithi107 ceph-mon[30373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:55:32.078 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:31 smithi107 ceph-mon[30373]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:55:32.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:31 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3764494794' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-10T10:55:32.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:31 smithi196 ceph-mon[34872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:55:32.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:31 smithi196 ceph-mon[34872]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:55:32.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:31 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3764494794' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-10T10:55:32.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:31 smithi184 ceph-mon[34585]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:55:32.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:31 smithi184 ceph-mon[34585]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-10T10:55:33.118 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:32 smithi107 ceph-mon[30373]: pgmap v384: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-10T10:55:33.118 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:32 smithi107 ceph-mon[30373]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-05-10T10:55:33.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:32 smithi196 ceph-mon[34872]: pgmap v384: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-10T10:55:33.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:32 smithi196 ceph-mon[34872]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-05-10T10:55:33.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.368+0000 7fdcea670700 1 -- 172.21.15.107:0/1127448241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdce406bb40 msgr2=0x7fdce4110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:33.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.368+0000 7fdcea670700 1 --2- 172.21.15.107:0/1127448241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdce406bb40 0x7fdce4110330 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00b0a0 tx=0x7fdcdc00b3b0 comp rx=0 tx=0).stop 2024-05-10T10:55:33.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.368+0000 7fdcea670700 1 -- 172.21.15.107:0/1127448241 shutdown_connections 2024-05-10T10:55:33.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.368+0000 7fdcea670700 1 --2- 172.21.15.107:0/1127448241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdce406bb40 0x7fdce4110330 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:33.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.368+0000 7fdcea670700 1 --2- 172.21.15.107:0/1127448241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdce4109510 0x7fdce41098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:33.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.368+0000 7fdcea670700 1 --2- 172.21.15.107:0/1127448241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdce406b180 0x7fdce406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:33.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.368+0000 7fdcea670700 1 -- 172.21.15.107:0/1127448241 >> 172.21.15.107:0/1127448241 conn(0x7fdce4079350 msgr2=0x7fdce4079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:33.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.368+0000 7fdcea670700 1 -- 172.21.15.107:0/1127448241 shutdown_connections 2024-05-10T10:55:33.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.368+0000 7fdcea670700 1 -- 172.21.15.107:0/1127448241 wait complete. 2024-05-10T10:55:33.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.369+0000 7fdcea670700 1 Processor -- start 2024-05-10T10:55:33.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.369+0000 7fdcea670700 1 -- start start 2024-05-10T10:55:33.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.369+0000 7fdcea670700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdce406b180 0x7fdce419f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:33.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.369+0000 7fdcea670700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdce406bb40 0x7fdce419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:33.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.369+0000 7fdcea670700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdce4109510 0x7fdce4199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:33.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.370+0000 7fdce37fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdce406bb40 0x7fdce419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:33.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.370+0000 7fdce37fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdce406bb40 0x7fdce419fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38052/0 (socket says 172.21.15.107:38052) 2024-05-10T10:55:33.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.370+0000 7fdce37fe700 1 -- 172.21.15.107:0/3529224349 learned_addr learned my addr 172.21.15.107:0/3529224349 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:33.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.370+0000 7fdcea670700 1 -- 172.21.15.107:0/3529224349 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdce41137e0 con 0x7fdce406bb40 2024-05-10T10:55:33.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.370+0000 7fdcea670700 1 -- 172.21.15.107:0/3529224349 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdce4113660 con 0x7fdce406b180 2024-05-10T10:55:33.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.370+0000 7fdcea670700 1 -- 172.21.15.107:0/3529224349 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fdce4113960 con 0x7fdce4109510 2024-05-10T10:55:33.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.370+0000 7fdce3fff700 1 --2- 172.21.15.107:0/3529224349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdce406b180 0x7fdce419f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:33.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.370+0000 7fdce8c0d700 1 --2- 172.21.15.107:0/3529224349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdce4109510 0x7fdce4199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:33.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.370+0000 7fdce37fe700 1 -- 172.21.15.107:0/3529224349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdce4109510 msgr2=0x7fdce4199a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:33.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.370+0000 7fdce37fe700 1 --2- 172.21.15.107:0/3529224349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdce4109510 0x7fdce4199a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:33.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.370+0000 7fdce37fe700 1 -- 172.21.15.107:0/3529224349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdce406b180 msgr2=0x7fdce419f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:33.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.370+0000 7fdce37fe700 1 --2- 172.21.15.107:0/3529224349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdce406b180 0x7fdce419f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:33.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.370+0000 7fdce37fe700 1 -- 172.21.15.107:0/3529224349 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce419a180 con 0x7fdce406bb40 2024-05-10T10:55:33.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.370+0000 7fdce37fe700 1 --2- 172.21.15.107:0/3529224349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdce406bb40 0x7fdce419fda0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400b530 tx=0x7fdcd400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:33.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.370+0000 7fdce17fa700 1 -- 172.21.15.107:0/3529224349 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4015020 con 0x7fdce406bb40 2024-05-10T10:55:33.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.370+0000 7fdcea670700 1 -- 172.21.15.107:0/3529224349 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce419a470 con 0x7fdce406bb40 2024-05-10T10:55:33.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.370+0000 7fdce17fa700 1 -- 172.21.15.107:0/3529224349 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdcd4011d00 con 0x7fdce406bb40 2024-05-10T10:55:33.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.370+0000 7fdce17fa700 1 -- 172.21.15.107:0/3529224349 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4010e60 con 0x7fdce406bb40 2024-05-10T10:55:33.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.370+0000 7fdcea670700 1 -- 172.21.15.107:0/3529224349 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce41a6730 con 0x7fdce406bb40 2024-05-10T10:55:33.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.371+0000 7fdcea670700 1 -- 172.21.15.107:0/3529224349 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce406a190 con 0x7fdce406bb40 2024-05-10T10:55:33.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.373+0000 7fdce17fa700 1 -- 172.21.15.107:0/3529224349 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 149704+0+0 (secure 0 0 0) 0x7fdcd4018020 con 0x7fdce406bb40 2024-05-10T10:55:33.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.373+0000 7fdce17fa700 1 --2- 172.21.15.107:0/3529224349 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fdccc0b2910 0x7fdccc0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:33.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.374+0000 7fdce3fff700 1 --2- 172.21.15.107:0/3529224349 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fdccc0b2910 0x7fdccc0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:33.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.374+0000 7fdce17fa700 1 -- 172.21.15.107:0/3529224349 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fdcd40e1fb0 con 0x7fdce406bb40 2024-05-10T10:55:33.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.374+0000 7fdce3fff700 1 --2- 172.21.15.107:0/3529224349 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fdccc0b2910 0x7fdccc0b4dd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8005ea0 tx=0x7fdcd8005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:33.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.377+0000 7fdce17fa700 1 -- 172.21.15.107:0/3529224349 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fdcd401f020 con 0x7fdce406bb40 2024-05-10T10:55:33.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:32 smithi184 ceph-mon[34585]: pgmap v384: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-10T10:55:33.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:32 smithi184 ceph-mon[34585]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-05-10T10:55:33.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.582+0000 7fdcea670700 1 -- 172.21.15.107:0/3529224349 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdce40638e0 con 0x7fdccc0b2910 2024-05-10T10:55:33.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.590+0000 7fdce17fa700 1 -- 172.21.15.107:0/3529224349 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258871 (secure 0 0 0) 0x7fdce40638e0 con 0x7fdccc0b2910 2024-05-10T10:55:33.594 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:55:33.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.594+0000 7fdcea670700 1 -- 172.21.15.107:0/3529224349 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fdccc0b2910 msgr2=0x7fdccc0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:33.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.594+0000 7fdcea670700 1 --2- 172.21.15.107:0/3529224349 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fdccc0b2910 0x7fdccc0b4dd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8005ea0 tx=0x7fdcd8005e30 comp rx=0 tx=0).stop 2024-05-10T10:55:33.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.594+0000 7fdcea670700 1 -- 172.21.15.107:0/3529224349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdce406bb40 msgr2=0x7fdce419fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:33.596 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.594+0000 7fdcea670700 1 --2- 172.21.15.107:0/3529224349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdce406bb40 0x7fdce419fda0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400b530 tx=0x7fdcd400b8f0 comp rx=0 tx=0).stop 2024-05-10T10:55:33.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.594+0000 7fdcea670700 1 -- 172.21.15.107:0/3529224349 shutdown_connections 2024-05-10T10:55:33.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.594+0000 7fdcea670700 1 --2- 172.21.15.107:0/3529224349 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fdccc0b2910 0x7fdccc0b4dd0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:33.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.594+0000 7fdcea670700 1 --2- 172.21.15.107:0/3529224349 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdce4109510 0x7fdce4199a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:33.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.594+0000 7fdcea670700 1 --2- 172.21.15.107:0/3529224349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdce406b180 0x7fdce419f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:33.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.594+0000 7fdcea670700 1 --2- 172.21.15.107:0/3529224349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdce406bb40 0x7fdce419fda0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:33.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.594+0000 7fdcea670700 1 -- 172.21.15.107:0/3529224349 >> 172.21.15.107:0/3529224349 conn(0x7fdce4079350 msgr2=0x7fdce4100e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:33.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.594+0000 7fdcea670700 1 -- 172.21.15.107:0/3529224349 shutdown_connections 2024-05-10T10:55:33.597 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:33.594+0000 7fdcea670700 1 -- 172.21.15.107:0/3529224349 wait complete. 2024-05-10T10:55:33.597 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-05-10T10:55:34.273 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2024-05-10T10:55:31.653783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663145,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1877,"num_read_kb":1044,"num_write":382,"num_write_kb":2300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951840,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":815,"ondisk_log_size":815,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374328,"kb_used_data":12696,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567496,"statfs":{"total":1151940427776,"available":1151557115904,"internally_reserved":0,"allocated":13000704,"data_stored":7213575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":62,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003236"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.634999+0000","last_change":"2024-05-10T10:52:15.686294+0000","last_active":"2024-05-10T10:54:07.634999+0000","last_peered":"2024-05-10T10:54:07.634999+0000","last_clean":"2024-05-10T10:54:07.634999+0000","last_became_active":"2024-05-10T10:52:15.685324+0000","last_became_peered":"2024-05-10T10:52:15.685324+0000","last_unstale":"2024-05-10T10:54:07.634999+0000","last_undegraded":"2024-05-10T10:54:07.634999+0000","last_fullsized":"2024-05-10T10:54:07.634999+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:20.777432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.625202+0000","last_change":"2024-05-10T10:52:15.687542+0000","last_active":"2024-05-10T10:54:07.625202+0000","last_peered":"2024-05-10T10:54:07.625202+0000","last_clean":"2024-05-10T10:54:07.625202+0000","last_became_active":"2024-05-10T10:52:15.687258+0000","last_became_peered":"2024-05-10T10:52:15.687258+0000","last_unstale":"2024-05-10T10:54:07.625202+0000","last_undegraded":"2024-05-10T10:54:07.625202+0000","last_fullsized":"2024-05-10T10:54:07.625202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:08.522392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.636006+0000","last_change":"2024-05-10T10:52:15.682314+0000","last_active":"2024-05-10T10:54:07.636006+0000","last_peered":"2024-05-10T10:54:07.636006+0000","last_clean":"2024-05-10T10:54:07.636006+0000","last_became_active":"2024-05-10T10:52:15.681939+0000","last_became_peered":"2024-05-10T10:52:15.681939+0000","last_unstale":"2024-05-10T10:54:07.636006+0000","last_undegraded":"2024-05-10T10:54:07.636006+0000","last_fullsized":"2024-05-10T10:54:07.636006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:04.857969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.629993+0000","last_change":"2024-05-10T10:52:15.693451+0000","last_active":"2024-05-10T10:54:07.629993+0000","last_peered":"2024-05-10T10:54:07.629993+0000","last_clean":"2024-05-10T10:54:07.629993+0000","last_became_active":"2024-05-10T10:52:15.693041+0000","last_became_peered":"2024-05-10T10:52:15.693041+0000","last_unstale":"2024-05-10T10:54:07.629993+0000","last_undegraded":"2024-05-10T10:54:07.629993+0000","last_fullsized":"2024-05-10T10:54:07.629993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:57:14.959699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.637732+0000","last_change":"2024-05-10T10:52:15.679527+0000","last_active":"2024-05-10T10:54:07.637732+0000","last_peered":"2024-05-10T10:54:07.637732+0000","last_clean":"2024-05-10T10:54:07.637732+0000","last_became_active":"2024-05-10T10:52:15.679153+0000","last_became_peered":"2024-05-10T10:52:15.679153+0000","last_unstale":"2024-05-10T10:54:07.637732+0000","last_undegraded":"2024-05-10T10:54:07.637732+0000","last_fullsized":"2024-05-10T10:54:07.637732+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:58.738486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628648+0000","last_change":"2024-05-10T10:52:15.685905+0000","last_active":"2024-05-10T10:54:07.628648+0000","last_peered":"2024-05-10T10:54:07.628648+0000","last_clean":"2024-05-10T10:54:07.628648+0000","last_became_active":"2024-05-10T10:52:15.685628+0000","last_became_peered":"2024-05-10T10:52:15.685628+0000","last_unstale":"2024-05-10T10:54:07.628648+0000","last_undegraded":"2024-05-10T10:54:07.628648+0000","last_fullsized":"2024-05-10T10:54:07.628648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:16.776307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.634298+0000","last_change":"2024-05-10T10:52:15.692951+0000","last_active":"2024-05-10T10:54:07.634298+0000","last_peered":"2024-05-10T10:54:07.634298+0000","last_clean":"2024-05-10T10:54:07.634298+0000","last_became_active":"2024-05-10T10:52:15.692594+0000","last_became_peered":"2024-05-10T10:52:15.692594+0000","last_unstale":"2024-05-10T10:54:07.634298+0000","last_undegraded":"2024-05-10T10:54:07.634298+0000","last_fullsized":"2024-05-10T10:54:07.634298+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:04.105565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.629178+0000","last_change":"2024-05-10T10:52:15.692349+0000","last_active":"2024-05-10T10:54:07.629178+0000","last_peered":"2024-05-10T10:54:07.629178+0000","last_clean":"2024-05-10T10:54:07.629178+0000","last_became_active":"2024-05-10T10:52:15.691840+0000","last_became_peered":"2024-05-10T10:52:15.691840+0000","last_unstale":"2024-05-10T10:54:07.629178+0000","last_undegraded":"2024-05-10T10:54:07.629178+0000","last_fullsized":"2024-05-10T10:54:07.629178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:32:25.011085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645356+0000","last_change":"2024-05-10T10:52:15.686531+0000","last_active":"2024-05-10T10:54:07.645356+0000","last_peered":"2024-05-10T10:54:07.645356+0000","last_clean":"2024-05-10T10:54:07.645356+0000","last_became_active":"2024-05-10T10:52:15.686029+0000","last_became_peered":"2024-05-10T10:52:15.686029+0000","last_unstale":"2024-05-10T10:54:07.645356+0000","last_undegraded":"2024-05-10T10:54:07.645356+0000","last_fullsized":"2024-05-10T10:54:07.645356+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:30.836606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.631823+0000","last_change":"2024-05-10T10:52:15.697314+0000","last_active":"2024-05-10T10:54:07.631823+0000","last_peered":"2024-05-10T10:54:07.631823+0000","last_clean":"2024-05-10T10:54:07.631823+0000","last_became_active":"2024-05-10T10:52:15.696944+0000","last_became_peered":"2024-05-10T10:52:15.696944+0000","last_unstale":"2024-05-10T10:54:07.631823+0000","last_undegraded":"2024-05-10T10:54:07.631823+0000","last_fullsized":"2024-05-10T10:54:07.631823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:10.098904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.644918+0000","last_change":"2024-05-10T10:52:15.690866+0000","last_active":"2024-05-10T10:54:07.644918+0000","last_peered":"2024-05-10T10:54:07.644918+0000","last_clean":"2024-05-10T10:54:07.644918+0000","last_became_active":"2024-05-10T10:52:15.690533+0000","last_became_peered":"2024-05-10T10:52:15.690533+0000","last_unstale":"2024-05-10T10:54:07.644918+0000","last_undegraded":"2024-05-10T10:54:07.644918+0000","last_fullsized":"2024-05-10T10:54:07.644918+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:48.290897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.626832+0000","last_change":"2024-05-10T10:52:15.696386+0000","last_active":"2024-05-10T10:54:07.626832+0000","last_peered":"2024-05-10T10:54:07.626832+0000","last_clean":"2024-05-10T10:54:07.626832+0000","last_became_active":"2024-05-10T10:52:15.696044+0000","last_became_peered":"2024-05-10T10:52:15.696044+0000","last_unstale":"2024-05-10T10:54:07.626832+0000","last_undegraded":"2024-05-10T10:54:07.626832+0000","last_fullsized":"2024-05-10T10:54:07.626832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:48.259860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.638961+0000","last_change":"2024-05-10T10:52:15.691796+0000","last_active":"2024-05-10T10:54:07.638961+0000","last_peered":"2024-05-10T10:54:07.638961+0000","last_clean":"2024-05-10T10:54:07.638961+0000","last_became_active":"2024-05-10T10:52:15.690952+0000","last_became_peered":"2024-05-10T10:52:15.690952+0000","last_unstale":"2024-05-10T10:54:07.638961+0000","last_undegraded":"2024-05-10T10:54:07.638961+0000","last_fullsized":"2024-05-10T10:54:07.638961+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:10.645645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.623536+0000","last_change":"2024-05-10T10:52:15.683303+0000","last_active":"2024-05-10T10:54:07.623536+0000","last_peered":"2024-05-10T10:54:07.623536+0000","last_clean":"2024-05-10T10:54:07.623536+0000","last_became_active":"2024-05-10T10:52:15.682753+0000","last_became_peered":"2024-05-10T10:52:15.682753+0000","last_unstale":"2024-05-10T10:54:07.623536+0000","last_undegraded":"2024-05-10T10:54:07.623536+0000","last_fullsized":"2024-05-10T10:54:07.623536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:00.167463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.630931+0000","last_change":"2024-05-10T10:52:15.691668+0000","last_active":"2024-05-10T10:54:07.630931+0000","last_peered":"2024-05-10T10:54:07.630931+0000","last_clean":"2024-05-10T10:54:07.630931+0000","last_became_active":"2024-05-10T10:52:15.691323+0000","last_became_peered":"2024-05-10T10:52:15.691323+0000","last_unstale":"2024-05-10T10:54:07.630931+0000","last_undegraded":"2024-05-10T10:54:07.630931+0000","last_fullsized":"2024-05-10T10:54:07.630931+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:09.235092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645579+0000","last_change":"2024-05-10T10:52:15.689859+0000","last_active":"2024-05-10T10:54:07.645579+0000","last_peered":"2024-05-10T10:54:07.645579+0000","last_clean":"2024-05-10T10:54:07.645579+0000","last_became_active":"2024-05-10T10:52:15.689060+0000","last_became_peered":"2024-05-10T10:52:15.689060+0000","last_unstale":"2024-05-10T10:54:07.645579+0000","last_undegraded":"2024-05-10T10:54:07.645579+0000","last_fullsized":"2024-05-10T10:54:07.645579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:42.029942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.635076+0000","last_change":"2024-05-10T10:52:15.686711+0000","last_active":"2024-05-10T10:54:07.635076+0000","last_peered":"2024-05-10T10:54:07.635076+0000","last_clean":"2024-05-10T10:54:07.635076+0000","last_became_active":"2024-05-10T10:52:15.685817+0000","last_became_peered":"2024-05-10T10:52:15.685817+0000","last_unstale":"2024-05-10T10:54:07.635076+0000","last_undegraded":"2024-05-10T10:54:07.635076+0000","last_fullsized":"2024-05-10T10:54:07.635076+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:50:25.703341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.621992+0000","last_change":"2024-05-10T10:52:15.681702+0000","last_active":"2024-05-10T10:54:07.621992+0000","last_peered":"2024-05-10T10:54:07.621992+0000","last_clean":"2024-05-10T10:54:07.621992+0000","last_became_active":"2024-05-10T10:52:15.681400+0000","last_became_peered":"2024-05-10T10:52:15.681400+0000","last_unstale":"2024-05-10T10:54:07.621992+0000","last_undegraded":"2024-05-10T10:54:07.621992+0000","last_fullsized":"2024-05-10T10:54:07.621992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:07.520500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.633710+0000","last_change":"2024-05-10T10:52:15.684321+0000","last_active":"2024-05-10T10:54:07.633710+0000","last_peered":"2024-05-10T10:54:07.633710+0000","last_clean":"2024-05-10T10:54:07.633710+0000","last_became_active":"2024-05-10T10:52:15.683099+0000","last_became_peered":"2024-05-10T10:52:15.683099+0000","last_unstale":"2024-05-10T10:54:07.633710+0000","last_undegraded":"2024-05-10T10:54:07.633710+0000","last_fullsized":"2024-05-10T10:54:07.633710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:09.310292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":217,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:27.905178+0000","last_change":"2024-05-10T10:52:12.530258+0000","last_active":"2024-05-10T10:55:27.905178+0000","last_peered":"2024-05-10T10:55:27.905178+0000","last_clean":"2024-05-10T10:55:27.905178+0000","last_became_active":"2024-05-10T10:52:12.529842+0000","last_became_peered":"2024-05-10T10:52:12.529842+0000","last_unstale":"2024-05-10T10:55:27.905178+0000","last_undegraded":"2024-05-10T10:55:27.905178+0000","last_fullsized":"2024-05-10T10:55:27.905178+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:13.525038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":177,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.625785+0000","last_change":"2024-05-10T10:53:09.698541+0000","last_active":"2024-05-10T10:54:07.625785+0000","last_peered":"2024-05-10T10:54:07.625785+0000","last_clean":"2024-05-10T10:54:07.625785+0000","last_became_active":"2024-05-10T10:53:09.698219+0000","last_became_peered":"2024-05-10T10:53:09.698219+0000","last_unstale":"2024-05-10T10:54:07.625785+0000","last_undegraded":"2024-05-10T10:54:07.625785+0000","last_fullsized":"2024-05-10T10:54:07.625785+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:27:11.837418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.910128+0000","last_change":"2024-05-10T10:52:12.630918+0000","last_active":"2024-05-10T10:53:08.910128+0000","last_peered":"2024-05-10T10:53:08.910128+0000","last_clean":"2024-05-10T10:53:08.910128+0000","last_became_active":"2024-05-10T10:52:12.630563+0000","last_became_peered":"2024-05-10T10:52:12.630563+0000","last_unstale":"2024-05-10T10:53:08.910128+0000","last_undegraded":"2024-05-10T10:53:08.910128+0000","last_fullsized":"2024-05-10T10:53:08.910128+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:58:03.341362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.643641+0000","last_change":"2024-05-10T10:52:15.676831+0000","last_active":"2024-05-10T10:54:07.643641+0000","last_peered":"2024-05-10T10:54:07.643641+0000","last_clean":"2024-05-10T10:54:07.643641+0000","last_became_active":"2024-05-10T10:52:15.676506+0000","last_became_peered":"2024-05-10T10:52:15.676506+0000","last_unstale":"2024-05-10T10:54:07.643641+0000","last_undegraded":"2024-05-10T10:54:07.643641+0000","last_fullsized":"2024-05-10T10:54:07.643641+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:43.498800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908972+0000","last_change":"2024-05-10T10:52:12.532092+0000","last_active":"2024-05-10T10:53:08.908972+0000","last_peered":"2024-05-10T10:53:08.908972+0000","last_clean":"2024-05-10T10:53:08.908972+0000","last_became_active":"2024-05-10T10:52:12.531649+0000","last_became_peered":"2024-05-10T10:52:12.531649+0000","last_unstale":"2024-05-10T10:53:08.908972+0000","last_undegraded":"2024-05-10T10:53:08.908972+0000","last_fullsized":"2024-05-10T10:53:08.908972+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.709935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.641656+0000","last_change":"2024-05-10T10:52:15.683024+0000","last_active":"2024-05-10T10:54:07.641656+0000","last_peered":"2024-05-10T10:54:07.641656+0000","last_clean":"2024-05-10T10:54:07.641656+0000","last_became_active":"2024-05-10T10:52:15.682655+0000","last_became_peered":"2024-05-10T10:52:15.682655+0000","last_unstale":"2024-05-10T10:54:07.641656+0000","last_undegraded":"2024-05-10T10:54:07.641656+0000","last_fullsized":"2024-05-10T10:54:07.641656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:27.922746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908833+0000","last_change":"2024-05-10T10:52:12.534000+0000","last_active":"2024-05-10T10:53:08.908833+0000","last_peered":"2024-05-10T10:53:08.908833+0000","last_clean":"2024-05-10T10:53:08.908833+0000","last_became_active":"2024-05-10T10:52:12.533609+0000","last_became_peered":"2024-05-10T10:52:12.533609+0000","last_unstale":"2024-05-10T10:53:08.908833+0000","last_undegraded":"2024-05-10T10:53:08.908833+0000","last_fullsized":"2024-05-10T10:53:08.908833+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:38:18.115926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.644043+0000","last_change":"2024-05-10T10:52:15.695263+0000","last_active":"2024-05-10T10:54:07.644043+0000","last_peered":"2024-05-10T10:54:07.644043+0000","last_clean":"2024-05-10T10:54:07.644043+0000","last_became_active":"2024-05-10T10:52:15.694890+0000","last_became_peered":"2024-05-10T10:52:15.694890+0000","last_unstale":"2024-05-10T10:54:07.644043+0000","last_undegraded":"2024-05-10T10:54:07.644043+0000","last_fullsized":"2024-05-10T10:54:07.644043+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:50:32.361110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'8","reported_seq":215,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:28.934246+0000","last_change":"2024-05-10T10:52:12.534673+0000","last_active":"2024-05-10T10:55:28.934246+0000","last_peered":"2024-05-10T10:55:28.934246+0000","last_clean":"2024-05-10T10:55:28.934246+0000","last_became_active":"2024-05-10T10:52:12.534031+0000","last_became_peered":"2024-05-10T10:52:12.534031+0000","last_unstale":"2024-05-10T10:55:28.934246+0000","last_undegraded":"2024-05-10T10:55:28.934246+0000","last_fullsized":"2024-05-10T10:55:28.934246+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:32.030866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":180,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.617741+0000","last_change":"2024-05-10T10:52:15.683282+0000","last_active":"2024-05-10T10:54:07.617741+0000","last_peered":"2024-05-10T10:54:07.617741+0000","last_clean":"2024-05-10T10:54:07.617741+0000","last_became_active":"2024-05-10T10:52:15.682421+0000","last_became_peered":"2024-05-10T10:52:15.682421+0000","last_unstale":"2024-05-10T10:54:07.617741+0000","last_undegraded":"2024-05-10T10:54:07.617741+0000","last_fullsized":"2024-05-10T10:54:07.617741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:12.014145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.724139+0000","last_change":"2024-05-10T10:52:12.532161+0000","last_active":"2024-05-10T10:53:09.724139+0000","last_peered":"2024-05-10T10:53:09.724139+0000","last_clean":"2024-05-10T10:53:09.724139+0000","last_became_active":"2024-05-10T10:52:12.531780+0000","last_became_peered":"2024-05-10T10:52:12.531780+0000","last_unstale":"2024-05-10T10:53:09.724139+0000","last_undegraded":"2024-05-10T10:53:09.724139+0000","last_fullsized":"2024-05-10T10:53:09.724139+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:08.724945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.632144+0000","last_change":"2024-05-10T10:52:15.694602+0000","last_active":"2024-05-10T10:54:07.632144+0000","last_peered":"2024-05-10T10:54:07.632144+0000","last_clean":"2024-05-10T10:54:07.632144+0000","last_became_active":"2024-05-10T10:52:15.694279+0000","last_became_peered":"2024-05-10T10:52:15.694279+0000","last_unstale":"2024-05-10T10:54:07.632144+0000","last_undegraded":"2024-05-10T10:54:07.632144+0000","last_fullsized":"2024-05-10T10:54:07.632144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:12:16.286092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.902480+0000","last_change":"2024-05-10T10:52:12.526817+0000","last_active":"2024-05-10T10:53:08.902480+0000","last_peered":"2024-05-10T10:53:08.902480+0000","last_clean":"2024-05-10T10:53:08.902480+0000","last_became_active":"2024-05-10T10:52:12.526315+0000","last_became_peered":"2024-05-10T10:52:12.526315+0000","last_unstale":"2024-05-10T10:53:08.902480+0000","last_undegraded":"2024-05-10T10:53:08.902480+0000","last_fullsized":"2024-05-10T10:53:08.902480+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:49.968299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.636024+0000","last_change":"2024-05-10T10:52:15.683201+0000","last_active":"2024-05-10T10:54:07.636024+0000","last_peered":"2024-05-10T10:54:07.636024+0000","last_clean":"2024-05-10T10:54:07.636024+0000","last_became_active":"2024-05-10T10:52:15.682412+0000","last_became_peered":"2024-05-10T10:52:15.682412+0000","last_unstale":"2024-05-10T10:54:07.636024+0000","last_undegraded":"2024-05-10T10:54:07.636024+0000","last_fullsized":"2024-05-10T10:54:07.636024+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:22.001179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697080+0000","last_change":"2024-05-10T10:52:12.531058+0000","last_active":"2024-05-10T10:53:09.697080+0000","last_peered":"2024-05-10T10:53:09.697080+0000","last_clean":"2024-05-10T10:53:09.697080+0000","last_became_active":"2024-05-10T10:52:12.530655+0000","last_became_peered":"2024-05-10T10:52:12.530655+0000","last_unstale":"2024-05-10T10:53:09.697080+0000","last_undegraded":"2024-05-10T10:53:09.697080+0000","last_fullsized":"2024-05-10T10:53:09.697080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:36:52.300420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.622213+0000","last_change":"2024-05-10T10:52:15.681697+0000","last_active":"2024-05-10T10:54:07.622213+0000","last_peered":"2024-05-10T10:54:07.622213+0000","last_clean":"2024-05-10T10:54:07.622213+0000","last_became_active":"2024-05-10T10:52:15.681396+0000","last_became_peered":"2024-05-10T10:52:15.681396+0000","last_unstale":"2024-05-10T10:54:07.622213+0000","last_undegraded":"2024-05-10T10:54:07.622213+0000","last_fullsized":"2024-05-10T10:54:07.622213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:35.390837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'6","reported_seq":385,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:28.941470+0000","last_change":"2024-05-10T10:52:12.532089+0000","last_active":"2024-05-10T10:55:28.941470+0000","last_peered":"2024-05-10T10:55:28.941470+0000","last_clean":"2024-05-10T10:55:28.941470+0000","last_became_active":"2024-05-10T10:52:12.531641+0000","last_became_peered":"2024-05-10T10:52:12.531641+0000","last_unstale":"2024-05-10T10:55:28.941470+0000","last_undegraded":"2024-05-10T10:55:28.941470+0000","last_fullsized":"2024-05-10T10:55:28.941470+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:34.517079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":352,"num_read_kb":352,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.641380+0000","last_change":"2024-05-10T10:52:15.685566+0000","last_active":"2024-05-10T10:54:07.641380+0000","last_peered":"2024-05-10T10:54:07.641380+0000","last_clean":"2024-05-10T10:54:07.641380+0000","last_became_active":"2024-05-10T10:52:15.685220+0000","last_became_peered":"2024-05-10T10:52:15.685220+0000","last_unstale":"2024-05-10T10:54:07.641380+0000","last_undegraded":"2024-05-10T10:54:07.641380+0000","last_fullsized":"2024-05-10T10:54:07.641380+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:06.140961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.906414+0000","last_change":"2024-05-10T10:52:12.533182+0000","last_active":"2024-05-10T10:53:08.906414+0000","last_peered":"2024-05-10T10:53:08.906414+0000","last_clean":"2024-05-10T10:53:08.906414+0000","last_became_active":"2024-05-10T10:52:12.532821+0000","last_became_peered":"2024-05-10T10:52:12.532821+0000","last_unstale":"2024-05-10T10:53:08.906414+0000","last_undegraded":"2024-05-10T10:53:08.906414+0000","last_fullsized":"2024-05-10T10:53:08.906414+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:54:15.930093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628636+0000","last_change":"2024-05-10T10:52:15.690491+0000","last_active":"2024-05-10T10:54:07.628636+0000","last_peered":"2024-05-10T10:54:07.628636+0000","last_clean":"2024-05-10T10:54:07.628636+0000","last_became_active":"2024-05-10T10:52:15.690200+0000","last_became_peered":"2024-05-10T10:52:15.690200+0000","last_unstale":"2024-05-10T10:54:07.628636+0000","last_undegraded":"2024-05-10T10:54:07.628636+0000","last_fullsized":"2024-05-10T10:54:07.628636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:28.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697533+0000","last_change":"2024-05-10T10:52:12.631966+0000","last_active":"2024-05-10T10:53:09.697533+0000","last_peered":"2024-05-10T10:53:09.697533+0000","last_clean":"2024-05-10T10:53:09.697533+0000","last_became_active":"2024-05-10T10:52:12.631539+0000","last_became_peered":"2024-05-10T10:52:12.631539+0000","last_unstale":"2024-05-10T10:53:09.697533+0000","last_undegraded":"2024-05-10T10:53:09.697533+0000","last_fullsized":"2024-05-10T10:53:09.697533+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:32:52.392307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645950+0000","last_change":"2024-05-10T10:52:15.692893+0000","last_active":"2024-05-10T10:54:07.645950+0000","last_peered":"2024-05-10T10:54:07.645950+0000","last_clean":"2024-05-10T10:54:07.645950+0000","last_became_active":"2024-05-10T10:52:15.692528+0000","last_became_peered":"2024-05-10T10:52:15.692528+0000","last_unstale":"2024-05-10T10:54:07.645950+0000","last_undegraded":"2024-05-10T10:54:07.645950+0000","last_fullsized":"2024-05-10T10:54:07.645950+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:51.452294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'38","reported_seq":427,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:29.353962+0000","last_change":"2024-05-10T10:52:12.532094+0000","last_active":"2024-05-10T10:55:29.353962+0000","last_peered":"2024-05-10T10:55:29.353962+0000","last_clean":"2024-05-10T10:55:29.353962+0000","last_became_active":"2024-05-10T10:52:12.531719+0000","last_became_peered":"2024-05-10T10:52:12.531719+0000","last_unstale":"2024-05-10T10:55:29.353962+0000","last_undegraded":"2024-05-10T10:55:29.353962+0000","last_fullsized":"2024-05-10T10:55:29.353962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:43:52.697528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65281,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":362,"num_read_kb":244,"num_write":40,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.637338+0000","last_change":"2024-05-10T10:52:15.688187+0000","last_active":"2024-05-10T10:54:07.637338+0000","last_peered":"2024-05-10T10:54:07.637338+0000","last_clean":"2024-05-10T10:54:07.637338+0000","last_became_active":"2024-05-10T10:52:15.687821+0000","last_became_peered":"2024-05-10T10:52:15.687821+0000","last_unstale":"2024-05-10T10:54:07.637338+0000","last_undegraded":"2024-05-10T10:54:07.637338+0000","last_fullsized":"2024-05-10T10:54:07.637338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:54.425892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.590055+0000","last_change":"2024-05-10T10:52:12.532185+0000","last_active":"2024-05-10T10:53:09.590055+0000","last_peered":"2024-05-10T10:53:09.590055+0000","last_clean":"2024-05-10T10:53:09.590055+0000","last_became_active":"2024-05-10T10:52:12.531795+0000","last_became_peered":"2024-05-10T10:52:12.531795+0000","last_unstale":"2024-05-10T10:53:09.590055+0000","last_undegraded":"2024-05-10T10:53:09.590055+0000","last_fullsized":"2024-05-10T10:53:09.590055+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:51.704767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.639760+0000","last_change":"2024-05-10T10:52:15.684388+0000","last_active":"2024-05-10T10:54:07.639760+0000","last_peered":"2024-05-10T10:54:07.639760+0000","last_clean":"2024-05-10T10:54:07.639760+0000","last_became_active":"2024-05-10T10:52:15.684061+0000","last_became_peered":"2024-05-10T10:52:15.684061+0000","last_unstale":"2024-05-10T10:54:07.639760+0000","last_undegraded":"2024-05-10T10:54:07.639760+0000","last_fullsized":"2024-05-10T10:54:07.639760+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:19.462083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697091+0000","last_change":"2024-05-10T10:52:12.531912+0000","last_active":"2024-05-10T10:53:09.697091+0000","last_peered":"2024-05-10T10:53:09.697091+0000","last_clean":"2024-05-10T10:53:09.697091+0000","last_became_active":"2024-05-10T10:52:12.531501+0000","last_became_peered":"2024-05-10T10:52:12.531501+0000","last_unstale":"2024-05-10T10:53:09.697091+0000","last_undegraded":"2024-05-10T10:53:09.697091+0000","last_fullsized":"2024-05-10T10:53:09.697091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:15.086519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.639559+0000","last_change":"2024-05-10T10:52:15.686521+0000","last_active":"2024-05-10T10:54:07.639559+0000","last_peered":"2024-05-10T10:54:07.639559+0000","last_clean":"2024-05-10T10:54:07.639559+0000","last_became_active":"2024-05-10T10:52:15.686142+0000","last_became_peered":"2024-05-10T10:52:15.686142+0000","last_unstale":"2024-05-10T10:54:07.639559+0000","last_undegraded":"2024-05-10T10:54:07.639559+0000","last_fullsized":"2024-05-10T10:54:07.639559+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:40.315401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":212,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:29.935313+0000","last_change":"2024-05-10T10:52:12.527774+0000","last_active":"2024-05-10T10:55:29.935313+0000","last_peered":"2024-05-10T10:55:29.935313+0000","last_clean":"2024-05-10T10:55:29.935313+0000","last_became_active":"2024-05-10T10:52:12.527412+0000","last_became_peered":"2024-05-10T10:52:12.527412+0000","last_unstale":"2024-05-10T10:55:29.935313+0000","last_undegraded":"2024-05-10T10:55:29.935313+0000","last_fullsized":"2024-05-10T10:55:29.935313+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:51:21.334653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":181,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.633856+0000","last_change":"2024-05-10T10:52:15.693427+0000","last_active":"2024-05-10T10:54:07.633856+0000","last_peered":"2024-05-10T10:54:07.633856+0000","last_clean":"2024-05-10T10:54:07.633856+0000","last_became_active":"2024-05-10T10:52:15.693114+0000","last_became_peered":"2024-05-10T10:52:15.693114+0000","last_unstale":"2024-05-10T10:54:07.633856+0000","last_undegraded":"2024-05-10T10:54:07.633856+0000","last_fullsized":"2024-05-10T10:54:07.633856+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:25:36.423413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908419+0000","last_change":"2024-05-10T10:52:12.631475+0000","last_active":"2024-05-10T10:53:08.908419+0000","last_peered":"2024-05-10T10:53:08.908419+0000","last_clean":"2024-05-10T10:53:08.908419+0000","last_became_active":"2024-05-10T10:52:12.631079+0000","last_became_peered":"2024-05-10T10:52:12.631079+0000","last_unstale":"2024-05-10T10:53:08.908419+0000","last_undegraded":"2024-05-10T10:53:08.908419+0000","last_fullsized":"2024-05-10T10:53:08.908419+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:52.975413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.631170+0000","last_change":"2024-05-10T10:53:09.302243+0000","last_active":"2024-05-10T10:54:07.631170+0000","last_peered":"2024-05-10T10:54:07.631170+0000","last_clean":"2024-05-10T10:54:07.631170+0000","last_became_active":"2024-05-10T10:53:09.301866+0000","last_became_peered":"2024-05-10T10:53:09.301866+0000","last_unstale":"2024-05-10T10:54:07.631170+0000","last_undegraded":"2024-05-10T10:54:07.631170+0000","last_fullsized":"2024-05-10T10:54:07.631170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:07.609569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.909051+0000","last_change":"2024-05-10T10:52:12.533071+0000","last_active":"2024-05-10T10:53:08.909051+0000","last_peered":"2024-05-10T10:53:08.909051+0000","last_clean":"2024-05-10T10:53:08.909051+0000","last_became_active":"2024-05-10T10:52:12.532655+0000","last_became_peered":"2024-05-10T10:52:12.532655+0000","last_unstale":"2024-05-10T10:53:08.909051+0000","last_undegraded":"2024-05-10T10:53:08.909051+0000","last_fullsized":"2024-05-10T10:53:08.909051+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:30.723701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.617339+0000","last_change":"2024-05-10T10:52:15.697362+0000","last_active":"2024-05-10T10:54:07.617339+0000","last_peered":"2024-05-10T10:54:07.617339+0000","last_clean":"2024-05-10T10:54:07.617339+0000","last_became_active":"2024-05-10T10:52:15.696915+0000","last_became_peered":"2024-05-10T10:52:15.696915+0000","last_unstale":"2024-05-10T10:54:07.617339+0000","last_undegraded":"2024-05-10T10:54:07.617339+0000","last_fullsized":"2024-05-10T10:54:07.617339+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:29:03.365667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.909592+0000","last_change":"2024-05-10T10:53:08.909109+0000","last_active":"2024-05-10T10:53:08.909592+0000","last_peered":"2024-05-10T10:53:08.909592+0000","last_clean":"2024-05-10T10:53:08.909592+0000","last_became_active":"2024-05-10T10:53:08.908677+0000","last_became_peered":"2024-05-10T10:53:08.908677+0000","last_unstale":"2024-05-10T10:53:08.909592+0000","last_undegraded":"2024-05-10T10:53:08.909592+0000","last_fullsized":"2024-05-10T10:53:08.909592+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:51.380479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.636306+0000","last_change":"2024-05-10T10:52:15.675837+0000","last_active":"2024-05-10T10:54:07.636306+0000","last_peered":"2024-05-10T10:54:07.636306+0000","last_clean":"2024-05-10T10:54:07.636306+0000","last_became_active":"2024-05-10T10:52:15.675438+0000","last_became_peered":"2024-05-10T10:52:15.675438+0000","last_unstale":"2024-05-10T10:54:07.636306+0000","last_undegraded":"2024-05-10T10:54:07.636306+0000","last_fullsized":"2024-05-10T10:54:07.636306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:23.142008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":209,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:27.905933+0000","last_change":"2024-05-10T10:52:12.530141+0000","last_active":"2024-05-10T10:55:27.905933+0000","last_peered":"2024-05-10T10:55:27.905933+0000","last_clean":"2024-05-10T10:55:27.905933+0000","last_became_active":"2024-05-10T10:52:12.529771+0000","last_became_peered":"2024-05-10T10:52:12.529771+0000","last_unstale":"2024-05-10T10:55:27.905933+0000","last_undegraded":"2024-05-10T10:55:27.905933+0000","last_fullsized":"2024-05-10T10:55:27.905933+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:42.803789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":177,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.630624+0000","last_change":"2024-05-10T10:52:15.686934+0000","last_active":"2024-05-10T10:54:07.630624+0000","last_peered":"2024-05-10T10:54:07.630624+0000","last_clean":"2024-05-10T10:54:07.630624+0000","last_became_active":"2024-05-10T10:52:15.686494+0000","last_became_peered":"2024-05-10T10:52:15.686494+0000","last_unstale":"2024-05-10T10:54:07.630624+0000","last_undegraded":"2024-05-10T10:54:07.630624+0000","last_fullsized":"2024-05-10T10:54:07.630624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:18.049088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.632452+0000","last_change":"2024-05-10T10:52:15.693243+0000","last_active":"2024-05-10T10:54:07.632452+0000","last_peered":"2024-05-10T10:54:07.632452+0000","last_clean":"2024-05-10T10:54:07.632452+0000","last_became_active":"2024-05-10T10:52:15.692868+0000","last_became_peered":"2024-05-10T10:52:15.692868+0000","last_unstale":"2024-05-10T10:54:07.632452+0000","last_undegraded":"2024-05-10T10:54:07.632452+0000","last_fullsized":"2024-05-10T10:54:07.632452+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:25.316500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":209,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:27.932051+0000","last_change":"2024-05-10T10:52:12.630916+0000","last_active":"2024-05-10T10:55:27.932051+0000","last_peered":"2024-05-10T10:55:27.932051+0000","last_clean":"2024-05-10T10:55:27.932051+0000","last_became_active":"2024-05-10T10:52:12.630564+0000","last_became_peered":"2024-05-10T10:52:12.630564+0000","last_unstale":"2024-05-10T10:55:27.932051+0000","last_undegraded":"2024-05-10T10:55:27.932051+0000","last_fullsized":"2024-05-10T10:55:27.932051+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:09:46.434409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":177,"num_read_kb":177,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.627930+0000","last_change":"2024-05-10T10:52:15.691017+0000","last_active":"2024-05-10T10:54:07.627930+0000","last_peered":"2024-05-10T10:54:07.627930+0000","last_clean":"2024-05-10T10:54:07.627930+0000","last_became_active":"2024-05-10T10:52:15.690705+0000","last_became_peered":"2024-05-10T10:52:15.690705+0000","last_unstale":"2024-05-10T10:54:07.627930+0000","last_undegraded":"2024-05-10T10:54:07.627930+0000","last_fullsized":"2024-05-10T10:54:07.627930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:50:43.517455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.058029+0000","last_change":"2024-05-10T10:52:12.529180+0000","last_active":"2024-05-10T10:53:09.058029+0000","last_peered":"2024-05-10T10:53:09.058029+0000","last_clean":"2024-05-10T10:53:09.058029+0000","last_became_active":"2024-05-10T10:52:12.528570+0000","last_became_peered":"2024-05-10T10:52:12.528570+0000","last_unstale":"2024-05-10T10:53:09.058029+0000","last_undegraded":"2024-05-10T10:53:09.058029+0000","last_fullsized":"2024-05-10T10:53:09.058029+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:31:53.254302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.906014+0000","last_change":"2024-05-10T10:50:51.113120+0000","last_active":"2024-05-10T10:53:08.906014+0000","last_peered":"2024-05-10T10:53:08.906014+0000","last_clean":"2024-05-10T10:53:08.906014+0000","last_became_active":"2024-05-10T10:50:51.107803+0000","last_became_peered":"2024-05-10T10:50:51.107803+0000","last_unstale":"2024-05-10T10:53:08.906014+0000","last_undegraded":"2024-05-10T10:53:08.906014+0000","last_fullsized":"2024-05-10T10:53:08.906014+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:47:32.190034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:47:32.190034+0000","last_clean_scrub_stamp":"2024-05-10T10:47:32.190034+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:53.599839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.635144+0000","last_change":"2024-05-10T10:52:15.689856+0000","last_active":"2024-05-10T10:54:07.635144+0000","last_peered":"2024-05-10T10:54:07.635144+0000","last_clean":"2024-05-10T10:54:07.635144+0000","last_became_active":"2024-05-10T10:52:15.689544+0000","last_became_peered":"2024-05-10T10:52:15.689544+0000","last_unstale":"2024-05-10T10:54:07.635144+0000","last_undegraded":"2024-05-10T10:54:07.635144+0000","last_fullsized":"2024-05-10T10:54:07.635144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:39.374857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.905966+0000","last_change":"2024-05-10T10:52:12.532217+0000","last_active":"2024-05-10T10:53:08.905966+0000","last_peered":"2024-05-10T10:53:08.905966+0000","last_clean":"2024-05-10T10:53:08.905966+0000","last_became_active":"2024-05-10T10:52:12.531575+0000","last_became_peered":"2024-05-10T10:52:12.531575+0000","last_unstale":"2024-05-10T10:53:08.905966+0000","last_undegraded":"2024-05-10T10:53:08.905966+0000","last_fullsized":"2024-05-10T10:53:08.905966+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:15:59.493728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908922+0000","last_change":"2024-05-10T10:52:12.631990+0000","last_active":"2024-05-10T10:53:08.908922+0000","last_peered":"2024-05-10T10:53:08.908922+0000","last_clean":"2024-05-10T10:53:08.908922+0000","last_became_active":"2024-05-10T10:52:12.631061+0000","last_became_peered":"2024-05-10T10:52:12.631061+0000","last_unstale":"2024-05-10T10:53:08.908922+0000","last_undegraded":"2024-05-10T10:53:08.908922+0000","last_fullsized":"2024-05-10T10:53:08.908922+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:30.298079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.633824+0000","last_change":"2024-05-10T10:52:15.678797+0000","last_active":"2024-05-10T10:54:07.633824+0000","last_peered":"2024-05-10T10:54:07.633824+0000","last_clean":"2024-05-10T10:54:07.633824+0000","last_became_active":"2024-05-10T10:52:15.678388+0000","last_became_peered":"2024-05-10T10:52:15.678388+0000","last_unstale":"2024-05-10T10:54:07.633824+0000","last_undegraded":"2024-05-10T10:54:07.633824+0000","last_fullsized":"2024-05-10T10:54:07.633824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:15.314479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'16","reported_seq":59,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.702396+0000","last_change":"2024-05-10T10:53:08.916967+0000","last_active":"2024-05-10T10:54:07.702396+0000","last_peered":"2024-05-10T10:54:07.702396+0000","last_clean":"2024-05-10T10:54:07.702396+0000","last_became_active":"2024-05-10T10:53:08.910538+0000","last_became_peered":"2024-05-10T10:53:08.910538+0000","last_unstale":"2024-05-10T10:54:07.702396+0000","last_undegraded":"2024-05-10T10:54:07.702396+0000","last_fullsized":"2024-05-10T10:54:07.702396+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:32.747935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.625103+0000","last_change":"2024-05-10T10:52:15.688313+0000","last_active":"2024-05-10T10:54:07.625103+0000","last_peered":"2024-05-10T10:54:07.625103+0000","last_clean":"2024-05-10T10:54:07.625103+0000","last_became_active":"2024-05-10T10:52:15.688028+0000","last_became_peered":"2024-05-10T10:52:15.688028+0000","last_unstale":"2024-05-10T10:54:07.625103+0000","last_undegraded":"2024-05-10T10:54:07.625103+0000","last_fullsized":"2024-05-10T10:54:07.625103+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:03.815985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.058171+0000","last_change":"2024-05-10T10:52:12.529409+0000","last_active":"2024-05-10T10:53:09.058171+0000","last_peered":"2024-05-10T10:53:09.058171+0000","last_clean":"2024-05-10T10:53:09.058171+0000","last_became_active":"2024-05-10T10:52:12.528837+0000","last_became_peered":"2024-05-10T10:52:12.528837+0000","last_unstale":"2024-05-10T10:53:09.058171+0000","last_undegraded":"2024-05-10T10:53:09.058171+0000","last_fullsized":"2024-05-10T10:53:09.058171+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:28.280292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.638966+0000","last_change":"2024-05-10T10:53:08.910952+0000","last_active":"2024-05-10T10:54:07.638966+0000","last_peered":"2024-05-10T10:54:07.638966+0000","last_clean":"2024-05-10T10:54:07.638966+0000","last_became_active":"2024-05-10T10:53:08.910564+0000","last_became_peered":"2024-05-10T10:53:08.910564+0000","last_unstale":"2024-05-10T10:54:07.638966+0000","last_undegraded":"2024-05-10T10:54:07.638966+0000","last_fullsized":"2024-05-10T10:54:07.638966+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:20.289280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.300782+0000","last_change":"2024-05-10T10:52:12.631048+0000","last_active":"2024-05-10T10:53:09.300782+0000","last_peered":"2024-05-10T10:53:09.300782+0000","last_clean":"2024-05-10T10:53:09.300782+0000","last_became_active":"2024-05-10T10:52:12.630754+0000","last_became_peered":"2024-05-10T10:52:12.630754+0000","last_unstale":"2024-05-10T10:53:09.300782+0000","last_undegraded":"2024-05-10T10:53:09.300782+0000","last_fullsized":"2024-05-10T10:53:09.300782+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:57.755423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.617061+0000","last_change":"2024-05-10T10:52:15.684552+0000","last_active":"2024-05-10T10:54:07.617061+0000","last_peered":"2024-05-10T10:54:07.617061+0000","last_clean":"2024-05-10T10:54:07.617061+0000","last_became_active":"2024-05-10T10:52:15.684174+0000","last_became_peered":"2024-05-10T10:52:15.684174+0000","last_unstale":"2024-05-10T10:54:07.617061+0000","last_undegraded":"2024-05-10T10:54:07.617061+0000","last_fullsized":"2024-05-10T10:54:07.617061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:21:51.633525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.909684+0000","last_change":"2024-05-10T10:52:12.525692+0000","last_active":"2024-05-10T10:53:08.909684+0000","last_peered":"2024-05-10T10:53:08.909684+0000","last_clean":"2024-05-10T10:53:08.909684+0000","last_became_active":"2024-05-10T10:52:12.525436+0000","last_became_peered":"2024-05-10T10:52:12.525436+0000","last_unstale":"2024-05-10T10:53:08.909684+0000","last_undegraded":"2024-05-10T10:53:08.909684+0000","last_fullsized":"2024-05-10T10:53:08.909684+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:34:40.801973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.627570+0000","last_change":"2024-05-10T10:52:15.689838+0000","last_active":"2024-05-10T10:54:07.627570+0000","last_peered":"2024-05-10T10:54:07.627570+0000","last_clean":"2024-05-10T10:54:07.627570+0000","last_became_active":"2024-05-10T10:52:15.689481+0000","last_became_peered":"2024-05-10T10:52:15.689481+0000","last_unstale":"2024-05-10T10:54:07.627570+0000","last_undegraded":"2024-05-10T10:54:07.627570+0000","last_fullsized":"2024-05-10T10:54:07.627570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:02:27.382859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.590271+0000","last_change":"2024-05-10T10:52:12.533782+0000","last_active":"2024-05-10T10:53:09.590271+0000","last_peered":"2024-05-10T10:53:09.590271+0000","last_clean":"2024-05-10T10:53:09.590271+0000","last_became_active":"2024-05-10T10:52:12.533457+0000","last_became_peered":"2024-05-10T10:52:12.533457+0000","last_unstale":"2024-05-10T10:53:09.590271+0000","last_undegraded":"2024-05-10T10:53:09.590271+0000","last_fullsized":"2024-05-10T10:53:09.590271+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:17.372672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628314+0000","last_change":"2024-05-10T10:52:15.691594+0000","last_active":"2024-05-10T10:54:07.628314+0000","last_peered":"2024-05-10T10:54:07.628314+0000","last_clean":"2024-05-10T10:54:07.628314+0000","last_became_active":"2024-05-10T10:52:15.690300+0000","last_became_peered":"2024-05-10T10:52:15.690300+0000","last_unstale":"2024-05-10T10:54:07.628314+0000","last_undegraded":"2024-05-10T10:54:07.628314+0000","last_fullsized":"2024-05-10T10:54:07.628314+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:05.228834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908625+0000","last_change":"2024-05-10T10:52:12.530693+0000","last_active":"2024-05-10T10:53:08.908625+0000","last_peered":"2024-05-10T10:53:08.908625+0000","last_clean":"2024-05-10T10:53:08.908625+0000","last_became_active":"2024-05-10T10:52:12.530310+0000","last_became_peered":"2024-05-10T10:52:12.530310+0000","last_unstale":"2024-05-10T10:53:08.908625+0000","last_undegraded":"2024-05-10T10:53:08.908625+0000","last_fullsized":"2024-05-10T10:53:08.908625+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:42:46.967318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645932+0000","last_change":"2024-05-10T10:52:15.695473+0000","last_active":"2024-05-10T10:54:07.645932+0000","last_peered":"2024-05-10T10:54:07.645932+0000","last_clean":"2024-05-10T10:54:07.645932+0000","last_became_active":"2024-05-10T10:52:15.695121+0000","last_became_peered":"2024-05-10T10:52:15.695121+0000","last_unstale":"2024-05-10T10:54:07.645932+0000","last_undegraded":"2024-05-10T10:54:07.645932+0000","last_fullsized":"2024-05-10T10:54:07.645932+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:48:08.019465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'5","reported_seq":207,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:24.928260+0000","last_change":"2024-05-10T10:52:12.630799+0000","last_active":"2024-05-10T10:55:24.928260+0000","last_peered":"2024-05-10T10:55:24.928260+0000","last_clean":"2024-05-10T10:55:24.928260+0000","last_became_active":"2024-05-10T10:52:12.630448+0000","last_became_peered":"2024-05-10T10:52:12.630448+0000","last_unstale":"2024-05-10T10:55:24.928260+0000","last_undegraded":"2024-05-10T10:55:24.928260+0000","last_fullsized":"2024-05-10T10:55:24.928260+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:27.335062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":175,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645545+0000","last_change":"2024-05-10T10:52:15.686691+0000","last_active":"2024-05-10T10:54:07.645545+0000","last_peered":"2024-05-10T10:54:07.645545+0000","last_clean":"2024-05-10T10:54:07.645545+0000","last_became_active":"2024-05-10T10:52:15.685886+0000","last_became_peered":"2024-05-10T10:52:15.685886+0000","last_unstale":"2024-05-10T10:54:07.645545+0000","last_undegraded":"2024-05-10T10:54:07.645545+0000","last_fullsized":"2024-05-10T10:54:07.645545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:45.199414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697407+0000","last_change":"2024-05-10T10:52:12.533535+0000","last_active":"2024-05-10T10:53:09.697407+0000","last_peered":"2024-05-10T10:53:09.697407+0000","last_clean":"2024-05-10T10:53:09.697407+0000","last_became_active":"2024-05-10T10:52:12.533146+0000","last_became_peered":"2024-05-10T10:52:12.533146+0000","last_unstale":"2024-05-10T10:53:09.697407+0000","last_undegraded":"2024-05-10T10:53:09.697407+0000","last_fullsized":"2024-05-10T10:53:09.697407+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:07:16.138240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.633963+0000","last_change":"2024-05-10T10:52:15.692013+0000","last_active":"2024-05-10T10:54:07.633963+0000","last_peered":"2024-05-10T10:54:07.633963+0000","last_clean":"2024-05-10T10:54:07.633963+0000","last_became_active":"2024-05-10T10:52:15.691660+0000","last_became_peered":"2024-05-10T10:52:15.691660+0000","last_unstale":"2024-05-10T10:54:07.633963+0000","last_undegraded":"2024-05-10T10:54:07.633963+0000","last_fullsized":"2024-05-10T10:54:07.633963+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:58.780961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.902507+0000","last_change":"2024-05-10T10:52:12.530962+0000","last_active":"2024-05-10T10:53:08.902507+0000","last_peered":"2024-05-10T10:53:08.902507+0000","last_clean":"2024-05-10T10:53:08.902507+0000","last_became_active":"2024-05-10T10:52:12.530610+0000","last_became_peered":"2024-05-10T10:52:12.530610+0000","last_unstale":"2024-05-10T10:53:08.902507+0000","last_undegraded":"2024-05-10T10:53:08.902507+0000","last_fullsized":"2024-05-10T10:53:08.902507+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:04:13.484713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.637879+0000","last_change":"2024-05-10T10:52:15.687218+0000","last_active":"2024-05-10T10:54:07.637879+0000","last_peered":"2024-05-10T10:54:07.637879+0000","last_clean":"2024-05-10T10:54:07.637879+0000","last_became_active":"2024-05-10T10:52:15.686888+0000","last_became_peered":"2024-05-10T10:52:15.686888+0000","last_unstale":"2024-05-10T10:54:07.637879+0000","last_undegraded":"2024-05-10T10:54:07.637879+0000","last_fullsized":"2024-05-10T10:54:07.637879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:53:53.420063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628235+0000","last_change":"2024-05-10T10:52:15.691196+0000","last_active":"2024-05-10T10:54:07.628235+0000","last_peered":"2024-05-10T10:54:07.628235+0000","last_clean":"2024-05-10T10:54:07.628235+0000","last_became_active":"2024-05-10T10:52:15.690865+0000","last_became_peered":"2024-05-10T10:52:15.690865+0000","last_unstale":"2024-05-10T10:54:07.628235+0000","last_undegraded":"2024-05-10T10:54:07.628235+0000","last_fullsized":"2024-05-10T10:54:07.628235+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:02:04.666193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.632644+0000","last_change":"2024-05-10T10:52:15.691239+0000","last_active":"2024-05-10T10:54:07.632644+0000","last_peered":"2024-05-10T10:54:07.632644+0000","last_clean":"2024-05-10T10:54:07.632644+0000","last_became_active":"2024-05-10T10:52:15.690877+0000","last_became_peered":"2024-05-10T10:52:15.690877+0000","last_unstale":"2024-05-10T10:54:07.632644+0000","last_undegraded":"2024-05-10T10:54:07.632644+0000","last_fullsized":"2024-05-10T10:54:07.632644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:16.564872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.627696+0000","last_change":"2024-05-10T10:52:15.681784+0000","last_active":"2024-05-10T10:54:07.627696+0000","last_peered":"2024-05-10T10:54:07.627696+0000","last_clean":"2024-05-10T10:54:07.627696+0000","last_became_active":"2024-05-10T10:52:15.680900+0000","last_became_peered":"2024-05-10T10:52:15.680900+0000","last_unstale":"2024-05-10T10:54:07.627696+0000","last_undegraded":"2024-05-10T10:54:07.627696+0000","last_fullsized":"2024-05-10T10:54:07.627696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:56.393338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.639243+0000","last_change":"2024-05-10T10:52:15.690659+0000","last_active":"2024-05-10T10:54:07.639243+0000","last_peered":"2024-05-10T10:54:07.639243+0000","last_clean":"2024-05-10T10:54:07.639243+0000","last_became_active":"2024-05-10T10:52:15.689723+0000","last_became_peered":"2024-05-10T10:52:15.689723+0000","last_unstale":"2024-05-10T10:54:07.639243+0000","last_undegraded":"2024-05-10T10:54:07.639243+0000","last_fullsized":"2024-05-10T10:54:07.639243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:53:35.212066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.638933+0000","last_change":"2024-05-10T10:53:08.908043+0000","last_active":"2024-05-10T10:54:07.638933+0000","last_peered":"2024-05-10T10:54:07.638933+0000","last_clean":"2024-05-10T10:54:07.638933+0000","last_became_active":"2024-05-10T10:53:08.907635+0000","last_became_peered":"2024-05-10T10:53:08.907635+0000","last_unstale":"2024-05-10T10:54:07.638933+0000","last_undegraded":"2024-05-10T10:54:07.638933+0000","last_fullsized":"2024-05-10T10:54:07.638933+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:03.613885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.617519+0000","last_change":"2024-05-10T10:52:15.690573+0000","last_active":"2024-05-10T10:54:07.617519+0000","last_peered":"2024-05-10T10:54:07.617519+0000","last_clean":"2024-05-10T10:54:07.617519+0000","last_became_active":"2024-05-10T10:52:15.690257+0000","last_became_peered":"2024-05-10T10:52:15.690257+0000","last_unstale":"2024-05-10T10:54:07.617519+0000","last_undegraded":"2024-05-10T10:54:07.617519+0000","last_fullsized":"2024-05-10T10:54:07.617519+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:37:27.128718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645112+0000","last_change":"2024-05-10T10:52:15.684914+0000","last_active":"2024-05-10T10:54:07.645112+0000","last_peered":"2024-05-10T10:54:07.645112+0000","last_clean":"2024-05-10T10:54:07.645112+0000","last_became_active":"2024-05-10T10:52:15.684557+0000","last_became_peered":"2024-05-10T10:52:15.684557+0000","last_unstale":"2024-05-10T10:54:07.645112+0000","last_undegraded":"2024-05-10T10:54:07.645112+0000","last_fullsized":"2024-05-10T10:54:07.645112+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:17.444305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.629396+0000","last_change":"2024-05-10T10:52:15.697047+0000","last_active":"2024-05-10T10:54:07.629396+0000","last_peered":"2024-05-10T10:54:07.629396+0000","last_clean":"2024-05-10T10:54:07.629396+0000","last_became_active":"2024-05-10T10:52:15.696726+0000","last_became_peered":"2024-05-10T10:52:15.696726+0000","last_unstale":"2024-05-10T10:54:07.629396+0000","last_undegraded":"2024-05-10T10:54:07.629396+0000","last_fullsized":"2024-05-10T10:54:07.629396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:14:30.777403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.629207+0000","last_change":"2024-05-10T10:52:15.695613+0000","last_active":"2024-05-10T10:54:07.629207+0000","last_peered":"2024-05-10T10:54:07.629207+0000","last_clean":"2024-05-10T10:54:07.629207+0000","last_became_active":"2024-05-10T10:52:15.695147+0000","last_became_peered":"2024-05-10T10:52:15.695147+0000","last_unstale":"2024-05-10T10:54:07.629207+0000","last_undegraded":"2024-05-10T10:54:07.629207+0000","last_fullsized":"2024-05-10T10:54:07.629207+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:14.175158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628823+0000","last_change":"2024-05-10T10:52:15.683914+0000","last_active":"2024-05-10T10:54:07.628823+0000","last_peered":"2024-05-10T10:54:07.628823+0000","last_clean":"2024-05-10T10:54:07.628823+0000","last_became_active":"2024-05-10T10:52:15.682359+0000","last_became_peered":"2024-05-10T10:52:15.682359+0000","last_unstale":"2024-05-10T10:54:07.628823+0000","last_undegraded":"2024-05-10T10:54:07.628823+0000","last_fullsized":"2024-05-10T10:54:07.628823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:23:41.018064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645608+0000","last_change":"2024-05-10T10:52:15.690862+0000","last_active":"2024-05-10T10:54:07.645608+0000","last_peered":"2024-05-10T10:54:07.645608+0000","last_clean":"2024-05-10T10:54:07.645608+0000","last_became_active":"2024-05-10T10:52:15.690520+0000","last_became_peered":"2024-05-10T10:52:15.690520+0000","last_unstale":"2024-05-10T10:54:07.645608+0000","last_undegraded":"2024-05-10T10:54:07.645608+0000","last_fullsized":"2024-05-10T10:54:07.645608+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:39.819473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.640578+0000","last_change":"2024-05-10T10:52:15.684605+0000","last_active":"2024-05-10T10:54:07.640578+0000","last_peered":"2024-05-10T10:54:07.640578+0000","last_clean":"2024-05-10T10:54:07.640578+0000","last_became_active":"2024-05-10T10:52:15.683863+0000","last_became_peered":"2024-05-10T10:52:15.683863+0000","last_unstale":"2024-05-10T10:54:07.640578+0000","last_undegraded":"2024-05-10T10:54:07.640578+0000","last_fullsized":"2024-05-10T10:54:07.640578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:49:35.187932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.619642+0000","last_change":"2024-05-10T10:52:15.698014+0000","last_active":"2024-05-10T10:54:07.619642+0000","last_peered":"2024-05-10T10:54:07.619642+0000","last_clean":"2024-05-10T10:54:07.619642+0000","last_became_active":"2024-05-10T10:52:15.697583+0000","last_became_peered":"2024-05-10T10:52:15.697583+0000","last_unstale":"2024-05-10T10:54:07.619642+0000","last_undegraded":"2024-05-10T10:54:07.619642+0000","last_fullsized":"2024-05-10T10:54:07.619642+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:30.792127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72543,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1801,"num_read_kb":980,"num_write":257,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":216397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645365,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":897024,"data_stored":436691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841597,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36900,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708252,"statfs":{"total":95995035648,"available":95957250048,"internally_reserved":0,"allocated":1601536,"data_stored":1092693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037826,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":921600,"data_stored":436621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234053,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":436999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430283,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1515520,"data_stored":1029658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593808,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":436338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":502224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738478,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":925696,"data_stored":437677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411427,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":502976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182494,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":436163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986267,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":905216,"data_stored":436199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790036,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36828,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708324,"statfs":{"total":95995035648,"available":95957323776,"internally_reserved":0,"allocated":1527808,"data_stored":1029336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":67017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T10:55:34.278 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-10T10:55:34.521 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:35.311 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:34 smithi107 ceph-mon[30373]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:55:35.311 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:34 smithi107 ceph-mon[30373]: pgmap v385: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 9 op/s 2024-05-10T10:55:35.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:34 smithi196 ceph-mon[34872]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:55:35.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:34 smithi196 ceph-mon[34872]: pgmap v385: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 9 op/s 2024-05-10T10:55:35.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:34 smithi184 ceph-mon[34585]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:55:35.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:34 smithi184 ceph-mon[34585]: pgmap v385: 97 pgs: 97 active+clean; 648 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 9 op/s 2024-05-10T10:55:36.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.149+0000 7fc262f50700 1 -- 172.21.15.107:0/1432967502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc25c1037b0 msgr2=0x7fc25c103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:36.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.149+0000 7fc262f50700 1 --2- 172.21.15.107:0/1432967502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc25c1037b0 0x7fc25c103b90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc2500099c0 tx=0x7fc250009cd0 comp rx=0 tx=0).stop 2024-05-10T10:55:36.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.150+0000 7fc262f50700 1 -- 172.21.15.107:0/1432967502 shutdown_connections 2024-05-10T10:55:36.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.150+0000 7fc262f50700 1 --2- 172.21.15.107:0/1432967502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc25c108880 0x7fc25c110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:36.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.150+0000 7fc262f50700 1 --2- 172.21.15.107:0/1432967502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc25c1037b0 0x7fc25c103b90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:36.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.150+0000 7fc262f50700 1 --2- 172.21.15.107:0/1432967502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc25c104160 0x7fc25c108150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:36.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.150+0000 7fc262f50700 1 -- 172.21.15.107:0/1432967502 >> 172.21.15.107:0/1432967502 conn(0x7fc25c07a580 msgr2=0x7fc25c07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:36.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.150+0000 7fc262f50700 1 -- 172.21.15.107:0/1432967502 shutdown_connections 2024-05-10T10:55:36.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.150+0000 7fc262f50700 1 -- 172.21.15.107:0/1432967502 wait complete. 2024-05-10T10:55:36.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.150+0000 7fc262f50700 1 Processor -- start 2024-05-10T10:55:36.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.150+0000 7fc262f50700 1 -- start start 2024-05-10T10:55:36.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.151+0000 7fc262f50700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc25c1037b0 0x7fc25c19f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:36.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.151+0000 7fc262f50700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc25c104160 0x7fc25c19ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:36.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.151+0000 7fc262f50700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc25c108880 0x7fc25c199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:36.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.151+0000 7fc262f50700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c113880 con 0x7fc25c104160 2024-05-10T10:55:36.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.151+0000 7fc262f50700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c113700 con 0x7fc25c108880 2024-05-10T10:55:36.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.151+0000 7fc262f50700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c113a00 con 0x7fc25c1037b0 2024-05-10T10:55:36.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.151+0000 7fc25bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc25c104160 0x7fc25c19ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:36.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.151+0000 7fc25bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc25c104160 0x7fc25c19ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38084/0 (socket says 172.21.15.107:38084) 2024-05-10T10:55:36.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.151+0000 7fc25bfff700 1 -- 172.21.15.107:0/3146594853 learned_addr learned my addr 172.21.15.107:0/3146594853 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:36.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.151+0000 7fc2614ed700 1 --2- 172.21.15.107:0/3146594853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc25c108880 0x7fc25c199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:36.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.151+0000 7fc260cec700 1 --2- 172.21.15.107:0/3146594853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc25c1037b0 0x7fc25c19f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:36.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.151+0000 7fc25bfff700 1 -- 172.21.15.107:0/3146594853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc25c1037b0 msgr2=0x7fc25c19f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:36.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.151+0000 7fc25bfff700 1 --2- 172.21.15.107:0/3146594853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc25c1037b0 0x7fc25c19f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:36.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.151+0000 7fc25bfff700 1 -- 172.21.15.107:0/3146594853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc25c108880 msgr2=0x7fc25c199b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:36.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.151+0000 7fc25bfff700 1 --2- 172.21.15.107:0/3146594853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc25c108880 0x7fc25c199b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:36.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.151+0000 7fc25bfff700 1 -- 172.21.15.107:0/3146594853 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25c19a2e0 con 0x7fc25c104160 2024-05-10T10:55:36.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.151+0000 7fc260cec700 1 --2- 172.21.15.107:0/3146594853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc25c1037b0 0x7fc25c19f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:55:36.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.151+0000 7fc25bfff700 1 --2- 172.21.15.107:0/3146594853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc25c104160 0x7fc25c19ff20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc24800b530 tx=0x7fc24800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:36.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.152+0000 7fc259ffb700 1 -- 172.21.15.107:0/3146594853 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248015020 con 0x7fc25c104160 2024-05-10T10:55:36.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.152+0000 7fc262f50700 1 -- 172.21.15.107:0/3146594853 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc25c19a5d0 con 0x7fc25c104160 2024-05-10T10:55:36.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.152+0000 7fc259ffb700 1 -- 172.21.15.107:0/3146594853 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc248011d00 con 0x7fc25c104160 2024-05-10T10:55:36.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.152+0000 7fc259ffb700 1 -- 172.21.15.107:0/3146594853 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24800f2e0 con 0x7fc25c104160 2024-05-10T10:55:36.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.152+0000 7fc262f50700 1 -- 172.21.15.107:0/3146594853 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc25c1a6800 con 0x7fc25c104160 2024-05-10T10:55:36.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.153+0000 7fc262f50700 1 -- 172.21.15.107:0/3146594853 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc25c10bac0 con 0x7fc25c104160 2024-05-10T10:55:36.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.154+0000 7fc259ffb700 1 -- 172.21.15.107:0/3146594853 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 149704+0+0 (secure 0 0 0) 0x7fc248018020 con 0x7fc25c104160 2024-05-10T10:55:36.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.155+0000 7fc259ffb700 1 --2- 172.21.15.107:0/3146594853 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc24c0b2910 0x7fc24c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:36.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.155+0000 7fc260cec700 1 --2- 172.21.15.107:0/3146594853 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc24c0b2910 0x7fc24c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:36.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.155+0000 7fc259ffb700 1 -- 172.21.15.107:0/3146594853 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fc2480e19f0 con 0x7fc25c104160 2024-05-10T10:55:36.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.155+0000 7fc260cec700 1 --2- 172.21.15.107:0/3146594853 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc24c0b2910 0x7fc24c0b4dd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc250006010 tx=0x7fc250009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:36.160 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.159+0000 7fc259ffb700 1 -- 172.21.15.107:0/3146594853 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc24801f020 con 0x7fc25c104160 2024-05-10T10:55:36.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.355+0000 7fc262f50700 1 -- 172.21.15.107:0/3146594853 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc25c0638e0 con 0x7fc24c0b2910 2024-05-10T10:55:36.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.363+0000 7fc259ffb700 1 -- 172.21.15.107:0/3146594853 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258876 (secure 0 0 0) 0x7fc25c0638e0 con 0x7fc24c0b2910 2024-05-10T10:55:36.367 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:55:36.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.366+0000 7fc262f50700 1 -- 172.21.15.107:0/3146594853 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc24c0b2910 msgr2=0x7fc24c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:36.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.366+0000 7fc262f50700 1 --2- 172.21.15.107:0/3146594853 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc24c0b2910 0x7fc24c0b4dd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc250006010 tx=0x7fc250009f10 comp rx=0 tx=0).stop 2024-05-10T10:55:36.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.366+0000 7fc262f50700 1 -- 172.21.15.107:0/3146594853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc25c104160 msgr2=0x7fc25c19ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:36.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.366+0000 7fc262f50700 1 --2- 172.21.15.107:0/3146594853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc25c104160 0x7fc25c19ff20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc24800b530 tx=0x7fc24800b840 comp rx=0 tx=0).stop 2024-05-10T10:55:36.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.366+0000 7fc262f50700 1 -- 172.21.15.107:0/3146594853 shutdown_connections 2024-05-10T10:55:36.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.366+0000 7fc262f50700 1 --2- 172.21.15.107:0/3146594853 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc24c0b2910 0x7fc24c0b4dd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:36.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.366+0000 7fc262f50700 1 --2- 172.21.15.107:0/3146594853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc25c1037b0 0x7fc25c19f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:36.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.366+0000 7fc262f50700 1 --2- 172.21.15.107:0/3146594853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc25c108880 0x7fc25c199b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:36.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.366+0000 7fc262f50700 1 --2- 172.21.15.107:0/3146594853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc25c104160 0x7fc25c19ff20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:36.369 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.366+0000 7fc262f50700 1 -- 172.21.15.107:0/3146594853 >> 172.21.15.107:0/3146594853 conn(0x7fc25c07a580 msgr2=0x7fc25c102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:36.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.366+0000 7fc262f50700 1 -- 172.21.15.107:0/3146594853 shutdown_connections 2024-05-10T10:55:36.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:36.366+0000 7fc262f50700 1 -- 172.21.15.107:0/3146594853 wait complete. 2024-05-10T10:55:36.370 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-05-10T10:55:37.071 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":386,"stamp":"2024-05-10T10:55:35.654622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":672211,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1927,"num_read_kb":1081,"num_write":394,"num_write_kb":2316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951840,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":824,"ondisk_log_size":824,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374344,"kb_used_data":12712,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567480,"statfs":{"total":1151940427776,"available":1151557099520,"internally_reserved":0,"allocated":13017088,"data_stored":7233555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9682,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":16,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002977"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.634999+0000","last_change":"2024-05-10T10:52:15.686294+0000","last_active":"2024-05-10T10:54:07.634999+0000","last_peered":"2024-05-10T10:54:07.634999+0000","last_clean":"2024-05-10T10:54:07.634999+0000","last_became_active":"2024-05-10T10:52:15.685324+0000","last_became_peered":"2024-05-10T10:52:15.685324+0000","last_unstale":"2024-05-10T10:54:07.634999+0000","last_undegraded":"2024-05-10T10:54:07.634999+0000","last_fullsized":"2024-05-10T10:54:07.634999+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:20.777432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.625202+0000","last_change":"2024-05-10T10:52:15.687542+0000","last_active":"2024-05-10T10:54:07.625202+0000","last_peered":"2024-05-10T10:54:07.625202+0000","last_clean":"2024-05-10T10:54:07.625202+0000","last_became_active":"2024-05-10T10:52:15.687258+0000","last_became_peered":"2024-05-10T10:52:15.687258+0000","last_unstale":"2024-05-10T10:54:07.625202+0000","last_undegraded":"2024-05-10T10:54:07.625202+0000","last_fullsized":"2024-05-10T10:54:07.625202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:08.522392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.636006+0000","last_change":"2024-05-10T10:52:15.682314+0000","last_active":"2024-05-10T10:54:07.636006+0000","last_peered":"2024-05-10T10:54:07.636006+0000","last_clean":"2024-05-10T10:54:07.636006+0000","last_became_active":"2024-05-10T10:52:15.681939+0000","last_became_peered":"2024-05-10T10:52:15.681939+0000","last_unstale":"2024-05-10T10:54:07.636006+0000","last_undegraded":"2024-05-10T10:54:07.636006+0000","last_fullsized":"2024-05-10T10:54:07.636006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:04.857969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.629993+0000","last_change":"2024-05-10T10:52:15.693451+0000","last_active":"2024-05-10T10:54:07.629993+0000","last_peered":"2024-05-10T10:54:07.629993+0000","last_clean":"2024-05-10T10:54:07.629993+0000","last_became_active":"2024-05-10T10:52:15.693041+0000","last_became_peered":"2024-05-10T10:52:15.693041+0000","last_unstale":"2024-05-10T10:54:07.629993+0000","last_undegraded":"2024-05-10T10:54:07.629993+0000","last_fullsized":"2024-05-10T10:54:07.629993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:57:14.959699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.637732+0000","last_change":"2024-05-10T10:52:15.679527+0000","last_active":"2024-05-10T10:54:07.637732+0000","last_peered":"2024-05-10T10:54:07.637732+0000","last_clean":"2024-05-10T10:54:07.637732+0000","last_became_active":"2024-05-10T10:52:15.679153+0000","last_became_peered":"2024-05-10T10:52:15.679153+0000","last_unstale":"2024-05-10T10:54:07.637732+0000","last_undegraded":"2024-05-10T10:54:07.637732+0000","last_fullsized":"2024-05-10T10:54:07.637732+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:58.738486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628648+0000","last_change":"2024-05-10T10:52:15.685905+0000","last_active":"2024-05-10T10:54:07.628648+0000","last_peered":"2024-05-10T10:54:07.628648+0000","last_clean":"2024-05-10T10:54:07.628648+0000","last_became_active":"2024-05-10T10:52:15.685628+0000","last_became_peered":"2024-05-10T10:52:15.685628+0000","last_unstale":"2024-05-10T10:54:07.628648+0000","last_undegraded":"2024-05-10T10:54:07.628648+0000","last_fullsized":"2024-05-10T10:54:07.628648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:16.776307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.634298+0000","last_change":"2024-05-10T10:52:15.692951+0000","last_active":"2024-05-10T10:54:07.634298+0000","last_peered":"2024-05-10T10:54:07.634298+0000","last_clean":"2024-05-10T10:54:07.634298+0000","last_became_active":"2024-05-10T10:52:15.692594+0000","last_became_peered":"2024-05-10T10:52:15.692594+0000","last_unstale":"2024-05-10T10:54:07.634298+0000","last_undegraded":"2024-05-10T10:54:07.634298+0000","last_fullsized":"2024-05-10T10:54:07.634298+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:04.105565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.629178+0000","last_change":"2024-05-10T10:52:15.692349+0000","last_active":"2024-05-10T10:54:07.629178+0000","last_peered":"2024-05-10T10:54:07.629178+0000","last_clean":"2024-05-10T10:54:07.629178+0000","last_became_active":"2024-05-10T10:52:15.691840+0000","last_became_peered":"2024-05-10T10:52:15.691840+0000","last_unstale":"2024-05-10T10:54:07.629178+0000","last_undegraded":"2024-05-10T10:54:07.629178+0000","last_fullsized":"2024-05-10T10:54:07.629178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:32:25.011085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645356+0000","last_change":"2024-05-10T10:52:15.686531+0000","last_active":"2024-05-10T10:54:07.645356+0000","last_peered":"2024-05-10T10:54:07.645356+0000","last_clean":"2024-05-10T10:54:07.645356+0000","last_became_active":"2024-05-10T10:52:15.686029+0000","last_became_peered":"2024-05-10T10:52:15.686029+0000","last_unstale":"2024-05-10T10:54:07.645356+0000","last_undegraded":"2024-05-10T10:54:07.645356+0000","last_fullsized":"2024-05-10T10:54:07.645356+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:30.836606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.631823+0000","last_change":"2024-05-10T10:52:15.697314+0000","last_active":"2024-05-10T10:54:07.631823+0000","last_peered":"2024-05-10T10:54:07.631823+0000","last_clean":"2024-05-10T10:54:07.631823+0000","last_became_active":"2024-05-10T10:52:15.696944+0000","last_became_peered":"2024-05-10T10:52:15.696944+0000","last_unstale":"2024-05-10T10:54:07.631823+0000","last_undegraded":"2024-05-10T10:54:07.631823+0000","last_fullsized":"2024-05-10T10:54:07.631823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:10.098904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.644918+0000","last_change":"2024-05-10T10:52:15.690866+0000","last_active":"2024-05-10T10:54:07.644918+0000","last_peered":"2024-05-10T10:54:07.644918+0000","last_clean":"2024-05-10T10:54:07.644918+0000","last_became_active":"2024-05-10T10:52:15.690533+0000","last_became_peered":"2024-05-10T10:52:15.690533+0000","last_unstale":"2024-05-10T10:54:07.644918+0000","last_undegraded":"2024-05-10T10:54:07.644918+0000","last_fullsized":"2024-05-10T10:54:07.644918+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:48.290897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.626832+0000","last_change":"2024-05-10T10:52:15.696386+0000","last_active":"2024-05-10T10:54:07.626832+0000","last_peered":"2024-05-10T10:54:07.626832+0000","last_clean":"2024-05-10T10:54:07.626832+0000","last_became_active":"2024-05-10T10:52:15.696044+0000","last_became_peered":"2024-05-10T10:52:15.696044+0000","last_unstale":"2024-05-10T10:54:07.626832+0000","last_undegraded":"2024-05-10T10:54:07.626832+0000","last_fullsized":"2024-05-10T10:54:07.626832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:48.259860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.638961+0000","last_change":"2024-05-10T10:52:15.691796+0000","last_active":"2024-05-10T10:54:07.638961+0000","last_peered":"2024-05-10T10:54:07.638961+0000","last_clean":"2024-05-10T10:54:07.638961+0000","last_became_active":"2024-05-10T10:52:15.690952+0000","last_became_peered":"2024-05-10T10:52:15.690952+0000","last_unstale":"2024-05-10T10:54:07.638961+0000","last_undegraded":"2024-05-10T10:54:07.638961+0000","last_fullsized":"2024-05-10T10:54:07.638961+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:10.645645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.623536+0000","last_change":"2024-05-10T10:52:15.683303+0000","last_active":"2024-05-10T10:54:07.623536+0000","last_peered":"2024-05-10T10:54:07.623536+0000","last_clean":"2024-05-10T10:54:07.623536+0000","last_became_active":"2024-05-10T10:52:15.682753+0000","last_became_peered":"2024-05-10T10:52:15.682753+0000","last_unstale":"2024-05-10T10:54:07.623536+0000","last_undegraded":"2024-05-10T10:54:07.623536+0000","last_fullsized":"2024-05-10T10:54:07.623536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:00.167463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.630931+0000","last_change":"2024-05-10T10:52:15.691668+0000","last_active":"2024-05-10T10:54:07.630931+0000","last_peered":"2024-05-10T10:54:07.630931+0000","last_clean":"2024-05-10T10:54:07.630931+0000","last_became_active":"2024-05-10T10:52:15.691323+0000","last_became_peered":"2024-05-10T10:52:15.691323+0000","last_unstale":"2024-05-10T10:54:07.630931+0000","last_undegraded":"2024-05-10T10:54:07.630931+0000","last_fullsized":"2024-05-10T10:54:07.630931+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:09.235092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645579+0000","last_change":"2024-05-10T10:52:15.689859+0000","last_active":"2024-05-10T10:54:07.645579+0000","last_peered":"2024-05-10T10:54:07.645579+0000","last_clean":"2024-05-10T10:54:07.645579+0000","last_became_active":"2024-05-10T10:52:15.689060+0000","last_became_peered":"2024-05-10T10:52:15.689060+0000","last_unstale":"2024-05-10T10:54:07.645579+0000","last_undegraded":"2024-05-10T10:54:07.645579+0000","last_fullsized":"2024-05-10T10:54:07.645579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:42.029942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.635076+0000","last_change":"2024-05-10T10:52:15.686711+0000","last_active":"2024-05-10T10:54:07.635076+0000","last_peered":"2024-05-10T10:54:07.635076+0000","last_clean":"2024-05-10T10:54:07.635076+0000","last_became_active":"2024-05-10T10:52:15.685817+0000","last_became_peered":"2024-05-10T10:52:15.685817+0000","last_unstale":"2024-05-10T10:54:07.635076+0000","last_undegraded":"2024-05-10T10:54:07.635076+0000","last_fullsized":"2024-05-10T10:54:07.635076+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:50:25.703341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.621992+0000","last_change":"2024-05-10T10:52:15.681702+0000","last_active":"2024-05-10T10:54:07.621992+0000","last_peered":"2024-05-10T10:54:07.621992+0000","last_clean":"2024-05-10T10:54:07.621992+0000","last_became_active":"2024-05-10T10:52:15.681400+0000","last_became_peered":"2024-05-10T10:52:15.681400+0000","last_unstale":"2024-05-10T10:54:07.621992+0000","last_undegraded":"2024-05-10T10:54:07.621992+0000","last_fullsized":"2024-05-10T10:54:07.621992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:07.520500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.633710+0000","last_change":"2024-05-10T10:52:15.684321+0000","last_active":"2024-05-10T10:54:07.633710+0000","last_peered":"2024-05-10T10:54:07.633710+0000","last_clean":"2024-05-10T10:54:07.633710+0000","last_became_active":"2024-05-10T10:52:15.683099+0000","last_became_peered":"2024-05-10T10:52:15.683099+0000","last_unstale":"2024-05-10T10:54:07.633710+0000","last_undegraded":"2024-05-10T10:54:07.633710+0000","last_fullsized":"2024-05-10T10:54:07.633710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:09.310292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":223,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:32.912940+0000","last_change":"2024-05-10T10:52:12.530258+0000","last_active":"2024-05-10T10:55:32.912940+0000","last_peered":"2024-05-10T10:55:32.912940+0000","last_clean":"2024-05-10T10:55:32.912940+0000","last_became_active":"2024-05-10T10:52:12.529842+0000","last_became_peered":"2024-05-10T10:52:12.529842+0000","last_unstale":"2024-05-10T10:55:32.912940+0000","last_undegraded":"2024-05-10T10:55:32.912940+0000","last_fullsized":"2024-05-10T10:55:32.912940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:13.525038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.625785+0000","last_change":"2024-05-10T10:53:09.698541+0000","last_active":"2024-05-10T10:54:07.625785+0000","last_peered":"2024-05-10T10:54:07.625785+0000","last_clean":"2024-05-10T10:54:07.625785+0000","last_became_active":"2024-05-10T10:53:09.698219+0000","last_became_peered":"2024-05-10T10:53:09.698219+0000","last_unstale":"2024-05-10T10:54:07.625785+0000","last_undegraded":"2024-05-10T10:54:07.625785+0000","last_fullsized":"2024-05-10T10:54:07.625785+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:27:11.837418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.910128+0000","last_change":"2024-05-10T10:52:12.630918+0000","last_active":"2024-05-10T10:53:08.910128+0000","last_peered":"2024-05-10T10:53:08.910128+0000","last_clean":"2024-05-10T10:53:08.910128+0000","last_became_active":"2024-05-10T10:52:12.630563+0000","last_became_peered":"2024-05-10T10:52:12.630563+0000","last_unstale":"2024-05-10T10:53:08.910128+0000","last_undegraded":"2024-05-10T10:53:08.910128+0000","last_fullsized":"2024-05-10T10:53:08.910128+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:58:03.341362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.643641+0000","last_change":"2024-05-10T10:52:15.676831+0000","last_active":"2024-05-10T10:54:07.643641+0000","last_peered":"2024-05-10T10:54:07.643641+0000","last_clean":"2024-05-10T10:54:07.643641+0000","last_became_active":"2024-05-10T10:52:15.676506+0000","last_became_peered":"2024-05-10T10:52:15.676506+0000","last_unstale":"2024-05-10T10:54:07.643641+0000","last_undegraded":"2024-05-10T10:54:07.643641+0000","last_fullsized":"2024-05-10T10:54:07.643641+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:43.498800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908972+0000","last_change":"2024-05-10T10:52:12.532092+0000","last_active":"2024-05-10T10:53:08.908972+0000","last_peered":"2024-05-10T10:53:08.908972+0000","last_clean":"2024-05-10T10:53:08.908972+0000","last_became_active":"2024-05-10T10:52:12.531649+0000","last_became_peered":"2024-05-10T10:52:12.531649+0000","last_unstale":"2024-05-10T10:53:08.908972+0000","last_undegraded":"2024-05-10T10:53:08.908972+0000","last_fullsized":"2024-05-10T10:53:08.908972+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.709935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.641656+0000","last_change":"2024-05-10T10:52:15.683024+0000","last_active":"2024-05-10T10:54:07.641656+0000","last_peered":"2024-05-10T10:54:07.641656+0000","last_clean":"2024-05-10T10:54:07.641656+0000","last_became_active":"2024-05-10T10:52:15.682655+0000","last_became_peered":"2024-05-10T10:52:15.682655+0000","last_unstale":"2024-05-10T10:54:07.641656+0000","last_undegraded":"2024-05-10T10:54:07.641656+0000","last_fullsized":"2024-05-10T10:54:07.641656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:27.922746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908833+0000","last_change":"2024-05-10T10:52:12.534000+0000","last_active":"2024-05-10T10:53:08.908833+0000","last_peered":"2024-05-10T10:53:08.908833+0000","last_clean":"2024-05-10T10:53:08.908833+0000","last_became_active":"2024-05-10T10:52:12.533609+0000","last_became_peered":"2024-05-10T10:52:12.533609+0000","last_unstale":"2024-05-10T10:53:08.908833+0000","last_undegraded":"2024-05-10T10:53:08.908833+0000","last_fullsized":"2024-05-10T10:53:08.908833+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:38:18.115926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.644043+0000","last_change":"2024-05-10T10:52:15.695263+0000","last_active":"2024-05-10T10:54:07.644043+0000","last_peered":"2024-05-10T10:54:07.644043+0000","last_clean":"2024-05-10T10:54:07.644043+0000","last_became_active":"2024-05-10T10:52:15.694890+0000","last_became_peered":"2024-05-10T10:52:15.694890+0000","last_unstale":"2024-05-10T10:54:07.644043+0000","last_undegraded":"2024-05-10T10:54:07.644043+0000","last_fullsized":"2024-05-10T10:54:07.644043+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:50:32.361110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'8","reported_seq":221,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:32.940654+0000","last_change":"2024-05-10T10:52:12.534673+0000","last_active":"2024-05-10T10:55:32.940654+0000","last_peered":"2024-05-10T10:55:32.940654+0000","last_clean":"2024-05-10T10:55:32.940654+0000","last_became_active":"2024-05-10T10:52:12.534031+0000","last_became_peered":"2024-05-10T10:52:12.534031+0000","last_unstale":"2024-05-10T10:55:32.940654+0000","last_undegraded":"2024-05-10T10:55:32.940654+0000","last_fullsized":"2024-05-10T10:55:32.940654+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:32.030866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.617741+0000","last_change":"2024-05-10T10:52:15.683282+0000","last_active":"2024-05-10T10:54:07.617741+0000","last_peered":"2024-05-10T10:54:07.617741+0000","last_clean":"2024-05-10T10:54:07.617741+0000","last_became_active":"2024-05-10T10:52:15.682421+0000","last_became_peered":"2024-05-10T10:52:15.682421+0000","last_unstale":"2024-05-10T10:54:07.617741+0000","last_undegraded":"2024-05-10T10:54:07.617741+0000","last_fullsized":"2024-05-10T10:54:07.617741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:12.014145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.724139+0000","last_change":"2024-05-10T10:52:12.532161+0000","last_active":"2024-05-10T10:53:09.724139+0000","last_peered":"2024-05-10T10:53:09.724139+0000","last_clean":"2024-05-10T10:53:09.724139+0000","last_became_active":"2024-05-10T10:52:12.531780+0000","last_became_peered":"2024-05-10T10:52:12.531780+0000","last_unstale":"2024-05-10T10:53:09.724139+0000","last_undegraded":"2024-05-10T10:53:09.724139+0000","last_fullsized":"2024-05-10T10:53:09.724139+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:08.724945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.632144+0000","last_change":"2024-05-10T10:52:15.694602+0000","last_active":"2024-05-10T10:54:07.632144+0000","last_peered":"2024-05-10T10:54:07.632144+0000","last_clean":"2024-05-10T10:54:07.632144+0000","last_became_active":"2024-05-10T10:52:15.694279+0000","last_became_peered":"2024-05-10T10:52:15.694279+0000","last_unstale":"2024-05-10T10:54:07.632144+0000","last_undegraded":"2024-05-10T10:54:07.632144+0000","last_fullsized":"2024-05-10T10:54:07.632144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:12:16.286092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.902480+0000","last_change":"2024-05-10T10:52:12.526817+0000","last_active":"2024-05-10T10:53:08.902480+0000","last_peered":"2024-05-10T10:53:08.902480+0000","last_clean":"2024-05-10T10:53:08.902480+0000","last_became_active":"2024-05-10T10:52:12.526315+0000","last_became_peered":"2024-05-10T10:52:12.526315+0000","last_unstale":"2024-05-10T10:53:08.902480+0000","last_undegraded":"2024-05-10T10:53:08.902480+0000","last_fullsized":"2024-05-10T10:53:08.902480+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:49.968299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.636024+0000","last_change":"2024-05-10T10:52:15.683201+0000","last_active":"2024-05-10T10:54:07.636024+0000","last_peered":"2024-05-10T10:54:07.636024+0000","last_clean":"2024-05-10T10:54:07.636024+0000","last_became_active":"2024-05-10T10:52:15.682412+0000","last_became_peered":"2024-05-10T10:52:15.682412+0000","last_unstale":"2024-05-10T10:54:07.636024+0000","last_undegraded":"2024-05-10T10:54:07.636024+0000","last_fullsized":"2024-05-10T10:54:07.636024+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:22.001179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697080+0000","last_change":"2024-05-10T10:52:12.531058+0000","last_active":"2024-05-10T10:53:09.697080+0000","last_peered":"2024-05-10T10:53:09.697080+0000","last_clean":"2024-05-10T10:53:09.697080+0000","last_became_active":"2024-05-10T10:52:12.530655+0000","last_became_peered":"2024-05-10T10:52:12.530655+0000","last_unstale":"2024-05-10T10:53:09.697080+0000","last_undegraded":"2024-05-10T10:53:09.697080+0000","last_fullsized":"2024-05-10T10:53:09.697080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:36:52.300420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.622213+0000","last_change":"2024-05-10T10:52:15.681697+0000","last_active":"2024-05-10T10:54:07.622213+0000","last_peered":"2024-05-10T10:54:07.622213+0000","last_clean":"2024-05-10T10:54:07.622213+0000","last_became_active":"2024-05-10T10:52:15.681396+0000","last_became_peered":"2024-05-10T10:52:15.681396+0000","last_unstale":"2024-05-10T10:54:07.622213+0000","last_undegraded":"2024-05-10T10:54:07.622213+0000","last_fullsized":"2024-05-10T10:54:07.622213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:35.390837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'7","reported_seq":396,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:33.941786+0000","last_change":"2024-05-10T10:52:12.532089+0000","last_active":"2024-05-10T10:55:33.941786+0000","last_peered":"2024-05-10T10:55:33.941786+0000","last_clean":"2024-05-10T10:55:33.941786+0000","last_became_active":"2024-05-10T10:52:12.531641+0000","last_became_peered":"2024-05-10T10:52:12.531641+0000","last_unstale":"2024-05-10T10:55:33.941786+0000","last_undegraded":"2024-05-10T10:55:33.941786+0000","last_fullsized":"2024-05-10T10:55:33.941786+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:34.517079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":362,"num_read_kb":362,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.641380+0000","last_change":"2024-05-10T10:52:15.685566+0000","last_active":"2024-05-10T10:54:07.641380+0000","last_peered":"2024-05-10T10:54:07.641380+0000","last_clean":"2024-05-10T10:54:07.641380+0000","last_became_active":"2024-05-10T10:52:15.685220+0000","last_became_peered":"2024-05-10T10:52:15.685220+0000","last_unstale":"2024-05-10T10:54:07.641380+0000","last_undegraded":"2024-05-10T10:54:07.641380+0000","last_fullsized":"2024-05-10T10:54:07.641380+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:06.140961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.906414+0000","last_change":"2024-05-10T10:52:12.533182+0000","last_active":"2024-05-10T10:53:08.906414+0000","last_peered":"2024-05-10T10:53:08.906414+0000","last_clean":"2024-05-10T10:53:08.906414+0000","last_became_active":"2024-05-10T10:52:12.532821+0000","last_became_peered":"2024-05-10T10:52:12.532821+0000","last_unstale":"2024-05-10T10:53:08.906414+0000","last_undegraded":"2024-05-10T10:53:08.906414+0000","last_fullsized":"2024-05-10T10:53:08.906414+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:54:15.930093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628636+0000","last_change":"2024-05-10T10:52:15.690491+0000","last_active":"2024-05-10T10:54:07.628636+0000","last_peered":"2024-05-10T10:54:07.628636+0000","last_clean":"2024-05-10T10:54:07.628636+0000","last_became_active":"2024-05-10T10:52:15.690200+0000","last_became_peered":"2024-05-10T10:52:15.690200+0000","last_unstale":"2024-05-10T10:54:07.628636+0000","last_undegraded":"2024-05-10T10:54:07.628636+0000","last_fullsized":"2024-05-10T10:54:07.628636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:28.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697533+0000","last_change":"2024-05-10T10:52:12.631966+0000","last_active":"2024-05-10T10:53:09.697533+0000","last_peered":"2024-05-10T10:53:09.697533+0000","last_clean":"2024-05-10T10:53:09.697533+0000","last_became_active":"2024-05-10T10:52:12.631539+0000","last_became_peered":"2024-05-10T10:52:12.631539+0000","last_unstale":"2024-05-10T10:53:09.697533+0000","last_undegraded":"2024-05-10T10:53:09.697533+0000","last_fullsized":"2024-05-10T10:53:09.697533+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:32:52.392307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645950+0000","last_change":"2024-05-10T10:52:15.692893+0000","last_active":"2024-05-10T10:54:07.645950+0000","last_peered":"2024-05-10T10:54:07.645950+0000","last_clean":"2024-05-10T10:54:07.645950+0000","last_became_active":"2024-05-10T10:52:15.692528+0000","last_became_peered":"2024-05-10T10:52:15.692528+0000","last_unstale":"2024-05-10T10:54:07.645950+0000","last_undegraded":"2024-05-10T10:54:07.645950+0000","last_fullsized":"2024-05-10T10:54:07.645950+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:51.452294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'40","reported_seq":442,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:33.942206+0000","last_change":"2024-05-10T10:52:12.532094+0000","last_active":"2024-05-10T10:55:33.942206+0000","last_peered":"2024-05-10T10:55:33.942206+0000","last_clean":"2024-05-10T10:55:33.942206+0000","last_became_active":"2024-05-10T10:52:12.531719+0000","last_became_peered":"2024-05-10T10:52:12.531719+0000","last_unstale":"2024-05-10T10:55:33.942206+0000","last_undegraded":"2024-05-10T10:55:33.942206+0000","last_fullsized":"2024-05-10T10:55:33.942206+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:43:52.697528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73565,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":375,"num_read_kb":259,"num_write":42,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.637338+0000","last_change":"2024-05-10T10:52:15.688187+0000","last_active":"2024-05-10T10:54:07.637338+0000","last_peered":"2024-05-10T10:54:07.637338+0000","last_clean":"2024-05-10T10:54:07.637338+0000","last_became_active":"2024-05-10T10:52:15.687821+0000","last_became_peered":"2024-05-10T10:52:15.687821+0000","last_unstale":"2024-05-10T10:54:07.637338+0000","last_undegraded":"2024-05-10T10:54:07.637338+0000","last_fullsized":"2024-05-10T10:54:07.637338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:54.425892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.590055+0000","last_change":"2024-05-10T10:52:12.532185+0000","last_active":"2024-05-10T10:53:09.590055+0000","last_peered":"2024-05-10T10:53:09.590055+0000","last_clean":"2024-05-10T10:53:09.590055+0000","last_became_active":"2024-05-10T10:52:12.531795+0000","last_became_peered":"2024-05-10T10:52:12.531795+0000","last_unstale":"2024-05-10T10:53:09.590055+0000","last_undegraded":"2024-05-10T10:53:09.590055+0000","last_fullsized":"2024-05-10T10:53:09.590055+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:51.704767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.639760+0000","last_change":"2024-05-10T10:52:15.684388+0000","last_active":"2024-05-10T10:54:07.639760+0000","last_peered":"2024-05-10T10:54:07.639760+0000","last_clean":"2024-05-10T10:54:07.639760+0000","last_became_active":"2024-05-10T10:52:15.684061+0000","last_became_peered":"2024-05-10T10:52:15.684061+0000","last_unstale":"2024-05-10T10:54:07.639760+0000","last_undegraded":"2024-05-10T10:54:07.639760+0000","last_fullsized":"2024-05-10T10:54:07.639760+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:19.462083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697091+0000","last_change":"2024-05-10T10:52:12.531912+0000","last_active":"2024-05-10T10:53:09.697091+0000","last_peered":"2024-05-10T10:53:09.697091+0000","last_clean":"2024-05-10T10:53:09.697091+0000","last_became_active":"2024-05-10T10:52:12.531501+0000","last_became_peered":"2024-05-10T10:52:12.531501+0000","last_unstale":"2024-05-10T10:53:09.697091+0000","last_undegraded":"2024-05-10T10:53:09.697091+0000","last_fullsized":"2024-05-10T10:53:09.697091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:15.086519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.639559+0000","last_change":"2024-05-10T10:52:15.686521+0000","last_active":"2024-05-10T10:54:07.639559+0000","last_peered":"2024-05-10T10:54:07.639559+0000","last_clean":"2024-05-10T10:54:07.639559+0000","last_became_active":"2024-05-10T10:52:15.686142+0000","last_became_peered":"2024-05-10T10:52:15.686142+0000","last_unstale":"2024-05-10T10:54:07.639559+0000","last_undegraded":"2024-05-10T10:54:07.639559+0000","last_fullsized":"2024-05-10T10:54:07.639559+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:40.315401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":212,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:29.935313+0000","last_change":"2024-05-10T10:52:12.527774+0000","last_active":"2024-05-10T10:55:29.935313+0000","last_peered":"2024-05-10T10:55:29.935313+0000","last_clean":"2024-05-10T10:55:29.935313+0000","last_became_active":"2024-05-10T10:52:12.527412+0000","last_became_peered":"2024-05-10T10:52:12.527412+0000","last_unstale":"2024-05-10T10:55:29.935313+0000","last_undegraded":"2024-05-10T10:55:29.935313+0000","last_fullsized":"2024-05-10T10:55:29.935313+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:51:21.334653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":181,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.633856+0000","last_change":"2024-05-10T10:52:15.693427+0000","last_active":"2024-05-10T10:54:07.633856+0000","last_peered":"2024-05-10T10:54:07.633856+0000","last_clean":"2024-05-10T10:54:07.633856+0000","last_became_active":"2024-05-10T10:52:15.693114+0000","last_became_peered":"2024-05-10T10:52:15.693114+0000","last_unstale":"2024-05-10T10:54:07.633856+0000","last_undegraded":"2024-05-10T10:54:07.633856+0000","last_fullsized":"2024-05-10T10:54:07.633856+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:25:36.423413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908419+0000","last_change":"2024-05-10T10:52:12.631475+0000","last_active":"2024-05-10T10:53:08.908419+0000","last_peered":"2024-05-10T10:53:08.908419+0000","last_clean":"2024-05-10T10:53:08.908419+0000","last_became_active":"2024-05-10T10:52:12.631079+0000","last_became_peered":"2024-05-10T10:52:12.631079+0000","last_unstale":"2024-05-10T10:53:08.908419+0000","last_undegraded":"2024-05-10T10:53:08.908419+0000","last_fullsized":"2024-05-10T10:53:08.908419+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:52.975413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.631170+0000","last_change":"2024-05-10T10:53:09.302243+0000","last_active":"2024-05-10T10:54:07.631170+0000","last_peered":"2024-05-10T10:54:07.631170+0000","last_clean":"2024-05-10T10:54:07.631170+0000","last_became_active":"2024-05-10T10:53:09.301866+0000","last_became_peered":"2024-05-10T10:53:09.301866+0000","last_unstale":"2024-05-10T10:54:07.631170+0000","last_undegraded":"2024-05-10T10:54:07.631170+0000","last_fullsized":"2024-05-10T10:54:07.631170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:07.609569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.909051+0000","last_change":"2024-05-10T10:52:12.533071+0000","last_active":"2024-05-10T10:53:08.909051+0000","last_peered":"2024-05-10T10:53:08.909051+0000","last_clean":"2024-05-10T10:53:08.909051+0000","last_became_active":"2024-05-10T10:52:12.532655+0000","last_became_peered":"2024-05-10T10:52:12.532655+0000","last_unstale":"2024-05-10T10:53:08.909051+0000","last_undegraded":"2024-05-10T10:53:08.909051+0000","last_fullsized":"2024-05-10T10:53:08.909051+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:30.723701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.617339+0000","last_change":"2024-05-10T10:52:15.697362+0000","last_active":"2024-05-10T10:54:07.617339+0000","last_peered":"2024-05-10T10:54:07.617339+0000","last_clean":"2024-05-10T10:54:07.617339+0000","last_became_active":"2024-05-10T10:52:15.696915+0000","last_became_peered":"2024-05-10T10:52:15.696915+0000","last_unstale":"2024-05-10T10:54:07.617339+0000","last_undegraded":"2024-05-10T10:54:07.617339+0000","last_fullsized":"2024-05-10T10:54:07.617339+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:29:03.365667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.909592+0000","last_change":"2024-05-10T10:53:08.909109+0000","last_active":"2024-05-10T10:53:08.909592+0000","last_peered":"2024-05-10T10:53:08.909592+0000","last_clean":"2024-05-10T10:53:08.909592+0000","last_became_active":"2024-05-10T10:53:08.908677+0000","last_became_peered":"2024-05-10T10:53:08.908677+0000","last_unstale":"2024-05-10T10:53:08.909592+0000","last_undegraded":"2024-05-10T10:53:08.909592+0000","last_fullsized":"2024-05-10T10:53:08.909592+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:51.380479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.636306+0000","last_change":"2024-05-10T10:52:15.675837+0000","last_active":"2024-05-10T10:54:07.636306+0000","last_peered":"2024-05-10T10:54:07.636306+0000","last_clean":"2024-05-10T10:54:07.636306+0000","last_became_active":"2024-05-10T10:52:15.675438+0000","last_became_peered":"2024-05-10T10:52:15.675438+0000","last_unstale":"2024-05-10T10:54:07.636306+0000","last_undegraded":"2024-05-10T10:54:07.636306+0000","last_fullsized":"2024-05-10T10:54:07.636306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:23.142008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":216,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:32.913683+0000","last_change":"2024-05-10T10:52:12.530141+0000","last_active":"2024-05-10T10:55:32.913683+0000","last_peered":"2024-05-10T10:55:32.913683+0000","last_clean":"2024-05-10T10:55:32.913683+0000","last_became_active":"2024-05-10T10:52:12.529771+0000","last_became_peered":"2024-05-10T10:52:12.529771+0000","last_unstale":"2024-05-10T10:55:32.913683+0000","last_undegraded":"2024-05-10T10:55:32.913683+0000","last_fullsized":"2024-05-10T10:55:32.913683+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:42.803789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":183,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.630624+0000","last_change":"2024-05-10T10:52:15.686934+0000","last_active":"2024-05-10T10:54:07.630624+0000","last_peered":"2024-05-10T10:54:07.630624+0000","last_clean":"2024-05-10T10:54:07.630624+0000","last_became_active":"2024-05-10T10:52:15.686494+0000","last_became_peered":"2024-05-10T10:52:15.686494+0000","last_unstale":"2024-05-10T10:54:07.630624+0000","last_undegraded":"2024-05-10T10:54:07.630624+0000","last_fullsized":"2024-05-10T10:54:07.630624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:18.049088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.632452+0000","last_change":"2024-05-10T10:52:15.693243+0000","last_active":"2024-05-10T10:54:07.632452+0000","last_peered":"2024-05-10T10:54:07.632452+0000","last_clean":"2024-05-10T10:54:07.632452+0000","last_became_active":"2024-05-10T10:52:15.692868+0000","last_became_peered":"2024-05-10T10:52:15.692868+0000","last_unstale":"2024-05-10T10:54:07.632452+0000","last_undegraded":"2024-05-10T10:54:07.632452+0000","last_fullsized":"2024-05-10T10:54:07.632452+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:25.316500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:32.939470+0000","last_change":"2024-05-10T10:52:12.630916+0000","last_active":"2024-05-10T10:55:32.939470+0000","last_peered":"2024-05-10T10:55:32.939470+0000","last_clean":"2024-05-10T10:55:32.939470+0000","last_became_active":"2024-05-10T10:52:12.630564+0000","last_became_peered":"2024-05-10T10:52:12.630564+0000","last_unstale":"2024-05-10T10:55:32.939470+0000","last_undegraded":"2024-05-10T10:55:32.939470+0000","last_fullsized":"2024-05-10T10:55:32.939470+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:09:46.434409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.627930+0000","last_change":"2024-05-10T10:52:15.691017+0000","last_active":"2024-05-10T10:54:07.627930+0000","last_peered":"2024-05-10T10:54:07.627930+0000","last_clean":"2024-05-10T10:54:07.627930+0000","last_became_active":"2024-05-10T10:52:15.690705+0000","last_became_peered":"2024-05-10T10:52:15.690705+0000","last_unstale":"2024-05-10T10:54:07.627930+0000","last_undegraded":"2024-05-10T10:54:07.627930+0000","last_fullsized":"2024-05-10T10:54:07.627930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:50:43.517455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.058029+0000","last_change":"2024-05-10T10:52:12.529180+0000","last_active":"2024-05-10T10:53:09.058029+0000","last_peered":"2024-05-10T10:53:09.058029+0000","last_clean":"2024-05-10T10:53:09.058029+0000","last_became_active":"2024-05-10T10:52:12.528570+0000","last_became_peered":"2024-05-10T10:52:12.528570+0000","last_unstale":"2024-05-10T10:53:09.058029+0000","last_undegraded":"2024-05-10T10:53:09.058029+0000","last_fullsized":"2024-05-10T10:53:09.058029+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:31:53.254302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.906014+0000","last_change":"2024-05-10T10:50:51.113120+0000","last_active":"2024-05-10T10:53:08.906014+0000","last_peered":"2024-05-10T10:53:08.906014+0000","last_clean":"2024-05-10T10:53:08.906014+0000","last_became_active":"2024-05-10T10:50:51.107803+0000","last_became_peered":"2024-05-10T10:50:51.107803+0000","last_unstale":"2024-05-10T10:53:08.906014+0000","last_undegraded":"2024-05-10T10:53:08.906014+0000","last_fullsized":"2024-05-10T10:53:08.906014+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:47:32.190034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:47:32.190034+0000","last_clean_scrub_stamp":"2024-05-10T10:47:32.190034+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:53.599839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.635144+0000","last_change":"2024-05-10T10:52:15.689856+0000","last_active":"2024-05-10T10:54:07.635144+0000","last_peered":"2024-05-10T10:54:07.635144+0000","last_clean":"2024-05-10T10:54:07.635144+0000","last_became_active":"2024-05-10T10:52:15.689544+0000","last_became_peered":"2024-05-10T10:52:15.689544+0000","last_unstale":"2024-05-10T10:54:07.635144+0000","last_undegraded":"2024-05-10T10:54:07.635144+0000","last_fullsized":"2024-05-10T10:54:07.635144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:39.374857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.905966+0000","last_change":"2024-05-10T10:52:12.532217+0000","last_active":"2024-05-10T10:53:08.905966+0000","last_peered":"2024-05-10T10:53:08.905966+0000","last_clean":"2024-05-10T10:53:08.905966+0000","last_became_active":"2024-05-10T10:52:12.531575+0000","last_became_peered":"2024-05-10T10:52:12.531575+0000","last_unstale":"2024-05-10T10:53:08.905966+0000","last_undegraded":"2024-05-10T10:53:08.905966+0000","last_fullsized":"2024-05-10T10:53:08.905966+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:15:59.493728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908922+0000","last_change":"2024-05-10T10:52:12.631990+0000","last_active":"2024-05-10T10:53:08.908922+0000","last_peered":"2024-05-10T10:53:08.908922+0000","last_clean":"2024-05-10T10:53:08.908922+0000","last_became_active":"2024-05-10T10:52:12.631061+0000","last_became_peered":"2024-05-10T10:52:12.631061+0000","last_unstale":"2024-05-10T10:53:08.908922+0000","last_undegraded":"2024-05-10T10:53:08.908922+0000","last_fullsized":"2024-05-10T10:53:08.908922+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:30.298079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.633824+0000","last_change":"2024-05-10T10:52:15.678797+0000","last_active":"2024-05-10T10:54:07.633824+0000","last_peered":"2024-05-10T10:54:07.633824+0000","last_clean":"2024-05-10T10:54:07.633824+0000","last_became_active":"2024-05-10T10:52:15.678388+0000","last_became_peered":"2024-05-10T10:52:15.678388+0000","last_unstale":"2024-05-10T10:54:07.633824+0000","last_undegraded":"2024-05-10T10:54:07.633824+0000","last_fullsized":"2024-05-10T10:54:07.633824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:15.314479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'18","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:29.714394+0000","last_change":"2024-05-10T10:53:08.916967+0000","last_active":"2024-05-10T10:55:29.714394+0000","last_peered":"2024-05-10T10:55:29.714394+0000","last_clean":"2024-05-10T10:55:29.714394+0000","last_became_active":"2024-05-10T10:53:08.910538+0000","last_became_peered":"2024-05-10T10:53:08.910538+0000","last_unstale":"2024-05-10T10:55:29.714394+0000","last_undegraded":"2024-05-10T10:55:29.714394+0000","last_fullsized":"2024-05-10T10:55:29.714394+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:32.747935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.625103+0000","last_change":"2024-05-10T10:52:15.688313+0000","last_active":"2024-05-10T10:54:07.625103+0000","last_peered":"2024-05-10T10:54:07.625103+0000","last_clean":"2024-05-10T10:54:07.625103+0000","last_became_active":"2024-05-10T10:52:15.688028+0000","last_became_peered":"2024-05-10T10:52:15.688028+0000","last_unstale":"2024-05-10T10:54:07.625103+0000","last_undegraded":"2024-05-10T10:54:07.625103+0000","last_fullsized":"2024-05-10T10:54:07.625103+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:03.815985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.058171+0000","last_change":"2024-05-10T10:52:12.529409+0000","last_active":"2024-05-10T10:53:09.058171+0000","last_peered":"2024-05-10T10:53:09.058171+0000","last_clean":"2024-05-10T10:53:09.058171+0000","last_became_active":"2024-05-10T10:52:12.528837+0000","last_became_peered":"2024-05-10T10:52:12.528837+0000","last_unstale":"2024-05-10T10:53:09.058171+0000","last_undegraded":"2024-05-10T10:53:09.058171+0000","last_fullsized":"2024-05-10T10:53:09.058171+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:28.280292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.638966+0000","last_change":"2024-05-10T10:53:08.910952+0000","last_active":"2024-05-10T10:54:07.638966+0000","last_peered":"2024-05-10T10:54:07.638966+0000","last_clean":"2024-05-10T10:54:07.638966+0000","last_became_active":"2024-05-10T10:53:08.910564+0000","last_became_peered":"2024-05-10T10:53:08.910564+0000","last_unstale":"2024-05-10T10:54:07.638966+0000","last_undegraded":"2024-05-10T10:54:07.638966+0000","last_fullsized":"2024-05-10T10:54:07.638966+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:20.289280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.300782+0000","last_change":"2024-05-10T10:52:12.631048+0000","last_active":"2024-05-10T10:53:09.300782+0000","last_peered":"2024-05-10T10:53:09.300782+0000","last_clean":"2024-05-10T10:53:09.300782+0000","last_became_active":"2024-05-10T10:52:12.630754+0000","last_became_peered":"2024-05-10T10:52:12.630754+0000","last_unstale":"2024-05-10T10:53:09.300782+0000","last_undegraded":"2024-05-10T10:53:09.300782+0000","last_fullsized":"2024-05-10T10:53:09.300782+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:57.755423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.617061+0000","last_change":"2024-05-10T10:52:15.684552+0000","last_active":"2024-05-10T10:54:07.617061+0000","last_peered":"2024-05-10T10:54:07.617061+0000","last_clean":"2024-05-10T10:54:07.617061+0000","last_became_active":"2024-05-10T10:52:15.684174+0000","last_became_peered":"2024-05-10T10:52:15.684174+0000","last_unstale":"2024-05-10T10:54:07.617061+0000","last_undegraded":"2024-05-10T10:54:07.617061+0000","last_fullsized":"2024-05-10T10:54:07.617061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:21:51.633525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.909684+0000","last_change":"2024-05-10T10:52:12.525692+0000","last_active":"2024-05-10T10:53:08.909684+0000","last_peered":"2024-05-10T10:53:08.909684+0000","last_clean":"2024-05-10T10:53:08.909684+0000","last_became_active":"2024-05-10T10:52:12.525436+0000","last_became_peered":"2024-05-10T10:52:12.525436+0000","last_unstale":"2024-05-10T10:53:08.909684+0000","last_undegraded":"2024-05-10T10:53:08.909684+0000","last_fullsized":"2024-05-10T10:53:08.909684+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:34:40.801973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.627570+0000","last_change":"2024-05-10T10:52:15.689838+0000","last_active":"2024-05-10T10:54:07.627570+0000","last_peered":"2024-05-10T10:54:07.627570+0000","last_clean":"2024-05-10T10:54:07.627570+0000","last_became_active":"2024-05-10T10:52:15.689481+0000","last_became_peered":"2024-05-10T10:52:15.689481+0000","last_unstale":"2024-05-10T10:54:07.627570+0000","last_undegraded":"2024-05-10T10:54:07.627570+0000","last_fullsized":"2024-05-10T10:54:07.627570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:02:27.382859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:21.842417+0000","last_change":"2024-05-10T10:52:12.533782+0000","last_active":"2024-05-10T10:54:21.842417+0000","last_peered":"2024-05-10T10:54:21.842417+0000","last_clean":"2024-05-10T10:54:21.842417+0000","last_became_active":"2024-05-10T10:52:12.533457+0000","last_became_peered":"2024-05-10T10:52:12.533457+0000","last_unstale":"2024-05-10T10:54:21.842417+0000","last_undegraded":"2024-05-10T10:54:21.842417+0000","last_fullsized":"2024-05-10T10:54:21.842417+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:17.372672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628314+0000","last_change":"2024-05-10T10:52:15.691594+0000","last_active":"2024-05-10T10:54:07.628314+0000","last_peered":"2024-05-10T10:54:07.628314+0000","last_clean":"2024-05-10T10:54:07.628314+0000","last_became_active":"2024-05-10T10:52:15.690300+0000","last_became_peered":"2024-05-10T10:52:15.690300+0000","last_unstale":"2024-05-10T10:54:07.628314+0000","last_undegraded":"2024-05-10T10:54:07.628314+0000","last_fullsized":"2024-05-10T10:54:07.628314+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:05.228834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908625+0000","last_change":"2024-05-10T10:52:12.530693+0000","last_active":"2024-05-10T10:53:08.908625+0000","last_peered":"2024-05-10T10:53:08.908625+0000","last_clean":"2024-05-10T10:53:08.908625+0000","last_became_active":"2024-05-10T10:52:12.530310+0000","last_became_peered":"2024-05-10T10:52:12.530310+0000","last_unstale":"2024-05-10T10:53:08.908625+0000","last_undegraded":"2024-05-10T10:53:08.908625+0000","last_fullsized":"2024-05-10T10:53:08.908625+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:42:46.967318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645932+0000","last_change":"2024-05-10T10:52:15.695473+0000","last_active":"2024-05-10T10:54:07.645932+0000","last_peered":"2024-05-10T10:54:07.645932+0000","last_clean":"2024-05-10T10:54:07.645932+0000","last_became_active":"2024-05-10T10:52:15.695121+0000","last_became_peered":"2024-05-10T10:52:15.695121+0000","last_unstale":"2024-05-10T10:54:07.645932+0000","last_undegraded":"2024-05-10T10:54:07.645932+0000","last_fullsized":"2024-05-10T10:54:07.645932+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:48:08.019465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'6","reported_seq":213,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:30.945144+0000","last_change":"2024-05-10T10:52:12.630799+0000","last_active":"2024-05-10T10:55:30.945144+0000","last_peered":"2024-05-10T10:55:30.945144+0000","last_clean":"2024-05-10T10:55:30.945144+0000","last_became_active":"2024-05-10T10:52:12.630448+0000","last_became_peered":"2024-05-10T10:52:12.630448+0000","last_unstale":"2024-05-10T10:55:30.945144+0000","last_undegraded":"2024-05-10T10:55:30.945144+0000","last_fullsized":"2024-05-10T10:55:30.945144+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:27.335062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645545+0000","last_change":"2024-05-10T10:52:15.686691+0000","last_active":"2024-05-10T10:54:07.645545+0000","last_peered":"2024-05-10T10:54:07.645545+0000","last_clean":"2024-05-10T10:54:07.645545+0000","last_became_active":"2024-05-10T10:52:15.685886+0000","last_became_peered":"2024-05-10T10:52:15.685886+0000","last_unstale":"2024-05-10T10:54:07.645545+0000","last_undegraded":"2024-05-10T10:54:07.645545+0000","last_fullsized":"2024-05-10T10:54:07.645545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:45.199414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697407+0000","last_change":"2024-05-10T10:52:12.533535+0000","last_active":"2024-05-10T10:53:09.697407+0000","last_peered":"2024-05-10T10:53:09.697407+0000","last_clean":"2024-05-10T10:53:09.697407+0000","last_became_active":"2024-05-10T10:52:12.533146+0000","last_became_peered":"2024-05-10T10:52:12.533146+0000","last_unstale":"2024-05-10T10:53:09.697407+0000","last_undegraded":"2024-05-10T10:53:09.697407+0000","last_fullsized":"2024-05-10T10:53:09.697407+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:07:16.138240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.633963+0000","last_change":"2024-05-10T10:52:15.692013+0000","last_active":"2024-05-10T10:54:07.633963+0000","last_peered":"2024-05-10T10:54:07.633963+0000","last_clean":"2024-05-10T10:54:07.633963+0000","last_became_active":"2024-05-10T10:52:15.691660+0000","last_became_peered":"2024-05-10T10:52:15.691660+0000","last_unstale":"2024-05-10T10:54:07.633963+0000","last_undegraded":"2024-05-10T10:54:07.633963+0000","last_fullsized":"2024-05-10T10:54:07.633963+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:58.780961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.902507+0000","last_change":"2024-05-10T10:52:12.530962+0000","last_active":"2024-05-10T10:53:08.902507+0000","last_peered":"2024-05-10T10:53:08.902507+0000","last_clean":"2024-05-10T10:53:08.902507+0000","last_became_active":"2024-05-10T10:52:12.530610+0000","last_became_peered":"2024-05-10T10:52:12.530610+0000","last_unstale":"2024-05-10T10:53:08.902507+0000","last_undegraded":"2024-05-10T10:53:08.902507+0000","last_fullsized":"2024-05-10T10:53:08.902507+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:04:13.484713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.637879+0000","last_change":"2024-05-10T10:52:15.687218+0000","last_active":"2024-05-10T10:54:07.637879+0000","last_peered":"2024-05-10T10:54:07.637879+0000","last_clean":"2024-05-10T10:54:07.637879+0000","last_became_active":"2024-05-10T10:52:15.686888+0000","last_became_peered":"2024-05-10T10:52:15.686888+0000","last_unstale":"2024-05-10T10:54:07.637879+0000","last_undegraded":"2024-05-10T10:54:07.637879+0000","last_fullsized":"2024-05-10T10:54:07.637879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:53:53.420063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628235+0000","last_change":"2024-05-10T10:52:15.691196+0000","last_active":"2024-05-10T10:54:07.628235+0000","last_peered":"2024-05-10T10:54:07.628235+0000","last_clean":"2024-05-10T10:54:07.628235+0000","last_became_active":"2024-05-10T10:52:15.690865+0000","last_became_peered":"2024-05-10T10:52:15.690865+0000","last_unstale":"2024-05-10T10:54:07.628235+0000","last_undegraded":"2024-05-10T10:54:07.628235+0000","last_fullsized":"2024-05-10T10:54:07.628235+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:02:04.666193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.632644+0000","last_change":"2024-05-10T10:52:15.691239+0000","last_active":"2024-05-10T10:54:07.632644+0000","last_peered":"2024-05-10T10:54:07.632644+0000","last_clean":"2024-05-10T10:54:07.632644+0000","last_became_active":"2024-05-10T10:52:15.690877+0000","last_became_peered":"2024-05-10T10:52:15.690877+0000","last_unstale":"2024-05-10T10:54:07.632644+0000","last_undegraded":"2024-05-10T10:54:07.632644+0000","last_fullsized":"2024-05-10T10:54:07.632644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:16.564872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.627696+0000","last_change":"2024-05-10T10:52:15.681784+0000","last_active":"2024-05-10T10:54:07.627696+0000","last_peered":"2024-05-10T10:54:07.627696+0000","last_clean":"2024-05-10T10:54:07.627696+0000","last_became_active":"2024-05-10T10:52:15.680900+0000","last_became_peered":"2024-05-10T10:52:15.680900+0000","last_unstale":"2024-05-10T10:54:07.627696+0000","last_undegraded":"2024-05-10T10:54:07.627696+0000","last_fullsized":"2024-05-10T10:54:07.627696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:56.393338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.639243+0000","last_change":"2024-05-10T10:52:15.690659+0000","last_active":"2024-05-10T10:54:07.639243+0000","last_peered":"2024-05-10T10:54:07.639243+0000","last_clean":"2024-05-10T10:54:07.639243+0000","last_became_active":"2024-05-10T10:52:15.689723+0000","last_became_peered":"2024-05-10T10:52:15.689723+0000","last_unstale":"2024-05-10T10:54:07.639243+0000","last_undegraded":"2024-05-10T10:54:07.639243+0000","last_fullsized":"2024-05-10T10:54:07.639243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:53:35.212066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.638933+0000","last_change":"2024-05-10T10:53:08.908043+0000","last_active":"2024-05-10T10:54:07.638933+0000","last_peered":"2024-05-10T10:54:07.638933+0000","last_clean":"2024-05-10T10:54:07.638933+0000","last_became_active":"2024-05-10T10:53:08.907635+0000","last_became_peered":"2024-05-10T10:53:08.907635+0000","last_unstale":"2024-05-10T10:54:07.638933+0000","last_undegraded":"2024-05-10T10:54:07.638933+0000","last_fullsized":"2024-05-10T10:54:07.638933+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:03.613885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.617519+0000","last_change":"2024-05-10T10:52:15.690573+0000","last_active":"2024-05-10T10:54:07.617519+0000","last_peered":"2024-05-10T10:54:07.617519+0000","last_clean":"2024-05-10T10:54:07.617519+0000","last_became_active":"2024-05-10T10:52:15.690257+0000","last_became_peered":"2024-05-10T10:52:15.690257+0000","last_unstale":"2024-05-10T10:54:07.617519+0000","last_undegraded":"2024-05-10T10:54:07.617519+0000","last_fullsized":"2024-05-10T10:54:07.617519+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:37:27.128718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645112+0000","last_change":"2024-05-10T10:52:15.684914+0000","last_active":"2024-05-10T10:54:07.645112+0000","last_peered":"2024-05-10T10:54:07.645112+0000","last_clean":"2024-05-10T10:54:07.645112+0000","last_became_active":"2024-05-10T10:52:15.684557+0000","last_became_peered":"2024-05-10T10:52:15.684557+0000","last_unstale":"2024-05-10T10:54:07.645112+0000","last_undegraded":"2024-05-10T10:54:07.645112+0000","last_fullsized":"2024-05-10T10:54:07.645112+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:17.444305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.629396+0000","last_change":"2024-05-10T10:52:15.697047+0000","last_active":"2024-05-10T10:54:07.629396+0000","last_peered":"2024-05-10T10:54:07.629396+0000","last_clean":"2024-05-10T10:54:07.629396+0000","last_became_active":"2024-05-10T10:52:15.696726+0000","last_became_peered":"2024-05-10T10:52:15.696726+0000","last_unstale":"2024-05-10T10:54:07.629396+0000","last_undegraded":"2024-05-10T10:54:07.629396+0000","last_fullsized":"2024-05-10T10:54:07.629396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:14:30.777403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.629207+0000","last_change":"2024-05-10T10:52:15.695613+0000","last_active":"2024-05-10T10:54:07.629207+0000","last_peered":"2024-05-10T10:54:07.629207+0000","last_clean":"2024-05-10T10:54:07.629207+0000","last_became_active":"2024-05-10T10:52:15.695147+0000","last_became_peered":"2024-05-10T10:52:15.695147+0000","last_unstale":"2024-05-10T10:54:07.629207+0000","last_undegraded":"2024-05-10T10:54:07.629207+0000","last_fullsized":"2024-05-10T10:54:07.629207+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:14.175158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628823+0000","last_change":"2024-05-10T10:52:15.683914+0000","last_active":"2024-05-10T10:54:07.628823+0000","last_peered":"2024-05-10T10:54:07.628823+0000","last_clean":"2024-05-10T10:54:07.628823+0000","last_became_active":"2024-05-10T10:52:15.682359+0000","last_became_peered":"2024-05-10T10:52:15.682359+0000","last_unstale":"2024-05-10T10:54:07.628823+0000","last_undegraded":"2024-05-10T10:54:07.628823+0000","last_fullsized":"2024-05-10T10:54:07.628823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:23:41.018064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645608+0000","last_change":"2024-05-10T10:52:15.690862+0000","last_active":"2024-05-10T10:54:07.645608+0000","last_peered":"2024-05-10T10:54:07.645608+0000","last_clean":"2024-05-10T10:54:07.645608+0000","last_became_active":"2024-05-10T10:52:15.690520+0000","last_became_peered":"2024-05-10T10:52:15.690520+0000","last_unstale":"2024-05-10T10:54:07.645608+0000","last_undegraded":"2024-05-10T10:54:07.645608+0000","last_fullsized":"2024-05-10T10:54:07.645608+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:39.819473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.640578+0000","last_change":"2024-05-10T10:52:15.684605+0000","last_active":"2024-05-10T10:54:07.640578+0000","last_peered":"2024-05-10T10:54:07.640578+0000","last_clean":"2024-05-10T10:54:07.640578+0000","last_became_active":"2024-05-10T10:52:15.683863+0000","last_became_peered":"2024-05-10T10:52:15.683863+0000","last_unstale":"2024-05-10T10:54:07.640578+0000","last_undegraded":"2024-05-10T10:54:07.640578+0000","last_fullsized":"2024-05-10T10:54:07.640578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:49:35.187932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.619642+0000","last_change":"2024-05-10T10:52:15.698014+0000","last_active":"2024-05-10T10:54:07.619642+0000","last_peered":"2024-05-10T10:54:07.619642+0000","last_clean":"2024-05-10T10:54:07.619642+0000","last_became_active":"2024-05-10T10:52:15.697583+0000","last_became_peered":"2024-05-10T10:52:15.697583+0000","last_unstale":"2024-05-10T10:54:07.619642+0000","last_undegraded":"2024-05-10T10:54:07.619642+0000","last_fullsized":"2024-05-10T10:54:07.619642+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:30.792127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":81609,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1851,"num_read_kb":1017,"num_write":269,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":241916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645366,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":897024,"data_stored":437082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841598,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36908,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708244,"statfs":{"total":95995035648,"available":95957241856,"internally_reserved":0,"allocated":1609728,"data_stored":1101285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037827,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":921600,"data_stored":436621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234054,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":436999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430284,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1515520,"data_stored":1030357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593809,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":436729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":511207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738478,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":925696,"data_stored":437677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411428,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":503592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182495,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":436163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986267,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":905216,"data_stored":436199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790037,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36828,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708324,"statfs":{"total":95995035648,"available":95957323776,"internally_reserved":0,"allocated":1527808,"data_stored":1029644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":75708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":74248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":75301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T10:55:37.075 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-10T10:55:37.075 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-10T10:55:37.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:36 smithi196 ceph-mon[34872]: pgmap v386: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-10T10:55:37.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:36 smithi196 ceph-mon[34872]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:55:37.318 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:37.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:36 smithi184 ceph-mon[34585]: pgmap v386: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-10T10:55:37.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:36 smithi184 ceph-mon[34585]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:55:37.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:36 smithi107 ceph-mon[30373]: pgmap v386: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-10T10:55:37.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:36 smithi107 ceph-mon[30373]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:55:39.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.069+0000 7f86a6325700 1 -- 172.21.15.107:0/4069313774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86a0108890 msgr2=0x7f86a0110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:39.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.069+0000 7f86a6325700 1 --2- 172.21.15.107:0/4069313774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86a0108890 0x7f86a0110410 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f869800b0d0 tx=0x7f869800b3e0 comp rx=0 tx=0).stop 2024-05-10T10:55:39.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.070+0000 7f86a6325700 1 -- 172.21.15.107:0/4069313774 shutdown_connections 2024-05-10T10:55:39.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.070+0000 7f86a6325700 1 --2- 172.21.15.107:0/4069313774 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86a0101c50 0x7f86a0102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:39.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.070+0000 7f86a6325700 1 --2- 172.21.15.107:0/4069313774 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86a0108890 0x7f86a0110410 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:39.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.070+0000 7f86a6325700 1 --2- 172.21.15.107:0/4069313774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86a0102600 0x7f86a0108160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:39.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.070+0000 7f86a6325700 1 -- 172.21.15.107:0/4069313774 >> 172.21.15.107:0/4069313774 conn(0x7f86a00789a0 msgr2=0x7f86a00ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:39.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.070+0000 7f86a6325700 1 -- 172.21.15.107:0/4069313774 shutdown_connections 2024-05-10T10:55:39.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.070+0000 7f86a6325700 1 -- 172.21.15.107:0/4069313774 wait complete. 2024-05-10T10:55:39.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.070+0000 7f86a6325700 1 Processor -- start 2024-05-10T10:55:39.071 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.070+0000 7f86a6325700 1 -- start start 2024-05-10T10:55:39.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.071+0000 7f86a6325700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86a0101c50 0x7f86a019f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:39.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.071+0000 7f86a6325700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86a0102600 0x7f86a019fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:39.073 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.071+0000 7f86a6325700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86a0108890 0x7f86a0199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:39.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.071+0000 7f86a6325700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f86a0113790 con 0x7f86a0102600 2024-05-10T10:55:39.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.071+0000 7f86a6325700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f86a0113610 con 0x7f86a0101c50 2024-05-10T10:55:39.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.071+0000 7f86a6325700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f86a0113910 con 0x7f86a0108890 2024-05-10T10:55:39.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.071+0000 7f869f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86a0102600 0x7f86a019fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:39.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.071+0000 7f869f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86a0102600 0x7f86a019fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53076/0 (socket says 172.21.15.107:53076) 2024-05-10T10:55:39.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.071+0000 7f869f7fe700 1 -- 172.21.15.107:0/2729696634 learned_addr learned my addr 172.21.15.107:0/2729696634 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:39.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.071+0000 7f869ffff700 1 --2- 172.21.15.107:0/2729696634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86a0101c50 0x7f86a019f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:39.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.071+0000 7f86a48c2700 1 --2- 172.21.15.107:0/2729696634 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86a0108890 0x7f86a0199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:39.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.071+0000 7f869f7fe700 1 -- 172.21.15.107:0/2729696634 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86a0108890 msgr2=0x7f86a0199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:39.074 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.071+0000 7f869f7fe700 1 --2- 172.21.15.107:0/2729696634 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86a0108890 0x7f86a0199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:39.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.071+0000 7f869f7fe700 1 -- 172.21.15.107:0/2729696634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86a0101c50 msgr2=0x7f86a019f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:39.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.071+0000 7f869f7fe700 1 --2- 172.21.15.107:0/2729696634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86a0101c50 0x7f86a019f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:39.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.071+0000 7f869f7fe700 1 -- 172.21.15.107:0/2729696634 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a0199ff0 con 0x7f86a0102600 2024-05-10T10:55:39.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.071+0000 7f869f7fe700 1 --2- 172.21.15.107:0/2729696634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86a0102600 0x7f86a019fc10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f869400c920 tx=0x7f869400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:39.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.072+0000 7f869d7fa700 1 -- 172.21.15.107:0/2729696634 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8694004a30 con 0x7f86a0102600 2024-05-10T10:55:39.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.072+0000 7f869d7fa700 1 -- 172.21.15.107:0/2729696634 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f86940054f0 con 0x7f86a0102600 2024-05-10T10:55:39.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.072+0000 7f86a6325700 1 -- 172.21.15.107:0/2729696634 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86a019a2e0 con 0x7f86a0102600 2024-05-10T10:55:39.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.072+0000 7f869d7fa700 1 -- 172.21.15.107:0/2729696634 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8694007cd0 con 0x7f86a0102600 2024-05-10T10:55:39.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.072+0000 7f86a6325700 1 -- 172.21.15.107:0/2729696634 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86a01a65a0 con 0x7f86a0102600 2024-05-10T10:55:39.075 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.073+0000 7f86a6325700 1 -- 172.21.15.107:0/2729696634 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86a006a190 con 0x7f86a0102600 2024-05-10T10:55:39.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.074+0000 7f869d7fa700 1 -- 172.21.15.107:0/2729696634 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 149704+0+0 (secure 0 0 0) 0x7f8694004eb0 con 0x7f86a0102600 2024-05-10T10:55:39.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.075+0000 7f869d7fa700 1 --2- 172.21.15.107:0/2729696634 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f86880b2990 0x7f86880b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:39.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.075+0000 7f869ffff700 1 --2- 172.21.15.107:0/2729696634 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f86880b2990 0x7f86880b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:39.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.075+0000 7f869d7fa700 1 -- 172.21.15.107:0/2729696634 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f86940e2180 con 0x7f86a0102600 2024-05-10T10:55:39.076 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.075+0000 7f869ffff700 1 --2- 172.21.15.107:0/2729696634 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f86880b2990 0x7f86880b4e50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86a019a9d0 tx=0x7f869000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:39.079 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.078+0000 7f869d7fa700 1 -- 172.21.15.107:0/2729696634 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8694014030 con 0x7f86a0102600 2024-05-10T10:55:39.223 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:38 smithi107 ceph-mon[30373]: pgmap v387: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-05-10T10:55:39.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.285+0000 7f86a6325700 1 -- 172.21.15.107:0/2729696634 --> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f86a00638e0 con 0x7f86880b2990 2024-05-10T10:55:39.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.292+0000 7f869d7fa700 1 -- 172.21.15.107:0/2729696634 <== mgr.14152 v2:172.21.15.107:6800/2062256859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258876 (secure 0 0 0) 0x7f86a00638e0 con 0x7f86880b2990 2024-05-10T10:55:39.297 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:55:39.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.295+0000 7f86a6325700 1 -- 172.21.15.107:0/2729696634 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f86880b2990 msgr2=0x7f86880b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:39.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.295+0000 7f86a6325700 1 --2- 172.21.15.107:0/2729696634 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f86880b2990 0x7f86880b4e50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f86a019a9d0 tx=0x7f869000a380 comp rx=0 tx=0).stop 2024-05-10T10:55:39.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.295+0000 7f86a6325700 1 -- 172.21.15.107:0/2729696634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86a0102600 msgr2=0x7f86a019fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:39.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.295+0000 7f86a6325700 1 --2- 172.21.15.107:0/2729696634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86a0102600 0x7f86a019fc10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f869400c920 tx=0x7f869400cc30 comp rx=0 tx=0).stop 2024-05-10T10:55:39.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.296+0000 7f86a6325700 1 -- 172.21.15.107:0/2729696634 shutdown_connections 2024-05-10T10:55:39.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.296+0000 7f86a6325700 1 --2- 172.21.15.107:0/2729696634 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f86880b2990 0x7f86880b4e50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:39.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.296+0000 7f86a6325700 1 --2- 172.21.15.107:0/2729696634 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f86a0108890 0x7f86a0199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:39.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.296+0000 7f86a6325700 1 --2- 172.21.15.107:0/2729696634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86a0101c50 0x7f86a019f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:39.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.296+0000 7f86a6325700 1 --2- 172.21.15.107:0/2729696634 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86a0102600 0x7f86a019fc10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:39.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.296+0000 7f86a6325700 1 -- 172.21.15.107:0/2729696634 >> 172.21.15.107:0/2729696634 conn(0x7f86a00789a0 msgr2=0x7f86a0107f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:39.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.296+0000 7f86a6325700 1 -- 172.21.15.107:0/2729696634 shutdown_connections 2024-05-10T10:55:39.299 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:39.296+0000 7f86a6325700 1 -- 172.21.15.107:0/2729696634 wait complete. 2024-05-10T10:55:39.300 INFO:teuthology.orchestra.run.smithi107.stderr:dumped all 2024-05-10T10:55:39.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:38 smithi196 ceph-mon[34872]: pgmap v387: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-05-10T10:55:39.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:38 smithi184 ceph-mon[34585]: pgmap v387: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-05-10T10:55:40.014 INFO:teuthology.orchestra.run.smithi107.stdout:{"pg_ready":true,"pg_map":{"version":387,"stamp":"2024-05-10T10:55:37.655112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":672211,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1938,"num_read_kb":1082,"num_write":394,"num_write_kb":2316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2951840,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":824,"ondisk_log_size":824,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374352,"kb_used_data":12720,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567472,"statfs":{"total":1151940427776,"available":1151557091328,"internally_reserved":0,"allocated":13025280,"data_stored":7242621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9682,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":63,"num_write":16,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002810"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.634999+0000","last_change":"2024-05-10T10:52:15.686294+0000","last_active":"2024-05-10T10:54:07.634999+0000","last_peered":"2024-05-10T10:54:07.634999+0000","last_clean":"2024-05-10T10:54:07.634999+0000","last_became_active":"2024-05-10T10:52:15.685324+0000","last_became_peered":"2024-05-10T10:52:15.685324+0000","last_unstale":"2024-05-10T10:54:07.634999+0000","last_undegraded":"2024-05-10T10:54:07.634999+0000","last_fullsized":"2024-05-10T10:54:07.634999+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:20.777432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.625202+0000","last_change":"2024-05-10T10:52:15.687542+0000","last_active":"2024-05-10T10:54:07.625202+0000","last_peered":"2024-05-10T10:54:07.625202+0000","last_clean":"2024-05-10T10:54:07.625202+0000","last_became_active":"2024-05-10T10:52:15.687258+0000","last_became_peered":"2024-05-10T10:52:15.687258+0000","last_unstale":"2024-05-10T10:54:07.625202+0000","last_undegraded":"2024-05-10T10:54:07.625202+0000","last_fullsized":"2024-05-10T10:54:07.625202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:08.522392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.636006+0000","last_change":"2024-05-10T10:52:15.682314+0000","last_active":"2024-05-10T10:54:07.636006+0000","last_peered":"2024-05-10T10:54:07.636006+0000","last_clean":"2024-05-10T10:54:07.636006+0000","last_became_active":"2024-05-10T10:52:15.681939+0000","last_became_peered":"2024-05-10T10:52:15.681939+0000","last_unstale":"2024-05-10T10:54:07.636006+0000","last_undegraded":"2024-05-10T10:54:07.636006+0000","last_fullsized":"2024-05-10T10:54:07.636006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:04.857969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.629993+0000","last_change":"2024-05-10T10:52:15.693451+0000","last_active":"2024-05-10T10:54:07.629993+0000","last_peered":"2024-05-10T10:54:07.629993+0000","last_clean":"2024-05-10T10:54:07.629993+0000","last_became_active":"2024-05-10T10:52:15.693041+0000","last_became_peered":"2024-05-10T10:52:15.693041+0000","last_unstale":"2024-05-10T10:54:07.629993+0000","last_undegraded":"2024-05-10T10:54:07.629993+0000","last_fullsized":"2024-05-10T10:54:07.629993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:57:14.959699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.637732+0000","last_change":"2024-05-10T10:52:15.679527+0000","last_active":"2024-05-10T10:54:07.637732+0000","last_peered":"2024-05-10T10:54:07.637732+0000","last_clean":"2024-05-10T10:54:07.637732+0000","last_became_active":"2024-05-10T10:52:15.679153+0000","last_became_peered":"2024-05-10T10:52:15.679153+0000","last_unstale":"2024-05-10T10:54:07.637732+0000","last_undegraded":"2024-05-10T10:54:07.637732+0000","last_fullsized":"2024-05-10T10:54:07.637732+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:58.738486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628648+0000","last_change":"2024-05-10T10:52:15.685905+0000","last_active":"2024-05-10T10:54:07.628648+0000","last_peered":"2024-05-10T10:54:07.628648+0000","last_clean":"2024-05-10T10:54:07.628648+0000","last_became_active":"2024-05-10T10:52:15.685628+0000","last_became_peered":"2024-05-10T10:52:15.685628+0000","last_unstale":"2024-05-10T10:54:07.628648+0000","last_undegraded":"2024-05-10T10:54:07.628648+0000","last_fullsized":"2024-05-10T10:54:07.628648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:16.776307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.634298+0000","last_change":"2024-05-10T10:52:15.692951+0000","last_active":"2024-05-10T10:54:07.634298+0000","last_peered":"2024-05-10T10:54:07.634298+0000","last_clean":"2024-05-10T10:54:07.634298+0000","last_became_active":"2024-05-10T10:52:15.692594+0000","last_became_peered":"2024-05-10T10:52:15.692594+0000","last_unstale":"2024-05-10T10:54:07.634298+0000","last_undegraded":"2024-05-10T10:54:07.634298+0000","last_fullsized":"2024-05-10T10:54:07.634298+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:04.105565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.629178+0000","last_change":"2024-05-10T10:52:15.692349+0000","last_active":"2024-05-10T10:54:07.629178+0000","last_peered":"2024-05-10T10:54:07.629178+0000","last_clean":"2024-05-10T10:54:07.629178+0000","last_became_active":"2024-05-10T10:52:15.691840+0000","last_became_peered":"2024-05-10T10:52:15.691840+0000","last_unstale":"2024-05-10T10:54:07.629178+0000","last_undegraded":"2024-05-10T10:54:07.629178+0000","last_fullsized":"2024-05-10T10:54:07.629178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:32:25.011085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645356+0000","last_change":"2024-05-10T10:52:15.686531+0000","last_active":"2024-05-10T10:54:07.645356+0000","last_peered":"2024-05-10T10:54:07.645356+0000","last_clean":"2024-05-10T10:54:07.645356+0000","last_became_active":"2024-05-10T10:52:15.686029+0000","last_became_peered":"2024-05-10T10:52:15.686029+0000","last_unstale":"2024-05-10T10:54:07.645356+0000","last_undegraded":"2024-05-10T10:54:07.645356+0000","last_fullsized":"2024-05-10T10:54:07.645356+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:58:30.836606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.631823+0000","last_change":"2024-05-10T10:52:15.697314+0000","last_active":"2024-05-10T10:54:07.631823+0000","last_peered":"2024-05-10T10:54:07.631823+0000","last_clean":"2024-05-10T10:54:07.631823+0000","last_became_active":"2024-05-10T10:52:15.696944+0000","last_became_peered":"2024-05-10T10:52:15.696944+0000","last_unstale":"2024-05-10T10:54:07.631823+0000","last_undegraded":"2024-05-10T10:54:07.631823+0000","last_fullsized":"2024-05-10T10:54:07.631823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:10.098904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.644918+0000","last_change":"2024-05-10T10:52:15.690866+0000","last_active":"2024-05-10T10:54:07.644918+0000","last_peered":"2024-05-10T10:54:07.644918+0000","last_clean":"2024-05-10T10:54:07.644918+0000","last_became_active":"2024-05-10T10:52:15.690533+0000","last_became_peered":"2024-05-10T10:52:15.690533+0000","last_unstale":"2024-05-10T10:54:07.644918+0000","last_undegraded":"2024-05-10T10:54:07.644918+0000","last_fullsized":"2024-05-10T10:54:07.644918+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:48.290897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.626832+0000","last_change":"2024-05-10T10:52:15.696386+0000","last_active":"2024-05-10T10:54:07.626832+0000","last_peered":"2024-05-10T10:54:07.626832+0000","last_clean":"2024-05-10T10:54:07.626832+0000","last_became_active":"2024-05-10T10:52:15.696044+0000","last_became_peered":"2024-05-10T10:52:15.696044+0000","last_unstale":"2024-05-10T10:54:07.626832+0000","last_undegraded":"2024-05-10T10:54:07.626832+0000","last_fullsized":"2024-05-10T10:54:07.626832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:48.259860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.638961+0000","last_change":"2024-05-10T10:52:15.691796+0000","last_active":"2024-05-10T10:54:07.638961+0000","last_peered":"2024-05-10T10:54:07.638961+0000","last_clean":"2024-05-10T10:54:07.638961+0000","last_became_active":"2024-05-10T10:52:15.690952+0000","last_became_peered":"2024-05-10T10:52:15.690952+0000","last_unstale":"2024-05-10T10:54:07.638961+0000","last_undegraded":"2024-05-10T10:54:07.638961+0000","last_fullsized":"2024-05-10T10:54:07.638961+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:10.645645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.623536+0000","last_change":"2024-05-10T10:52:15.683303+0000","last_active":"2024-05-10T10:54:07.623536+0000","last_peered":"2024-05-10T10:54:07.623536+0000","last_clean":"2024-05-10T10:54:07.623536+0000","last_became_active":"2024-05-10T10:52:15.682753+0000","last_became_peered":"2024-05-10T10:52:15.682753+0000","last_unstale":"2024-05-10T10:54:07.623536+0000","last_undegraded":"2024-05-10T10:54:07.623536+0000","last_fullsized":"2024-05-10T10:54:07.623536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:02:00.167463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.630931+0000","last_change":"2024-05-10T10:52:15.691668+0000","last_active":"2024-05-10T10:54:07.630931+0000","last_peered":"2024-05-10T10:54:07.630931+0000","last_clean":"2024-05-10T10:54:07.630931+0000","last_became_active":"2024-05-10T10:52:15.691323+0000","last_became_peered":"2024-05-10T10:52:15.691323+0000","last_unstale":"2024-05-10T10:54:07.630931+0000","last_undegraded":"2024-05-10T10:54:07.630931+0000","last_fullsized":"2024-05-10T10:54:07.630931+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:09.235092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645579+0000","last_change":"2024-05-10T10:52:15.689859+0000","last_active":"2024-05-10T10:54:07.645579+0000","last_peered":"2024-05-10T10:54:07.645579+0000","last_clean":"2024-05-10T10:54:07.645579+0000","last_became_active":"2024-05-10T10:52:15.689060+0000","last_became_peered":"2024-05-10T10:52:15.689060+0000","last_unstale":"2024-05-10T10:54:07.645579+0000","last_undegraded":"2024-05-10T10:54:07.645579+0000","last_fullsized":"2024-05-10T10:54:07.645579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:42.029942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.635076+0000","last_change":"2024-05-10T10:52:15.686711+0000","last_active":"2024-05-10T10:54:07.635076+0000","last_peered":"2024-05-10T10:54:07.635076+0000","last_clean":"2024-05-10T10:54:07.635076+0000","last_became_active":"2024-05-10T10:52:15.685817+0000","last_became_peered":"2024-05-10T10:52:15.685817+0000","last_unstale":"2024-05-10T10:54:07.635076+0000","last_undegraded":"2024-05-10T10:54:07.635076+0000","last_fullsized":"2024-05-10T10:54:07.635076+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:50:25.703341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.621992+0000","last_change":"2024-05-10T10:52:15.681702+0000","last_active":"2024-05-10T10:54:07.621992+0000","last_peered":"2024-05-10T10:54:07.621992+0000","last_clean":"2024-05-10T10:54:07.621992+0000","last_became_active":"2024-05-10T10:52:15.681400+0000","last_became_peered":"2024-05-10T10:52:15.681400+0000","last_unstale":"2024-05-10T10:54:07.621992+0000","last_undegraded":"2024-05-10T10:54:07.621992+0000","last_fullsized":"2024-05-10T10:54:07.621992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:18:07.520500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.633710+0000","last_change":"2024-05-10T10:52:15.684321+0000","last_active":"2024-05-10T10:54:07.633710+0000","last_peered":"2024-05-10T10:54:07.633710+0000","last_clean":"2024-05-10T10:54:07.633710+0000","last_became_active":"2024-05-10T10:52:15.683099+0000","last_became_peered":"2024-05-10T10:52:15.683099+0000","last_unstale":"2024-05-10T10:54:07.633710+0000","last_undegraded":"2024-05-10T10:54:07.633710+0000","last_fullsized":"2024-05-10T10:54:07.633710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:09.310292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":223,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:32.912940+0000","last_change":"2024-05-10T10:52:12.530258+0000","last_active":"2024-05-10T10:55:32.912940+0000","last_peered":"2024-05-10T10:55:32.912940+0000","last_clean":"2024-05-10T10:55:32.912940+0000","last_became_active":"2024-05-10T10:52:12.529842+0000","last_became_peered":"2024-05-10T10:52:12.529842+0000","last_unstale":"2024-05-10T10:55:32.912940+0000","last_undegraded":"2024-05-10T10:55:32.912940+0000","last_fullsized":"2024-05-10T10:55:32.912940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:13.525038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.625785+0000","last_change":"2024-05-10T10:53:09.698541+0000","last_active":"2024-05-10T10:54:07.625785+0000","last_peered":"2024-05-10T10:54:07.625785+0000","last_clean":"2024-05-10T10:54:07.625785+0000","last_became_active":"2024-05-10T10:53:09.698219+0000","last_became_peered":"2024-05-10T10:53:09.698219+0000","last_unstale":"2024-05-10T10:54:07.625785+0000","last_undegraded":"2024-05-10T10:54:07.625785+0000","last_fullsized":"2024-05-10T10:54:07.625785+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:27:11.837418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.910128+0000","last_change":"2024-05-10T10:52:12.630918+0000","last_active":"2024-05-10T10:53:08.910128+0000","last_peered":"2024-05-10T10:53:08.910128+0000","last_clean":"2024-05-10T10:53:08.910128+0000","last_became_active":"2024-05-10T10:52:12.630563+0000","last_became_peered":"2024-05-10T10:52:12.630563+0000","last_unstale":"2024-05-10T10:53:08.910128+0000","last_undegraded":"2024-05-10T10:53:08.910128+0000","last_fullsized":"2024-05-10T10:53:08.910128+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:58:03.341362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.643641+0000","last_change":"2024-05-10T10:52:15.676831+0000","last_active":"2024-05-10T10:54:07.643641+0000","last_peered":"2024-05-10T10:54:07.643641+0000","last_clean":"2024-05-10T10:54:07.643641+0000","last_became_active":"2024-05-10T10:52:15.676506+0000","last_became_peered":"2024-05-10T10:52:15.676506+0000","last_unstale":"2024-05-10T10:54:07.643641+0000","last_undegraded":"2024-05-10T10:54:07.643641+0000","last_fullsized":"2024-05-10T10:54:07.643641+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:43.498800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908972+0000","last_change":"2024-05-10T10:52:12.532092+0000","last_active":"2024-05-10T10:53:08.908972+0000","last_peered":"2024-05-10T10:53:08.908972+0000","last_clean":"2024-05-10T10:53:08.908972+0000","last_became_active":"2024-05-10T10:52:12.531649+0000","last_became_peered":"2024-05-10T10:52:12.531649+0000","last_unstale":"2024-05-10T10:53:08.908972+0000","last_undegraded":"2024-05-10T10:53:08.908972+0000","last_fullsized":"2024-05-10T10:53:08.908972+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.709935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.641656+0000","last_change":"2024-05-10T10:52:15.683024+0000","last_active":"2024-05-10T10:54:07.641656+0000","last_peered":"2024-05-10T10:54:07.641656+0000","last_clean":"2024-05-10T10:54:07.641656+0000","last_became_active":"2024-05-10T10:52:15.682655+0000","last_became_peered":"2024-05-10T10:52:15.682655+0000","last_unstale":"2024-05-10T10:54:07.641656+0000","last_undegraded":"2024-05-10T10:54:07.641656+0000","last_fullsized":"2024-05-10T10:54:07.641656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:27.922746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908833+0000","last_change":"2024-05-10T10:52:12.534000+0000","last_active":"2024-05-10T10:53:08.908833+0000","last_peered":"2024-05-10T10:53:08.908833+0000","last_clean":"2024-05-10T10:53:08.908833+0000","last_became_active":"2024-05-10T10:52:12.533609+0000","last_became_peered":"2024-05-10T10:52:12.533609+0000","last_unstale":"2024-05-10T10:53:08.908833+0000","last_undegraded":"2024-05-10T10:53:08.908833+0000","last_fullsized":"2024-05-10T10:53:08.908833+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:38:18.115926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.644043+0000","last_change":"2024-05-10T10:52:15.695263+0000","last_active":"2024-05-10T10:54:07.644043+0000","last_peered":"2024-05-10T10:54:07.644043+0000","last_clean":"2024-05-10T10:54:07.644043+0000","last_became_active":"2024-05-10T10:52:15.694890+0000","last_became_peered":"2024-05-10T10:52:15.694890+0000","last_unstale":"2024-05-10T10:54:07.644043+0000","last_undegraded":"2024-05-10T10:54:07.644043+0000","last_fullsized":"2024-05-10T10:54:07.644043+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:50:32.361110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'8","reported_seq":221,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:32.940654+0000","last_change":"2024-05-10T10:52:12.534673+0000","last_active":"2024-05-10T10:55:32.940654+0000","last_peered":"2024-05-10T10:55:32.940654+0000","last_clean":"2024-05-10T10:55:32.940654+0000","last_became_active":"2024-05-10T10:52:12.534031+0000","last_became_peered":"2024-05-10T10:52:12.534031+0000","last_unstale":"2024-05-10T10:55:32.940654+0000","last_undegraded":"2024-05-10T10:55:32.940654+0000","last_fullsized":"2024-05-10T10:55:32.940654+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:32.030866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1462,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.617741+0000","last_change":"2024-05-10T10:52:15.683282+0000","last_active":"2024-05-10T10:54:07.617741+0000","last_peered":"2024-05-10T10:54:07.617741+0000","last_clean":"2024-05-10T10:54:07.617741+0000","last_became_active":"2024-05-10T10:52:15.682421+0000","last_became_peered":"2024-05-10T10:52:15.682421+0000","last_unstale":"2024-05-10T10:54:07.617741+0000","last_undegraded":"2024-05-10T10:54:07.617741+0000","last_fullsized":"2024-05-10T10:54:07.617741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:08:12.014145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.724139+0000","last_change":"2024-05-10T10:52:12.532161+0000","last_active":"2024-05-10T10:53:09.724139+0000","last_peered":"2024-05-10T10:53:09.724139+0000","last_clean":"2024-05-10T10:53:09.724139+0000","last_became_active":"2024-05-10T10:52:12.531780+0000","last_became_peered":"2024-05-10T10:52:12.531780+0000","last_unstale":"2024-05-10T10:53:09.724139+0000","last_undegraded":"2024-05-10T10:53:09.724139+0000","last_fullsized":"2024-05-10T10:53:09.724139+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:58:08.724945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.632144+0000","last_change":"2024-05-10T10:52:15.694602+0000","last_active":"2024-05-10T10:54:07.632144+0000","last_peered":"2024-05-10T10:54:07.632144+0000","last_clean":"2024-05-10T10:54:07.632144+0000","last_became_active":"2024-05-10T10:52:15.694279+0000","last_became_peered":"2024-05-10T10:52:15.694279+0000","last_unstale":"2024-05-10T10:54:07.632144+0000","last_undegraded":"2024-05-10T10:54:07.632144+0000","last_fullsized":"2024-05-10T10:54:07.632144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:12:16.286092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.902480+0000","last_change":"2024-05-10T10:52:12.526817+0000","last_active":"2024-05-10T10:53:08.902480+0000","last_peered":"2024-05-10T10:53:08.902480+0000","last_clean":"2024-05-10T10:53:08.902480+0000","last_became_active":"2024-05-10T10:52:12.526315+0000","last_became_peered":"2024-05-10T10:52:12.526315+0000","last_unstale":"2024-05-10T10:53:08.902480+0000","last_undegraded":"2024-05-10T10:53:08.902480+0000","last_fullsized":"2024-05-10T10:53:08.902480+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:56:49.968299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.636024+0000","last_change":"2024-05-10T10:52:15.683201+0000","last_active":"2024-05-10T10:54:07.636024+0000","last_peered":"2024-05-10T10:54:07.636024+0000","last_clean":"2024-05-10T10:54:07.636024+0000","last_became_active":"2024-05-10T10:52:15.682412+0000","last_became_peered":"2024-05-10T10:52:15.682412+0000","last_unstale":"2024-05-10T10:54:07.636024+0000","last_undegraded":"2024-05-10T10:54:07.636024+0000","last_fullsized":"2024-05-10T10:54:07.636024+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:39:22.001179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697080+0000","last_change":"2024-05-10T10:52:12.531058+0000","last_active":"2024-05-10T10:53:09.697080+0000","last_peered":"2024-05-10T10:53:09.697080+0000","last_clean":"2024-05-10T10:53:09.697080+0000","last_became_active":"2024-05-10T10:52:12.530655+0000","last_became_peered":"2024-05-10T10:52:12.530655+0000","last_unstale":"2024-05-10T10:53:09.697080+0000","last_undegraded":"2024-05-10T10:53:09.697080+0000","last_fullsized":"2024-05-10T10:53:09.697080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:36:52.300420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.622213+0000","last_change":"2024-05-10T10:52:15.681697+0000","last_active":"2024-05-10T10:54:07.622213+0000","last_peered":"2024-05-10T10:54:07.622213+0000","last_clean":"2024-05-10T10:54:07.622213+0000","last_became_active":"2024-05-10T10:52:15.681396+0000","last_became_peered":"2024-05-10T10:52:15.681396+0000","last_unstale":"2024-05-10T10:54:07.622213+0000","last_undegraded":"2024-05-10T10:54:07.622213+0000","last_fullsized":"2024-05-10T10:54:07.622213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:35.390837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'7","reported_seq":396,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:33.941786+0000","last_change":"2024-05-10T10:52:12.532089+0000","last_active":"2024-05-10T10:55:33.941786+0000","last_peered":"2024-05-10T10:55:33.941786+0000","last_clean":"2024-05-10T10:55:33.941786+0000","last_became_active":"2024-05-10T10:52:12.531641+0000","last_became_peered":"2024-05-10T10:52:12.531641+0000","last_unstale":"2024-05-10T10:55:33.941786+0000","last_undegraded":"2024-05-10T10:55:33.941786+0000","last_fullsized":"2024-05-10T10:55:33.941786+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:04:34.517079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":362,"num_read_kb":362,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.641380+0000","last_change":"2024-05-10T10:52:15.685566+0000","last_active":"2024-05-10T10:54:07.641380+0000","last_peered":"2024-05-10T10:54:07.641380+0000","last_clean":"2024-05-10T10:54:07.641380+0000","last_became_active":"2024-05-10T10:52:15.685220+0000","last_became_peered":"2024-05-10T10:52:15.685220+0000","last_unstale":"2024-05-10T10:54:07.641380+0000","last_undegraded":"2024-05-10T10:54:07.641380+0000","last_fullsized":"2024-05-10T10:54:07.641380+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:27:06.140961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.906414+0000","last_change":"2024-05-10T10:52:12.533182+0000","last_active":"2024-05-10T10:53:08.906414+0000","last_peered":"2024-05-10T10:53:08.906414+0000","last_clean":"2024-05-10T10:53:08.906414+0000","last_became_active":"2024-05-10T10:52:12.532821+0000","last_became_peered":"2024-05-10T10:52:12.532821+0000","last_unstale":"2024-05-10T10:53:08.906414+0000","last_undegraded":"2024-05-10T10:53:08.906414+0000","last_fullsized":"2024-05-10T10:53:08.906414+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:54:15.930093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628636+0000","last_change":"2024-05-10T10:52:15.690491+0000","last_active":"2024-05-10T10:54:07.628636+0000","last_peered":"2024-05-10T10:54:07.628636+0000","last_clean":"2024-05-10T10:54:07.628636+0000","last_became_active":"2024-05-10T10:52:15.690200+0000","last_became_peered":"2024-05-10T10:52:15.690200+0000","last_unstale":"2024-05-10T10:54:07.628636+0000","last_undegraded":"2024-05-10T10:54:07.628636+0000","last_fullsized":"2024-05-10T10:54:07.628636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:28.315294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697533+0000","last_change":"2024-05-10T10:52:12.631966+0000","last_active":"2024-05-10T10:53:09.697533+0000","last_peered":"2024-05-10T10:53:09.697533+0000","last_clean":"2024-05-10T10:53:09.697533+0000","last_became_active":"2024-05-10T10:52:12.631539+0000","last_became_peered":"2024-05-10T10:52:12.631539+0000","last_unstale":"2024-05-10T10:53:09.697533+0000","last_undegraded":"2024-05-10T10:53:09.697533+0000","last_fullsized":"2024-05-10T10:53:09.697533+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:32:52.392307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645950+0000","last_change":"2024-05-10T10:52:15.692893+0000","last_active":"2024-05-10T10:54:07.645950+0000","last_peered":"2024-05-10T10:54:07.645950+0000","last_clean":"2024-05-10T10:54:07.645950+0000","last_became_active":"2024-05-10T10:52:15.692528+0000","last_became_peered":"2024-05-10T10:52:15.692528+0000","last_unstale":"2024-05-10T10:54:07.645950+0000","last_undegraded":"2024-05-10T10:54:07.645950+0000","last_fullsized":"2024-05-10T10:54:07.645950+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:51.452294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'40","reported_seq":442,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:33.942206+0000","last_change":"2024-05-10T10:52:12.532094+0000","last_active":"2024-05-10T10:55:33.942206+0000","last_peered":"2024-05-10T10:55:33.942206+0000","last_clean":"2024-05-10T10:55:33.942206+0000","last_became_active":"2024-05-10T10:52:12.531719+0000","last_became_peered":"2024-05-10T10:52:12.531719+0000","last_unstale":"2024-05-10T10:55:33.942206+0000","last_undegraded":"2024-05-10T10:55:33.942206+0000","last_fullsized":"2024-05-10T10:55:33.942206+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:43:52.697528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73565,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":375,"num_read_kb":259,"num_write":42,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.637338+0000","last_change":"2024-05-10T10:52:15.688187+0000","last_active":"2024-05-10T10:54:07.637338+0000","last_peered":"2024-05-10T10:54:07.637338+0000","last_clean":"2024-05-10T10:54:07.637338+0000","last_became_active":"2024-05-10T10:52:15.687821+0000","last_became_peered":"2024-05-10T10:52:15.687821+0000","last_unstale":"2024-05-10T10:54:07.637338+0000","last_undegraded":"2024-05-10T10:54:07.637338+0000","last_fullsized":"2024-05-10T10:54:07.637338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:54.425892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.590055+0000","last_change":"2024-05-10T10:52:12.532185+0000","last_active":"2024-05-10T10:53:09.590055+0000","last_peered":"2024-05-10T10:53:09.590055+0000","last_clean":"2024-05-10T10:53:09.590055+0000","last_became_active":"2024-05-10T10:52:12.531795+0000","last_became_peered":"2024-05-10T10:52:12.531795+0000","last_unstale":"2024-05-10T10:53:09.590055+0000","last_undegraded":"2024-05-10T10:53:09.590055+0000","last_fullsized":"2024-05-10T10:53:09.590055+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:51.704767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.639760+0000","last_change":"2024-05-10T10:52:15.684388+0000","last_active":"2024-05-10T10:54:07.639760+0000","last_peered":"2024-05-10T10:54:07.639760+0000","last_clean":"2024-05-10T10:54:07.639760+0000","last_became_active":"2024-05-10T10:52:15.684061+0000","last_became_peered":"2024-05-10T10:52:15.684061+0000","last_unstale":"2024-05-10T10:54:07.639760+0000","last_undegraded":"2024-05-10T10:54:07.639760+0000","last_fullsized":"2024-05-10T10:54:07.639760+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:19.462083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697091+0000","last_change":"2024-05-10T10:52:12.531912+0000","last_active":"2024-05-10T10:53:09.697091+0000","last_peered":"2024-05-10T10:53:09.697091+0000","last_clean":"2024-05-10T10:53:09.697091+0000","last_became_active":"2024-05-10T10:52:12.531501+0000","last_became_peered":"2024-05-10T10:52:12.531501+0000","last_unstale":"2024-05-10T10:53:09.697091+0000","last_undegraded":"2024-05-10T10:53:09.697091+0000","last_fullsized":"2024-05-10T10:53:09.697091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:15.086519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.639559+0000","last_change":"2024-05-10T10:52:15.686521+0000","last_active":"2024-05-10T10:54:07.639559+0000","last_peered":"2024-05-10T10:54:07.639559+0000","last_clean":"2024-05-10T10:54:07.639559+0000","last_became_active":"2024-05-10T10:52:15.686142+0000","last_became_peered":"2024-05-10T10:52:15.686142+0000","last_unstale":"2024-05-10T10:54:07.639559+0000","last_undegraded":"2024-05-10T10:54:07.639559+0000","last_fullsized":"2024-05-10T10:54:07.639559+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:40.315401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":217,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:34.943592+0000","last_change":"2024-05-10T10:52:12.527774+0000","last_active":"2024-05-10T10:55:34.943592+0000","last_peered":"2024-05-10T10:55:34.943592+0000","last_clean":"2024-05-10T10:55:34.943592+0000","last_became_active":"2024-05-10T10:52:12.527412+0000","last_became_peered":"2024-05-10T10:52:12.527412+0000","last_unstale":"2024-05-10T10:55:34.943592+0000","last_undegraded":"2024-05-10T10:55:34.943592+0000","last_fullsized":"2024-05-10T10:55:34.943592+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:51:21.334653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.633856+0000","last_change":"2024-05-10T10:52:15.693427+0000","last_active":"2024-05-10T10:54:07.633856+0000","last_peered":"2024-05-10T10:54:07.633856+0000","last_clean":"2024-05-10T10:54:07.633856+0000","last_became_active":"2024-05-10T10:52:15.693114+0000","last_became_peered":"2024-05-10T10:52:15.693114+0000","last_unstale":"2024-05-10T10:54:07.633856+0000","last_undegraded":"2024-05-10T10:54:07.633856+0000","last_fullsized":"2024-05-10T10:54:07.633856+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:25:36.423413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908419+0000","last_change":"2024-05-10T10:52:12.631475+0000","last_active":"2024-05-10T10:53:08.908419+0000","last_peered":"2024-05-10T10:53:08.908419+0000","last_clean":"2024-05-10T10:53:08.908419+0000","last_became_active":"2024-05-10T10:52:12.631079+0000","last_became_peered":"2024-05-10T10:52:12.631079+0000","last_unstale":"2024-05-10T10:53:08.908419+0000","last_undegraded":"2024-05-10T10:53:08.908419+0000","last_fullsized":"2024-05-10T10:53:08.908419+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:52.975413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.631170+0000","last_change":"2024-05-10T10:53:09.302243+0000","last_active":"2024-05-10T10:54:07.631170+0000","last_peered":"2024-05-10T10:54:07.631170+0000","last_clean":"2024-05-10T10:54:07.631170+0000","last_became_active":"2024-05-10T10:53:09.301866+0000","last_became_peered":"2024-05-10T10:53:09.301866+0000","last_unstale":"2024-05-10T10:54:07.631170+0000","last_undegraded":"2024-05-10T10:54:07.631170+0000","last_fullsized":"2024-05-10T10:54:07.631170+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:07.609569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.909051+0000","last_change":"2024-05-10T10:52:12.533071+0000","last_active":"2024-05-10T10:53:08.909051+0000","last_peered":"2024-05-10T10:53:08.909051+0000","last_clean":"2024-05-10T10:53:08.909051+0000","last_became_active":"2024-05-10T10:52:12.532655+0000","last_became_peered":"2024-05-10T10:52:12.532655+0000","last_unstale":"2024-05-10T10:53:08.909051+0000","last_undegraded":"2024-05-10T10:53:08.909051+0000","last_fullsized":"2024-05-10T10:53:08.909051+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:06:30.723701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.617339+0000","last_change":"2024-05-10T10:52:15.697362+0000","last_active":"2024-05-10T10:54:07.617339+0000","last_peered":"2024-05-10T10:54:07.617339+0000","last_clean":"2024-05-10T10:54:07.617339+0000","last_became_active":"2024-05-10T10:52:15.696915+0000","last_became_peered":"2024-05-10T10:52:15.696915+0000","last_unstale":"2024-05-10T10:54:07.617339+0000","last_undegraded":"2024-05-10T10:54:07.617339+0000","last_fullsized":"2024-05-10T10:54:07.617339+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:29:03.365667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.909592+0000","last_change":"2024-05-10T10:53:08.909109+0000","last_active":"2024-05-10T10:53:08.909592+0000","last_peered":"2024-05-10T10:53:08.909592+0000","last_clean":"2024-05-10T10:53:08.909592+0000","last_became_active":"2024-05-10T10:53:08.908677+0000","last_became_peered":"2024-05-10T10:53:08.908677+0000","last_unstale":"2024-05-10T10:53:08.909592+0000","last_undegraded":"2024-05-10T10:53:08.909592+0000","last_fullsized":"2024-05-10T10:53:08.909592+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:51.380479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.636306+0000","last_change":"2024-05-10T10:52:15.675837+0000","last_active":"2024-05-10T10:54:07.636306+0000","last_peered":"2024-05-10T10:54:07.636306+0000","last_clean":"2024-05-10T10:54:07.636306+0000","last_became_active":"2024-05-10T10:52:15.675438+0000","last_became_peered":"2024-05-10T10:52:15.675438+0000","last_unstale":"2024-05-10T10:54:07.636306+0000","last_undegraded":"2024-05-10T10:54:07.636306+0000","last_fullsized":"2024-05-10T10:54:07.636306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:23.142008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":216,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:32.913683+0000","last_change":"2024-05-10T10:52:12.530141+0000","last_active":"2024-05-10T10:55:32.913683+0000","last_peered":"2024-05-10T10:55:32.913683+0000","last_clean":"2024-05-10T10:55:32.913683+0000","last_became_active":"2024-05-10T10:52:12.529771+0000","last_became_peered":"2024-05-10T10:52:12.529771+0000","last_unstale":"2024-05-10T10:55:32.913683+0000","last_undegraded":"2024-05-10T10:55:32.913683+0000","last_fullsized":"2024-05-10T10:55:32.913683+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:42.803789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":183,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.630624+0000","last_change":"2024-05-10T10:52:15.686934+0000","last_active":"2024-05-10T10:54:07.630624+0000","last_peered":"2024-05-10T10:54:07.630624+0000","last_clean":"2024-05-10T10:54:07.630624+0000","last_became_active":"2024-05-10T10:52:15.686494+0000","last_became_peered":"2024-05-10T10:52:15.686494+0000","last_unstale":"2024-05-10T10:54:07.630624+0000","last_undegraded":"2024-05-10T10:54:07.630624+0000","last_fullsized":"2024-05-10T10:54:07.630624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:56:18.049088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.632452+0000","last_change":"2024-05-10T10:52:15.693243+0000","last_active":"2024-05-10T10:54:07.632452+0000","last_peered":"2024-05-10T10:54:07.632452+0000","last_clean":"2024-05-10T10:54:07.632452+0000","last_became_active":"2024-05-10T10:52:15.692868+0000","last_became_peered":"2024-05-10T10:52:15.692868+0000","last_unstale":"2024-05-10T10:54:07.632452+0000","last_undegraded":"2024-05-10T10:54:07.632452+0000","last_fullsized":"2024-05-10T10:54:07.632452+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:25.316500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":214,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:32.939470+0000","last_change":"2024-05-10T10:52:12.630916+0000","last_active":"2024-05-10T10:55:32.939470+0000","last_peered":"2024-05-10T10:55:32.939470+0000","last_clean":"2024-05-10T10:55:32.939470+0000","last_became_active":"2024-05-10T10:52:12.630564+0000","last_became_peered":"2024-05-10T10:52:12.630564+0000","last_unstale":"2024-05-10T10:55:32.939470+0000","last_undegraded":"2024-05-10T10:55:32.939470+0000","last_fullsized":"2024-05-10T10:55:32.939470+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:09:46.434409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.627930+0000","last_change":"2024-05-10T10:52:15.691017+0000","last_active":"2024-05-10T10:54:07.627930+0000","last_peered":"2024-05-10T10:54:07.627930+0000","last_clean":"2024-05-10T10:54:07.627930+0000","last_became_active":"2024-05-10T10:52:15.690705+0000","last_became_peered":"2024-05-10T10:52:15.690705+0000","last_unstale":"2024-05-10T10:54:07.627930+0000","last_undegraded":"2024-05-10T10:54:07.627930+0000","last_fullsized":"2024-05-10T10:54:07.627930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:50:43.517455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.058029+0000","last_change":"2024-05-10T10:52:12.529180+0000","last_active":"2024-05-10T10:53:09.058029+0000","last_peered":"2024-05-10T10:53:09.058029+0000","last_clean":"2024-05-10T10:53:09.058029+0000","last_became_active":"2024-05-10T10:52:12.528570+0000","last_became_peered":"2024-05-10T10:52:12.528570+0000","last_unstale":"2024-05-10T10:53:09.058029+0000","last_undegraded":"2024-05-10T10:53:09.058029+0000","last_fullsized":"2024-05-10T10:53:09.058029+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:31:53.254302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.906014+0000","last_change":"2024-05-10T10:50:51.113120+0000","last_active":"2024-05-10T10:53:08.906014+0000","last_peered":"2024-05-10T10:53:08.906014+0000","last_clean":"2024-05-10T10:53:08.906014+0000","last_became_active":"2024-05-10T10:50:51.107803+0000","last_became_peered":"2024-05-10T10:50:51.107803+0000","last_unstale":"2024-05-10T10:53:08.906014+0000","last_undegraded":"2024-05-10T10:53:08.906014+0000","last_fullsized":"2024-05-10T10:53:08.906014+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:47:32.190034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:47:32.190034+0000","last_clean_scrub_stamp":"2024-05-10T10:47:32.190034+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:53.599839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.635144+0000","last_change":"2024-05-10T10:52:15.689856+0000","last_active":"2024-05-10T10:54:07.635144+0000","last_peered":"2024-05-10T10:54:07.635144+0000","last_clean":"2024-05-10T10:54:07.635144+0000","last_became_active":"2024-05-10T10:52:15.689544+0000","last_became_peered":"2024-05-10T10:52:15.689544+0000","last_unstale":"2024-05-10T10:54:07.635144+0000","last_undegraded":"2024-05-10T10:54:07.635144+0000","last_fullsized":"2024-05-10T10:54:07.635144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:42:39.374857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.905966+0000","last_change":"2024-05-10T10:52:12.532217+0000","last_active":"2024-05-10T10:53:08.905966+0000","last_peered":"2024-05-10T10:53:08.905966+0000","last_clean":"2024-05-10T10:53:08.905966+0000","last_became_active":"2024-05-10T10:52:12.531575+0000","last_became_peered":"2024-05-10T10:52:12.531575+0000","last_unstale":"2024-05-10T10:53:08.905966+0000","last_undegraded":"2024-05-10T10:53:08.905966+0000","last_fullsized":"2024-05-10T10:53:08.905966+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:15:59.493728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908922+0000","last_change":"2024-05-10T10:52:12.631990+0000","last_active":"2024-05-10T10:53:08.908922+0000","last_peered":"2024-05-10T10:53:08.908922+0000","last_clean":"2024-05-10T10:53:08.908922+0000","last_became_active":"2024-05-10T10:52:12.631061+0000","last_became_peered":"2024-05-10T10:52:12.631061+0000","last_unstale":"2024-05-10T10:53:08.908922+0000","last_undegraded":"2024-05-10T10:53:08.908922+0000","last_fullsized":"2024-05-10T10:53:08.908922+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:30.298079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.633824+0000","last_change":"2024-05-10T10:52:15.678797+0000","last_active":"2024-05-10T10:54:07.633824+0000","last_peered":"2024-05-10T10:54:07.633824+0000","last_clean":"2024-05-10T10:54:07.633824+0000","last_became_active":"2024-05-10T10:52:15.678388+0000","last_became_peered":"2024-05-10T10:52:15.678388+0000","last_unstale":"2024-05-10T10:54:07.633824+0000","last_undegraded":"2024-05-10T10:54:07.633824+0000","last_fullsized":"2024-05-10T10:54:07.633824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:15.314479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'18","reported_seq":61,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:29.714394+0000","last_change":"2024-05-10T10:53:08.916967+0000","last_active":"2024-05-10T10:55:29.714394+0000","last_peered":"2024-05-10T10:55:29.714394+0000","last_clean":"2024-05-10T10:55:29.714394+0000","last_became_active":"2024-05-10T10:53:08.910538+0000","last_became_peered":"2024-05-10T10:53:08.910538+0000","last_unstale":"2024-05-10T10:55:29.714394+0000","last_undegraded":"2024-05-10T10:55:29.714394+0000","last_fullsized":"2024-05-10T10:55:29.714394+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:41:32.747935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.625103+0000","last_change":"2024-05-10T10:52:15.688313+0000","last_active":"2024-05-10T10:54:07.625103+0000","last_peered":"2024-05-10T10:54:07.625103+0000","last_clean":"2024-05-10T10:54:07.625103+0000","last_became_active":"2024-05-10T10:52:15.688028+0000","last_became_peered":"2024-05-10T10:52:15.688028+0000","last_unstale":"2024-05-10T10:54:07.625103+0000","last_undegraded":"2024-05-10T10:54:07.625103+0000","last_fullsized":"2024-05-10T10:54:07.625103+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:03.815985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.058171+0000","last_change":"2024-05-10T10:52:12.529409+0000","last_active":"2024-05-10T10:53:09.058171+0000","last_peered":"2024-05-10T10:53:09.058171+0000","last_clean":"2024-05-10T10:53:09.058171+0000","last_became_active":"2024-05-10T10:52:12.528837+0000","last_became_peered":"2024-05-10T10:52:12.528837+0000","last_unstale":"2024-05-10T10:53:09.058171+0000","last_undegraded":"2024-05-10T10:53:09.058171+0000","last_fullsized":"2024-05-10T10:53:09.058171+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:16:28.280292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.638966+0000","last_change":"2024-05-10T10:53:08.910952+0000","last_active":"2024-05-10T10:54:07.638966+0000","last_peered":"2024-05-10T10:54:07.638966+0000","last_clean":"2024-05-10T10:54:07.638966+0000","last_became_active":"2024-05-10T10:53:08.910564+0000","last_became_peered":"2024-05-10T10:53:08.910564+0000","last_unstale":"2024-05-10T10:54:07.638966+0000","last_undegraded":"2024-05-10T10:54:07.638966+0000","last_fullsized":"2024-05-10T10:54:07.638966+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:33:20.289280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.300782+0000","last_change":"2024-05-10T10:52:12.631048+0000","last_active":"2024-05-10T10:53:09.300782+0000","last_peered":"2024-05-10T10:53:09.300782+0000","last_clean":"2024-05-10T10:53:09.300782+0000","last_became_active":"2024-05-10T10:52:12.630754+0000","last_became_peered":"2024-05-10T10:52:12.630754+0000","last_unstale":"2024-05-10T10:53:09.300782+0000","last_undegraded":"2024-05-10T10:53:09.300782+0000","last_fullsized":"2024-05-10T10:53:09.300782+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:53:57.755423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.617061+0000","last_change":"2024-05-10T10:52:15.684552+0000","last_active":"2024-05-10T10:54:07.617061+0000","last_peered":"2024-05-10T10:54:07.617061+0000","last_clean":"2024-05-10T10:54:07.617061+0000","last_became_active":"2024-05-10T10:52:15.684174+0000","last_became_peered":"2024-05-10T10:52:15.684174+0000","last_unstale":"2024-05-10T10:54:07.617061+0000","last_undegraded":"2024-05-10T10:54:07.617061+0000","last_fullsized":"2024-05-10T10:54:07.617061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:21:51.633525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.909684+0000","last_change":"2024-05-10T10:52:12.525692+0000","last_active":"2024-05-10T10:53:08.909684+0000","last_peered":"2024-05-10T10:53:08.909684+0000","last_clean":"2024-05-10T10:53:08.909684+0000","last_became_active":"2024-05-10T10:52:12.525436+0000","last_became_peered":"2024-05-10T10:52:12.525436+0000","last_unstale":"2024-05-10T10:53:08.909684+0000","last_undegraded":"2024-05-10T10:53:08.909684+0000","last_fullsized":"2024-05-10T10:53:08.909684+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:34:40.801973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.627570+0000","last_change":"2024-05-10T10:52:15.689838+0000","last_active":"2024-05-10T10:54:07.627570+0000","last_peered":"2024-05-10T10:54:07.627570+0000","last_clean":"2024-05-10T10:54:07.627570+0000","last_became_active":"2024-05-10T10:52:15.689481+0000","last_became_peered":"2024-05-10T10:52:15.689481+0000","last_unstale":"2024-05-10T10:54:07.627570+0000","last_undegraded":"2024-05-10T10:54:07.627570+0000","last_fullsized":"2024-05-10T10:54:07.627570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:02:27.382859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:21.842417+0000","last_change":"2024-05-10T10:52:12.533782+0000","last_active":"2024-05-10T10:54:21.842417+0000","last_peered":"2024-05-10T10:54:21.842417+0000","last_clean":"2024-05-10T10:54:21.842417+0000","last_became_active":"2024-05-10T10:52:12.533457+0000","last_became_peered":"2024-05-10T10:52:12.533457+0000","last_unstale":"2024-05-10T10:54:21.842417+0000","last_undegraded":"2024-05-10T10:54:21.842417+0000","last_fullsized":"2024-05-10T10:54:21.842417+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:17.372672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628314+0000","last_change":"2024-05-10T10:52:15.691594+0000","last_active":"2024-05-10T10:54:07.628314+0000","last_peered":"2024-05-10T10:54:07.628314+0000","last_clean":"2024-05-10T10:54:07.628314+0000","last_became_active":"2024-05-10T10:52:15.690300+0000","last_became_peered":"2024-05-10T10:52:15.690300+0000","last_unstale":"2024-05-10T10:54:07.628314+0000","last_undegraded":"2024-05-10T10:54:07.628314+0000","last_fullsized":"2024-05-10T10:54:07.628314+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:14:05.228834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.908625+0000","last_change":"2024-05-10T10:52:12.530693+0000","last_active":"2024-05-10T10:53:08.908625+0000","last_peered":"2024-05-10T10:53:08.908625+0000","last_clean":"2024-05-10T10:53:08.908625+0000","last_became_active":"2024-05-10T10:52:12.530310+0000","last_became_peered":"2024-05-10T10:52:12.530310+0000","last_unstale":"2024-05-10T10:53:08.908625+0000","last_undegraded":"2024-05-10T10:53:08.908625+0000","last_fullsized":"2024-05-10T10:53:08.908625+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:42:46.967318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645932+0000","last_change":"2024-05-10T10:52:15.695473+0000","last_active":"2024-05-10T10:54:07.645932+0000","last_peered":"2024-05-10T10:54:07.645932+0000","last_clean":"2024-05-10T10:54:07.645932+0000","last_became_active":"2024-05-10T10:52:15.695121+0000","last_became_peered":"2024-05-10T10:52:15.695121+0000","last_unstale":"2024-05-10T10:54:07.645932+0000","last_undegraded":"2024-05-10T10:54:07.645932+0000","last_fullsized":"2024-05-10T10:54:07.645932+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:48:08.019465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'6","reported_seq":219,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:55:34.951859+0000","last_change":"2024-05-10T10:52:12.630799+0000","last_active":"2024-05-10T10:55:34.951859+0000","last_peered":"2024-05-10T10:55:34.951859+0000","last_clean":"2024-05-10T10:55:34.951859+0000","last_became_active":"2024-05-10T10:52:12.630448+0000","last_became_peered":"2024-05-10T10:52:12.630448+0000","last_unstale":"2024-05-10T10:55:34.951859+0000","last_undegraded":"2024-05-10T10:55:34.951859+0000","last_fullsized":"2024-05-10T10:55:34.951859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:57:27.335062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645545+0000","last_change":"2024-05-10T10:52:15.686691+0000","last_active":"2024-05-10T10:54:07.645545+0000","last_peered":"2024-05-10T10:54:07.645545+0000","last_clean":"2024-05-10T10:54:07.645545+0000","last_became_active":"2024-05-10T10:52:15.685886+0000","last_became_peered":"2024-05-10T10:52:15.685886+0000","last_unstale":"2024-05-10T10:54:07.645545+0000","last_undegraded":"2024-05-10T10:54:07.645545+0000","last_fullsized":"2024-05-10T10:54:07.645545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:44:45.199414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:09.697407+0000","last_change":"2024-05-10T10:52:12.533535+0000","last_active":"2024-05-10T10:53:09.697407+0000","last_peered":"2024-05-10T10:53:09.697407+0000","last_clean":"2024-05-10T10:53:09.697407+0000","last_became_active":"2024-05-10T10:52:12.533146+0000","last_became_peered":"2024-05-10T10:52:12.533146+0000","last_unstale":"2024-05-10T10:53:09.697407+0000","last_undegraded":"2024-05-10T10:53:09.697407+0000","last_fullsized":"2024-05-10T10:53:09.697407+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:07:16.138240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.633963+0000","last_change":"2024-05-10T10:52:15.692013+0000","last_active":"2024-05-10T10:54:07.633963+0000","last_peered":"2024-05-10T10:54:07.633963+0000","last_clean":"2024-05-10T10:54:07.633963+0000","last_became_active":"2024-05-10T10:52:15.691660+0000","last_became_peered":"2024-05-10T10:52:15.691660+0000","last_unstale":"2024-05-10T10:54:07.633963+0000","last_undegraded":"2024-05-10T10:54:07.633963+0000","last_fullsized":"2024-05-10T10:54:07.633963+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:58.780961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:53:08.902507+0000","last_change":"2024-05-10T10:52:12.530962+0000","last_active":"2024-05-10T10:53:08.902507+0000","last_peered":"2024-05-10T10:53:08.902507+0000","last_clean":"2024-05-10T10:53:08.902507+0000","last_became_active":"2024-05-10T10:52:12.530610+0000","last_became_peered":"2024-05-10T10:52:12.530610+0000","last_unstale":"2024-05-10T10:53:08.902507+0000","last_undegraded":"2024-05-10T10:53:08.902507+0000","last_fullsized":"2024-05-10T10:53:08.902507+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:11.509706+0000","last_clean_scrub_stamp":"2024-05-10T10:52:11.509706+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:04:13.484713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.637879+0000","last_change":"2024-05-10T10:52:15.687218+0000","last_active":"2024-05-10T10:54:07.637879+0000","last_peered":"2024-05-10T10:54:07.637879+0000","last_clean":"2024-05-10T10:54:07.637879+0000","last_became_active":"2024-05-10T10:52:15.686888+0000","last_became_peered":"2024-05-10T10:52:15.686888+0000","last_unstale":"2024-05-10T10:54:07.637879+0000","last_undegraded":"2024-05-10T10:54:07.637879+0000","last_fullsized":"2024-05-10T10:54:07.637879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:53:53.420063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628235+0000","last_change":"2024-05-10T10:52:15.691196+0000","last_active":"2024-05-10T10:54:07.628235+0000","last_peered":"2024-05-10T10:54:07.628235+0000","last_clean":"2024-05-10T10:54:07.628235+0000","last_became_active":"2024-05-10T10:52:15.690865+0000","last_became_peered":"2024-05-10T10:52:15.690865+0000","last_unstale":"2024-05-10T10:54:07.628235+0000","last_undegraded":"2024-05-10T10:54:07.628235+0000","last_fullsized":"2024-05-10T10:54:07.628235+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:02:04.666193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.632644+0000","last_change":"2024-05-10T10:52:15.691239+0000","last_active":"2024-05-10T10:54:07.632644+0000","last_peered":"2024-05-10T10:54:07.632644+0000","last_clean":"2024-05-10T10:54:07.632644+0000","last_became_active":"2024-05-10T10:52:15.690877+0000","last_became_peered":"2024-05-10T10:52:15.690877+0000","last_unstale":"2024-05-10T10:54:07.632644+0000","last_undegraded":"2024-05-10T10:54:07.632644+0000","last_fullsized":"2024-05-10T10:54:07.632644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:16.564872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.627696+0000","last_change":"2024-05-10T10:52:15.681784+0000","last_active":"2024-05-10T10:54:07.627696+0000","last_peered":"2024-05-10T10:54:07.627696+0000","last_clean":"2024-05-10T10:54:07.627696+0000","last_became_active":"2024-05-10T10:52:15.680900+0000","last_became_peered":"2024-05-10T10:52:15.680900+0000","last_unstale":"2024-05-10T10:54:07.627696+0000","last_undegraded":"2024-05-10T10:54:07.627696+0000","last_fullsized":"2024-05-10T10:54:07.627696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:56.393338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.639243+0000","last_change":"2024-05-10T10:52:15.690659+0000","last_active":"2024-05-10T10:54:07.639243+0000","last_peered":"2024-05-10T10:54:07.639243+0000","last_clean":"2024-05-10T10:54:07.639243+0000","last_became_active":"2024-05-10T10:52:15.689723+0000","last_became_peered":"2024-05-10T10:52:15.689723+0000","last_unstale":"2024-05-10T10:54:07.639243+0000","last_undegraded":"2024-05-10T10:54:07.639243+0000","last_fullsized":"2024-05-10T10:54:07.639243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:53:35.212066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.638933+0000","last_change":"2024-05-10T10:53:08.908043+0000","last_active":"2024-05-10T10:54:07.638933+0000","last_peered":"2024-05-10T10:54:07.638933+0000","last_clean":"2024-05-10T10:54:07.638933+0000","last_became_active":"2024-05-10T10:53:08.907635+0000","last_became_peered":"2024-05-10T10:53:08.907635+0000","last_unstale":"2024-05-10T10:54:07.638933+0000","last_undegraded":"2024-05-10T10:54:07.638933+0000","last_fullsized":"2024-05-10T10:54:07.638933+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:19:03.613885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.617519+0000","last_change":"2024-05-10T10:52:15.690573+0000","last_active":"2024-05-10T10:54:07.617519+0000","last_peered":"2024-05-10T10:54:07.617519+0000","last_clean":"2024-05-10T10:54:07.617519+0000","last_became_active":"2024-05-10T10:52:15.690257+0000","last_became_peered":"2024-05-10T10:52:15.690257+0000","last_unstale":"2024-05-10T10:54:07.617519+0000","last_undegraded":"2024-05-10T10:54:07.617519+0000","last_fullsized":"2024-05-10T10:54:07.617519+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:37:27.128718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645112+0000","last_change":"2024-05-10T10:52:15.684914+0000","last_active":"2024-05-10T10:54:07.645112+0000","last_peered":"2024-05-10T10:54:07.645112+0000","last_clean":"2024-05-10T10:54:07.645112+0000","last_became_active":"2024-05-10T10:52:15.684557+0000","last_became_peered":"2024-05-10T10:52:15.684557+0000","last_unstale":"2024-05-10T10:54:07.645112+0000","last_undegraded":"2024-05-10T10:54:07.645112+0000","last_fullsized":"2024-05-10T10:54:07.645112+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:17.444305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.629396+0000","last_change":"2024-05-10T10:52:15.697047+0000","last_active":"2024-05-10T10:54:07.629396+0000","last_peered":"2024-05-10T10:54:07.629396+0000","last_clean":"2024-05-10T10:54:07.629396+0000","last_became_active":"2024-05-10T10:52:15.696726+0000","last_became_peered":"2024-05-10T10:52:15.696726+0000","last_unstale":"2024-05-10T10:54:07.629396+0000","last_undegraded":"2024-05-10T10:54:07.629396+0000","last_fullsized":"2024-05-10T10:54:07.629396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:14:30.777403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.629207+0000","last_change":"2024-05-10T10:52:15.695613+0000","last_active":"2024-05-10T10:54:07.629207+0000","last_peered":"2024-05-10T10:54:07.629207+0000","last_clean":"2024-05-10T10:54:07.629207+0000","last_became_active":"2024-05-10T10:52:15.695147+0000","last_became_peered":"2024-05-10T10:52:15.695147+0000","last_unstale":"2024-05-10T10:54:07.629207+0000","last_undegraded":"2024-05-10T10:54:07.629207+0000","last_fullsized":"2024-05-10T10:54:07.629207+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:14.175158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.628823+0000","last_change":"2024-05-10T10:52:15.683914+0000","last_active":"2024-05-10T10:54:07.628823+0000","last_peered":"2024-05-10T10:54:07.628823+0000","last_clean":"2024-05-10T10:54:07.628823+0000","last_became_active":"2024-05-10T10:52:15.682359+0000","last_became_peered":"2024-05-10T10:52:15.682359+0000","last_unstale":"2024-05-10T10:54:07.628823+0000","last_undegraded":"2024-05-10T10:54:07.628823+0000","last_fullsized":"2024-05-10T10:54:07.628823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T22:23:41.018064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.645608+0000","last_change":"2024-05-10T10:52:15.690862+0000","last_active":"2024-05-10T10:54:07.645608+0000","last_peered":"2024-05-10T10:54:07.645608+0000","last_clean":"2024-05-10T10:54:07.645608+0000","last_became_active":"2024-05-10T10:52:15.690520+0000","last_became_peered":"2024-05-10T10:52:15.690520+0000","last_unstale":"2024-05-10T10:54:07.645608+0000","last_undegraded":"2024-05-10T10:54:07.645608+0000","last_fullsized":"2024-05-10T10:54:07.645608+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:50:39.819473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.640578+0000","last_change":"2024-05-10T10:52:15.684605+0000","last_active":"2024-05-10T10:54:07.640578+0000","last_peered":"2024-05-10T10:54:07.640578+0000","last_clean":"2024-05-10T10:54:07.640578+0000","last_became_active":"2024-05-10T10:52:15.683863+0000","last_became_peered":"2024-05-10T10:52:15.683863+0000","last_unstale":"2024-05-10T10:54:07.640578+0000","last_undegraded":"2024-05-10T10:54:07.640578+0000","last_fullsized":"2024-05-10T10:54:07.640578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:49:35.187932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-10T10:54:07.619642+0000","last_change":"2024-05-10T10:52:15.698014+0000","last_active":"2024-05-10T10:54:07.619642+0000","last_peered":"2024-05-10T10:54:07.619642+0000","last_clean":"2024-05-10T10:54:07.619642+0000","last_became_active":"2024-05-10T10:52:15.697583+0000","last_became_peered":"2024-05-10T10:52:15.697583+0000","last_unstale":"2024-05-10T10:54:07.619642+0000","last_undegraded":"2024-05-10T10:54:07.619642+0000","last_fullsized":"2024-05-10T10:54:07.619642+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T10:52:14.659846+0000","last_clean_scrub_stamp":"2024-05-10T10:52:14.659846+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:58:30.792127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":81609,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1862,"num_read_kb":1018,"num_write":269,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":244827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645366,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":897024,"data_stored":437082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841598,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36908,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708244,"statfs":{"total":95995035648,"available":95957241856,"internally_reserved":0,"allocated":1609728,"data_stored":1101285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037827,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":921600,"data_stored":436621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234055,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":436999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430284,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1515520,"data_stored":1030357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593809,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":436729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":511207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738479,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":925696,"data_stored":438068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411429,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":512267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182495,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":436163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986268,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":905216,"data_stored":436199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790037,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36828,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708324,"statfs":{"total":95995035648,"available":95957323776,"internally_reserved":0,"allocated":1527808,"data_stored":1029644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":75708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":76768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":75301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T10:55:40.019 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:55:40.264 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:40.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:40 smithi196 ceph-mon[34872]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:55:40.387 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:39 smithi107 ceph-mon[30373]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:55:40.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:40 smithi184 ceph-mon[34585]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-10T10:55:41.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:41 smithi196 ceph-mon[34872]: pgmap v388: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-10T10:55:41.340 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:41 smithi107 ceph-mon[30373]: pgmap v388: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-10T10:55:41.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:41 smithi184 ceph-mon[34585]: pgmap v388: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-10T10:55:41.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.918+0000 7fcdec469700 1 -- 172.21.15.107:0/411169759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcde4107be0 msgr2=0x7fcde4107fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:41.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.918+0000 7fcdec469700 1 --2- 172.21.15.107:0/411169759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcde4107be0 0x7fcde4107fc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcde00099c0 tx=0x7fcde0009cd0 comp rx=0 tx=0).stop 2024-05-10T10:55:41.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.918+0000 7fcdec469700 1 -- 172.21.15.107:0/411169759 shutdown_connections 2024-05-10T10:55:41.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.918+0000 7fcdec469700 1 --2- 172.21.15.107:0/411169759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcde4102540 0x7fcde410e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:41.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.918+0000 7fcdec469700 1 --2- 172.21.15.107:0/411169759 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcde4107be0 0x7fcde4107fc0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:41.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.918+0000 7fcdec469700 1 --2- 172.21.15.107:0/411169759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcde4101b80 0x7fcde4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:41.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.918+0000 7fcdec469700 1 -- 172.21.15.107:0/411169759 >> 172.21.15.107:0/411169759 conn(0x7fcde4078a10 msgr2=0x7fcde40ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:41.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.918+0000 7fcdec469700 1 -- 172.21.15.107:0/411169759 shutdown_connections 2024-05-10T10:55:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.918+0000 7fcdec469700 1 -- 172.21.15.107:0/411169759 wait complete. 2024-05-10T10:55:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.919+0000 7fcdec469700 1 Processor -- start 2024-05-10T10:55:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.919+0000 7fcdec469700 1 -- start start 2024-05-10T10:55:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.919+0000 7fcdec469700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcde4101b80 0x7fcde419a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.919+0000 7fcdec469700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcde4102540 0x7fcde419ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.919+0000 7fcdec469700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcde4107be0 0x7fcde41a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.919+0000 7fcdec469700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcde41126b0 con 0x7fcde4102540 2024-05-10T10:55:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.919+0000 7fcdec469700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcde4112530 con 0x7fcde4107be0 2024-05-10T10:55:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.919+0000 7fcdec469700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcde4112830 con 0x7fcde4101b80 2024-05-10T10:55:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.919+0000 7fcde9a04700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcde4102540 0x7fcde419ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.919+0000 7fcde9a04700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcde4102540 0x7fcde419ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53084/0 (socket says 172.21.15.107:53084) 2024-05-10T10:55:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.919+0000 7fcde9a04700 1 -- 172.21.15.107:0/1486954692 learned_addr learned my addr 172.21.15.107:0/1486954692 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:41.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.919+0000 7fcdeaa06700 1 --2- 172.21.15.107:0/1486954692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcde4107be0 0x7fcde41a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.919+0000 7fcdea205700 1 --2- 172.21.15.107:0/1486954692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcde4101b80 0x7fcde419a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.919+0000 7fcde9a04700 1 -- 172.21.15.107:0/1486954692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcde4101b80 msgr2=0x7fcde419a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.920+0000 7fcde9a04700 1 --2- 172.21.15.107:0/1486954692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcde4101b80 0x7fcde419a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.920+0000 7fcde9a04700 1 -- 172.21.15.107:0/1486954692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcde4107be0 msgr2=0x7fcde41a59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.920+0000 7fcde9a04700 1 --2- 172.21.15.107:0/1486954692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcde4107be0 0x7fcde41a59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.920+0000 7fcde9a04700 1 -- 172.21.15.107:0/1486954692 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde41a5ef0 con 0x7fcde4102540 2024-05-10T10:55:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.920+0000 7fcde9a04700 1 --2- 172.21.15.107:0/1486954692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcde4102540 0x7fcde419ae70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400c920 tx=0x7fcdd400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.920+0000 7fcddb7fe700 1 -- 172.21.15.107:0/1486954692 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4007b00 con 0x7fcde4102540 2024-05-10T10:55:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.920+0000 7fcddb7fe700 1 -- 172.21.15.107:0/1486954692 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcdd4004d00 con 0x7fcde4102540 2024-05-10T10:55:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.920+0000 7fcdec469700 1 -- 172.21.15.107:0/1486954692 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde41a6180 con 0x7fcde4102540 2024-05-10T10:55:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.920+0000 7fcddb7fe700 1 -- 172.21.15.107:0/1486954692 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4005650 con 0x7fcde4102540 2024-05-10T10:55:41.923 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.920+0000 7fcdec469700 1 -- 172.21.15.107:0/1486954692 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde41a66e0 con 0x7fcde4102540 2024-05-10T10:55:41.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.921+0000 7fcdec469700 1 -- 172.21.15.107:0/1486954692 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde406a190 con 0x7fcde4102540 2024-05-10T10:55:41.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.922+0000 7fcddb7fe700 1 -- 172.21.15.107:0/1486954692 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 149704+0+0 (secure 0 0 0) 0x7fcdd4007ca0 con 0x7fcde4102540 2024-05-10T10:55:41.924 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.923+0000 7fcddb7fe700 1 --2- 172.21.15.107:0/1486954692 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcdd00b2990 0x7fcdd00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:41.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.923+0000 7fcddb7fe700 1 -- 172.21.15.107:0/1486954692 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fcdd40e1d90 con 0x7fcde4102540 2024-05-10T10:55:41.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.923+0000 7fcdea205700 1 --2- 172.21.15.107:0/1486954692 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcdd00b2990 0x7fcdd00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:41.925 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.923+0000 7fcdea205700 1 --2- 172.21.15.107:0/1486954692 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcdd00b2990 0x7fcdd00b4e50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcde0000c00 tx=0x7fcde0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:41.928 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:41.927+0000 7fcddb7fe700 1 -- 172.21.15.107:0/1486954692 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fcdd4014030 con 0x7fcde4102540 2024-05-10T10:55:42.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:42.175+0000 7fcdec469700 1 -- 172.21.15.107:0/1486954692 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcde41a6a70 con 0x7fcde4102540 2024-05-10T10:55:42.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:42.176+0000 7fcddb7fe700 1 -- 172.21.15.107:0/1486954692 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11951 (secure 0 0 0) 0x7fcdd4004eb0 con 0x7fcde4102540 2024-05-10T10:55:42.177 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:55:42.177 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T10:52:17.367732+0000","modified":"2024-05-10T10:55:30.125781+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24482,"mds_1":24449,"mds_2":24442,"mds_3":24431,"mds_4":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/2332963094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":2332963094},{"type":"v1","addr":"172.21.15.107:6841","nonce":2332963094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.184:6839/16501252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":16501252},{"type":"v1","addr":"172.21.15.184:6839","nonce":16501252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24430,24431,24482,24449,24442]},"id":1}]} 2024-05-10T10:55:42.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:42.178+0000 7fcdec469700 1 -- 172.21.15.107:0/1486954692 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcdd00b2990 msgr2=0x7fcdd00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:42.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:42.178+0000 7fcdec469700 1 --2- 172.21.15.107:0/1486954692 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcdd00b2990 0x7fcdd00b4e50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcde0000c00 tx=0x7fcde0005fd0 comp rx=0 tx=0).stop 2024-05-10T10:55:42.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:42.178+0000 7fcdec469700 1 -- 172.21.15.107:0/1486954692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcde4102540 msgr2=0x7fcde419ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:42.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:42.178+0000 7fcdec469700 1 --2- 172.21.15.107:0/1486954692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcde4102540 0x7fcde419ae70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400c920 tx=0x7fcdd400cc30 comp rx=0 tx=0).stop 2024-05-10T10:55:42.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:42.178+0000 7fcdec469700 1 -- 172.21.15.107:0/1486954692 shutdown_connections 2024-05-10T10:55:42.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:42.178+0000 7fcdec469700 1 --2- 172.21.15.107:0/1486954692 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcdd00b2990 0x7fcdd00b4e50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:42.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:42.178+0000 7fcdec469700 1 --2- 172.21.15.107:0/1486954692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcde4101b80 0x7fcde419a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:42.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:42.178+0000 7fcdec469700 1 --2- 172.21.15.107:0/1486954692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcde4107be0 0x7fcde41a59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:42.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:42.178+0000 7fcdec469700 1 --2- 172.21.15.107:0/1486954692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcde4102540 0x7fcde419ae70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:42.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:42.178+0000 7fcdec469700 1 -- 172.21.15.107:0/1486954692 >> 172.21.15.107:0/1486954692 conn(0x7fcde4078a10 msgr2=0x7fcde40fff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:42.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:42.179+0000 7fcdec469700 1 -- 172.21.15.107:0/1486954692 shutdown_connections 2024-05-10T10:55:42.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:42.179+0000 7fcdec469700 1 -- 172.21.15.107:0/1486954692 wait complete. 2024-05-10T10:55:42.180 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 27 2024-05-10T10:55:42.768 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:55:43.011 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:43.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:43 smithi196 ceph-mon[34872]: pgmap v389: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T10:55:43.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:43 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1486954692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:55:43.366 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:43 smithi107 ceph-mon[30373]: pgmap v389: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T10:55:43.367 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:43 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1486954692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:55:43.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:43 smithi184 ceph-mon[34585]: pgmap v389: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T10:55:43.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:43 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1486954692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:55:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.528+0000 7f352099d640 1 -- 172.21.15.107:0/773900834 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f351c1034c0 msgr2=0x7f351c109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.528+0000 7f352099d640 1 --2- 172.21.15.107:0/773900834 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f351c1034c0 0x7f351c109d50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3514009ca0 tx=0x7f351402a8c0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.528+0000 7f352099d640 1 -- 172.21.15.107:0/773900834 shutdown_connections 2024-05-10T10:55:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.528+0000 7f352099d640 1 --2- 172.21.15.107:0/773900834 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f351c1034c0 0x7f351c109d50 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.528+0000 7f352099d640 1 --2- 172.21.15.107:0/773900834 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f351c102b00 0x7f351c102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.528+0000 7f352099d640 1 --2- 172.21.15.107:0/773900834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f351c101910 0x7f351c101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.528+0000 7f352099d640 1 -- 172.21.15.107:0/773900834 >> 172.21.15.107:0/773900834 conn(0x7f351c0fce80 msgr2=0x7f351c0ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.528+0000 7f352099d640 1 -- 172.21.15.107:0/773900834 shutdown_connections 2024-05-10T10:55:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.528+0000 7f352099d640 1 -- 172.21.15.107:0/773900834 wait complete. 2024-05-10T10:55:44.529 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.528+0000 7f352099d640 1 Processor -- start 2024-05-10T10:55:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.529+0000 7f352099d640 1 -- start start 2024-05-10T10:55:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.529+0000 7f352099d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f351c101910 0x7f351c198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.529+0000 7f352099d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f351c102b00 0x7f351c1991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.529+0000 7f352099d640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f351c1034c0 0x7f351c1a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.529+0000 7f352099d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f351c10e680 con 0x7f351c101910 2024-05-10T10:55:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.529+0000 7f352099d640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f351c10e500 con 0x7f351c102b00 2024-05-10T10:55:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.529+0000 7f352099d640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f351c10e800 con 0x7f351c1034c0 2024-05-10T10:55:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.529+0000 7f351a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f351c101910 0x7f351c198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.529+0000 7f351a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f351c101910 0x7f351c198c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53104/0 (socket says 172.21.15.107:53104) 2024-05-10T10:55:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.529+0000 7f351a59c640 1 -- 172.21.15.107:0/2574200977 learned_addr learned my addr 172.21.15.107:0/2574200977 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.529+0000 7f3511d9b640 1 --2- 172.21.15.107:0/2574200977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f351c102b00 0x7f351c1991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.529+0000 7f351ad9d640 1 --2- 172.21.15.107:0/2574200977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f351c1034c0 0x7f351c1a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.529+0000 7f351a59c640 1 -- 172.21.15.107:0/2574200977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f351c1034c0 msgr2=0x7f351c1a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.529+0000 7f351a59c640 1 --2- 172.21.15.107:0/2574200977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f351c1034c0 0x7f351c1a01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.529+0000 7f351a59c640 1 -- 172.21.15.107:0/2574200977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f351c102b00 msgr2=0x7f351c1991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.529+0000 7f351a59c640 1 --2- 172.21.15.107:0/2574200977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f351c102b00 0x7f351c1991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.529+0000 7f351a59c640 1 -- 172.21.15.107:0/2574200977 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351c1a0890 con 0x7f351c101910 2024-05-10T10:55:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.529+0000 7f351a59c640 1 --2- 172.21.15.107:0/2574200977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f351c101910 0x7f351c198c80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f350c00d770 tx=0x7f350c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.530+0000 7f3513fff640 1 -- 172.21.15.107:0/2574200977 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c017070 con 0x7f351c101910 2024-05-10T10:55:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.530+0000 7f3513fff640 1 -- 172.21.15.107:0/2574200977 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f350c009c30 con 0x7f351c101910 2024-05-10T10:55:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.530+0000 7f352099d640 1 -- 172.21.15.107:0/2574200977 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f351c1a0b80 con 0x7f351c101910 2024-05-10T10:55:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.530+0000 7f3513fff640 1 -- 172.21.15.107:0/2574200977 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c003d70 con 0x7f351c101910 2024-05-10T10:55:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.530+0000 7f352099d640 1 -- 172.21.15.107:0/2574200977 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f351c1a10d0 con 0x7f351c101910 2024-05-10T10:55:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.532+0000 7f3513fff640 1 -- 172.21.15.107:0/2574200977 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 149704+0+0 (secure 0 0 0) 0x7f350c003f10 con 0x7f351c101910 2024-05-10T10:55:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.532+0000 7f3523791740 1 Processor -- start 2024-05-10T10:55:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.532+0000 7f3523791740 1 -- start start 2024-05-10T10:55:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f3523791740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0dddb0 0x55db2a0de1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f3523791740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0de7a0 0x55db2a0e32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f3523791740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0e3910 0x55db2a0e5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f3523791740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55db2a0425d0 con 0x55db2a0dddb0 2024-05-10T10:55:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f3523791740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55db29ffb890 con 0x55db2a0e3910 2024-05-10T10:55:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f3523791740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55db2a03e590 con 0x55db2a0de7a0 2024-05-10T10:55:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f351ad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0dddb0 0x55db2a0de1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f351ad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0dddb0 0x55db2a0de1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53114/0 (socket says 172.21.15.107:53114) 2024-05-10T10:55:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f351ad9d640 1 -- 172.21.15.107:0/2754542183 learned_addr learned my addr 172.21.15.107:0/2754542183 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f3511d9b640 1 --2- 172.21.15.107:0/2754542183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0e3910 0x55db2a0e5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f351a59c640 1 --2- 172.21.15.107:0/2754542183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0de7a0 0x55db2a0e32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f351ad9d640 1 -- 172.21.15.107:0/2754542183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0de7a0 msgr2=0x55db2a0e32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f351ad9d640 1 --2- 172.21.15.107:0/2754542183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0de7a0 0x55db2a0e32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f351ad9d640 1 -- 172.21.15.107:0/2754542183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0e3910 msgr2=0x55db2a0e5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f351ad9d640 1 --2- 172.21.15.107:0/2754542183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0e3910 0x55db2a0e5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f3513fff640 1 --2- 172.21.15.107:0/2574200977 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f35080b2920 0x7f35080b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f351ad9d640 1 -- 172.21.15.107:0/2754542183 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db29d54210 con 0x55db2a0dddb0 2024-05-10T10:55:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f351a59c640 1 --2- 172.21.15.107:0/2574200977 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f35080b2920 0x7f35080b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f351ad9d640 1 --2- 172.21.15.107:0/2754542183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0dddb0 0x55db2a0de1d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3514035000 tx=0x7f35140093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08c086430c961c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f3513fff640 1 -- 172.21.15.107:0/2574200977 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f350c0e1ce0 con 0x7f351c101910 2024-05-10T10:55:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.533+0000 7f3510d99640 1 -- 172.21.15.107:0/2754542183 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3514031650 con 0x55db2a0dddb0 2024-05-10T10:55:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.534+0000 7f3510d99640 1 -- 172.21.15.107:0/2754542183 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3514036040 con 0x55db2a0dddb0 2024-05-10T10:55:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.534+0000 7f3510d99640 1 -- 172.21.15.107:0/2754542183 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35140045e0 con 0x55db2a0dddb0 2024-05-10T10:55:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.534+0000 7f3523791740 1 -- 172.21.15.107:0/2754542183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0dddb0 msgr2=0x55db2a0de1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.534+0000 7f351a59c640 1 --2- 172.21.15.107:0/2574200977 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f35080b2920 0x7f35080b4de0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55db2a0df210 tx=0x7f350c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.534+0000 7f3523791740 1 --2- 172.21.15.107:0/2754542183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0dddb0 0x55db2a0de1d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3514035000 tx=0x7f35140093e0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.534+0000 7f3523791740 1 -- 172.21.15.107:0/2754542183 shutdown_connections 2024-05-10T10:55:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.534+0000 7f3523791740 1 --2- 172.21.15.107:0/2754542183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0e3910 0x55db2a0e5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.534+0000 7f3523791740 1 --2- 172.21.15.107:0/2754542183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0de7a0 0x55db2a0e32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.534+0000 7f3523791740 1 --2- 172.21.15.107:0/2754542183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0dddb0 0x55db2a0de1d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.542 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.534+0000 7f3523791740 1 -- 172.21.15.107:0/2754542183 >> 172.21.15.107:0/2754542183 conn(0x55db2a0d9420 msgr2=0x55db2a0d9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.534+0000 7f3523791740 1 -- 172.21.15.107:0/2754542183 shutdown_connections 2024-05-10T10:55:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.534+0000 7f3523791740 1 -- 172.21.15.107:0/2754542183 wait complete. 2024-05-10T10:55:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.535+0000 7f3523791740 1 -- start start 2024-05-10T10:55:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.535+0000 7f3523791740 1 Processor -- start 2024-05-10T10:55:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.535+0000 7f3523791740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0dddb0 0x55db2a0e7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.535+0000 7f3523791740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0de7a0 0x55db2a0e8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.535+0000 7f3523791740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0e3910 0x55db2a0ef4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.535+0000 7f3523791740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55db2a0e6860 con 0x55db2a0de7a0 2024-05-10T10:55:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.535+0000 7f3523791740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55db29fff370 con 0x55db2a0e3910 2024-05-10T10:55:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.535+0000 7f3523791740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55db2a0e69e0 con 0x55db2a0dddb0 2024-05-10T10:55:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.535+0000 7f3523791740 10 client.0 _ll_register_callbacks cb 0x55db29d53a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:55:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.535+0000 7f3511d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0de7a0 0x55db2a0e8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.535+0000 7f3511d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0de7a0 0x55db2a0e8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53116/0 (socket says 172.21.15.107:53116) 2024-05-10T10:55:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.535+0000 7f3511d9b640 1 -- 172.21.15.107:0/229889570 learned_addr learned my addr 172.21.15.107:0/229889570 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:44.543 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.535+0000 7f351ad9d640 1 --2- 172.21.15.107:0/229889570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0e3910 0x55db2a0ef4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.535+0000 7f351ad9d640 1 --2- 172.21.15.107:0/229889570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0dddb0 0x55db2a0e7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.535+0000 7f3511d9b640 1 -- 172.21.15.107:0/229889570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0dddb0 msgr2=0x55db2a0e7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.535+0000 7f3511d9b640 1 --2- 172.21.15.107:0/229889570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0dddb0 0x55db2a0e7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.535+0000 7f3511d9b640 1 -- 172.21.15.107:0/229889570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0e3910 msgr2=0x55db2a0ef4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.535+0000 7f3511d9b640 1 --2- 172.21.15.107:0/229889570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0e3910 0x55db2a0ef4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.535+0000 7f3511d9b640 1 -- 172.21.15.107:0/229889570 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db29e20620 con 0x55db2a0de7a0 2024-05-10T10:55:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.536+0000 7f3511d9b640 1 --2- 172.21.15.107:0/229889570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0de7a0 0x55db2a0e8470 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f350400b990 tx=0x7f350400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48cc73ea2a6b90e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.536+0000 7f3501ffb640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:55:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.536+0000 7f3501ffb640 1 -- 172.21.15.107:0/229889570 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3504003d40 con 0x55db2a0de7a0 2024-05-10T10:55:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.536+0000 7f3501ffb640 1 -- 172.21.15.107:0/229889570 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f3504011440 con 0x55db2a0de7a0 2024-05-10T10:55:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.536+0000 7f3523791740 1 -- 172.21.15.107:0/229889570 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3514036040 con 0x55db2a0de7a0 2024-05-10T10:55:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.536+0000 7f3501ffb640 1 -- 172.21.15.107:0/229889570 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3504011640 con 0x55db2a0de7a0 2024-05-10T10:55:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.536+0000 7f3523791740 10 client.15243 fetch_fsmap learned FSMap version 27 2024-05-10T10:55:44.544 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.536+0000 7f3523791740 1 -- 172.21.15.107:0/229889570 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55db2a0f25b0 con 0x55db2a0de7a0 2024-05-10T10:55:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.536+0000 7f3501ffb640 1 -- 172.21.15.107:0/229889570 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3514036040 con 0x55db2a0de7a0 2024-05-10T10:55:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.536+0000 7f3501ffb640 1 -- 172.21.15.107:0/229889570 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f350401b900 con 0x55db2a0de7a0 2024-05-10T10:55:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.536+0000 7f3523791740 10 client.15243 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:55:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.536+0000 7f3523791740 10 client.15243 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:55:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.536+0000 7f3523791740 20 client.15243 populate_metadata read hostname 'smithi107' 2024-05-10T10:55:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.536+0000 7f3523791740 1 --2- 172.21.15.107:0/229889570 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55db2a0f3cf0 0x55db2a0f6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.536+0000 7f3523791740 4 client.15243 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:55:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.536+0000 7f3523791740 1 -- 172.21.15.107:0/229889570 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db2a0501e0 con 0x55db2a0f3cf0 2024-05-10T10:55:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.537+0000 7f351ad9d640 1 --2- 172.21.15.107:0/229889570 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55db2a0f3cf0 0x55db2a0f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.537+0000 7f351ad9d640 1 --2- 172.21.15.107:0/229889570 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55db2a0f3cf0 0x55db2a0f6130 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9db4ecf52b908cc7 server_cookie=450d3347b70fb698 in_seq=0 out_seq=0 2024-05-10T10:55:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.537+0000 7f3501ffb640 10 client.15243 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:55:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.538+0000 7f3501ffb640 1 -- 172.21.15.107:0/229889570 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55db2a0501e0 con 0x55db2a0f3cf0 2024-05-10T10:55:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.538+0000 7f3501ffb640 10 client.15243 handle_command_reply: tid=0 2024-05-10T10:55:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.538+0000 7f3523791740 1 client.15243 shutdown 2024-05-10T10:55:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.538+0000 7f3523791740 1 -- 172.21.15.107:0/229889570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0de7a0 msgr2=0x55db2a0e8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.538+0000 7f3523791740 1 --2- 172.21.15.107:0/229889570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0de7a0 0x55db2a0e8470 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f350400b990 tx=0x7f350400be50 comp rx=0 tx=0).stop 2024-05-10T10:55:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.538+0000 7f3523791740 1 -- 172.21.15.107:0/229889570 shutdown_connections 2024-05-10T10:55:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.538+0000 7f3523791740 1 --2- 172.21.15.107:0/229889570 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55db2a0f3cf0 0x55db2a0f6130 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.538+0000 7f3523791740 1 --2- 172.21.15.107:0/229889570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0e3910 0x55db2a0ef4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.538+0000 7f3523791740 1 --2- 172.21.15.107:0/229889570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0de7a0 0x55db2a0e8470 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.538+0000 7f3523791740 1 --2- 172.21.15.107:0/229889570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0dddb0 0x55db2a0e7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.538+0000 7f3501ffb640 0 client.15243 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:55:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.538+0000 7f3523791740 1 -- 172.21.15.107:0/229889570 >> 172.21.15.107:0/229889570 conn(0x55db2a0d9420 msgr2=0x55db2a0d8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.538+0000 7f3523791740 1 -- 172.21.15.107:0/229889570 shutdown_connections 2024-05-10T10:55:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.538+0000 7f3523791740 1 -- 172.21.15.107:0/229889570 wait complete. 2024-05-10T10:55:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.538+0000 7f3523791740 20 client.15243 trim_cache size 0 max 16384 2024-05-10T10:55:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.553+0000 7f3523791740 1 Processor -- start 2024-05-10T10:55:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.553+0000 7f3523791740 1 -- start start 2024-05-10T10:55:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.553+0000 7f3523791740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0dddb0 0x55db2a0dc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.553+0000 7f3523791740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0de7a0 0x55db2a0ef470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.553+0000 7f3523791740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0e3910 0x55db2a0dc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.553+0000 7f3523791740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f351c1a9d60 con 0x55db2a0dddb0 2024-05-10T10:55:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.553+0000 7f3523791740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f351c1ab8a0 con 0x55db2a0de7a0 2024-05-10T10:55:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.553+0000 7f3523791740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f351c1aa430 con 0x55db2a0e3910 2024-05-10T10:55:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.553+0000 7f351ad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0dddb0 0x55db2a0dc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.553+0000 7f351ad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0dddb0 0x55db2a0dc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53128/0 (socket says 172.21.15.107:53128) 2024-05-10T10:55:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.553+0000 7f351ad9d640 1 -- 172.21.15.107:0/3564887649 learned_addr learned my addr 172.21.15.107:0/3564887649 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.553+0000 7f3511d9b640 1 --2- 172.21.15.107:0/3564887649 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0de7a0 0x55db2a0ef470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.553+0000 7f351ad9d640 1 --2- 172.21.15.107:0/3564887649 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0e3910 0x55db2a0dc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.553+0000 7f351ad9d640 1 -- 172.21.15.107:0/3564887649 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0e3910 msgr2=0x55db2a0dc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.553+0000 7f351ad9d640 1 --2- 172.21.15.107:0/3564887649 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0e3910 0x55db2a0dc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.553+0000 7f351ad9d640 1 -- 172.21.15.107:0/3564887649 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0de7a0 msgr2=0x55db2a0ef470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.553+0000 7f351ad9d640 1 --2- 172.21.15.107:0/3564887649 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0de7a0 0x55db2a0ef470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.553+0000 7f351ad9d640 1 -- 172.21.15.107:0/3564887649 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db2a0e7350 con 0x55db2a0dddb0 2024-05-10T10:55:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.553+0000 7f351ad9d640 1 --2- 172.21.15.107:0/3564887649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0dddb0 0x55db2a0dc100 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f351402c010 tx=0x7f3514031b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a4a13ef81d5127 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.554+0000 7f3503fff640 1 -- 172.21.15.107:0/3564887649 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351404a040 con 0x55db2a0dddb0 2024-05-10T10:55:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.554+0000 7f3503fff640 1 -- 172.21.15.107:0/3564887649 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3514036070 con 0x55db2a0dddb0 2024-05-10T10:55:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.554+0000 7f3503fff640 1 -- 172.21.15.107:0/3564887649 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351402f660 con 0x55db2a0dddb0 2024-05-10T10:55:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.554+0000 7f3523791740 1 -- 172.21.15.107:0/3564887649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0dddb0 msgr2=0x55db2a0dc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.554+0000 7f3523791740 1 --2- 172.21.15.107:0/3564887649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0dddb0 0x55db2a0dc100 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f351402c010 tx=0x7f3514031b40 comp rx=0 tx=0).stop 2024-05-10T10:55:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.554+0000 7f3523791740 1 -- 172.21.15.107:0/3564887649 shutdown_connections 2024-05-10T10:55:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.554+0000 7f3523791740 1 --2- 172.21.15.107:0/3564887649 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0e3910 0x55db2a0dc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.554+0000 7f3523791740 1 --2- 172.21.15.107:0/3564887649 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0de7a0 0x55db2a0ef470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.554+0000 7f3523791740 1 --2- 172.21.15.107:0/3564887649 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0dddb0 0x55db2a0dc100 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.554+0000 7f3523791740 1 -- 172.21.15.107:0/3564887649 >> 172.21.15.107:0/3564887649 conn(0x55db2a0d9420 msgr2=0x55db2a0df980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.554+0000 7f3523791740 1 -- 172.21.15.107:0/3564887649 shutdown_connections 2024-05-10T10:55:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.554+0000 7f3523791740 1 -- 172.21.15.107:0/3564887649 wait complete. 2024-05-10T10:55:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.554+0000 7f3523791740 1 -- start start 2024-05-10T10:55:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f3523791740 1 Processor -- start 2024-05-10T10:55:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f3523791740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0dddb0 0x55db2a0ec900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f3523791740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0de7a0 0x55db2a0ece40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f3523791740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0e3910 0x55db2a0ede50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f3523791740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f351c1ab1d0 con 0x55db2a0e3910 2024-05-10T10:55:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f3523791740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f351c1aab00 con 0x55db2a0dddb0 2024-05-10T10:55:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f3523791740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f351c1a7d40 con 0x55db2a0de7a0 2024-05-10T10:55:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f3523791740 10 client.0 _ll_register_callbacks cb 0x7f35040041d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:55:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f351ad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0e3910 0x55db2a0ede50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f351ad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0e3910 0x55db2a0ede50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53136/0 (socket says 172.21.15.107:53136) 2024-05-10T10:55:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f351ad9d640 1 -- 172.21.15.107:0/740717698 learned_addr learned my addr 172.21.15.107:0/740717698 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f351ad9d640 1 --2- 172.21.15.107:0/740717698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0dddb0 0x55db2a0ec900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f3511d9b640 1 --2- 172.21.15.107:0/740717698 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0de7a0 0x55db2a0ece40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f351ad9d640 1 -- 172.21.15.107:0/740717698 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0de7a0 msgr2=0x55db2a0ece40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f351ad9d640 1 --2- 172.21.15.107:0/740717698 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0de7a0 0x55db2a0ece40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f351ad9d640 1 -- 172.21.15.107:0/740717698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0dddb0 msgr2=0x55db2a0ec900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f351ad9d640 1 --2- 172.21.15.107:0/740717698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0dddb0 0x55db2a0ec900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f351ad9d640 1 -- 172.21.15.107:0/740717698 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db2a0ee440 con 0x55db2a0e3910 2024-05-10T10:55:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f351ad9d640 1 --2- 172.21.15.107:0/740717698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0e3910 0x55db2a0ede50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3514006010 tx=0x7f351402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c84fefd2cef87d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f3501ffb640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:55:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.555+0000 7f3501ffb640 1 -- 172.21.15.107:0/740717698 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3514031590 con 0x55db2a0e3910 2024-05-10T10:55:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.556+0000 7f3501ffb640 1 -- 172.21.15.107:0/740717698 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f3514031730 con 0x55db2a0e3910 2024-05-10T10:55:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.556+0000 7f3523791740 1 -- 172.21.15.107:0/740717698 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3514036070 con 0x55db2a0e3910 2024-05-10T10:55:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.556+0000 7f3501ffb640 1 -- 172.21.15.107:0/740717698 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3514004b40 con 0x55db2a0e3910 2024-05-10T10:55:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.556+0000 7f3523791740 10 client.15249 fetch_fsmap learned FSMap version 27 2024-05-10T10:55:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.556+0000 7f3523791740 1 -- 172.21.15.107:0/740717698 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55db2a0ef750 con 0x55db2a0e3910 2024-05-10T10:55:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.556+0000 7f3501ffb640 1 -- 172.21.15.107:0/740717698 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3514036070 con 0x55db2a0e3910 2024-05-10T10:55:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.556+0000 7f3501ffb640 1 -- 172.21.15.107:0/740717698 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3514050040 con 0x55db2a0e3910 2024-05-10T10:55:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.556+0000 7f3523791740 10 client.15249 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:55:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.556+0000 7f3523791740 10 client.15249 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:55:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.556+0000 7f3523791740 20 client.15249 populate_metadata read hostname 'smithi107' 2024-05-10T10:55:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.556+0000 7f3523791740 1 --2- 172.21.15.107:0/740717698 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55db2a15e870 0x55db2a160c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.556+0000 7f3523791740 4 client.15249 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T10:55:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.556+0000 7f3523791740 1 -- 172.21.15.107:0/740717698 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55db2a04a050 con 0x55db2a15e870 2024-05-10T10:55:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.556+0000 7f3511d9b640 1 --2- 172.21.15.107:0/740717698 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55db2a15e870 0x55db2a160c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.557+0000 7f3501ffb640 10 client.15249 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:55:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.557+0000 7f3511d9b640 1 --2- 172.21.15.107:0/740717698 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55db2a15e870 0x55db2a160c60 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=594257a9400a75a7 server_cookie=61f47b646bd248a in_seq=0 out_seq=0 2024-05-10T10:55:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.568+0000 7f3501ffb640 1 -- 172.21.15.107:0/740717698 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55db2a04a050 con 0x55db2a15e870 2024-05-10T10:55:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.568+0000 7f3501ffb640 10 client.15249 handle_command_reply: tid=0 2024-05-10T10:55:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.568+0000 7f3523791740 1 client.15249 shutdown 2024-05-10T10:55:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.568+0000 7f3523791740 1 -- 172.21.15.107:0/740717698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0e3910 msgr2=0x55db2a0ede50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.568+0000 7f3523791740 1 --2- 172.21.15.107:0/740717698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0e3910 0x55db2a0ede50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3514006010 tx=0x7f351402a8c0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.569 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.568+0000 7f3523791740 1 -- 172.21.15.107:0/740717698 shutdown_connections 2024-05-10T10:55:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.568+0000 7f3523791740 1 --2- 172.21.15.107:0/740717698 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55db2a15e870 0x55db2a160c60 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.568+0000 7f3523791740 1 --2- 172.21.15.107:0/740717698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55db2a0e3910 0x55db2a0ede50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.568+0000 7f3523791740 1 --2- 172.21.15.107:0/740717698 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55db2a0de7a0 0x55db2a0ece40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.568+0000 7f3501ffb640 0 client.15249 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:55:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.568+0000 7f3523791740 1 --2- 172.21.15.107:0/740717698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55db2a0dddb0 0x55db2a0ec900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.568+0000 7f3523791740 1 -- 172.21.15.107:0/740717698 >> 172.21.15.107:0/740717698 conn(0x55db2a0d9420 msgr2=0x55db2a0dc100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.568+0000 7f3523791740 1 -- 172.21.15.107:0/740717698 shutdown_connections 2024-05-10T10:55:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.569+0000 7f3523791740 1 -- 172.21.15.107:0/740717698 wait complete. 2024-05-10T10:55:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.569+0000 7f3523791740 20 client.15249 trim_cache size 0 max 16384 2024-05-10T10:55:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:{ 2024-05-10T10:55:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "message": "", 2024-05-10T10:55:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "return_code": 0 2024-05-10T10:55:44.571 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:} 2024-05-10T10:55:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.569+0000 7f352099d640 1 -- 172.21.15.107:0/2574200977 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f35080b2920 msgr2=0x7f35080b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.569+0000 7f352099d640 1 --2- 172.21.15.107:0/2574200977 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f35080b2920 0x7f35080b4de0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55db2a0df210 tx=0x7f350c000bc0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.569+0000 7f352099d640 1 -- 172.21.15.107:0/2574200977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f351c101910 msgr2=0x7f351c198c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.569+0000 7f352099d640 1 --2- 172.21.15.107:0/2574200977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f351c101910 0x7f351c198c80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f350c00d770 tx=0x7f350c00dc30 comp rx=0 tx=0).stop 2024-05-10T10:55:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.569+0000 7f352099d640 1 -- 172.21.15.107:0/2574200977 shutdown_connections 2024-05-10T10:55:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.569+0000 7f352099d640 1 --2- 172.21.15.107:0/2574200977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f351c1034c0 0x7f351c1a01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.569+0000 7f352099d640 1 --2- 172.21.15.107:0/2574200977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f351c102b00 0x7f351c1991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.569+0000 7f352099d640 1 --2- 172.21.15.107:0/2574200977 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f35080b2920 0x7f35080b4de0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.569+0000 7f352099d640 1 --2- 172.21.15.107:0/2574200977 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f351c101910 0x7f351c198c80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.569+0000 7f352099d640 1 -- 172.21.15.107:0/2574200977 >> 172.21.15.107:0/2574200977 conn(0x7f351c0fce80 msgr2=0x7f351c105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.569+0000 7f352099d640 1 -- 172.21.15.107:0/2574200977 shutdown_connections 2024-05-10T10:55:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:44.569+0000 7f352099d640 1 -- 172.21.15.107:0/2574200977 wait complete. 2024-05-10T10:55:44.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.675+0000 7fb509241700 1 -- 172.21.15.107:0/2101871172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb504108410 msgr2=0x7fb5041087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:44.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.675+0000 7fb509241700 1 --2- 172.21.15.107:0/2101871172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb504108410 0x7fb5041087f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009990 tx=0x7fb4f4009ca0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.675+0000 7fb509241700 1 -- 172.21.15.107:0/2101871172 shutdown_connections 2024-05-10T10:55:44.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.675+0000 7fb509241700 1 --2- 172.21.15.107:0/2101871172 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb504102d60 0x7fb50410f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.675+0000 7fb509241700 1 --2- 172.21.15.107:0/2101871172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb504108410 0x7fb5041087f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.675+0000 7fb509241700 1 --2- 172.21.15.107:0/2101871172 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb5041023a0 0x7fb504102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.675+0000 7fb509241700 1 -- 172.21.15.107:0/2101871172 >> 172.21.15.107:0/2101871172 conn(0x7fb504079350 msgr2=0x7fb504079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:44.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.675+0000 7fb509241700 1 -- 172.21.15.107:0/2101871172 shutdown_connections 2024-05-10T10:55:44.676 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.675+0000 7fb509241700 1 -- 172.21.15.107:0/2101871172 wait complete. 2024-05-10T10:55:44.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.676+0000 7fb509241700 1 Processor -- start 2024-05-10T10:55:44.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.676+0000 7fb509241700 1 -- start start 2024-05-10T10:55:44.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.676+0000 7fb509241700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb5041023a0 0x7fb50419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.676+0000 7fb509241700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb504102d60 0x7fb50419afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.678 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.676+0000 7fb509241700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb504108410 0x7fb5041a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.676+0000 7fb509241700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb504112690 con 0x7fb504108410 2024-05-10T10:55:44.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.676+0000 7fb509241700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb504112510 con 0x7fb504102d60 2024-05-10T10:55:44.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.676+0000 7fb509241700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb504112810 con 0x7fb5041023a0 2024-05-10T10:55:44.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.676+0000 7fb50359e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb504108410 0x7fb5041a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.676+0000 7fb50359e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb504108410 0x7fb5041a5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:53154/0 (socket says 172.21.15.107:53154) 2024-05-10T10:55:44.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.676+0000 7fb50359e700 1 -- 172.21.15.107:0/1235788537 learned_addr learned my addr 172.21.15.107:0/1235788537 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:44.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.676+0000 7fb4fbfff700 1 --2- 172.21.15.107:0/1235788537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb504102d60 0x7fb50419afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.676+0000 7fb502d9d700 1 --2- 172.21.15.107:0/1235788537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb5041023a0 0x7fb50419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.677+0000 7fb50359e700 1 -- 172.21.15.107:0/1235788537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb5041023a0 msgr2=0x7fb50419aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:44.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.677+0000 7fb50359e700 1 --2- 172.21.15.107:0/1235788537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb5041023a0 0x7fb50419aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.677+0000 7fb50359e700 1 -- 172.21.15.107:0/1235788537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb504102d60 msgr2=0x7fb50419afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:44.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.677+0000 7fb50359e700 1 --2- 172.21.15.107:0/1235788537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb504102d60 0x7fb50419afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.677+0000 7fb50359e700 1 -- 172.21.15.107:0/1235788537 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5041a6030 con 0x7fb504108410 2024-05-10T10:55:44.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.677+0000 7fb50359e700 1 --2- 172.21.15.107:0/1235788537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb504108410 0x7fb5041a5af0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc007ee0 tx=0x7fb4fc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:44.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.677+0000 7fb500d99700 1 -- 172.21.15.107:0/1235788537 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc004bb0 con 0x7fb504108410 2024-05-10T10:55:44.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.677+0000 7fb509241700 1 -- 172.21.15.107:0/1235788537 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5041988c0 con 0x7fb504108410 2024-05-10T10:55:44.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.677+0000 7fb500d99700 1 -- 172.21.15.107:0/1235788537 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb4fc004d50 con 0x7fb504108410 2024-05-10T10:55:44.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.677+0000 7fb500d99700 1 -- 172.21.15.107:0/1235788537 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc0059e0 con 0x7fb504108410 2024-05-10T10:55:44.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.677+0000 7fb509241700 1 -- 172.21.15.107:0/1235788537 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb504198e50 con 0x7fb504108410 2024-05-10T10:55:44.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.678+0000 7fb509241700 1 -- 172.21.15.107:0/1235788537 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb50406a190 con 0x7fb504108410 2024-05-10T10:55:44.680 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.680+0000 7fb500d99700 1 -- 172.21.15.107:0/1235788537 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 149704+0+0 (secure 0 0 0) 0x7fb4fc01a020 con 0x7fb504108410 2024-05-10T10:55:44.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.681+0000 7fb500d99700 1 --2- 172.21.15.107:0/1235788537 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4f00b2910 0x7fb4f00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:44.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.681+0000 7fb502d9d700 1 --2- 172.21.15.107:0/1235788537 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4f00b2910 0x7fb4f00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:44.681 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.681+0000 7fb500d99700 1 -- 172.21.15.107:0/1235788537 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fb4fc0e1ed0 con 0x7fb504108410 2024-05-10T10:55:44.682 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.681+0000 7fb502d9d700 1 --2- 172.21.15.107:0/1235788537 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4f00b2910 0x7fb4f00b4dd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400b5c0 tx=0x7fb4f4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:44.685 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.685+0000 7fb500d99700 1 -- 172.21.15.107:0/1235788537 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb4fc010070 con 0x7fb504108410 2024-05-10T10:55:44.933 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.933+0000 7fb509241700 1 -- 172.21.15.107:0/1235788537 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb50402e510 con 0x7fb504108410 2024-05-10T10:55:44.934 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.933+0000 7fb500d99700 1 -- 172.21.15.107:0/1235788537 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11951 (secure 0 0 0) 0x7fb4fc0a9b90 con 0x7fb504108410 2024-05-10T10:55:44.934 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:55:44.934 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T10:52:17.367732+0000","modified":"2024-05-10T10:55:30.125781+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24482,"mds_1":24449,"mds_2":24442,"mds_3":24431,"mds_4":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/2332963094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":2332963094},{"type":"v1","addr":"172.21.15.107:6841","nonce":2332963094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.184:6839/16501252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":16501252},{"type":"v1","addr":"172.21.15.184:6839","nonce":16501252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24430,24431,24482,24449,24442]},"id":1}]} 2024-05-10T10:55:44.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.936+0000 7fb509241700 1 -- 172.21.15.107:0/1235788537 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4f00b2910 msgr2=0x7fb4f00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:44.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.936+0000 7fb509241700 1 --2- 172.21.15.107:0/1235788537 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4f00b2910 0x7fb4f00b4dd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400b5c0 tx=0x7fb4f4005960 comp rx=0 tx=0).stop 2024-05-10T10:55:44.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.936+0000 7fb509241700 1 -- 172.21.15.107:0/1235788537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb504108410 msgr2=0x7fb5041a5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:44.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.936+0000 7fb509241700 1 --2- 172.21.15.107:0/1235788537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb504108410 0x7fb5041a5af0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc007ee0 tx=0x7fb4fc00d3b0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.936+0000 7fb509241700 1 -- 172.21.15.107:0/1235788537 shutdown_connections 2024-05-10T10:55:44.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.936+0000 7fb509241700 1 --2- 172.21.15.107:0/1235788537 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4f00b2910 0x7fb4f00b4dd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.936+0000 7fb509241700 1 --2- 172.21.15.107:0/1235788537 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb5041023a0 0x7fb50419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.936+0000 7fb509241700 1 --2- 172.21.15.107:0/1235788537 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb504108410 0x7fb5041a5af0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.936+0000 7fb509241700 1 --2- 172.21.15.107:0/1235788537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb504102d60 0x7fb50419afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:44.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.936+0000 7fb509241700 1 -- 172.21.15.107:0/1235788537 >> 172.21.15.107:0/1235788537 conn(0x7fb504079350 msgr2=0x7fb504100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:44.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.936+0000 7fb509241700 1 -- 172.21.15.107:0/1235788537 shutdown_connections 2024-05-10T10:55:44.937 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:44.936+0000 7fb509241700 1 -- 172.21.15.107:0/1235788537 wait complete. 2024-05-10T10:55:44.938 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 27 2024-05-10T10:55:45.310 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:45 smithi107 ceph-mon[30373]: pgmap v390: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-05-10T10:55:45.310 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:45 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1235788537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:55:45.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:45 smithi196 ceph-mon[34872]: pgmap v390: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-05-10T10:55:45.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:45 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1235788537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:55:45.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:45 smithi184 ceph-mon[34585]: pgmap v390: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-05-10T10:55:45.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:45 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1235788537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:55:45.639 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-10T10:55:45.884 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:47.271 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:47 smithi107 ceph-mon[30373]: pgmap v391: 97 pgs: 97 active+clean; 659 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-05-10T10:55:47.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:47 smithi196 ceph-mon[34872]: pgmap v391: 97 pgs: 97 active+clean; 659 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-05-10T10:55:47.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:47 smithi184 ceph-mon[34585]: pgmap v391: 97 pgs: 97 active+clean; 659 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-05-10T10:55:47.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.531+0000 7f8bfbc69700 1 -- 172.21.15.107:0/3573791259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bf41056e0 msgr2=0x7f8bf4105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:47.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.531+0000 7f8bfbc69700 1 --2- 172.21.15.107:0/3573791259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bf41056e0 0x7f8bf4105b60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009990 tx=0x7f8be4009ca0 comp rx=0 tx=0).stop 2024-05-10T10:55:47.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.531+0000 7f8bfbc69700 1 -- 172.21.15.107:0/3573791259 shutdown_connections 2024-05-10T10:55:47.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.531+0000 7f8bfbc69700 1 --2- 172.21.15.107:0/3573791259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bf41060a0 0x7f8bf41125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:47.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.531+0000 7f8bfbc69700 1 --2- 172.21.15.107:0/3573791259 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bf410b6e0 0x7f8bf410bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:47.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.531+0000 7f8bfbc69700 1 --2- 172.21.15.107:0/3573791259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bf41056e0 0x7f8bf4105b60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:47.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.531+0000 7f8bfbc69700 1 -- 172.21.15.107:0/3573791259 >> 172.21.15.107:0/3573791259 conn(0x7f8bf41011d0 msgr2=0x7f8bf41035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:47.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.531+0000 7f8bfbc69700 1 -- 172.21.15.107:0/3573791259 shutdown_connections 2024-05-10T10:55:47.532 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.531+0000 7f8bfbc69700 1 -- 172.21.15.107:0/3573791259 wait complete. 2024-05-10T10:55:47.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bfbc69700 1 Processor -- start 2024-05-10T10:55:47.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bfbc69700 1 -- start start 2024-05-10T10:55:47.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bfbc69700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bf41056e0 0x7f8bf419bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:47.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bfbc69700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bf41060a0 0x7f8bf419c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:47.534 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bfbc69700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bf410b6e0 0x7f8bf41a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:47.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bfbc69700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf4115a00 con 0x7f8bf410b6e0 2024-05-10T10:55:47.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bfbc69700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf4115880 con 0x7f8bf41060a0 2024-05-10T10:55:47.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bfbc69700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf4115b80 con 0x7f8bf41056e0 2024-05-10T10:55:47.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bfa206700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bf410b6e0 0x7f8bf41a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:47.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bfa206700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bf410b6e0 0x7f8bf41a0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44566/0 (socket says 172.21.15.107:44566) 2024-05-10T10:55:47.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bfa206700 1 -- 172.21.15.107:0/1389904200 learned_addr learned my addr 172.21.15.107:0/1389904200 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:47.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bf9204700 1 --2- 172.21.15.107:0/1389904200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bf41060a0 0x7f8bf419c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:47.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bf9a05700 1 --2- 172.21.15.107:0/1389904200 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bf41056e0 0x7f8bf419bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:47.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bfa206700 1 -- 172.21.15.107:0/1389904200 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bf41056e0 msgr2=0x7f8bf419bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:47.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bfa206700 1 --2- 172.21.15.107:0/1389904200 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bf41056e0 0x7f8bf419bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:47.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bfa206700 1 -- 172.21.15.107:0/1389904200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bf41060a0 msgr2=0x7f8bf419c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:47.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bfa206700 1 --2- 172.21.15.107:0/1389904200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bf41060a0 0x7f8bf419c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:47.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bfa206700 1 -- 172.21.15.107:0/1389904200 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf41a0e90 con 0x7f8bf410b6e0 2024-05-10T10:55:47.535 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bf9a05700 1 --2- 172.21.15.107:0/1389904200 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bf41056e0 0x7f8bf419bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:55:47.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.532+0000 7f8bfa206700 1 --2- 172.21.15.107:0/1389904200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bf410b6e0 0x7f8bf41a0750 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00ef30 tx=0x7f8bec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:47.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.533+0000 7f8beaffd700 1 -- 172.21.15.107:0/1389904200 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec0092e0 con 0x7f8bf410b6e0 2024-05-10T10:55:47.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.533+0000 7f8beaffd700 1 -- 172.21.15.107:0/1389904200 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8bec004bb0 con 0x7f8bf410b6e0 2024-05-10T10:55:47.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.533+0000 7f8bfbc69700 1 -- 172.21.15.107:0/1389904200 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf41a1120 con 0x7f8bf410b6e0 2024-05-10T10:55:47.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.533+0000 7f8beaffd700 1 -- 172.21.15.107:0/1389904200 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec004280 con 0x7f8bf410b6e0 2024-05-10T10:55:47.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.533+0000 7f8bfbc69700 1 -- 172.21.15.107:0/1389904200 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf41a8a00 con 0x7f8bf410b6e0 2024-05-10T10:55:47.536 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.534+0000 7f8bfbc69700 1 -- 172.21.15.107:0/1389904200 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf406a190 con 0x7f8bf410b6e0 2024-05-10T10:55:47.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.535+0000 7f8beaffd700 1 -- 172.21.15.107:0/1389904200 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 149704+0+0 (secure 0 0 0) 0x7f8bec01b030 con 0x7f8bf410b6e0 2024-05-10T10:55:47.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.536+0000 7f8beaffd700 1 --2- 172.21.15.107:0/1389904200 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8be00b2910 0x7f8be00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:47.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.536+0000 7f8bf9a05700 1 --2- 172.21.15.107:0/1389904200 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8be00b2910 0x7f8be00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:47.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.536+0000 7f8beaffd700 1 -- 172.21.15.107:0/1389904200 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f8bec0e27d0 con 0x7f8bf410b6e0 2024-05-10T10:55:47.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.536+0000 7f8bf9a05700 1 --2- 172.21.15.107:0/1389904200 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8be00b2910 0x7f8be00b4dd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0005e90 tx=0x7f8bf0005d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:47.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.539+0000 7f8beaffd700 1 -- 172.21.15.107:0/1389904200 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8bec022020 con 0x7f8bf410b6e0 2024-05-10T10:55:47.743 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.742+0000 7f8bfbc69700 1 -- 172.21.15.107:0/1389904200 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8bf402e510 con 0x7f8bf410b6e0 2024-05-10T10:55:47.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.743+0000 7f8beaffd700 1 -- 172.21.15.107:0/1389904200 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22560 (secure 0 0 0) 0x7f8bec010040 con 0x7f8bf410b6e0 2024-05-10T10:55:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:55:47.744 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":82,"fsid":"0ba8a8e4-0eba-11ef-bc98-c7b262605968","created":"2024-05-10T10:44:13.064379+0000","modified":"2024-05-10T10:53:08.899432+0000","last_up_change":"2024-05-10T10:51:12.979718+0000","last_in_change":"2024-05-10T10:50:53.297651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T10:47:31.600062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T10:52:10.705022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T10:52:14.377732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"503f960c-a74b-4979-9bf9-42c90a2885a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6803","nonce":4213004004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6805","nonce":4213004004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6809","nonce":4213004004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6807","nonce":4213004004}]},"public_addr":"172.21.15.107:6803/4213004004","cluster_addr":"172.21.15.107:6805/4213004004","heartbeat_back_addr":"172.21.15.107:6809/4213004004","heartbeat_front_addr":"172.21.15.107:6807/4213004004","state":["exists","up"]},{"osd":1,"uuid":"f0f89167-1aa1-40a1-b122-c7f203c587d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6801","nonce":3242825160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6803","nonce":3242825160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6807","nonce":3242825160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6805","nonce":3242825160}]},"public_addr":"172.21.15.184:6801/3242825160","cluster_addr":"172.21.15.184:6803/3242825160","heartbeat_back_addr":"172.21.15.184:6807/3242825160","heartbeat_front_addr":"172.21.15.184:6805/3242825160","state":["exists","up"]},{"osd":2,"uuid":"7588b9be-b935-450a-944f-3feca69c029c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6801","nonce":137473043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6803","nonce":137473043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6807","nonce":137473043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6805","nonce":137473043}]},"public_addr":"172.21.15.196:6801/137473043","cluster_addr":"172.21.15.196:6803/137473043","heartbeat_back_addr":"172.21.15.196:6807/137473043","heartbeat_front_addr":"172.21.15.196:6805/137473043","state":["exists","up"]},{"osd":3,"uuid":"589ec3bb-884a-4441-a9d2-1f34ab372cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6811","nonce":1995642021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6813","nonce":1995642021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6817","nonce":1995642021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6815","nonce":1995642021}]},"public_addr":"172.21.15.107:6811/1995642021","cluster_addr":"172.21.15.107:6813/1995642021","heartbeat_back_addr":"172.21.15.107:6817/1995642021","heartbeat_front_addr":"172.21.15.107:6815/1995642021","state":["exists","up"]},{"osd":4,"uuid":"b72cdb50-492b-4406-8f21-37e4b2cf5a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6809","nonce":271550329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6811","nonce":271550329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6815","nonce":271550329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6813","nonce":271550329}]},"public_addr":"172.21.15.184:6809/271550329","cluster_addr":"172.21.15.184:6811/271550329","heartbeat_back_addr":"172.21.15.184:6815/271550329","heartbeat_front_addr":"172.21.15.184:6813/271550329","state":["exists","up"]},{"osd":5,"uuid":"05b6ad82-9153-44df-ae64-50c82d304429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6809","nonce":3681130435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6811","nonce":3681130435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6815","nonce":3681130435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6813","nonce":3681130435}]},"public_addr":"172.21.15.196:6809/3681130435","cluster_addr":"172.21.15.196:6811/3681130435","heartbeat_back_addr":"172.21.15.196:6815/3681130435","heartbeat_front_addr":"172.21.15.196:6813/3681130435","state":["exists","up"]},{"osd":6,"uuid":"bceadd7a-20bf-4482-aaab-46a2539cf37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6819","nonce":4223253757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6821","nonce":4223253757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6825","nonce":4223253757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6823","nonce":4223253757}]},"public_addr":"172.21.15.107:6819/4223253757","cluster_addr":"172.21.15.107:6821/4223253757","heartbeat_back_addr":"172.21.15.107:6825/4223253757","heartbeat_front_addr":"172.21.15.107:6823/4223253757","state":["exists","up"]},{"osd":7,"uuid":"0d9243a6-0e16-4677-a0b0-010be4162148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6817","nonce":2850715284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6819","nonce":2850715284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6823","nonce":2850715284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6821","nonce":2850715284}]},"public_addr":"172.21.15.184:6817/2850715284","cluster_addr":"172.21.15.184:6819/2850715284","heartbeat_back_addr":"172.21.15.184:6823/2850715284","heartbeat_front_addr":"172.21.15.184:6821/2850715284","state":["exists","up"]},{"osd":8,"uuid":"24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6817","nonce":504426486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6819","nonce":504426486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6823","nonce":504426486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6821","nonce":504426486}]},"public_addr":"172.21.15.196:6817/504426486","cluster_addr":"172.21.15.196:6819/504426486","heartbeat_back_addr":"172.21.15.196:6823/504426486","heartbeat_front_addr":"172.21.15.196:6821/504426486","state":["exists","up"]},{"osd":9,"uuid":"8bcb03ec-1342-4679-9343-fcefd28dd69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6827","nonce":1533051760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6829","nonce":1533051760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6833","nonce":1533051760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6831","nonce":1533051760}]},"public_addr":"172.21.15.107:6827/1533051760","cluster_addr":"172.21.15.107:6829/1533051760","heartbeat_back_addr":"172.21.15.107:6833/1533051760","heartbeat_front_addr":"172.21.15.107:6831/1533051760","state":["exists","up"]},{"osd":10,"uuid":"78374015-aa7f-4288-b5ae-be64a5182bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6825","nonce":1387541139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6827","nonce":1387541139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6831","nonce":1387541139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6829","nonce":1387541139}]},"public_addr":"172.21.15.184:6825/1387541139","cluster_addr":"172.21.15.184:6827/1387541139","heartbeat_back_addr":"172.21.15.184:6831/1387541139","heartbeat_front_addr":"172.21.15.184:6829/1387541139","state":["exists","up"]},{"osd":11,"uuid":"4aeb2b1a-f35e-44ea-be64-f60c31a096e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6825","nonce":3861964533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6827","nonce":3861964533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6831","nonce":3861964533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6829","nonce":3861964533}]},"public_addr":"172.21.15.196:6825/3861964533","cluster_addr":"172.21.15.196:6827/3861964533","heartbeat_back_addr":"172.21.15.196:6831/3861964533","heartbeat_front_addr":"172.21.15.196:6829/3861964533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:46:42.110232+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:06.232727+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:29.623425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:53.466546+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:17.927564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:41.913454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:06.610629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:31.048807+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:54.922097+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:20.727547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:46.072303+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:51:11.022775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:0/3518338734":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/4092342993":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6800/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:6800/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3761740075":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/2215024983":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/2124974715":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3361930986":"2024-05-11T10:44:40.339608+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T10:55:47.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.746+0000 7f8bfbc69700 1 -- 172.21.15.107:0/1389904200 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8be00b2910 msgr2=0x7f8be00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:47.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.746+0000 7f8bfbc69700 1 --2- 172.21.15.107:0/1389904200 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8be00b2910 0x7f8be00b4dd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0005e90 tx=0x7f8bf0005d20 comp rx=0 tx=0).stop 2024-05-10T10:55:47.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.746+0000 7f8bfbc69700 1 -- 172.21.15.107:0/1389904200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bf410b6e0 msgr2=0x7f8bf41a0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:47.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.746+0000 7f8bfbc69700 1 --2- 172.21.15.107:0/1389904200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bf410b6e0 0x7f8bf41a0750 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00ef30 tx=0x7f8bec00c3a0 comp rx=0 tx=0).stop 2024-05-10T10:55:47.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.746+0000 7f8bfbc69700 1 -- 172.21.15.107:0/1389904200 shutdown_connections 2024-05-10T10:55:47.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.746+0000 7f8bfbc69700 1 --2- 172.21.15.107:0/1389904200 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8be00b2910 0x7f8be00b4dd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:47.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.746+0000 7f8bfbc69700 1 --2- 172.21.15.107:0/1389904200 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8bf41056e0 0x7f8bf419bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:47.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.746+0000 7f8bfbc69700 1 --2- 172.21.15.107:0/1389904200 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8bf410b6e0 0x7f8bf41a0750 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:47.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.746+0000 7f8bfbc69700 1 --2- 172.21.15.107:0/1389904200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bf41060a0 0x7f8bf419c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:47.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.746+0000 7f8bfbc69700 1 -- 172.21.15.107:0/1389904200 >> 172.21.15.107:0/1389904200 conn(0x7f8bf41011d0 msgr2=0x7f8bf4101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:47.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.746+0000 7f8bfbc69700 1 -- 172.21.15.107:0/1389904200 shutdown_connections 2024-05-10T10:55:47.747 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:47.746+0000 7f8bfbc69700 1 -- 172.21.15.107:0/1389904200 wait complete. 2024-05-10T10:55:48.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:48 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1389904200' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:55:48.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:48 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1389904200' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:55:48.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:48 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1389904200' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T10:55:48.455 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-05-10T10:55:48.702 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:49.075 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:49 smithi107 ceph-mon[30373]: pgmap v392: 97 pgs: 97 active+clean; 659 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-05-10T10:55:49.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:49 smithi196 ceph-mon[34872]: pgmap v392: 97 pgs: 97 active+clean; 659 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-05-10T10:55:49.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:49 smithi184 ceph-mon[34585]: pgmap v392: 97 pgs: 97 active+clean; 659 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-05-10T10:55:51.107 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:51 smithi107 ceph-mon[30373]: pgmap v393: 97 pgs: 97 active+clean; 659 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-05-10T10:55:51.108 INFO:teuthology.orchestra.run.smithi107.stdout:{"run_dir":"/var/run/ceph"} 2024-05-10T10:55:51.109 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-05-10T10:55:51.109 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1698 2024-05-10T10:55:51.109 DEBUG:tasks.quiescer:Yielding 2024-05-10T10:55:51.110 INFO:teuthology.run_tasks:Running task workunit... 2024-05-10T10:55:51.124 INFO:tasks.workunit:Pulling workunits from ref d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T10:55:51.125 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-10T10:55:51.125 INFO:tasks.workunit:timeout=3h 2024-05-10T10:55:51.125 INFO:tasks.workunit:cleanup=True 2024-05-10T10:55:51.125 DEBUG:teuthology.orchestra.run.smithi107:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-10T10:55:51.126 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:55:51.142 INFO:teuthology.orchestra.run.smithi107.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-10T10:55:51.143 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-10T10:55:51.143 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5ch/92d Inode: 1099511628283 Links: 2 2024-05-10T10:55:51.143 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T10:55:51.143 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-05-10T10:55:51.143 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-10 10:52:47.476205016 +0000 2024-05-10T10:55:51.143 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-10 10:52:47.476205016 +0000 2024-05-10T10:55:51.143 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-10 10:55:29.421834712 +0000 2024-05-10T10:55:51.143 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-05-10 10:52:47.476205016 +0000 2024-05-10T10:55:51.143 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-10T10:55:51.143 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-10T10:55:51.216 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d39fa08867836ac070c47cb66c782fa559fd480b 2024-05-10T10:55:51.272 INFO:tasks.workunit.client.0.smithi107.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-10T10:55:51.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:51 smithi196 ceph-mon[34872]: pgmap v393: 97 pgs: 97 active+clean; 659 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-05-10T10:55:51.378 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:51.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:51 smithi184 ceph-mon[34585]: pgmap v393: 97 pgs: 97 active+clean; 659 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-05-10T10:55:53.165 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:53 smithi107 ceph-mon[30373]: pgmap v394: 97 pgs: 97 active+clean; 660 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-05-10T10:55:53.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.171+0000 7f7a028ac700 1 -- 172.21.15.107:0/1381467366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79fc102630 msgr2=0x7f79fc102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:53.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.171+0000 7f7a028ac700 1 --2- 172.21.15.107:0/1381467366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79fc102630 0x7f79fc102a10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f79ec0099c0 tx=0x7f79ec009cd0 comp rx=0 tx=0).stop 2024-05-10T10:55:53.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.171+0000 7f7a028ac700 1 -- 172.21.15.107:0/1381467366 shutdown_connections 2024-05-10T10:55:53.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.171+0000 7f7a028ac700 1 --2- 172.21.15.107:0/1381467366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79fc1076c0 0x7f79fc10f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:53.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.171+0000 7f7a028ac700 1 --2- 172.21.15.107:0/1381467366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79fc102630 0x7f79fc102a10 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:53.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.171+0000 7f7a028ac700 1 --2- 172.21.15.107:0/1381467366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79fc102fe0 0x7f79fc106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:53.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.171+0000 7f7a028ac700 1 -- 172.21.15.107:0/1381467366 >> 172.21.15.107:0/1381467366 conn(0x7f79fc079370 msgr2=0x7f79fc079780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:53.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.171+0000 7f7a028ac700 1 -- 172.21.15.107:0/1381467366 shutdown_connections 2024-05-10T10:55:53.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.171+0000 7f7a028ac700 1 -- 172.21.15.107:0/1381467366 wait complete. 2024-05-10T10:55:53.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.172+0000 7f7a028ac700 1 Processor -- start 2024-05-10T10:55:53.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.172+0000 7f7a028ac700 1 -- start start 2024-05-10T10:55:53.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.172+0000 7f7a028ac700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79fc102630 0x7f79fc19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:53.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.172+0000 7f7a028ac700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79fc102fe0 0x7f79fc19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:53.174 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.172+0000 7f7a028ac700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79fc1076c0 0x7f79fc1999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:53.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.172+0000 7f7a028ac700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc112690 con 0x7f79fc102fe0 2024-05-10T10:55:53.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.172+0000 7f7a028ac700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc112510 con 0x7f79fc102630 2024-05-10T10:55:53.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.172+0000 7f7a028ac700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc112810 con 0x7f79fc1076c0 2024-05-10T10:55:53.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.172+0000 7f79fb7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79fc102fe0 0x7f79fc19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:53.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.172+0000 7f79fb7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79fc102fe0 0x7f79fc19fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44596/0 (socket says 172.21.15.107:44596) 2024-05-10T10:55:53.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.172+0000 7f79fb7fe700 1 -- 172.21.15.107:0/3505338997 learned_addr learned my addr 172.21.15.107:0/3505338997 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:53.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.172+0000 7f7a00e49700 1 --2- 172.21.15.107:0/3505338997 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79fc1076c0 0x7f79fc1999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:53.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.172+0000 7f79fbfff700 1 --2- 172.21.15.107:0/3505338997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79fc102630 0x7f79fc19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:53.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.173+0000 7f79fb7fe700 1 -- 172.21.15.107:0/3505338997 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79fc1076c0 msgr2=0x7f79fc1999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:53.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.173+0000 7f79fb7fe700 1 --2- 172.21.15.107:0/3505338997 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79fc1076c0 0x7f79fc1999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:53.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.173+0000 7f79fb7fe700 1 -- 172.21.15.107:0/3505338997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79fc102630 msgr2=0x7f79fc19f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:53.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.173+0000 7f79fb7fe700 1 --2- 172.21.15.107:0/3505338997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79fc102630 0x7f79fc19f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:53.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.173+0000 7f79fb7fe700 1 -- 172.21.15.107:0/3505338997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79fc19a140 con 0x7f79fc102fe0 2024-05-10T10:55:53.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.173+0000 7f79fbfff700 1 --2- 172.21.15.107:0/3505338997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79fc102630 0x7f79fc19f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:55:53.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.173+0000 7f79fb7fe700 1 --2- 172.21.15.107:0/3505338997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79fc102fe0 0x7f79fc19fd60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f79f000c9e0 tx=0x7f79f000cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:53.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.173+0000 7f79f97fa700 1 -- 172.21.15.107:0/3505338997 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f0007aa0 con 0x7f79fc102fe0 2024-05-10T10:55:53.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.173+0000 7f79f97fa700 1 -- 172.21.15.107:0/3505338997 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f79f0007c40 con 0x7f79fc102fe0 2024-05-10T10:55:53.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.173+0000 7f7a028ac700 1 -- 172.21.15.107:0/3505338997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79fc19a430 con 0x7f79fc102fe0 2024-05-10T10:55:53.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.173+0000 7f79f97fa700 1 -- 172.21.15.107:0/3505338997 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f00186f0 con 0x7f79fc102fe0 2024-05-10T10:55:53.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.173+0000 7f7a028ac700 1 -- 172.21.15.107:0/3505338997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79fc1a66f0 con 0x7f79fc102fe0 2024-05-10T10:55:53.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.174+0000 7f7a028ac700 1 -- 172.21.15.107:0/3505338997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79fc06a190 con 0x7f79fc102fe0 2024-05-10T10:55:53.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.175+0000 7f79f97fa700 1 -- 172.21.15.107:0/3505338997 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 149704+0+0 (secure 0 0 0) 0x7f79f000f9b0 con 0x7f79fc102fe0 2024-05-10T10:55:53.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.176+0000 7f79f97fa700 1 --2- 172.21.15.107:0/3505338997 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f79e40b2910 0x7f79e40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:53.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.176+0000 7f79fbfff700 1 --2- 172.21.15.107:0/3505338997 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f79e40b2910 0x7f79e40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:53.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.176+0000 7f79f97fa700 1 -- 172.21.15.107:0/3505338997 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f79f00e2280 con 0x7f79fc102fe0 2024-05-10T10:55:53.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.177+0000 7f79fbfff700 1 --2- 172.21.15.107:0/3505338997 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f79e40b2910 0x7f79e40b4dd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f79ec000c00 tx=0x7f79ec005ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:53.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.181+0000 7f79f97fa700 1 -- 172.21.15.107:0/3505338997 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f79f0014030 con 0x7f79fc102fe0 2024-05-10T10:55:53.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:53 smithi196 ceph-mon[34872]: pgmap v394: 97 pgs: 97 active+clean; 660 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-05-10T10:55:53.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:53 smithi184 ceph-mon[34585]: pgmap v394: 97 pgs: 97 active+clean; 660 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-05-10T10:55:53.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.426+0000 7f7a028ac700 1 -- 172.21.15.107:0/3505338997 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79fc02e510 con 0x7f79fc102fe0 2024-05-10T10:55:53.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.427+0000 7f79f97fa700 1 -- 172.21.15.107:0/3505338997 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11951 (secure 0 0 0) 0x7f79f0007df0 con 0x7f79fc102fe0 2024-05-10T10:55:53.429 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:55:53.429 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T10:52:17.367732+0000","modified":"2024-05-10T10:55:30.125781+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24482,"mds_1":24449,"mds_2":24442,"mds_3":24431,"mds_4":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/2332963094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":2332963094},{"type":"v1","addr":"172.21.15.107:6841","nonce":2332963094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.184:6839/16501252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":16501252},{"type":"v1","addr":"172.21.15.184:6839","nonce":16501252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24430,24431,24482,24449,24442]},"id":1}]} 2024-05-10T10:55:53.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.429+0000 7f7a028ac700 1 -- 172.21.15.107:0/3505338997 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f79e40b2910 msgr2=0x7f79e40b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:53.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.429+0000 7f7a028ac700 1 --2- 172.21.15.107:0/3505338997 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f79e40b2910 0x7f79e40b4dd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f79ec000c00 tx=0x7f79ec005ab0 comp rx=0 tx=0).stop 2024-05-10T10:55:53.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.429+0000 7f7a028ac700 1 -- 172.21.15.107:0/3505338997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79fc102fe0 msgr2=0x7f79fc19fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:53.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.429+0000 7f7a028ac700 1 --2- 172.21.15.107:0/3505338997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79fc102fe0 0x7f79fc19fd60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f79f000c9e0 tx=0x7f79f000cda0 comp rx=0 tx=0).stop 2024-05-10T10:55:53.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.429+0000 7f7a028ac700 1 -- 172.21.15.107:0/3505338997 shutdown_connections 2024-05-10T10:55:53.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.429+0000 7f7a028ac700 1 --2- 172.21.15.107:0/3505338997 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f79e40b2910 0x7f79e40b4dd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:53.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.429+0000 7f7a028ac700 1 --2- 172.21.15.107:0/3505338997 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79fc1076c0 0x7f79fc1999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:53.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.429+0000 7f7a028ac700 1 --2- 172.21.15.107:0/3505338997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f79fc102630 0x7f79fc19f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:53.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.429+0000 7f7a028ac700 1 --2- 172.21.15.107:0/3505338997 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79fc102fe0 0x7f79fc19fd60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:53.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.429+0000 7f7a028ac700 1 -- 172.21.15.107:0/3505338997 >> 172.21.15.107:0/3505338997 conn(0x7f79fc079370 msgr2=0x7f79fc101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:53.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.429+0000 7f7a028ac700 1 -- 172.21.15.107:0/3505338997 shutdown_connections 2024-05-10T10:55:53.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:53.429+0000 7f7a028ac700 1 -- 172.21.15.107:0/3505338997 wait complete. 2024-05-10T10:55:53.432 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 27 2024-05-10T10:55:54.042 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-10T10:52:17.367732+0000', 'modified': '2024-05-10T10:55:30.125781+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24482, 'mds_1': 24449, 'mds_2': 24442, 'mds_3': 24431, 'mds_4': 24430}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14592': {'gid': 14592, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.107:6839/1923447762', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6838', 'nonce': 1923447762}, {'type': 'v1', 'addr': '172.21.15.107:6839', 'nonce': 1923447762}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14604': {'gid': 14604, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.107:6841/2332963094', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6840', 'nonce': 2332963094}, {'type': 'v1', 'addr': '172.21.15.107:6841', 'nonce': 2332963094}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.196:6833/2603001203', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6832', 'nonce': 2603001203}, {'type': 'v1', 'addr': '172.21.15.196:6833', 'nonce': 2603001203}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24404': {'gid': 24404, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6833/3101071828', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6832', 'nonce': 3101071828}, {'type': 'v1', 'addr': '172.21.15.184:6833', 'nonce': 3101071828}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24418': {'gid': 24418, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.196:6835/3609693196', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6834', 'nonce': 3609693196}, {'type': 'v1', 'addr': '172.21.15.196:6835', 'nonce': 3609693196}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'c', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.196:6837/3628757645', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6836', 'nonce': 3628757645}, {'type': 'v1', 'addr': '172.21.15.196:6837', 'nonce': 3628757645}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'e', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.184:6835/872203477', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 872203477}, {'type': 'v1', 'addr': '172.21.15.184:6835', 'nonce': 872203477}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.196:6839/4142119667', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6838', 'nonce': 4142119667}, {'type': 'v1', 'addr': '172.21.15.196:6839', 'nonce': 4142119667}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.184:6837/4239260328', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6836', 'nonce': 4239260328}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 4239260328}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.184:6839/16501252', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6838', 'nonce': 16501252}, {'type': 'v1', 'addr': '172.21.15.184:6839', 'nonce': 16501252}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24482, 'qdb_cluster': [24430, 24431, 24482, 24449, 24442]} 2024-05-10T10:55:54.042 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-10T10:55:54.042 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell mds.c status 2024-05-10T10:55:54.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:54 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3505338997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:55:54.326 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:54.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:54 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3505338997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:55:54.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:54 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3505338997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:55:55.290 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:55 smithi184 ceph-mon[34585]: pgmap v395: 97 pgs: 97 active+clean; 660 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-10T10:55:55.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:55 smithi196 ceph-mon[34872]: pgmap v395: 97 pgs: 97 active+clean; 660 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-10T10:55:55.375 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:55 smithi107 ceph-mon[30373]: pgmap v395: 97 pgs: 97 active+clean; 660 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-10T10:55:55.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.874+0000 7f39a1d43700 1 -- 172.21.15.107:0/4201376413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f399c103f00 msgr2=0x7f399c1103b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:55.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.874+0000 7f39a1d43700 1 --2- 172.21.15.107:0/4201376413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f399c103f00 0x7f399c1103b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f398c0099c0 tx=0x7f398c009cd0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.874+0000 7f39a1d43700 1 -- 172.21.15.107:0/4201376413 shutdown_connections 2024-05-10T10:55:55.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.874+0000 7f39a1d43700 1 --2- 172.21.15.107:0/4201376413 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f399c103f00 0x7f399c1103b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.874+0000 7f39a1d43700 1 --2- 172.21.15.107:0/4201376413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f399c1095e0 0x7f399c1099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.874+0000 7f39a1d43700 1 --2- 172.21.15.107:0/4201376413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f399c103540 0x7f399c1039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.874+0000 7f39a1d43700 1 -- 172.21.15.107:0/4201376413 >> 172.21.15.107:0/4201376413 conn(0x7f399c07a650 msgr2=0x7f399c07aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:55.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.874+0000 7f39a1d43700 1 -- 172.21.15.107:0/4201376413 shutdown_connections 2024-05-10T10:55:55.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.874+0000 7f39a1d43700 1 -- 172.21.15.107:0/4201376413 wait complete. 2024-05-10T10:55:55.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.875+0000 7f39a1d43700 1 Processor -- start 2024-05-10T10:55:55.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.875+0000 7f39a1d43700 1 -- start start 2024-05-10T10:55:55.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.875+0000 7f39a1d43700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f399c103540 0x7f399c19f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:55.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.875+0000 7f39a1d43700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f399c103f00 0x7f399c19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:55.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.875+0000 7f39a1d43700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f399c1095e0 0x7f399c199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:55.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.875+0000 7f39a1d43700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f399c113820 con 0x7f399c103540 2024-05-10T10:55:55.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.875+0000 7f39a1d43700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f399c1136a0 con 0x7f399c1095e0 2024-05-10T10:55:55.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.875+0000 7f39a1d43700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f399c1139a0 con 0x7f399c103f00 2024-05-10T10:55:55.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.875+0000 7f399b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f399c103540 0x7f399c19f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:55.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.875+0000 7f399b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f399c103540 0x7f399c19f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44612/0 (socket says 172.21.15.107:44612) 2024-05-10T10:55:55.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.875+0000 7f399b7fe700 1 -- 172.21.15.107:0/349256883 learned_addr learned my addr 172.21.15.107:0/349256883 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:55.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.876+0000 7f399bfff700 1 --2- 172.21.15.107:0/349256883 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f399c1095e0 0x7f399c199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:55.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.876+0000 7f399affd700 1 --2- 172.21.15.107:0/349256883 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f399c103f00 0x7f399c19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:55.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.876+0000 7f399b7fe700 1 -- 172.21.15.107:0/349256883 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f399c103f00 msgr2=0x7f399c19fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:55.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.876+0000 7f399b7fe700 1 --2- 172.21.15.107:0/349256883 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f399c103f00 0x7f399c19fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.876+0000 7f399b7fe700 1 -- 172.21.15.107:0/349256883 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f399c1095e0 msgr2=0x7f399c199a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:55.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.876+0000 7f399b7fe700 1 --2- 172.21.15.107:0/349256883 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f399c1095e0 0x7f399c199a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.876+0000 7f399b7fe700 1 -- 172.21.15.107:0/349256883 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f399c19a180 con 0x7f399c103540 2024-05-10T10:55:55.890 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.876+0000 7f399affd700 1 --2- 172.21.15.107:0/349256883 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f399c103f00 0x7f399c19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:55:55.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.876+0000 7f399b7fe700 1 --2- 172.21.15.107:0/349256883 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f399c103540 0x7f399c19f810 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f39940060b0 tx=0x7f399400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:55.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.876+0000 7f3998ff9700 1 -- 172.21.15.107:0/349256883 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399401a070 con 0x7f399c103540 2024-05-10T10:55:55.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.876+0000 7f3998ff9700 1 -- 172.21.15.107:0/349256883 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f399400ddd0 con 0x7f399c103540 2024-05-10T10:55:55.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.876+0000 7f39a1d43700 1 -- 172.21.15.107:0/349256883 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f399c19a470 con 0x7f399c103540 2024-05-10T10:55:55.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.876+0000 7f3998ff9700 1 -- 172.21.15.107:0/349256883 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39940147c0 con 0x7f399c103540 2024-05-10T10:55:55.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.876+0000 7f39a1d43700 1 -- 172.21.15.107:0/349256883 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f399c1a66e0 con 0x7f399c103540 2024-05-10T10:55:55.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.878+0000 7f3998ff9700 1 -- 172.21.15.107:0/349256883 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 149704+0+0 (secure 0 0 0) 0x7f399401d070 con 0x7f399c103540 2024-05-10T10:55:55.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.879+0000 7f3998ff9700 1 --2- 172.21.15.107:0/349256883 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f39880b2910 0x7f39880b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:55.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.879+0000 7f399affd700 1 --2- 172.21.15.107:0/349256883 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f39880b2910 0x7f39880b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:55.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.879+0000 7f3998ff9700 1 -- 172.21.15.107:0/349256883 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f39940e1ad0 con 0x7f399c103540 2024-05-10T10:55:55.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.880+0000 7f399affd700 1 --2- 172.21.15.107:0/349256883 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f39880b2910 0x7f39880b4dd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f399c07abc0 tx=0x7f398400b2c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:55.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.880+0000 7f39ac5d6b80 1 Processor -- start 2024-05-10T10:55:55.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.880+0000 7f39ac5d6b80 1 -- start start 2024-05-10T10:55:55.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.880+0000 7f39ac5d6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787ee480 0x55f9787ee860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:55.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.880+0000 7f39ac5d6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787eeda0 0x55f9787f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:55.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.880+0000 7f39ac5d6b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787f2c30 0x55f9787f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:55.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.880+0000 7f39ac5d6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f978740810 con 0x55f9787eeda0 2024-05-10T10:55:55.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.880+0000 7f39ac5d6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f9786df770 con 0x55f9787ee480 2024-05-10T10:55:55.892 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.880+0000 7f39ac5d6b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f97873c7d0 con 0x55f9787f2c30 2024-05-10T10:55:55.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.880+0000 7f399affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787eeda0 0x55f9787f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:55.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.880+0000 7f399affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787eeda0 0x55f9787f26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44618/0 (socket says 172.21.15.107:44618) 2024-05-10T10:55:55.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.880+0000 7f399affd700 1 -- 172.21.15.107:0/3413679744 learned_addr learned my addr 172.21.15.107:0/3413679744 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:55.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.880+0000 7f399b7fe700 1 --2- 172.21.15.107:0/3413679744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787ee480 0x55f9787ee860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:55.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.880+0000 7f399bfff700 1 --2- 172.21.15.107:0/3413679744 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787f2c30 0x55f9787f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:55.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.880+0000 7f399affd700 1 -- 172.21.15.107:0/3413679744 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787f2c30 msgr2=0x55f9787f30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:55.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.880+0000 7f399affd700 1 --2- 172.21.15.107:0/3413679744 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787f2c30 0x55f9787f30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.880+0000 7f399affd700 1 -- 172.21.15.107:0/3413679744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787ee480 msgr2=0x55f9787ee860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:55.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.880+0000 7f399affd700 1 --2- 172.21.15.107:0/3413679744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787ee480 0x55f9787ee860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.880+0000 7f399affd700 1 -- 172.21.15.107:0/3413679744 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f97868d880 con 0x55f9787eeda0 2024-05-10T10:55:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.881+0000 7f399affd700 1 --2- 172.21.15.107:0/3413679744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787eeda0 0x55f9787f26a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f398400ff00 tx=0x7f3984012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1b9a923e162502 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.881+0000 7f3991ffb700 1 -- 172.21.15.107:0/3413679744 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3984022070 con 0x55f9787eeda0 2024-05-10T10:55:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.881+0000 7f3991ffb700 1 -- 172.21.15.107:0/3413679744 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3984011c60 con 0x55f9787eeda0 2024-05-10T10:55:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.881+0000 7f3991ffb700 1 -- 172.21.15.107:0/3413679744 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398401d630 con 0x55f9787eeda0 2024-05-10T10:55:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.882+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/3413679744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787eeda0 msgr2=0x55f9787f26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.882+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/3413679744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787eeda0 0x55f9787f26a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f398400ff00 tx=0x7f3984012000 comp rx=0 tx=0).stop 2024-05-10T10:55:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.882+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/3413679744 shutdown_connections 2024-05-10T10:55:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.882+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/3413679744 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787f2c30 0x55f9787f30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.882+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/3413679744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787ee480 0x55f9787ee860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.882+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/3413679744 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787eeda0 0x55f9787f26a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.882+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/3413679744 >> 172.21.15.107:0/3413679744 conn(0x55f97871a0b0 msgr2=0x55f9787e8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:55.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.882+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/3413679744 shutdown_connections 2024-05-10T10:55:55.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.882+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/3413679744 wait complete. 2024-05-10T10:55:55.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.882+0000 7f39ac5d6b80 1 -- start start 2024-05-10T10:55:55.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.882+0000 7f39ac5d6b80 1 Processor -- start 2024-05-10T10:55:55.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f39ac5d6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787ee480 0x55f9787f9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:55.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f39ac5d6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787eeda0 0x55f9787f7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:55.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f39ac5d6b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787f2c30 0x55f9787f7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:55.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f39ac5d6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f9787fae40 con 0x55f9787eeda0 2024-05-10T10:55:55.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f39ac5d6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f9786a6be0 con 0x55f9787ee480 2024-05-10T10:55:55.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f39ac5d6b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f9787fafc0 con 0x55f9787f2c30 2024-05-10T10:55:55.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f39ac5d6b80 10 client.0 _ll_register_callbacks cb 0x55f9786d88d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:55:55.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f399affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787eeda0 0x55f9787f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:55.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f399affd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787eeda0 0x55f9787f7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44620/0 (socket says 172.21.15.107:44620) 2024-05-10T10:55:55.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f399affd700 1 -- 172.21.15.107:0/1125539146 learned_addr learned my addr 172.21.15.107:0/1125539146 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:55.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f399bfff700 1 --2- 172.21.15.107:0/1125539146 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787f2c30 0x55f9787f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:55.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f399b7fe700 1 --2- 172.21.15.107:0/1125539146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787ee480 0x55f9787f9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:55.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f399affd700 1 -- 172.21.15.107:0/1125539146 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787f2c30 msgr2=0x55f9787f7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:55.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f399affd700 1 --2- 172.21.15.107:0/1125539146 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787f2c30 0x55f9787f7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f399affd700 1 -- 172.21.15.107:0/1125539146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787ee480 msgr2=0x55f9787f9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:55.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f399affd700 1 --2- 172.21.15.107:0/1125539146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787ee480 0x55f9787f9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f399affd700 1 -- 172.21.15.107:0/1125539146 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9786dc640 con 0x55f9787eeda0 2024-05-10T10:55:55.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f399bfff700 1 --2- 172.21.15.107:0/1125539146 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787f2c30 0x55f9787f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:55:55.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f399affd700 1 --2- 172.21.15.107:0/1125539146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787eeda0 0x55f9787f7310 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f398401eea0 tx=0x7f398400bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e087bb165e5569 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:55.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f397affd700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:55:55.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f397affd700 1 -- 172.21.15.107:0/1125539146 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3984022050 con 0x55f9787eeda0 2024-05-10T10:55:55.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f397affd700 1 -- 172.21.15.107:0/1125539146 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f398401e840 con 0x55f9787eeda0 2024-05-10T10:55:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/1125539146 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3984011c60 con 0x55f9787eeda0 2024-05-10T10:55:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.883+0000 7f397affd700 1 -- 172.21.15.107:0/1125539146 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f398401ea40 con 0x55f9787eeda0 2024-05-10T10:55:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.884+0000 7f39ac5d6b80 10 client.15279 fetch_fsmap learned FSMap version 27 2024-05-10T10:55:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.884+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/1125539146 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f9788055a0 con 0x55f9787eeda0 2024-05-10T10:55:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.884+0000 7f397affd700 1 -- 172.21.15.107:0/1125539146 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3984011c60 con 0x55f9787eeda0 2024-05-10T10:55:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.884+0000 7f397affd700 1 -- 172.21.15.107:0/1125539146 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f3984030530 con 0x55f9787eeda0 2024-05-10T10:55:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.884+0000 7f39ac5d6b80 10 client.15279 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:55:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.884+0000 7f39ac5d6b80 10 client.15279 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T10:55:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.884+0000 7f39ac5d6b80 20 client.15279 populate_metadata read hostname 'smithi107' 2024-05-10T10:55:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.884+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/1125539146 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55f9788078c0 0x55f978808d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.884+0000 7f39ac5d6b80 4 client.15279 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:55:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.884+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/1125539146 --> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9787ba600 con 0x55f9788078c0 2024-05-10T10:55:55.897 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.884+0000 7f399b7fe700 1 --2- 172.21.15.107:0/1125539146 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55f9788078c0 0x55f978808d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:55.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.885+0000 7f397affd700 10 client.15279 ms_handle_connect on v2:172.21.15.196:6836/3628757645 2024-05-10T10:55:55.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.885+0000 7f399b7fe700 1 --2- 172.21.15.107:0/1125539146 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55f9788078c0 0x55f978808d30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=85dc9360912f503f server_cookie=30925b9d6f30c926 in_seq=0 out_seq=0 2024-05-10T10:55:55.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.886+0000 7f397affd700 1 -- 172.21.15.107:0/1125539146 <== mds.4 v2:172.21.15.196:6836/3628757645 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f9787ba600 con 0x55f9788078c0 2024-05-10T10:55:55.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.886+0000 7f397affd700 10 client.15279 handle_command_reply: tid=0 2024-05-10T10:55:55.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.886+0000 7f39ac5d6b80 1 client.15279 shutdown 2024-05-10T10:55:55.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.886+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/1125539146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787eeda0 msgr2=0x55f9787f7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:55.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.886+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/1125539146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787eeda0 0x55f9787f7310 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f398401eea0 tx=0x7f398400bb60 comp rx=0 tx=0).stop 2024-05-10T10:55:55.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.886+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/1125539146 shutdown_connections 2024-05-10T10:55:55.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.886+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/1125539146 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55f9788078c0 0x55f978808d30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.886+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/1125539146 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787f2c30 0x55f9787f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.898 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.886+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/1125539146 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787ee480 0x55f9787f9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.886+0000 7f397affd700 0 client.15279 ms_handle_reset on v2:172.21.15.196:6836/3628757645 2024-05-10T10:55:55.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.886+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/1125539146 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787eeda0 0x55f9787f7310 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.886+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/1125539146 >> 172.21.15.107:0/1125539146 conn(0x55f97871a0b0 msgr2=0x55f9787e36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:55.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.886+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/1125539146 shutdown_connections 2024-05-10T10:55:55.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.886+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/1125539146 wait complete. 2024-05-10T10:55:55.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.886+0000 7f39ac5d6b80 20 client.15279 trim_cache size 0 max 16384 2024-05-10T10:55:55.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.906+0000 7f39ac5d6b80 1 Processor -- start 2024-05-10T10:55:55.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.907+0000 7f39ac5d6b80 1 -- start start 2024-05-10T10:55:55.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.907+0000 7f39ac5d6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787ee480 0x55f9787f05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:55.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.907+0000 7f39ac5d6b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787eeda0 0x55f9787f0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:55.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.907+0000 7f39ac5d6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787f2c30 0x55f9787e2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:55.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.907+0000 7f39ac5d6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f978807070 con 0x55f9787ee480 2024-05-10T10:55:55.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.907+0000 7f39ac5d6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f978807740 con 0x55f9787f2c30 2024-05-10T10:55:55.908 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.907+0000 7f39ac5d6b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f978807e10 con 0x55f9787eeda0 2024-05-10T10:55:55.911 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.907+0000 7f399b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787ee480 0x55f9787f05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:55.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.907+0000 7f399b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787ee480 0x55f9787f05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44624/0 (socket says 172.21.15.107:44624) 2024-05-10T10:55:55.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.907+0000 7f399b7fe700 1 -- 172.21.15.107:0/3118750194 learned_addr learned my addr 172.21.15.107:0/3118750194 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:55.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.907+0000 7f399bfff700 1 --2- 172.21.15.107:0/3118750194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787f2c30 0x55f9787e2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:55.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.907+0000 7f399b7fe700 1 -- 172.21.15.107:0/3118750194 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787eeda0 msgr2=0x55f9787f0ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T10:55:55.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.907+0000 7f399b7fe700 1 --2- 172.21.15.107:0/3118750194 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787eeda0 0x55f9787f0ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.907+0000 7f399b7fe700 1 -- 172.21.15.107:0/3118750194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787f2c30 msgr2=0x55f9787e2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:55.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.907+0000 7f399b7fe700 1 --2- 172.21.15.107:0/3118750194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787f2c30 0x55f9787e2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.907+0000 7f399b7fe700 1 -- 172.21.15.107:0/3118750194 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9787ea4d0 con 0x55f9787ee480 2024-05-10T10:55:55.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.907+0000 7f399bfff700 1 --2- 172.21.15.107:0/3118750194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787f2c30 0x55f9787e2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:55:55.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.907+0000 7f399b7fe700 1 --2- 172.21.15.107:0/3118750194 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787ee480 0x55f9787f05a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f39940a9020 tx=0x7f39940a5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5c7b51cfd6fb79 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:55.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.908+0000 7f39917fa700 1 -- 172.21.15.107:0/3118750194 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39940c2070 con 0x55f9787ee480 2024-05-10T10:55:55.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.908+0000 7f39917fa700 1 -- 172.21.15.107:0/3118750194 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f39940b1ef0 con 0x55f9787ee480 2024-05-10T10:55:55.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.908+0000 7f39917fa700 1 -- 172.21.15.107:0/3118750194 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39940b1cc0 con 0x55f9787ee480 2024-05-10T10:55:55.912 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.908+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/3118750194 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787ee480 msgr2=0x55f9787f05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:55.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.908+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/3118750194 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787ee480 0x55f9787f05a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f39940a9020 tx=0x7f39940a5040 comp rx=0 tx=0).stop 2024-05-10T10:55:55.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.908+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/3118750194 shutdown_connections 2024-05-10T10:55:55.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.908+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/3118750194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787f2c30 0x55f9787e2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.908+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/3118750194 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787ee480 0x55f9787f05a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.908+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/3118750194 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787eeda0 0x55f9787f0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.908+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/3118750194 >> 172.21.15.107:0/3118750194 conn(0x55f97871a0b0 msgr2=0x55f9787f5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:55.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.908+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/3118750194 shutdown_connections 2024-05-10T10:55:55.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.909+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/3118750194 wait complete. 2024-05-10T10:55:55.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.909+0000 7f39ac5d6b80 1 -- start start 2024-05-10T10:55:55.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.909+0000 7f39ac5d6b80 1 Processor -- start 2024-05-10T10:55:55.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.909+0000 7f39ac5d6b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787ee480 0x55f9787efc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:55.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.909+0000 7f39ac5d6b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787eeda0 0x55f9787f01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:55.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.909+0000 7f39ac5d6b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787f2c30 0x55f9787f0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:55.913 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.909+0000 7f39ac5d6b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f978808bb0 con 0x55f9787f2c30 2024-05-10T10:55:55.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.909+0000 7f39ac5d6b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f9788084e0 con 0x55f9787eeda0 2024-05-10T10:55:55.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.909+0000 7f39ac5d6b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f978809280 con 0x55f9787ee480 2024-05-10T10:55:55.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.909+0000 7f39ac5d6b80 10 client.0 _ll_register_callbacks cb 0x55f9786d88d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:55:55.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.910+0000 7f399bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787f2c30 0x55f9787f0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:55.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.910+0000 7f399bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787f2c30 0x55f9787f0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44632/0 (socket says 172.21.15.107:44632) 2024-05-10T10:55:55.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.910+0000 7f399bfff700 1 -- 172.21.15.107:0/1823455319 learned_addr learned my addr 172.21.15.107:0/1823455319 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:55.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.910+0000 7f399affd700 1 --2- 172.21.15.107:0/1823455319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787eeda0 0x55f9787f01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:55.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.910+0000 7f399b7fe700 1 --2- 172.21.15.107:0/1823455319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787ee480 0x55f9787efc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:55.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.910+0000 7f399bfff700 1 -- 172.21.15.107:0/1823455319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787ee480 msgr2=0x55f9787efc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:55.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.910+0000 7f399bfff700 1 --2- 172.21.15.107:0/1823455319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787ee480 0x55f9787efc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.910+0000 7f399bfff700 1 -- 172.21.15.107:0/1823455319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787eeda0 msgr2=0x55f9787f01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:55.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.910+0000 7f399bfff700 1 --2- 172.21.15.107:0/1823455319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787eeda0 0x55f9787f01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.910+0000 7f399bfff700 1 -- 172.21.15.107:0/1823455319 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f97880e5e0 con 0x55f9787f2c30 2024-05-10T10:55:55.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.910+0000 7f399b7fe700 1 --2- 172.21.15.107:0/1823455319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787ee480 0x55f9787efc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:55:55.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.910+0000 7f399bfff700 1 --2- 172.21.15.107:0/1823455319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787f2c30 0x55f9787f0710 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f398c0098e0 tx=0x7f398c003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6636161e38f56fc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:55.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.910+0000 7f397affd700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:55:55.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.910+0000 7f397affd700 1 -- 172.21.15.107:0/1823455319 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c028020 con 0x55f9787f2c30 2024-05-10T10:55:55.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.910+0000 7f397affd700 1 -- 172.21.15.107:0/1823455319 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f398c0054c0 con 0x55f9787f2c30 2024-05-10T10:55:55.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.910+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/1823455319 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39940b1ef0 con 0x55f9787f2c30 2024-05-10T10:55:55.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.910+0000 7f397affd700 1 -- 172.21.15.107:0/1823455319 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f398c0056c0 con 0x55f9787f2c30 2024-05-10T10:55:55.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.910+0000 7f39ac5d6b80 10 client.15285 fetch_fsmap learned FSMap version 27 2024-05-10T10:55:55.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.910+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/1823455319 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f978877490 con 0x55f9787f2c30 2024-05-10T10:55:55.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.911+0000 7f397affd700 1 -- 172.21.15.107:0/1823455319 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f39940b1ef0 con 0x55f9787f2c30 2024-05-10T10:55:55.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.911+0000 7f397affd700 1 -- 172.21.15.107:0/1823455319 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f398c00f8b0 con 0x55f9787f2c30 2024-05-10T10:55:55.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.911+0000 7f39ac5d6b80 10 client.15285 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:55:55.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.911+0000 7f39ac5d6b80 10 client.15285 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-10T10:55:55.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.911+0000 7f39ac5d6b80 20 client.15285 populate_metadata read hostname 'smithi107' 2024-05-10T10:55:55.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.911+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/1823455319 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55f97887c130 0x55f97887ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:55.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.911+0000 7f39ac5d6b80 4 client.15285 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T10:55:55.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.911+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/1823455319 --> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] -- command(tid 0: {"prefix": "status"}) -- 0x55f97874e1f0 con 0x55f97887c130 2024-05-10T10:55:55.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.911+0000 7f399b7fe700 1 --2- 172.21.15.107:0/1823455319 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55f97887c130 0x55f97887ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:55.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.912+0000 7f397affd700 10 client.15285 ms_handle_connect on v2:172.21.15.196:6836/3628757645 2024-05-10T10:55:55.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.912+0000 7f399b7fe700 1 --2- 172.21.15.107:0/1823455319 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55f97887c130 0x55f97887ae40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b468f5455bdc3cd6 server_cookie=d49f1ee0e2cf7aa0 in_seq=0 out_seq=0 2024-05-10T10:55:55.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.912+0000 7f397affd700 1 -- 172.21.15.107:0/1823455319 <== mds.4 v2:172.21.15.196:6836/3628757645 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55f97874e1f0 con 0x55f97887c130 2024-05-10T10:55:55.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.912+0000 7f397affd700 10 client.15285 handle_command_reply: tid=0 2024-05-10T10:55:55.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.912+0000 7f39ac5d6b80 1 client.15285 shutdown 2024-05-10T10:55:55.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.912+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/1823455319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787f2c30 msgr2=0x55f9787f0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:55.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.912+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/1823455319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787f2c30 0x55f9787f0710 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f398c0098e0 tx=0x7f398c003730 comp rx=0 tx=0).stop 2024-05-10T10:55:55.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.912+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/1823455319 shutdown_connections 2024-05-10T10:55:55.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.912+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/1823455319 >> [v2:172.21.15.196:6836/3628757645,v1:172.21.15.196:6837/3628757645] conn(0x55f97887c130 0x55f97887ae40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.912+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/1823455319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f9787ee480 0x55f9787efc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.912+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/1823455319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f9787f2c30 0x55f9787f0710 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.912+0000 7f39ac5d6b80 1 --2- 172.21.15.107:0/1823455319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9787eeda0 0x55f9787f01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.912+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/1823455319 >> 172.21.15.107:0/1823455319 conn(0x55f97871a0b0 msgr2=0x55f9787e36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:55.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.912+0000 7f397affd700 0 client.15285 ms_handle_reset on v2:172.21.15.196:6836/3628757645 2024-05-10T10:55:55.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.912+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/1823455319 shutdown_connections 2024-05-10T10:55:55.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.912+0000 7f39ac5d6b80 1 -- 172.21.15.107:0/1823455319 wait complete. 2024-05-10T10:55:55.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.912+0000 7f39ac5d6b80 20 client.15285 trim_cache size 0 max 16384 2024-05-10T10:55:55.919 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:55:55.919 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "0ba8a8e4-0eba-11ef-bc98-c7b262605968", 2024-05-10T10:55:55.919 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 4, 2024-05-10T10:55:55.919 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24430, 2024-05-10T10:55:55.919 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2024-05-10T10:55:55.919 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2024-05-10T10:55:55.920 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2024-05-10T10:55:55.920 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 203.108240607, 2024-05-10T10:55:55.920 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 27, 2024-05-10T10:55:55.920 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 82, 2024-05-10T10:55:55.920 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 82, 2024-05-10T10:55:55.920 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 251.094820771 2024-05-10T10:55:55.920 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:55:55.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.913+0000 7f39a1d43700 1 -- 172.21.15.107:0/349256883 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f39880b2910 msgr2=0x7f39880b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:55.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.913+0000 7f39a1d43700 1 --2- 172.21.15.107:0/349256883 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f39880b2910 0x7f39880b4dd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f399c07abc0 tx=0x7f398400b2c0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.913+0000 7f39a1d43700 1 -- 172.21.15.107:0/349256883 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f399c103540 msgr2=0x7f399c19f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:55.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.913+0000 7f39a1d43700 1 --2- 172.21.15.107:0/349256883 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f399c103540 0x7f399c19f810 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f39940060b0 tx=0x7f399400d3b0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.913+0000 7f39a1d43700 1 -- 172.21.15.107:0/349256883 shutdown_connections 2024-05-10T10:55:55.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.913+0000 7f39a1d43700 1 --2- 172.21.15.107:0/349256883 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f39880b2910 0x7f39880b4dd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.913+0000 7f39a1d43700 1 --2- 172.21.15.107:0/349256883 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f399c1095e0 0x7f399c199a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.913+0000 7f39a1d43700 1 --2- 172.21.15.107:0/349256883 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f399c103540 0x7f399c19f810 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.921 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.913+0000 7f39a1d43700 1 --2- 172.21.15.107:0/349256883 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f399c103f00 0x7f399c19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:55.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.913+0000 7f39a1d43700 1 -- 172.21.15.107:0/349256883 >> 172.21.15.107:0/349256883 conn(0x7f399c07a650 msgr2=0x7f399c102080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:55.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.913+0000 7f39a1d43700 1 -- 172.21.15.107:0/349256883 shutdown_connections 2024-05-10T10:55:55.922 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:55.913+0000 7f39a1d43700 1 -- 172.21.15.107:0/349256883 wait complete. 2024-05-10T10:55:56.571 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell mds.e status 2024-05-10T10:55:56.823 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:57.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:57 smithi107 ceph-mon[30373]: pgmap v396: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.4 KiB/s wr, 16 op/s 2024-05-10T10:55:57.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:57 smithi196 ceph-mon[34872]: pgmap v396: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.4 KiB/s wr, 16 op/s 2024-05-10T10:55:57.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:57 smithi184 ceph-mon[34585]: pgmap v396: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.4 KiB/s wr, 16 op/s 2024-05-10T10:55:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.663+0000 7f49788fc640 1 -- 172.21.15.107:0/801368567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4974102b00 msgr2=0x7f4974102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.663+0000 7f49788fc640 1 --2- 172.21.15.107:0/801368567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4974102b00 0x7f4974102f80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f495c009900 tx=0x7f495c02a410 comp rx=0 tx=0).stop 2024-05-10T10:55:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.663+0000 7f49788fc640 1 -- 172.21.15.107:0/801368567 shutdown_connections 2024-05-10T10:55:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.663+0000 7f49788fc640 1 --2- 172.21.15.107:0/801368567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49741034c0 0x7f4974109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.663+0000 7f49788fc640 1 --2- 172.21.15.107:0/801368567 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4974102b00 0x7f4974102f80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.663+0000 7f49788fc640 1 --2- 172.21.15.107:0/801368567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4974101910 0x7f4974101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.663+0000 7f49788fc640 1 -- 172.21.15.107:0/801368567 >> 172.21.15.107:0/801368567 conn(0x7f49740fce80 msgr2=0x7f49740ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.663+0000 7f49788fc640 1 -- 172.21.15.107:0/801368567 shutdown_connections 2024-05-10T10:55:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.663+0000 7f49788fc640 1 -- 172.21.15.107:0/801368567 wait complete. 2024-05-10T10:55:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.664+0000 7f49788fc640 1 Processor -- start 2024-05-10T10:55:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.664+0000 7f49788fc640 1 -- start start 2024-05-10T10:55:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.664+0000 7f49788fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4974101910 0x7f4974198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.664+0000 7f49788fc640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4974102b00 0x7f49741991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.664+0000 7f49788fc640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49741034c0 0x7f49741a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.664+0000 7f49788fc640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f497410d640 con 0x7f4974101910 2024-05-10T10:55:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.664+0000 7f49788fc640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f497410d4c0 con 0x7f49741034c0 2024-05-10T10:55:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.664+0000 7f49788fc640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f497410d7c0 con 0x7f4974102b00 2024-05-10T10:55:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.664+0000 7f497259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4974101910 0x7f4974198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.664+0000 7f497259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4974101910 0x7f4974198c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44336/0 (socket says 172.21.15.107:44336) 2024-05-10T10:55:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.664+0000 7f497259c640 1 -- 172.21.15.107:0/3718099807 learned_addr learned my addr 172.21.15.107:0/3718099807 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.665+0000 7f4972d9d640 1 --2- 172.21.15.107:0/3718099807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49741034c0 0x7f49741a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.665+0000 7f496bfff640 1 --2- 172.21.15.107:0/3718099807 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4974102b00 0x7f49741991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.665+0000 7f497259c640 1 -- 172.21.15.107:0/3718099807 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4974102b00 msgr2=0x7f49741991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.665+0000 7f497259c640 1 --2- 172.21.15.107:0/3718099807 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4974102b00 0x7f49741991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.665+0000 7f497259c640 1 -- 172.21.15.107:0/3718099807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49741034c0 msgr2=0x7f49741a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.665+0000 7f497259c640 1 --2- 172.21.15.107:0/3718099807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49741034c0 0x7f49741a0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.665+0000 7f497259c640 1 -- 172.21.15.107:0/3718099807 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49741a08d0 con 0x7f4974101910 2024-05-10T10:55:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.665+0000 7f4972d9d640 1 --2- 172.21.15.107:0/3718099807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49741034c0 0x7f49741a0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:55:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.665+0000 7f497259c640 1 --2- 172.21.15.107:0/3718099807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4974101910 0x7f4974198c90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f496400b450 tx=0x7f496400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.665+0000 7f496b7fe640 1 -- 172.21.15.107:0/3718099807 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4964015020 con 0x7f4974101910 2024-05-10T10:55:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.665+0000 7f49788fc640 1 -- 172.21.15.107:0/3718099807 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49741a0bc0 con 0x7f4974101910 2024-05-10T10:55:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.665+0000 7f496b7fe640 1 -- 172.21.15.107:0/3718099807 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4964011d60 con 0x7f4974101910 2024-05-10T10:55:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.665+0000 7f496b7fe640 1 -- 172.21.15.107:0/3718099807 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496400f340 con 0x7f4974101910 2024-05-10T10:55:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.665+0000 7f49788fc640 1 -- 172.21.15.107:0/3718099807 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49741a1110 con 0x7f4974101910 2024-05-10T10:55:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.668+0000 7f496b7fe640 1 -- 172.21.15.107:0/3718099807 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 149704+0+0 (secure 0 0 0) 0x7f4964018020 con 0x7f4974101910 2024-05-10T10:55:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.668+0000 7f497b613740 1 Processor -- start 2024-05-10T10:55:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.668+0000 7f497b613740 1 -- start start 2024-05-10T10:55:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.668+0000 7f497b613740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084d1c0 0x5598f084d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.668+0000 7f497b613740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084dbb0 0x5598f08526b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:57.676 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.668+0000 7f497b613740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0852d20 0x5598f08551b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.668+0000 7f497b613740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5598f07ad5d0 con 0x5598f0852d20 2024-05-10T10:55:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.668+0000 7f497b613740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5598f0766890 con 0x5598f084d1c0 2024-05-10T10:55:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.668+0000 7f497b613740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5598f07a9590 con 0x5598f084dbb0 2024-05-10T10:55:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.668+0000 7f496bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0852d20 0x5598f08551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.668+0000 7f496bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0852d20 0x5598f08551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44352/0 (socket says 172.21.15.107:44352) 2024-05-10T10:55:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.668+0000 7f496bfff640 1 -- 172.21.15.107:0/1843128297 learned_addr learned my addr 172.21.15.107:0/1843128297 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.668+0000 7f4972d9d640 1 --2- 172.21.15.107:0/1843128297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084d1c0 0x5598f084d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.669+0000 7f497259c640 1 --2- 172.21.15.107:0/1843128297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084dbb0 0x5598f08526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.669+0000 7f496bfff640 1 -- 172.21.15.107:0/1843128297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084dbb0 msgr2=0x5598f08526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.669+0000 7f496bfff640 1 --2- 172.21.15.107:0/1843128297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084dbb0 0x5598f08526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.677 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.669+0000 7f496bfff640 1 -- 172.21.15.107:0/1843128297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084d1c0 msgr2=0x5598f084d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.669+0000 7f496bfff640 1 --2- 172.21.15.107:0/1843128297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084d1c0 0x5598f084d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.669+0000 7f496bfff640 1 -- 172.21.15.107:0/1843128297 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598f04bf210 con 0x5598f0852d20 2024-05-10T10:55:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.669+0000 7f496b7fe640 1 --2- 172.21.15.107:0/3718099807 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f49600b2920 0x7f49600b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.669+0000 7f496bfff640 1 --2- 172.21.15.107:0/1843128297 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0852d20 0x5598f08551b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f495c004230 tx=0x7f495c004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649c10927199714b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.669+0000 7f4972d9d640 1 --2- 172.21.15.107:0/3718099807 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f49600b2920 0x7f49600b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.669+0000 7f496b7fe640 1 -- 172.21.15.107:0/3718099807 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f49640e1cf0 con 0x7f4974101910 2024-05-10T10:55:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.669+0000 7f4968ff9640 1 -- 172.21.15.107:0/1843128297 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495c03f070 con 0x5598f0852d20 2024-05-10T10:55:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.669+0000 7f4968ff9640 1 -- 172.21.15.107:0/1843128297 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f495c005510 con 0x5598f0852d20 2024-05-10T10:55:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.669+0000 7f4968ff9640 1 -- 172.21.15.107:0/1843128297 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495c035030 con 0x5598f0852d20 2024-05-10T10:55:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.670+0000 7f497b613740 1 -- 172.21.15.107:0/1843128297 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0852d20 msgr2=0x5598f08551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:57.678 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.670+0000 7f4972d9d640 1 --2- 172.21.15.107:0/3718099807 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f49600b2920 0x7f49600b4de0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x5598f084e410 tx=0x7f496c007720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.670+0000 7f497b613740 1 --2- 172.21.15.107:0/1843128297 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0852d20 0x5598f08551b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f495c004230 tx=0x7f495c004260 comp rx=0 tx=0).stop 2024-05-10T10:55:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.670+0000 7f497b613740 1 -- 172.21.15.107:0/1843128297 shutdown_connections 2024-05-10T10:55:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.670+0000 7f497b613740 1 --2- 172.21.15.107:0/1843128297 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0852d20 0x5598f08551b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.670+0000 7f497b613740 1 --2- 172.21.15.107:0/1843128297 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084dbb0 0x5598f08526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.670+0000 7f497b613740 1 --2- 172.21.15.107:0/1843128297 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084d1c0 0x5598f084d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.670+0000 7f497b613740 1 -- 172.21.15.107:0/1843128297 >> 172.21.15.107:0/1843128297 conn(0x5598f0844420 msgr2=0x5598f0844820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.670+0000 7f497b613740 1 -- 172.21.15.107:0/1843128297 shutdown_connections 2024-05-10T10:55:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.670+0000 7f497b613740 1 -- 172.21.15.107:0/1843128297 wait complete. 2024-05-10T10:55:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.670+0000 7f497b613740 1 -- start start 2024-05-10T10:55:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.670+0000 7f497b613740 1 Processor -- start 2024-05-10T10:55:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f497b613740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084d1c0 0x5598f08572f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:57.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f497b613740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084dbb0 0x5598f0857830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f497b613740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0852d20 0x5598f085e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f497b613740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5598f0855c70 con 0x5598f0852d20 2024-05-10T10:55:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f497b613740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5598f076a370 con 0x5598f084dbb0 2024-05-10T10:55:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f497b613740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5598f0855df0 con 0x5598f084d1c0 2024-05-10T10:55:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f497b613740 10 client.0 _ll_register_callbacks cb 0x5598f04bea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:55:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f4972d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0852d20 0x5598f085e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f4972d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0852d20 0x5598f085e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44364/0 (socket says 172.21.15.107:44364) 2024-05-10T10:55:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f4972d9d640 1 -- 172.21.15.107:0/2459759287 learned_addr learned my addr 172.21.15.107:0/2459759287 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f497259c640 1 --2- 172.21.15.107:0/2459759287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084d1c0 0x5598f08572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f496bfff640 1 --2- 172.21.15.107:0/2459759287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084dbb0 0x5598f0857830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f4972d9d640 1 -- 172.21.15.107:0/2459759287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084d1c0 msgr2=0x5598f08572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:57.680 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f4972d9d640 1 --2- 172.21.15.107:0/2459759287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084d1c0 0x5598f08572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f4972d9d640 1 -- 172.21.15.107:0/2459759287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084dbb0 msgr2=0x5598f0857830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f4972d9d640 1 --2- 172.21.15.107:0/2459759287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084dbb0 0x5598f0857830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f4972d9d640 1 -- 172.21.15.107:0/2459759287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598f058b620 con 0x5598f0852d20 2024-05-10T10:55:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f4972d9d640 1 --2- 172.21.15.107:0/2459759287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0852d20 0x5598f085e870 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f496c0043d0 tx=0x7f496c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6791236db516f8a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f4959ffb640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:55:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f4959ffb640 1 -- 172.21.15.107:0/2459759287 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c00fe10 con 0x5598f0852d20 2024-05-10T10:55:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f4959ffb640 1 -- 172.21.15.107:0/2459759287 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f496c01c420 con 0x5598f0852d20 2024-05-10T10:55:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f497b613740 1 -- 172.21.15.107:0/2459759287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f495c005510 con 0x5598f0852d20 2024-05-10T10:55:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f4959ffb640 1 -- 172.21.15.107:0/2459759287 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f496c01c620 con 0x5598f0852d20 2024-05-10T10:55:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f497b613740 10 client.15297 fetch_fsmap learned FSMap version 27 2024-05-10T10:55:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.671+0000 7f497b613740 1 -- 172.21.15.107:0/2459759287 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5598f0861920 con 0x5598f0852d20 2024-05-10T10:55:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.672+0000 7f4959ffb640 1 -- 172.21.15.107:0/2459759287 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f495c005510 con 0x5598f0852d20 2024-05-10T10:55:57.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.672+0000 7f4959ffb640 1 -- 172.21.15.107:0/2459759287 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f496c026910 con 0x5598f0852d20 2024-05-10T10:55:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.672+0000 7f497b613740 10 client.15297 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:55:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.672+0000 7f497b613740 10 client.15297 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:55:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.672+0000 7f497b613740 20 client.15297 populate_metadata read hostname 'smithi107' 2024-05-10T10:55:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.672+0000 7f497b613740 1 --2- 172.21.15.107:0/2459759287 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5598f0863080 0x5598f08654e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.672+0000 7f497b613740 4 client.15297 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:55:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.672+0000 7f497b613740 1 -- 172.21.15.107:0/2459759287 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598f07bb1e0 con 0x5598f0863080 2024-05-10T10:55:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.672+0000 7f497259c640 1 --2- 172.21.15.107:0/2459759287 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5598f0863080 0x5598f08654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.672+0000 7f497259c640 1 --2- 172.21.15.107:0/2459759287 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5598f0863080 0x5598f08654e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a36d4be0ab6e8538 server_cookie=2f575f04e4e1ba4e in_seq=0 out_seq=0 2024-05-10T10:55:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.673+0000 7f4959ffb640 10 client.15297 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:55:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.673+0000 7f4959ffb640 1 -- 172.21.15.107:0/2459759287 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5598f07bb1e0 con 0x5598f0863080 2024-05-10T10:55:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.673+0000 7f4959ffb640 10 client.15297 handle_command_reply: tid=0 2024-05-10T10:55:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.673+0000 7f497b613740 1 client.15297 shutdown 2024-05-10T10:55:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.673+0000 7f497b613740 1 -- 172.21.15.107:0/2459759287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0852d20 msgr2=0x5598f085e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:57.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.673+0000 7f497b613740 1 --2- 172.21.15.107:0/2459759287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0852d20 0x5598f085e870 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f496c0043d0 tx=0x7f496c004a40 comp rx=0 tx=0).stop 2024-05-10T10:55:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.673+0000 7f497b613740 1 -- 172.21.15.107:0/2459759287 shutdown_connections 2024-05-10T10:55:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.674+0000 7f497b613740 1 --2- 172.21.15.107:0/2459759287 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5598f0863080 0x5598f08654e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.674+0000 7f497b613740 1 --2- 172.21.15.107:0/2459759287 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0852d20 0x5598f085e870 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.674+0000 7f497b613740 1 --2- 172.21.15.107:0/2459759287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084dbb0 0x5598f0857830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.674+0000 7f497b613740 1 --2- 172.21.15.107:0/2459759287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084d1c0 0x5598f08572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.674+0000 7f497b613740 1 -- 172.21.15.107:0/2459759287 >> 172.21.15.107:0/2459759287 conn(0x5598f0844420 msgr2=0x5598f0843580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.674+0000 7f4959ffb640 0 client.15297 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:55:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.674+0000 7f497b613740 1 -- 172.21.15.107:0/2459759287 shutdown_connections 2024-05-10T10:55:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.674+0000 7f497b613740 1 -- 172.21.15.107:0/2459759287 wait complete. 2024-05-10T10:55:57.683 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.674+0000 7f497b613740 20 client.15297 trim_cache size 0 max 16384 2024-05-10T10:55:57.694 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.689+0000 7f497b613740 1 Processor -- start 2024-05-10T10:55:57.694 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.689+0000 7f497b613740 1 -- start start 2024-05-10T10:55:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.689+0000 7f497b613740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0844420 0x5598f0869de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.689+0000 7f497b613740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084d1c0 0x5598f085e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.689+0000 7f497b613740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084dbb0 0x5598f086a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.689+0000 7f497b613740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f49741a7b80 con 0x5598f0844420 2024-05-10T10:55:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.689+0000 7f497b613740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f49741a96c0 con 0x5598f084d1c0 2024-05-10T10:55:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.689+0000 7f497b613740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f49741a8250 con 0x5598f084dbb0 2024-05-10T10:55:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.689+0000 7f497259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0844420 0x5598f0869de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.689+0000 7f497259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0844420 0x5598f0869de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44378/0 (socket says 172.21.15.107:44378) 2024-05-10T10:55:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.689+0000 7f497259c640 1 -- 172.21.15.107:0/3664132633 learned_addr learned my addr 172.21.15.107:0/3664132633 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.689+0000 7f496bfff640 1 --2- 172.21.15.107:0/3664132633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084d1c0 0x5598f085e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.690+0000 7f4972d9d640 1 --2- 172.21.15.107:0/3664132633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084dbb0 0x5598f086a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.690+0000 7f497259c640 1 -- 172.21.15.107:0/3664132633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084dbb0 msgr2=0x5598f086a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.690+0000 7f497259c640 1 --2- 172.21.15.107:0/3664132633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084dbb0 0x5598f086a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.690+0000 7f497259c640 1 -- 172.21.15.107:0/3664132633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084d1c0 msgr2=0x5598f085e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.690+0000 7f497259c640 1 --2- 172.21.15.107:0/3664132633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084d1c0 0x5598f085e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.690+0000 7f497259c640 1 -- 172.21.15.107:0/3664132633 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598f0844250 con 0x5598f0844420 2024-05-10T10:55:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.690+0000 7f4972d9d640 1 --2- 172.21.15.107:0/3664132633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084dbb0 0x5598f086a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:55:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.690+0000 7f497259c640 1 --2- 172.21.15.107:0/3664132633 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0844420 0x5598f0869de0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f496400be10 tx=0x7f49640a8c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e927888c2050ddc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.690+0000 7f495bfff640 1 -- 172.21.15.107:0/3664132633 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4964009200 con 0x5598f0844420 2024-05-10T10:55:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.690+0000 7f495bfff640 1 -- 172.21.15.107:0/3664132633 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f49640a93c0 con 0x5598f0844420 2024-05-10T10:55:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.690+0000 7f495bfff640 1 -- 172.21.15.107:0/3664132633 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49640a8620 con 0x5598f0844420 2024-05-10T10:55:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497b613740 1 -- 172.21.15.107:0/3664132633 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0844420 msgr2=0x5598f0869de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497b613740 1 --2- 172.21.15.107:0/3664132633 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0844420 0x5598f0869de0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f496400be10 tx=0x7f49640a8c30 comp rx=0 tx=0).stop 2024-05-10T10:55:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497b613740 1 -- 172.21.15.107:0/3664132633 shutdown_connections 2024-05-10T10:55:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497b613740 1 --2- 172.21.15.107:0/3664132633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084dbb0 0x5598f086a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497b613740 1 --2- 172.21.15.107:0/3664132633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084d1c0 0x5598f085e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497b613740 1 --2- 172.21.15.107:0/3664132633 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0844420 0x5598f0869de0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497b613740 1 -- 172.21.15.107:0/3664132633 >> 172.21.15.107:0/3664132633 conn(0x5598f0856eb0 msgr2=0x5598f0864df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497b613740 1 -- 172.21.15.107:0/3664132633 shutdown_connections 2024-05-10T10:55:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497b613740 1 -- 172.21.15.107:0/3664132633 wait complete. 2024-05-10T10:55:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497b613740 1 -- start start 2024-05-10T10:55:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497b613740 1 Processor -- start 2024-05-10T10:55:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497b613740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0844420 0x5598f085c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497b613740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084d1c0 0x5598f085c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497b613740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084dbb0 0x5598f085d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497b613740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f49741a8ff0 con 0x5598f0844420 2024-05-10T10:55:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497b613740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f49741a8920 con 0x5598f084dbb0 2024-05-10T10:55:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497b613740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f49741a5b80 con 0x5598f084d1c0 2024-05-10T10:55:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497b613740 10 client.0 _ll_register_callbacks cb 0x7f496c011f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:55:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0844420 0x5598f085c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0844420 0x5598f085c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44392/0 (socket says 172.21.15.107:44392) 2024-05-10T10:55:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.691+0000 7f497259c640 1 -- 172.21.15.107:0/311011325 learned_addr learned my addr 172.21.15.107:0/311011325 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f4972d9d640 1 --2- 172.21.15.107:0/311011325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084dbb0 0x5598f085d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f496bfff640 1 --2- 172.21.15.107:0/311011325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084d1c0 0x5598f085c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f497259c640 1 -- 172.21.15.107:0/311011325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084d1c0 msgr2=0x5598f085c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f497259c640 1 --2- 172.21.15.107:0/311011325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084d1c0 0x5598f085c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f497259c640 1 -- 172.21.15.107:0/311011325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084dbb0 msgr2=0x5598f085d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f497259c640 1 --2- 172.21.15.107:0/311011325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084dbb0 0x5598f085d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f497259c640 1 -- 172.21.15.107:0/311011325 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598f085de00 con 0x5598f0844420 2024-05-10T10:55:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f497259c640 1 --2- 172.21.15.107:0/311011325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0844420 0x5598f085c2c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f49640a6630 tx=0x7f49640a8850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a4bae30543e835 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f4959ffb640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:55:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f4959ffb640 1 -- 172.21.15.107:0/311011325 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49640c3060 con 0x5598f0844420 2024-05-10T10:55:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f4959ffb640 1 -- 172.21.15.107:0/311011325 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f4964011890 con 0x5598f0844420 2024-05-10T10:55:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f497b613740 1 -- 172.21.15.107:0/311011325 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49640a93c0 con 0x5598f0844420 2024-05-10T10:55:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f4959ffb640 1 -- 172.21.15.107:0/311011325 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f49640a8ed0 con 0x5598f0844420 2024-05-10T10:55:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f497b613740 10 client.15303 fetch_fsmap learned FSMap version 27 2024-05-10T10:55:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f497b613740 1 -- 172.21.15.107:0/311011325 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5598f08cdcf0 con 0x5598f0844420 2024-05-10T10:55:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f4959ffb640 1 -- 172.21.15.107:0/311011325 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f49640a93c0 con 0x5598f0844420 2024-05-10T10:55:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f4959ffb640 1 -- 172.21.15.107:0/311011325 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f49640a3ae0 con 0x5598f0844420 2024-05-10T10:55:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f497b613740 10 client.15303 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:55:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f497b613740 10 client.15303 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:55:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f497b613740 20 client.15303 populate_metadata read hostname 'smithi107' 2024-05-10T10:55:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f497b613740 1 --2- 172.21.15.107:0/311011325 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5598f0852d20 0x5598f08d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f497b613740 4 client.15303 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T10:55:57.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.692+0000 7f497b613740 1 -- 172.21.15.107:0/311011325 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5598f07b5050 con 0x5598f0852d20 2024-05-10T10:55:57.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.693+0000 7f496bfff640 1 --2- 172.21.15.107:0/311011325 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5598f0852d20 0x5598f08d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:57.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.693+0000 7f496bfff640 1 --2- 172.21.15.107:0/311011325 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5598f0852d20 0x5598f08d0630 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85915d4bfec53085 server_cookie=e5f70a2b63a0af73 in_seq=0 out_seq=0 2024-05-10T10:55:57.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.693+0000 7f4959ffb640 10 client.15303 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:55:57.702 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.701+0000 7f4959ffb640 1 -- 172.21.15.107:0/311011325 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5598f07b5050 con 0x5598f0852d20 2024-05-10T10:55:57.702 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.701+0000 7f4959ffb640 10 client.15303 handle_command_reply: tid=0 2024-05-10T10:55:57.702 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.701+0000 7f497b613740 1 client.15303 shutdown 2024-05-10T10:55:57.702 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.701+0000 7f497b613740 1 -- 172.21.15.107:0/311011325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0844420 msgr2=0x5598f085c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:57.702 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.701+0000 7f497b613740 1 --2- 172.21.15.107:0/311011325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0844420 0x5598f085c2c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f49640a6630 tx=0x7f49640a8850 comp rx=0 tx=0).stop 2024-05-10T10:55:57.702 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.701+0000 7f497b613740 1 -- 172.21.15.107:0/311011325 shutdown_connections 2024-05-10T10:55:57.702 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.701+0000 7f497b613740 1 --2- 172.21.15.107:0/311011325 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5598f0852d20 0x5598f08d0630 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.702 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.701+0000 7f497b613740 1 --2- 172.21.15.107:0/311011325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5598f084dbb0 0x5598f085d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.703 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.701+0000 7f497b613740 1 --2- 172.21.15.107:0/311011325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5598f084d1c0 0x5598f085c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.703 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.701+0000 7f4959ffb640 0 client.15303 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:55:57.703 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.701+0000 7f497b613740 1 --2- 172.21.15.107:0/311011325 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5598f0844420 0x5598f085c2c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.703 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.701+0000 7f497b613740 1 -- 172.21.15.107:0/311011325 >> 172.21.15.107:0/311011325 conn(0x5598f0856eb0 msgr2=0x5598f0842cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:57.703 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.701+0000 7f497b613740 1 -- 172.21.15.107:0/311011325 shutdown_connections 2024-05-10T10:55:57.703 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.701+0000 7f497b613740 1 -- 172.21.15.107:0/311011325 wait complete. 2024-05-10T10:55:57.703 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.701+0000 7f497b613740 20 client.15303 trim_cache size 0 max 16384 2024-05-10T10:55:57.703 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:{ 2024-05-10T10:55:57.703 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "message": "", 2024-05-10T10:55:57.704 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "return_code": 0 2024-05-10T10:55:57.704 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:} 2024-05-10T10:55:57.704 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.702+0000 7f49788fc640 1 -- 172.21.15.107:0/3718099807 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f49600b2920 msgr2=0x7f49600b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:57.704 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.702+0000 7f49788fc640 1 --2- 172.21.15.107:0/3718099807 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f49600b2920 0x7f49600b4de0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x5598f084e410 tx=0x7f496c007720 comp rx=0 tx=0).stop 2024-05-10T10:55:57.705 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.702+0000 7f49788fc640 1 -- 172.21.15.107:0/3718099807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4974101910 msgr2=0x7f4974198c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:57.705 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.702+0000 7f49788fc640 1 --2- 172.21.15.107:0/3718099807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4974101910 0x7f4974198c90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f496400b450 tx=0x7f496400b910 comp rx=0 tx=0).stop 2024-05-10T10:55:57.705 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.702+0000 7f49788fc640 1 -- 172.21.15.107:0/3718099807 shutdown_connections 2024-05-10T10:55:57.705 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.702+0000 7f49788fc640 1 --2- 172.21.15.107:0/3718099807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49741034c0 0x7f49741a0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.705 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.702+0000 7f49788fc640 1 --2- 172.21.15.107:0/3718099807 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4974102b00 0x7f49741991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.705 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.702+0000 7f49788fc640 1 --2- 172.21.15.107:0/3718099807 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f49600b2920 0x7f49600b4de0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.705 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.702+0000 7f49788fc640 1 --2- 172.21.15.107:0/3718099807 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4974101910 0x7f4974198c90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:57.705 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.702+0000 7f49788fc640 1 -- 172.21.15.107:0/3718099807 >> 172.21.15.107:0/3718099807 conn(0x7f49740fce80 msgr2=0x7f49740fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:57.705 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.702+0000 7f49788fc640 1 -- 172.21.15.107:0/3718099807 shutdown_connections 2024-05-10T10:55:57.705 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:55:57.702+0000 7f49788fc640 1 -- 172.21.15.107:0/3718099807 wait complete. 2024-05-10T10:55:58.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.459+0000 7fccb620b700 1 -- 172.21.15.107:0/942293369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccb01023d0 msgr2=0x7fccb0102830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:58.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.459+0000 7fccb620b700 1 --2- 172.21.15.107:0/942293369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccb01023d0 0x7fccb0102830 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009990 tx=0x7fcca0009ca0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.459+0000 7fccb620b700 1 -- 172.21.15.107:0/942293369 shutdown_connections 2024-05-10T10:55:58.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.459+0000 7fccb620b700 1 --2- 172.21.15.107:0/942293369 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccb0102d70 0x7fccb010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.459+0000 7fccb620b700 1 --2- 172.21.15.107:0/942293369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccb0108410 0x7fccb01087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.459+0000 7fccb620b700 1 --2- 172.21.15.107:0/942293369 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccb01023d0 0x7fccb0102830 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.459+0000 7fccb620b700 1 -- 172.21.15.107:0/942293369 >> 172.21.15.107:0/942293369 conn(0x7fccb0079340 msgr2=0x7fccb0079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:58.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.459+0000 7fccb620b700 1 -- 172.21.15.107:0/942293369 shutdown_connections 2024-05-10T10:55:58.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.459+0000 7fccb620b700 1 -- 172.21.15.107:0/942293369 wait complete. 2024-05-10T10:55:58.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.460+0000 7fccb620b700 1 Processor -- start 2024-05-10T10:55:58.461 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.460+0000 7fccb620b700 1 -- start start 2024-05-10T10:55:58.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccb620b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccb01023d0 0x7fccb010f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:58.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccb620b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccb0102d70 0x7fccb010ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:58.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccb620b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccb0108410 0x7fccb0110460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:58.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccb620b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fccb01137d0 con 0x7fccb0108410 2024-05-10T10:55:58.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccb620b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fccb0113650 con 0x7fccb01023d0 2024-05-10T10:55:58.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccb620b700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fccb0113950 con 0x7fccb0102d70 2024-05-10T10:55:58.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccaffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccb0108410 0x7fccb0110460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:58.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccaffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccb0108410 0x7fccb0110460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44406/0 (socket says 172.21.15.107:44406) 2024-05-10T10:55:58.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccaffff700 1 -- 172.21.15.107:0/2377294095 learned_addr learned my addr 172.21.15.107:0/2377294095 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:58.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccaeffd700 1 --2- 172.21.15.107:0/2377294095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccb0102d70 0x7fccb010ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:58.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccaf7fe700 1 --2- 172.21.15.107:0/2377294095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccb01023d0 0x7fccb010f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:58.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccaffff700 1 -- 172.21.15.107:0/2377294095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccb0102d70 msgr2=0x7fccb010ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:58.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccaffff700 1 --2- 172.21.15.107:0/2377294095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccb0102d70 0x7fccb010ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccaffff700 1 -- 172.21.15.107:0/2377294095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccb01023d0 msgr2=0x7fccb010f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:58.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccaffff700 1 --2- 172.21.15.107:0/2377294095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccb01023d0 0x7fccb010f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccaffff700 1 -- 172.21.15.107:0/2377294095 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb01a8130 con 0x7fccb0108410 2024-05-10T10:55:58.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccaffff700 1 --2- 172.21.15.107:0/2377294095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccb0108410 0x7fccb0110460 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcca8007d70 tx=0x7fcca800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:58.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccacff9700 1 -- 172.21.15.107:0/2377294095 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca8016020 con 0x7fccb0108410 2024-05-10T10:55:58.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccacff9700 1 -- 172.21.15.107:0/2377294095 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcca800ad40 con 0x7fccb0108410 2024-05-10T10:55:58.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccb620b700 1 -- 172.21.15.107:0/2377294095 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb01a8420 con 0x7fccb0108410 2024-05-10T10:55:58.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccacff9700 1 -- 172.21.15.107:0/2377294095 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca8011620 con 0x7fccb0108410 2024-05-10T10:55:58.465 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.461+0000 7fccb620b700 1 -- 172.21.15.107:0/2377294095 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb01a8930 con 0x7fccb0108410 2024-05-10T10:55:58.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.465+0000 7fccacff9700 1 -- 172.21.15.107:0/2377294095 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 149704+0+0 (secure 0 0 0) 0x7fcca8019020 con 0x7fccb0108410 2024-05-10T10:55:58.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.465+0000 7fccacff9700 1 --2- 172.21.15.107:0/2377294095 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcc9c0b2990 0x7fcc9c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:58.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.465+0000 7fccaf7fe700 1 --2- 172.21.15.107:0/2377294095 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcc9c0b2990 0x7fcc9c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:58.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.465+0000 7fccacff9700 1 -- 172.21.15.107:0/2377294095 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fcca80e20e0 con 0x7fccb0108410 2024-05-10T10:55:58.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.465+0000 7fccc0a9eb80 1 Processor -- start 2024-05-10T10:55:58.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccc0a9eb80 1 -- start start 2024-05-10T10:55:58.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccc0a9eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 0x556128dab540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:58.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccc0a9eb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128daba80 0x556128da57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:58.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccc0a9eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128da5d00 0x556128da6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:58.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccc0a9eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556128cf78f0 con 0x556128dab160 2024-05-10T10:55:58.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccc0a9eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556128c5cd50 con 0x556128da5d00 2024-05-10T10:55:58.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccc0a9eb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x556128cf38b0 con 0x556128daba80 2024-05-10T10:55:58.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccaf7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 0x556128dab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:58.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccaf7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 0x556128dab540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44408/0 (socket says 172.21.15.107:44408) 2024-05-10T10:55:58.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccaf7fe700 1 -- 172.21.15.107:0/3639532596 learned_addr learned my addr 172.21.15.107:0/3639532596 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:58.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccaf7fe700 1 --2- 172.21.15.107:0/2377294095 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcc9c0b2990 0x7fcc9c0b4e50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcc98005fd0 tx=0x7fcc98005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:58.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccaffff700 1 --2- 172.21.15.107:0/3639532596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128da5d00 0x556128da6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:58.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccaeffd700 1 --2- 172.21.15.107:0/3639532596 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128daba80 0x556128da57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:58.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccaf7fe700 1 -- 172.21.15.107:0/3639532596 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128daba80 msgr2=0x556128da57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:58.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccaf7fe700 1 --2- 172.21.15.107:0/3639532596 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128daba80 0x556128da57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccaf7fe700 1 -- 172.21.15.107:0/3639532596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128da5d00 msgr2=0x556128da6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:58.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccaf7fe700 1 --2- 172.21.15.107:0/3639532596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128da5d00 0x556128da6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccaf7fe700 1 -- 172.21.15.107:0/3639532596 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556128c44880 con 0x556128dab160 2024-05-10T10:55:58.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccaeffd700 1 --2- 172.21.15.107:0/3639532596 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128daba80 0x556128da57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:55:58.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.466+0000 7fccaf7fe700 1 --2- 172.21.15.107:0/3639532596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 0x556128dab540 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800ebe0 tx=0x7fcc98011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5eea62f16128ca server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:58.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.467+0000 7fcca5ffb700 1 -- 172.21.15.107:0/3639532596 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc98021070 con 0x556128dab160 2024-05-10T10:55:58.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.467+0000 7fcca5ffb700 1 -- 172.21.15.107:0/3639532596 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcc98010cd0 con 0x556128dab160 2024-05-10T10:55:58.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.467+0000 7fcca5ffb700 1 -- 172.21.15.107:0/3639532596 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9800f620 con 0x556128dab160 2024-05-10T10:55:58.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.467+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/3639532596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 msgr2=0x556128dab540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:58.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.467+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/3639532596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 0x556128dab540 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800ebe0 tx=0x7fcc98011000 comp rx=0 tx=0).stop 2024-05-10T10:55:58.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.467+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/3639532596 shutdown_connections 2024-05-10T10:55:58.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.467+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/3639532596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128da5d00 0x556128da6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.467+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/3639532596 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 0x556128dab540 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.467+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/3639532596 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128daba80 0x556128da57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.467+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/3639532596 >> 172.21.15.107:0/3639532596 conn(0x556128cd1b20 msgr2=0x556128da0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:58.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.468+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/3639532596 shutdown_connections 2024-05-10T10:55:58.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.468+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/3639532596 wait complete. 2024-05-10T10:55:58.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.468+0000 7fccc0a9eb80 1 -- start start 2024-05-10T10:55:58.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.468+0000 7fccc0a9eb80 1 Processor -- start 2024-05-10T10:55:58.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.468+0000 7fccc0a9eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128da5d00 0x556128db1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:58.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.468+0000 7fccc0a9eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 0x556128daea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:58.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.468+0000 7fccc0a9eb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128daba80 0x556128daef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:58.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.468+0000 7fccc0a9eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556128db2400 con 0x556128dab160 2024-05-10T10:55:58.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.468+0000 7fccc0a9eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556128cb0e80 con 0x556128da5d00 2024-05-10T10:55:58.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.468+0000 7fccc0a9eb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x556128db2580 con 0x556128daba80 2024-05-10T10:55:58.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.468+0000 7fccc0a9eb80 10 client.0 _ll_register_callbacks cb 0x556128c8b560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:55:58.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.468+0000 7fccaeffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 0x556128daea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:58.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.468+0000 7fccaeffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 0x556128daea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44424/0 (socket says 172.21.15.107:44424) 2024-05-10T10:55:58.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.469+0000 7fccaeffd700 1 -- 172.21.15.107:0/3378184485 learned_addr learned my addr 172.21.15.107:0/3378184485 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:58.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.469+0000 7fccaf7fe700 1 --2- 172.21.15.107:0/3378184485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128da5d00 0x556128db1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:58.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.469+0000 7fccaffff700 1 --2- 172.21.15.107:0/3378184485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128daba80 0x556128daef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:58.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.469+0000 7fccaeffd700 1 -- 172.21.15.107:0/3378184485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128daba80 msgr2=0x556128daef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:58.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.469+0000 7fccaeffd700 1 --2- 172.21.15.107:0/3378184485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128daba80 0x556128daef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.469+0000 7fccaeffd700 1 -- 172.21.15.107:0/3378184485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128da5d00 msgr2=0x556128db1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:58.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.469+0000 7fccaeffd700 1 --2- 172.21.15.107:0/3378184485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128da5d00 0x556128db1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.469+0000 7fccaeffd700 1 -- 172.21.15.107:0/3378184485 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556128cae710 con 0x556128dab160 2024-05-10T10:55:58.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.469+0000 7fccaeffd700 1 --2- 172.21.15.107:0/3378184485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 0x556128daea00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009990 tx=0x7fcca0009910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0597e3e457b3ba6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:58.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.469+0000 7fcc8effd700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:55:58.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.469+0000 7fcc8effd700 1 -- 172.21.15.107:0/3378184485 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca0028060 con 0x556128dab160 2024-05-10T10:55:58.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.469+0000 7fcc8effd700 1 -- 172.21.15.107:0/3378184485 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fcca00054d0 con 0x556128dab160 2024-05-10T10:55:58.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.469+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/3378184485 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc98010cd0 con 0x556128dab160 2024-05-10T10:55:58.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.469+0000 7fcc8effd700 1 -- 172.21.15.107:0/3378184485 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcca00056d0 con 0x556128dab160 2024-05-10T10:55:58.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.469+0000 7fccc0a9eb80 10 client.15315 fetch_fsmap learned FSMap version 27 2024-05-10T10:55:58.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.469+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/3378184485 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556128dbcc20 con 0x556128dab160 2024-05-10T10:55:58.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.469+0000 7fcc8effd700 1 -- 172.21.15.107:0/3378184485 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcc98010cd0 con 0x556128dab160 2024-05-10T10:55:58.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.470+0000 7fcc8effd700 1 -- 172.21.15.107:0/3378184485 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fcca002d070 con 0x556128dab160 2024-05-10T10:55:58.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.470+0000 7fccc0a9eb80 10 client.15315 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:55:58.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.470+0000 7fccc0a9eb80 10 client.15315 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-10T10:55:58.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.470+0000 7fccc0a9eb80 20 client.15315 populate_metadata read hostname 'smithi107' 2024-05-10T10:55:58.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.470+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/3378184485 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x556128dbf270 0x556128dc06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:58.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.470+0000 7fccc0a9eb80 4 client.15315 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:55:58.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.470+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/3378184485 --> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556128d052d0 con 0x556128dbf270 2024-05-10T10:55:58.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.470+0000 7fccaf7fe700 1 --2- 172.21.15.107:0/3378184485 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x556128dbf270 0x556128dc06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:58.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.471+0000 7fccaf7fe700 1 --2- 172.21.15.107:0/3378184485 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x556128dbf270 0x556128dc06e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=28e0299c8617c9f7 server_cookie=c557e61c862c74a7 in_seq=0 out_seq=0 2024-05-10T10:55:58.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.471+0000 7fcc8effd700 10 client.15315 ms_handle_connect on v2:172.21.15.184:6834/872203477 2024-05-10T10:55:58.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.471+0000 7fcc8effd700 1 -- 172.21.15.107:0/3378184485 <== mds.3 v2:172.21.15.184:6834/872203477 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556128d052d0 con 0x556128dbf270 2024-05-10T10:55:58.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.471+0000 7fcc8effd700 10 client.15315 handle_command_reply: tid=0 2024-05-10T10:55:58.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.471+0000 7fccc0a9eb80 1 client.15315 shutdown 2024-05-10T10:55:58.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.471+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/3378184485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 msgr2=0x556128daea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:58.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.471+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/3378184485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 0x556128daea00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009990 tx=0x7fcca0009910 comp rx=0 tx=0).stop 2024-05-10T10:55:58.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.471+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/3378184485 shutdown_connections 2024-05-10T10:55:58.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.471+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/3378184485 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x556128dbf270 0x556128dc06e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.472+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/3378184485 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128daba80 0x556128daef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.472+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/3378184485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128da5d00 0x556128db1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.472+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/3378184485 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 0x556128daea00 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.472+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/3378184485 >> 172.21.15.107:0/3378184485 conn(0x556128cd1b20 msgr2=0x556128d9aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:58.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.472+0000 7fcc8effd700 0 client.15315 ms_handle_reset on v2:172.21.15.184:6834/872203477 2024-05-10T10:55:58.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.472+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/3378184485 shutdown_connections 2024-05-10T10:55:58.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.472+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/3378184485 wait complete. 2024-05-10T10:55:58.478 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.472+0000 7fccc0a9eb80 20 client.15315 trim_cache size 0 max 16384 2024-05-10T10:55:58.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.492+0000 7fccc0a9eb80 1 Processor -- start 2024-05-10T10:55:58.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.492+0000 7fccc0a9eb80 1 -- start start 2024-05-10T10:55:58.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fccc0a9eb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128da5d00 0x556128d9abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:58.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fccc0a9eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 0x556128dad310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:58.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fccc0a9eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128daba80 0x556128dad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:58.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fccc0a9eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556128dbea20 con 0x556128dab160 2024-05-10T10:55:58.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fccc0a9eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556128dbf0f0 con 0x556128daba80 2024-05-10T10:55:58.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fccc0a9eb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x556128dbf7c0 con 0x556128da5d00 2024-05-10T10:55:58.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fccaeffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 0x556128dad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:58.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fccaeffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 0x556128dad310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44440/0 (socket says 172.21.15.107:44440) 2024-05-10T10:55:58.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fccaeffd700 1 -- 172.21.15.107:0/601217502 learned_addr learned my addr 172.21.15.107:0/601217502 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:58.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fccaffff700 1 --2- 172.21.15.107:0/601217502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128daba80 0x556128dad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:58.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fccaeffd700 1 -- 172.21.15.107:0/601217502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128da5d00 msgr2=0x556128d9abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:58.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fccaeffd700 1 --2- 172.21.15.107:0/601217502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128da5d00 0x556128d9abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fccaeffd700 1 -- 172.21.15.107:0/601217502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128daba80 msgr2=0x556128dad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:58.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fccaeffd700 1 --2- 172.21.15.107:0/601217502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128daba80 0x556128dad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fccaeffd700 1 -- 172.21.15.107:0/601217502 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556128d9cc30 con 0x556128dab160 2024-05-10T10:55:58.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fccaffff700 1 --2- 172.21.15.107:0/601217502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128daba80 0x556128dad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:55:58.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fccaeffd700 1 --2- 172.21.15.107:0/601217502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 0x556128dad310 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcca0005090 tx=0x7fcca0009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01dd0f9aa91dd0e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:58.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fcca57fa700 1 -- 172.21.15.107:0/601217502 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca0033070 con 0x556128dab160 2024-05-10T10:55:58.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fcca57fa700 1 -- 172.21.15.107:0/601217502 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcca000f660 con 0x556128dab160 2024-05-10T10:55:58.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.493+0000 7fcca57fa700 1 -- 172.21.15.107:0/601217502 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca000bd40 con 0x556128dab160 2024-05-10T10:55:58.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.494+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/601217502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 msgr2=0x556128dad310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:58.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.494+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/601217502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 0x556128dad310 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcca0005090 tx=0x7fcca0009ca0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.494+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/601217502 shutdown_connections 2024-05-10T10:55:58.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.494+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/601217502 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128da5d00 0x556128d9abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.494+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/601217502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128daba80 0x556128dad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.494+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/601217502 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128dab160 0x556128dad310 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.494+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/601217502 >> 172.21.15.107:0/601217502 conn(0x556128cd1b20 msgr2=0x556128da8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:58.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.494+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/601217502 shutdown_connections 2024-05-10T10:55:58.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.494+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/601217502 wait complete. 2024-05-10T10:55:58.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.494+0000 7fccc0a9eb80 1 -- start start 2024-05-10T10:55:58.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.494+0000 7fccc0a9eb80 1 Processor -- start 2024-05-10T10:55:58.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccc0a9eb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128da5d00 0x556128d9a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:58.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccc0a9eb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128dab160 0x556128d9a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:58.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccc0a9eb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128daba80 0x556128d9ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:58.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccc0a9eb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x556128dc0560 con 0x556128daba80 2024-05-10T10:55:58.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccc0a9eb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556128dbfe90 con 0x556128dab160 2024-05-10T10:55:58.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccc0a9eb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x556128dc0c30 con 0x556128da5d00 2024-05-10T10:55:58.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccc0a9eb80 10 client.0 _ll_register_callbacks cb 0x556128c8b560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:55:58.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccaffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128daba80 0x556128d9ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:58.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccaffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128daba80 0x556128d9ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44446/0 (socket says 172.21.15.107:44446) 2024-05-10T10:55:58.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccaffff700 1 -- 172.21.15.107:0/1089966352 learned_addr learned my addr 172.21.15.107:0/1089966352 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:55:58.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccaeffd700 1 --2- 172.21.15.107:0/1089966352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128dab160 0x556128d9a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:58.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccaf7fe700 1 --2- 172.21.15.107:0/1089966352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128da5d00 0x556128d9a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:58.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccaffff700 1 -- 172.21.15.107:0/1089966352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128da5d00 msgr2=0x556128d9a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:58.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccaffff700 1 --2- 172.21.15.107:0/1089966352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128da5d00 0x556128d9a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccaffff700 1 -- 172.21.15.107:0/1089966352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128dab160 msgr2=0x556128d9a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:55:58.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccaffff700 1 --2- 172.21.15.107:0/1089966352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128dab160 0x556128d9a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccaffff700 1 -- 172.21.15.107:0/1089966352 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556128dc8080 con 0x556128daba80 2024-05-10T10:55:58.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccaeffd700 1 --2- 172.21.15.107:0/1089966352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128dab160 0x556128d9a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:55:58.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccaffff700 1 --2- 172.21.15.107:0/1089966352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128daba80 0x556128d9ac40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcca80a5830 tx=0x7fcca8006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af7e8294779da1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:55:58.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fcc8effd700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:55:58.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fcc8effd700 1 -- 172.21.15.107:0/1089966352 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca80c3060 con 0x556128daba80 2024-05-10T10:55:58.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fcc8effd700 1 -- 172.21.15.107:0/1089966352 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fcca80cc0b0 con 0x556128daba80 2024-05-10T10:55:58.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.495+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/1089966352 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcca000f660 con 0x556128daba80 2024-05-10T10:55:58.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.496+0000 7fcc8effd700 1 -- 172.21.15.107:0/1089966352 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcca80a9eb0 con 0x556128daba80 2024-05-10T10:55:58.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.496+0000 7fccc0a9eb80 10 client.15321 fetch_fsmap learned FSMap version 27 2024-05-10T10:55:58.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.496+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/1089966352 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556128e2aa80 con 0x556128daba80 2024-05-10T10:55:58.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.496+0000 7fcc8effd700 1 -- 172.21.15.107:0/1089966352 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcca000f660 con 0x556128daba80 2024-05-10T10:55:58.501 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.496+0000 7fcc8effd700 1 -- 172.21.15.107:0/1089966352 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fcca80aab70 con 0x556128daba80 2024-05-10T10:55:58.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.496+0000 7fccc0a9eb80 10 client.15321 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:55:58.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.496+0000 7fccc0a9eb80 10 client.15321 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-10T10:55:58.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.496+0000 7fccc0a9eb80 20 client.15321 populate_metadata read hostname 'smithi107' 2024-05-10T10:55:58.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.496+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/1089966352 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x556128e2f5f0 0x556128e2e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:55:58.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.496+0000 7fccc0a9eb80 4 client.15321 mds_command: new command op to 24431 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T10:55:58.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.496+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/1089966352 --> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] -- command(tid 0: {"prefix": "status"}) -- 0x556128cff370 con 0x556128e2f5f0 2024-05-10T10:55:58.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.496+0000 7fccaf7fe700 1 --2- 172.21.15.107:0/1089966352 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x556128e2f5f0 0x556128e2e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:55:58.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.497+0000 7fccaf7fe700 1 --2- 172.21.15.107:0/1089966352 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x556128e2f5f0 0x556128e2e300 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f0725f5e87e0b597 server_cookie=3d302f25d80ed50c in_seq=0 out_seq=0 2024-05-10T10:55:58.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.497+0000 7fcc8effd700 10 client.15321 ms_handle_connect on v2:172.21.15.184:6834/872203477 2024-05-10T10:55:58.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.497+0000 7fcc8effd700 1 -- 172.21.15.107:0/1089966352 <== mds.3 v2:172.21.15.184:6834/872203477 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x556128cff370 con 0x556128e2f5f0 2024-05-10T10:55:58.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.497+0000 7fcc8effd700 10 client.15321 handle_command_reply: tid=0 2024-05-10T10:55:58.502 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.497+0000 7fccc0a9eb80 1 client.15321 shutdown 2024-05-10T10:55:58.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.497+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/1089966352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128daba80 msgr2=0x556128d9ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:58.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.497+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/1089966352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128daba80 0x556128d9ac40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcca80a5830 tx=0x7fcca8006040 comp rx=0 tx=0).stop 2024-05-10T10:55:58.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.497+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/1089966352 shutdown_connections 2024-05-10T10:55:58.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.497+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/1089966352 >> [v2:172.21.15.184:6834/872203477,v1:172.21.15.184:6835/872203477] conn(0x556128e2f5f0 0x556128e2e300 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.497+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/1089966352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556128da5d00 0x556128d9a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.497+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/1089966352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x556128daba80 0x556128d9ac40 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.497+0000 7fccc0a9eb80 1 --2- 172.21.15.107:0/1089966352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556128dab160 0x556128d9a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.497+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/1089966352 >> 172.21.15.107:0/1089966352 conn(0x556128cd1b20 msgr2=0x556128dad2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:58.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.497+0000 7fcc8effd700 0 client.15321 ms_handle_reset on v2:172.21.15.184:6834/872203477 2024-05-10T10:55:58.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.497+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/1089966352 shutdown_connections 2024-05-10T10:55:58.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.497+0000 7fccc0a9eb80 1 -- 172.21.15.107:0/1089966352 wait complete. 2024-05-10T10:55:58.504 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.498+0000 7fccc0a9eb80 20 client.15321 trim_cache size 0 max 16384 2024-05-10T10:55:58.505 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:55:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "0ba8a8e4-0eba-11ef-bc98-c7b262605968", 2024-05-10T10:55:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 3, 2024-05-10T10:55:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24431, 2024-05-10T10:55:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2024-05-10T10:55:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2024-05-10T10:55:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2024-05-10T10:55:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 206.69964705000001, 2024-05-10T10:55:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 27, 2024-05-10T10:55:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 82, 2024-05-10T10:55:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 82, 2024-05-10T10:55:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 258.99940067799997 2024-05-10T10:55:58.505 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:55:58.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.498+0000 7fccb620b700 1 -- 172.21.15.107:0/2377294095 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcc9c0b2990 msgr2=0x7fcc9c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:58.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.498+0000 7fccb620b700 1 --2- 172.21.15.107:0/2377294095 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcc9c0b2990 0x7fcc9c0b4e50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcc98005fd0 tx=0x7fcc98005db0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.498+0000 7fccb620b700 1 -- 172.21.15.107:0/2377294095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccb0108410 msgr2=0x7fccb0110460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:55:58.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.498+0000 7fccb620b700 1 --2- 172.21.15.107:0/2377294095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccb0108410 0x7fccb0110460 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcca8007d70 tx=0x7fcca800a340 comp rx=0 tx=0).stop 2024-05-10T10:55:58.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.498+0000 7fccb620b700 1 -- 172.21.15.107:0/2377294095 shutdown_connections 2024-05-10T10:55:58.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.498+0000 7fccb620b700 1 --2- 172.21.15.107:0/2377294095 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcc9c0b2990 0x7fcc9c0b4e50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.498+0000 7fccb620b700 1 --2- 172.21.15.107:0/2377294095 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fccb0108410 0x7fccb0110460 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.498+0000 7fccb620b700 1 --2- 172.21.15.107:0/2377294095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fccb01023d0 0x7fccb010f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.498+0000 7fccb620b700 1 --2- 172.21.15.107:0/2377294095 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccb0102d70 0x7fccb010ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:55:58.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.498+0000 7fccb620b700 1 -- 172.21.15.107:0/2377294095 >> 172.21.15.107:0/2377294095 conn(0x7fccb0079340 msgr2=0x7fccb01012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:55:58.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.498+0000 7fccb620b700 1 -- 172.21.15.107:0/2377294095 shutdown_connections 2024-05-10T10:55:58.507 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:55:58.498+0000 7fccb620b700 1 -- 172.21.15.107:0/2377294095 wait complete. 2024-05-10T10:55:59.076 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:55:59 smithi107 ceph-mon[30373]: pgmap v397: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-05-10T10:55:59.105 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell mds.i status 2024-05-10T10:55:59.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:55:59 smithi196 ceph-mon[34872]: pgmap v397: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-05-10T10:55:59.350 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:55:59.388 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:55:59 smithi184 ceph-mon[34585]: pgmap v397: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-05-10T10:56:01.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.108+0000 7f57a3332700 1 -- 172.21.15.107:0/2493157686 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f579c1023a0 msgr2=0x7f579c102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:01.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.108+0000 7f57a3332700 1 --2- 172.21.15.107:0/2493157686 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f579c1023a0 0x7f579c102820 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f578c009990 tx=0x7f578c009ca0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.108+0000 7f57a3332700 1 -- 172.21.15.107:0/2493157686 shutdown_connections 2024-05-10T10:56:01.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.108+0000 7f57a3332700 1 --2- 172.21.15.107:0/2493157686 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f579c108410 0x7f579c1087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.108+0000 7f57a3332700 1 --2- 172.21.15.107:0/2493157686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f579c102d60 0x7f579c10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.111 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.108+0000 7f57a3332700 1 --2- 172.21.15.107:0/2493157686 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f579c1023a0 0x7f579c102820 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.108+0000 7f57a3332700 1 -- 172.21.15.107:0/2493157686 >> 172.21.15.107:0/2493157686 conn(0x7f579c079350 msgr2=0x7f579c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:01.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.108+0000 7f57a3332700 1 -- 172.21.15.107:0/2493157686 shutdown_connections 2024-05-10T10:56:01.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.108+0000 7f57a3332700 1 -- 172.21.15.107:0/2493157686 wait complete. 2024-05-10T10:56:01.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.109+0000 7f57a3332700 1 Processor -- start 2024-05-10T10:56:01.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.109+0000 7f57a3332700 1 -- start start 2024-05-10T10:56:01.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.109+0000 7f57a3332700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f579c1023a0 0x7f579c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:01.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.109+0000 7f57a3332700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f579c102d60 0x7f579c19b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:01.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.109+0000 7f57a3332700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f579c108410 0x7f579c1a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:01.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.109+0000 7f57a3332700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f579c1126f0 con 0x7f579c102d60 2024-05-10T10:56:01.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.109+0000 7f57a3332700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f579c112570 con 0x7f579c1023a0 2024-05-10T10:56:01.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.109+0000 7f57a3332700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f579c112870 con 0x7f579c108410 2024-05-10T10:56:01.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.109+0000 7f57a08cd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f579c102d60 0x7f579c19b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:01.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.109+0000 7f57a08cd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f579c102d60 0x7f579c19b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44470/0 (socket says 172.21.15.107:44470) 2024-05-10T10:56:01.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.109+0000 7f57a08cd700 1 -- 172.21.15.107:0/2891023063 learned_addr learned my addr 172.21.15.107:0/2891023063 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:01.112 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.110+0000 7f57a10ce700 1 --2- 172.21.15.107:0/2891023063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f579c1023a0 0x7f579c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:01.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.110+0000 7f57a18cf700 1 --2- 172.21.15.107:0/2891023063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f579c108410 0x7f579c1a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:01.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.110+0000 7f57a08cd700 1 -- 172.21.15.107:0/2891023063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f579c108410 msgr2=0x7f579c1a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:01.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.110+0000 7f57a08cd700 1 --2- 172.21.15.107:0/2891023063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f579c108410 0x7f579c1a5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.110+0000 7f57a08cd700 1 -- 172.21.15.107:0/2891023063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f579c1023a0 msgr2=0x7f579c19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:01.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.110+0000 7f57a08cd700 1 --2- 172.21.15.107:0/2891023063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f579c1023a0 0x7f579c19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.110+0000 7f57a08cd700 1 -- 172.21.15.107:0/2891023063 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579c1a6110 con 0x7f579c102d60 2024-05-10T10:56:01.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.110+0000 7f57a18cf700 1 --2- 172.21.15.107:0/2891023063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f579c108410 0x7f579c1a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:56:01.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.110+0000 7f57a08cd700 1 --2- 172.21.15.107:0/2891023063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f579c102d60 0x7f579c19b090 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f578c000c00 tx=0x7f578c0037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:01.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.110+0000 7f57927fc700 1 -- 172.21.15.107:0/2891023063 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c027070 con 0x7f579c102d60 2024-05-10T10:56:01.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.110+0000 7f57927fc700 1 -- 172.21.15.107:0/2891023063 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f578c0041e0 con 0x7f579c102d60 2024-05-10T10:56:01.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.110+0000 7f57a3332700 1 -- 172.21.15.107:0/2891023063 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f579c1a62e0 con 0x7f579c102d60 2024-05-10T10:56:01.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.110+0000 7f57927fc700 1 -- 172.21.15.107:0/2891023063 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c00f460 con 0x7f579c102d60 2024-05-10T10:56:01.113 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.110+0000 7f57a3332700 1 -- 172.21.15.107:0/2891023063 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f579c1a6730 con 0x7f579c102d60 2024-05-10T10:56:01.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.113+0000 7f57927fc700 1 -- 172.21.15.107:0/2891023063 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 149704+0+0 (secure 0 0 0) 0x7f578c02a070 con 0x7f579c102d60 2024-05-10T10:56:01.114 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.113+0000 7f57927fc700 1 --2- 172.21.15.107:0/2891023063 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f57880b2910 0x7f57880b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:01.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.113+0000 7f57a10ce700 1 --2- 172.21.15.107:0/2891023063 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f57880b2910 0x7f57880b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:01.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.113+0000 7f57927fc700 1 -- 172.21.15.107:0/2891023063 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f578c0e3120 con 0x7f579c102d60 2024-05-10T10:56:01.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.114+0000 7f57adbc5b80 1 Processor -- start 2024-05-10T10:56:01.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.114+0000 7f57a10ce700 1 --2- 172.21.15.107:0/2891023063 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f57880b2910 0x7f57880b4dd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5798006fd0 tx=0x7f5798008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:01.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.114+0000 7f57adbc5b80 1 -- start start 2024-05-10T10:56:01.115 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:01 smithi107 ceph-mon[30373]: pgmap v398: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-10T10:56:01.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.114+0000 7f57adbc5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30160 0x564f60d30540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:01.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.114+0000 7f57adbc5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30a80 0x564f60d2a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:01.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.114+0000 7f57adbc5b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d2ad00 0x564f60d2b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:01.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.114+0000 7f57adbc5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564f60c7c8f0 con 0x564f60d30160 2024-05-10T10:56:01.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.114+0000 7f57adbc5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564f60be1d50 con 0x564f60d30a80 2024-05-10T10:56:01.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.114+0000 7f57adbc5b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x564f60c788b0 con 0x564f60d2ad00 2024-05-10T10:56:01.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.114+0000 7f57a10ce700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30160 0x564f60d30540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:01.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.114+0000 7f57a10ce700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30160 0x564f60d30540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44480/0 (socket says 172.21.15.107:44480) 2024-05-10T10:56:01.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.114+0000 7f57a10ce700 1 -- 172.21.15.107:0/2089932698 learned_addr learned my addr 172.21.15.107:0/2089932698 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:01.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.115+0000 7f57a18cf700 1 --2- 172.21.15.107:0/2089932698 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d2ad00 0x564f60d2b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:01.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.115+0000 7f57a08cd700 1 --2- 172.21.15.107:0/2089932698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30a80 0x564f60d2a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:01.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.115+0000 7f57a10ce700 1 -- 172.21.15.107:0/2089932698 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d2ad00 msgr2=0x564f60d2b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:01.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.115+0000 7f57a10ce700 1 --2- 172.21.15.107:0/2089932698 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d2ad00 0x564f60d2b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.115+0000 7f57a10ce700 1 -- 172.21.15.107:0/2089932698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30a80 msgr2=0x564f60d2a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:01.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.115+0000 7f57a10ce700 1 --2- 172.21.15.107:0/2089932698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30a80 0x564f60d2a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.115+0000 7f57a10ce700 1 -- 172.21.15.107:0/2089932698 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f60bc9880 con 0x564f60d30160 2024-05-10T10:56:01.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.115+0000 7f57a10ce700 1 --2- 172.21.15.107:0/2089932698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30160 0x564f60d30540 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f579800d750 tx=0x7f5798010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1bbaf30eaeb464 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:01.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.115+0000 7f57877fe700 1 -- 172.21.15.107:0/2089932698 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5798024070 con 0x564f60d30160 2024-05-10T10:56:01.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.115+0000 7f57877fe700 1 -- 172.21.15.107:0/2089932698 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f579800de70 con 0x564f60d30160 2024-05-10T10:56:01.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.115+0000 7f57877fe700 1 -- 172.21.15.107:0/2089932698 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579801fab0 con 0x564f60d30160 2024-05-10T10:56:01.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.116+0000 7f57adbc5b80 1 -- 172.21.15.107:0/2089932698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30160 msgr2=0x564f60d30540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:01.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.116+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/2089932698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30160 0x564f60d30540 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f579800d750 tx=0x7f5798010000 comp rx=0 tx=0).stop 2024-05-10T10:56:01.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.116+0000 7f57adbc5b80 1 -- 172.21.15.107:0/2089932698 shutdown_connections 2024-05-10T10:56:01.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.116+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/2089932698 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d2ad00 0x564f60d2b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.116+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/2089932698 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30160 0x564f60d30540 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.116+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/2089932698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30a80 0x564f60d2a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.116+0000 7f57adbc5b80 1 -- 172.21.15.107:0/2089932698 >> 172.21.15.107:0/2089932698 conn(0x564f60c56b20 msgr2=0x564f60d25250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:01.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.116+0000 7f57adbc5b80 1 -- 172.21.15.107:0/2089932698 shutdown_connections 2024-05-10T10:56:01.121 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.116+0000 7f57adbc5b80 1 -- 172.21.15.107:0/2089932698 wait complete. 2024-05-10T10:56:01.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.116+0000 7f57adbc5b80 1 -- start start 2024-05-10T10:56:01.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.117+0000 7f57adbc5b80 1 Processor -- start 2024-05-10T10:56:01.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.117+0000 7f57adbc5b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d2ad00 0x564f60d36670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:01.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.117+0000 7f57adbc5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30160 0x564f60d33a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:01.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.117+0000 7f57adbc5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30a80 0x564f60d33f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:01.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.117+0000 7f57adbc5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564f60d3b810 con 0x564f60d30160 2024-05-10T10:56:01.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.117+0000 7f57adbc5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564f60c35e80 con 0x564f60d30a80 2024-05-10T10:56:01.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.117+0000 7f57adbc5b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x564f60d3b990 con 0x564f60d2ad00 2024-05-10T10:56:01.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.117+0000 7f57a08cd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30160 0x564f60d33a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:01.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.117+0000 7f57adbc5b80 10 client.0 _ll_register_callbacks cb 0x564f60c10560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:56:01.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.117+0000 7f57a08cd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30160 0x564f60d33a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44494/0 (socket says 172.21.15.107:44494) 2024-05-10T10:56:01.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.117+0000 7f57a08cd700 1 -- 172.21.15.107:0/937889853 learned_addr learned my addr 172.21.15.107:0/937889853 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:01.122 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.117+0000 7f57a18cf700 1 --2- 172.21.15.107:0/937889853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30a80 0x564f60d33f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:01.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.117+0000 7f57a10ce700 1 --2- 172.21.15.107:0/937889853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d2ad00 0x564f60d36670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:01.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.117+0000 7f57a08cd700 1 -- 172.21.15.107:0/937889853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d2ad00 msgr2=0x564f60d36670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:01.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.117+0000 7f57a08cd700 1 --2- 172.21.15.107:0/937889853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d2ad00 0x564f60d36670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.117+0000 7f57a08cd700 1 -- 172.21.15.107:0/937889853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30a80 msgr2=0x564f60d33f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:01.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.117+0000 7f57a08cd700 1 --2- 172.21.15.107:0/937889853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30a80 0x564f60d33f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.118+0000 7f57a08cd700 1 -- 172.21.15.107:0/937889853 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f60c33710 con 0x564f60d30160 2024-05-10T10:56:01.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.118+0000 7f57a10ce700 1 --2- 172.21.15.107:0/937889853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d2ad00 0x564f60d36670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:56:01.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.118+0000 7f57a08cd700 1 --2- 172.21.15.107:0/937889853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30160 0x564f60d33a10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f578c0a79e0 tx=0x7f578c0aacb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd701b302055839f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:01.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.118+0000 7f5784ff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:56:01.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.118+0000 7f5784ff9700 1 -- 172.21.15.107:0/937889853 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c0aa0c0 con 0x564f60d30160 2024-05-10T10:56:01.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.118+0000 7f5784ff9700 1 -- 172.21.15.107:0/937889853 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f578c0922c0 con 0x564f60d30160 2024-05-10T10:56:01.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.118+0000 7f57adbc5b80 1 -- 172.21.15.107:0/937889853 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f579800de70 con 0x564f60d30160 2024-05-10T10:56:01.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.118+0000 7f5784ff9700 1 -- 172.21.15.107:0/937889853 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f578c0a9ee0 con 0x564f60d30160 2024-05-10T10:56:01.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.118+0000 7f57adbc5b80 10 client.15333 fetch_fsmap learned FSMap version 27 2024-05-10T10:56:01.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.118+0000 7f57adbc5b80 1 -- 172.21.15.107:0/937889853 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564f60d45fc0 con 0x564f60d30160 2024-05-10T10:56:01.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.118+0000 7f5784ff9700 1 -- 172.21.15.107:0/937889853 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f579800de70 con 0x564f60d30160 2024-05-10T10:56:01.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.118+0000 7f5784ff9700 1 -- 172.21.15.107:0/937889853 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f578c090ce0 con 0x564f60d30160 2024-05-10T10:56:01.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.118+0000 7f57adbc5b80 10 client.15333 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:56:01.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.119+0000 7f57adbc5b80 10 client.15333 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-10T10:56:01.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.119+0000 7f57adbc5b80 20 client.15333 populate_metadata read hostname 'smithi107' 2024-05-10T10:56:01.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.119+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/937889853 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x564f60d48640 0x564f60d49ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:01.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.119+0000 7f57adbc5b80 4 client.15333 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:56:01.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.119+0000 7f57adbc5b80 1 -- 172.21.15.107:0/937889853 --> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f60c8a2d0 con 0x564f60d48640 2024-05-10T10:56:01.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.119+0000 7f57a10ce700 1 --2- 172.21.15.107:0/937889853 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x564f60d48640 0x564f60d49ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:01.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.119+0000 7f57a10ce700 1 --2- 172.21.15.107:0/937889853 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x564f60d48640 0x564f60d49ab0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2f980ca9106ed7f8 server_cookie=1f9bdd9c657586d0 in_seq=0 out_seq=0 2024-05-10T10:56:01.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.119+0000 7f5784ff9700 10 client.15333 ms_handle_connect on v2:172.21.15.196:6838/4142119667 2024-05-10T10:56:01.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.120+0000 7f5784ff9700 1 -- 172.21.15.107:0/937889853 <== mds.2 v2:172.21.15.196:6838/4142119667 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564f60c8a2d0 con 0x564f60d48640 2024-05-10T10:56:01.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.120+0000 7f5784ff9700 10 client.15333 handle_command_reply: tid=0 2024-05-10T10:56:01.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.120+0000 7f57adbc5b80 1 client.15333 shutdown 2024-05-10T10:56:01.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.120+0000 7f57adbc5b80 1 -- 172.21.15.107:0/937889853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30160 msgr2=0x564f60d33a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:01.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.120+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/937889853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30160 0x564f60d33a10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f578c0a79e0 tx=0x7f578c0aacb0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.120+0000 7f57adbc5b80 1 -- 172.21.15.107:0/937889853 shutdown_connections 2024-05-10T10:56:01.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.120+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/937889853 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x564f60d48640 0x564f60d49ab0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.120+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/937889853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d2ad00 0x564f60d36670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.120+0000 7f5784ff9700 0 client.15333 ms_handle_reset on v2:172.21.15.196:6838/4142119667 2024-05-10T10:56:01.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.120+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/937889853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30a80 0x564f60d33f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.120+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/937889853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30160 0x564f60d33a10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.120+0000 7f57adbc5b80 1 -- 172.21.15.107:0/937889853 >> 172.21.15.107:0/937889853 conn(0x564f60c56b20 msgr2=0x564f60d1fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:01.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.120+0000 7f57adbc5b80 1 -- 172.21.15.107:0/937889853 shutdown_connections 2024-05-10T10:56:01.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.120+0000 7f57adbc5b80 1 -- 172.21.15.107:0/937889853 wait complete. 2024-05-10T10:56:01.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.120+0000 7f57adbc5b80 20 client.15333 trim_cache size 0 max 16384 2024-05-10T10:56:01.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.141+0000 7f57adbc5b80 1 Processor -- start 2024-05-10T10:56:01.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.141+0000 7f57adbc5b80 1 -- start start 2024-05-10T10:56:01.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.141+0000 7f57adbc5b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d2ad00 0x564f60d33fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:01.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.141+0000 7f57adbc5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30160 0x564f60d2a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:01.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.141+0000 7f57adbc5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30a80 0x564f60d31570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:01.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.141+0000 7f57adbc5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564f60d47df0 con 0x564f60d30a80 2024-05-10T10:56:01.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.141+0000 7f57adbc5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564f60d484c0 con 0x564f60d30160 2024-05-10T10:56:01.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.141+0000 7f57adbc5b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x564f60d48b90 con 0x564f60d2ad00 2024-05-10T10:56:01.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.141+0000 7f57a18cf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30a80 0x564f60d31570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:01.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.141+0000 7f57a18cf700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30a80 0x564f60d31570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44506/0 (socket says 172.21.15.107:44506) 2024-05-10T10:56:01.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.141+0000 7f57a18cf700 1 -- 172.21.15.107:0/484123385 learned_addr learned my addr 172.21.15.107:0/484123385 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:01.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.141+0000 7f57a10ce700 1 --2- 172.21.15.107:0/484123385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d2ad00 0x564f60d33fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:01.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.142+0000 7f57a08cd700 1 --2- 172.21.15.107:0/484123385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30160 0x564f60d2a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:01.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.142+0000 7f57a18cf700 1 -- 172.21.15.107:0/484123385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d2ad00 msgr2=0x564f60d33fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:01.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.142+0000 7f57a18cf700 1 --2- 172.21.15.107:0/484123385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d2ad00 0x564f60d33fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.142+0000 7f57a18cf700 1 -- 172.21.15.107:0/484123385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30160 msgr2=0x564f60d2a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:01.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.142+0000 7f57a18cf700 1 --2- 172.21.15.107:0/484123385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30160 0x564f60d2a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.142+0000 7f57a18cf700 1 -- 172.21.15.107:0/484123385 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f60d25d20 con 0x564f60d30a80 2024-05-10T10:56:01.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.142+0000 7f57a18cf700 1 --2- 172.21.15.107:0/484123385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30a80 0x564f60d31570 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f57940087a0 tx=0x7f5794008ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33663fc42e63392 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:01.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.142+0000 7f5786ffd700 1 -- 172.21.15.107:0/484123385 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579401a070 con 0x564f60d30a80 2024-05-10T10:56:01.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.142+0000 7f5786ffd700 1 -- 172.21.15.107:0/484123385 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5794015b40 con 0x564f60d30a80 2024-05-10T10:56:01.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.142+0000 7f5786ffd700 1 -- 172.21.15.107:0/484123385 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5794016de0 con 0x564f60d30a80 2024-05-10T10:56:01.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.143+0000 7f57adbc5b80 1 -- 172.21.15.107:0/484123385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30a80 msgr2=0x564f60d31570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:01.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.143+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/484123385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30a80 0x564f60d31570 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f57940087a0 tx=0x7f5794008ab0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.143+0000 7f57adbc5b80 1 -- 172.21.15.107:0/484123385 shutdown_connections 2024-05-10T10:56:01.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.143+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/484123385 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d2ad00 0x564f60d33fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.143+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/484123385 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d30a80 0x564f60d31570 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.143+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/484123385 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30160 0x564f60d2a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.143+0000 7f57adbc5b80 1 -- 172.21.15.107:0/484123385 >> 172.21.15.107:0/484123385 conn(0x564f60c56b20 msgr2=0x564f60d30e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:01.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.143+0000 7f57adbc5b80 1 -- 172.21.15.107:0/484123385 shutdown_connections 2024-05-10T10:56:01.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.143+0000 7f57adbc5b80 1 -- 172.21.15.107:0/484123385 wait complete. 2024-05-10T10:56:01.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.143+0000 7f57adbc5b80 1 -- start start 2024-05-10T10:56:01.146 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.143+0000 7f57adbc5b80 1 Processor -- start 2024-05-10T10:56:01.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57adbc5b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d2ad00 0x564f60d1ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:01.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57adbc5b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30160 0x564f60d1f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:01.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57adbc5b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d30a80 0x564f60d1f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:01.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57adbc5b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x564f60d49930 con 0x564f60d2ad00 2024-05-10T10:56:01.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57adbc5b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564f60d49260 con 0x564f60d30160 2024-05-10T10:56:01.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57adbc5b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x564f60d4a000 con 0x564f60d30a80 2024-05-10T10:56:01.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57adbc5b80 10 client.0 _ll_register_callbacks cb 0x564f60c10560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:56:01.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57a10ce700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d2ad00 0x564f60d1ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:01.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57a10ce700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d2ad00 0x564f60d1ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44510/0 (socket says 172.21.15.107:44510) 2024-05-10T10:56:01.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57a10ce700 1 -- 172.21.15.107:0/3852294633 learned_addr learned my addr 172.21.15.107:0/3852294633 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:01.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57a08cd700 1 --2- 172.21.15.107:0/3852294633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30160 0x564f60d1f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:01.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57a10ce700 1 -- 172.21.15.107:0/3852294633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d30a80 msgr2=0x564f60d1f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:01.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57a18cf700 1 --2- 172.21.15.107:0/3852294633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d30a80 0x564f60d1f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:01.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57a10ce700 1 --2- 172.21.15.107:0/3852294633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d30a80 0x564f60d1f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57a10ce700 1 -- 172.21.15.107:0/3852294633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30160 msgr2=0x564f60d1f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:01.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57a10ce700 1 --2- 172.21.15.107:0/3852294633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30160 0x564f60d1f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57a10ce700 1 -- 172.21.15.107:0/3852294633 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f60d51210 con 0x564f60d2ad00 2024-05-10T10:56:01.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57a08cd700 1 --2- 172.21.15.107:0/3852294633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30160 0x564f60d1f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:56:01.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57a10ce700 1 --2- 172.21.15.107:0/3852294633 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d2ad00 0x564f60d1ef60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5798008010 tx=0x7f579801f530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531f03eee5fbcbf2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:01.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f5784ff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:56:01.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f5784ff9700 1 -- 172.21.15.107:0/3852294633 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5798024040 con 0x564f60d2ad00 2024-05-10T10:56:01.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f5784ff9700 1 -- 172.21.15.107:0/3852294633 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f579801fab0 con 0x564f60d2ad00 2024-05-10T10:56:01.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.144+0000 7f57adbc5b80 1 -- 172.21.15.107:0/3852294633 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5794015b40 con 0x564f60d2ad00 2024-05-10T10:56:01.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.145+0000 7f5784ff9700 1 -- 172.21.15.107:0/3852294633 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f579801fcd0 con 0x564f60d2ad00 2024-05-10T10:56:01.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.145+0000 7f57adbc5b80 10 client.15339 fetch_fsmap learned FSMap version 27 2024-05-10T10:56:01.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.145+0000 7f57adbc5b80 1 -- 172.21.15.107:0/3852294633 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564f60db3d60 con 0x564f60d2ad00 2024-05-10T10:56:01.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.145+0000 7f5784ff9700 1 -- 172.21.15.107:0/3852294633 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5794015b40 con 0x564f60d2ad00 2024-05-10T10:56:01.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.145+0000 7f5784ff9700 1 -- 172.21.15.107:0/3852294633 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f5798013070 con 0x564f60d2ad00 2024-05-10T10:56:01.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.145+0000 7f57adbc5b80 10 client.15339 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:56:01.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.145+0000 7f57adbc5b80 10 client.15339 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-10T10:56:01.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.145+0000 7f57adbc5b80 20 client.15339 populate_metadata read hostname 'smithi107' 2024-05-10T10:56:01.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.145+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/3852294633 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x564f60d48640 0x564f60db7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:01.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.145+0000 7f57adbc5b80 4 client.15339 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T10:56:01.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.145+0000 7f57adbc5b80 1 -- 172.21.15.107:0/3852294633 --> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] -- command(tid 0: {"prefix": "status"}) -- 0x564f60c84370 con 0x564f60d48640 2024-05-10T10:56:01.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.145+0000 7f57a08cd700 1 --2- 172.21.15.107:0/3852294633 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x564f60d48640 0x564f60db7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:01.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.146+0000 7f57a08cd700 1 --2- 172.21.15.107:0/3852294633 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x564f60d48640 0x564f60db7550 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2abd6a22c811049c server_cookie=e72197c98065bbf7 in_seq=0 out_seq=0 2024-05-10T10:56:01.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.146+0000 7f5784ff9700 10 client.15339 ms_handle_connect on v2:172.21.15.196:6838/4142119667 2024-05-10T10:56:01.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.146+0000 7f5784ff9700 1 -- 172.21.15.107:0/3852294633 <== mds.2 v2:172.21.15.196:6838/4142119667 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564f60c84370 con 0x564f60d48640 2024-05-10T10:56:01.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.146+0000 7f5784ff9700 10 client.15339 handle_command_reply: tid=0 2024-05-10T10:56:01.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.146+0000 7f57adbc5b80 1 client.15339 shutdown 2024-05-10T10:56:01.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.146+0000 7f57adbc5b80 1 -- 172.21.15.107:0/3852294633 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d2ad00 msgr2=0x564f60d1ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:01.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.146+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/3852294633 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d2ad00 0x564f60d1ef60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5798008010 tx=0x7f579801f530 comp rx=0 tx=0).stop 2024-05-10T10:56:01.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.146+0000 7f57adbc5b80 1 -- 172.21.15.107:0/3852294633 shutdown_connections 2024-05-10T10:56:01.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.146+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/3852294633 >> [v2:172.21.15.196:6838/4142119667,v1:172.21.15.196:6839/4142119667] conn(0x564f60d48640 0x564f60db7550 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.146+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/3852294633 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x564f60d30a80 0x564f60d1f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.146+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/3852294633 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x564f60d2ad00 0x564f60d1ef60 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.146+0000 7f57adbc5b80 1 --2- 172.21.15.107:0/3852294633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f60d30160 0x564f60d1f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.146+0000 7f57adbc5b80 1 -- 172.21.15.107:0/3852294633 >> 172.21.15.107:0/3852294633 conn(0x564f60c56b20 msgr2=0x564f60d35010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:01.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.146+0000 7f5784ff9700 0 client.15339 ms_handle_reset on v2:172.21.15.196:6838/4142119667 2024-05-10T10:56:01.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.146+0000 7f57adbc5b80 1 -- 172.21.15.107:0/3852294633 shutdown_connections 2024-05-10T10:56:01.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.146+0000 7f57adbc5b80 1 -- 172.21.15.107:0/3852294633 wait complete. 2024-05-10T10:56:01.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.146+0000 7f57adbc5b80 20 client.15339 trim_cache size 0 max 16384 2024-05-10T10:56:01.153 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:56:01.153 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "0ba8a8e4-0eba-11ef-bc98-c7b262605968", 2024-05-10T10:56:01.153 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 2, 2024-05-10T10:56:01.153 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24442, 2024-05-10T10:56:01.153 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2024-05-10T10:56:01.154 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2024-05-10T10:56:01.154 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2024-05-10T10:56:01.154 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 210.356786734, 2024-05-10T10:56:01.154 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 27, 2024-05-10T10:56:01.154 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 82, 2024-05-10T10:56:01.154 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 82, 2024-05-10T10:56:01.154 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 250.79565215900001 2024-05-10T10:56:01.154 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:56:01.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.147+0000 7f57a3332700 1 -- 172.21.15.107:0/2891023063 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f57880b2910 msgr2=0x7f57880b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:01.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.147+0000 7f57a3332700 1 --2- 172.21.15.107:0/2891023063 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f57880b2910 0x7f57880b4dd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5798006fd0 tx=0x7f5798008040 comp rx=0 tx=0).stop 2024-05-10T10:56:01.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.147+0000 7f57a3332700 1 -- 172.21.15.107:0/2891023063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f579c102d60 msgr2=0x7f579c19b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:01.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.147+0000 7f57a3332700 1 --2- 172.21.15.107:0/2891023063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f579c102d60 0x7f579c19b090 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f578c000c00 tx=0x7f578c0037a0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.147+0000 7f57a3332700 1 -- 172.21.15.107:0/2891023063 shutdown_connections 2024-05-10T10:56:01.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.147+0000 7f57a3332700 1 --2- 172.21.15.107:0/2891023063 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f57880b2910 0x7f57880b4dd0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.147+0000 7f57a3332700 1 --2- 172.21.15.107:0/2891023063 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f579c108410 0x7f579c1a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.147+0000 7f57a3332700 1 --2- 172.21.15.107:0/2891023063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f579c1023a0 0x7f579c19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.147+0000 7f57a3332700 1 --2- 172.21.15.107:0/2891023063 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f579c102d60 0x7f579c19b090 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:01.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.147+0000 7f57a3332700 1 -- 172.21.15.107:0/2891023063 >> 172.21.15.107:0/2891023063 conn(0x7f579c079350 msgr2=0x7f579c100fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:01.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.147+0000 7f57a3332700 1 -- 172.21.15.107:0/2891023063 shutdown_connections 2024-05-10T10:56:01.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:01.147+0000 7f57a3332700 1 -- 172.21.15.107:0/2891023063 wait complete. 2024-05-10T10:56:01.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:01 smithi196 ceph-mon[34872]: pgmap v398: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-10T10:56:01.331 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:01 smithi184 ceph-mon[34585]: pgmap v398: 97 pgs: 97 active+clean; 665 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-10T10:56:01.803 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell mds.h status 2024-05-10T10:56:02.047 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:56:03.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:03 smithi107 ceph-mon[30373]: pgmap v399: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-05-10T10:56:03.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:03 smithi196 ceph-mon[34872]: pgmap v399: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-05-10T10:56:03.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:03 smithi184 ceph-mon[34585]: pgmap v399: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-05-10T10:56:03.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.759+0000 7fb0b7fd8700 1 -- 172.21.15.107:0/601823320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b006b7d0 msgr2=0x7fb0b0102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:03.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.759+0000 7fb0b7fd8700 1 --2- 172.21.15.107:0/601823320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b006b7d0 0x7fb0b0102600 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0009990 tx=0x7fb0a0009ca0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.760+0000 7fb0b7fd8700 1 -- 172.21.15.107:0/601823320 shutdown_connections 2024-05-10T10:56:03.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.760+0000 7fb0b7fd8700 1 --2- 172.21.15.107:0/601823320 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0b0106830 0x7fb0b0106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.760+0000 7fb0b7fd8700 1 --2- 172.21.15.107:0/601823320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0b006b360 0x7fb0b01020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.760+0000 7fb0b7fd8700 1 --2- 172.21.15.107:0/601823320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b006b7d0 0x7fb0b0102600 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.760+0000 7fb0b7fd8700 1 -- 172.21.15.107:0/601823320 >> 172.21.15.107:0/601823320 conn(0x7fb0b00776c0 msgr2=0x7fb0b0077ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:03.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.760+0000 7fb0b7fd8700 1 -- 172.21.15.107:0/601823320 shutdown_connections 2024-05-10T10:56:03.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.760+0000 7fb0b7fd8700 1 -- 172.21.15.107:0/601823320 wait complete. 2024-05-10T10:56:03.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.760+0000 7fb0b7fd8700 1 Processor -- start 2024-05-10T10:56:03.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.760+0000 7fb0b7fd8700 1 -- start start 2024-05-10T10:56:03.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0b7fd8700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0b006b360 0x7fb0b019f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:03.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0b7fd8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0b006b7d0 0x7fb0b019fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:03.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0b7fd8700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b0106830 0x7fb0b0199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:03.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0b7fd8700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b0112730 con 0x7fb0b0106830 2024-05-10T10:56:03.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0b7fd8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b01125b0 con 0x7fb0b006b7d0 2024-05-10T10:56:03.763 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0b7fd8700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b01128b0 con 0x7fb0b006b360 2024-05-10T10:56:03.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0b6575700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b0106830 0x7fb0b0199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:03.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0b6575700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b0106830 0x7fb0b0199aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44516/0 (socket says 172.21.15.107:44516) 2024-05-10T10:56:03.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0b6575700 1 -- 172.21.15.107:0/1745123993 learned_addr learned my addr 172.21.15.107:0/1745123993 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:03.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0b5d74700 1 --2- 172.21.15.107:0/1745123993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0b006b360 0x7fb0b019f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:03.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0b5573700 1 --2- 172.21.15.107:0/1745123993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0b006b7d0 0x7fb0b019fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:03.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0b6575700 1 -- 172.21.15.107:0/1745123993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0b006b360 msgr2=0x7fb0b019f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:03.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0b6575700 1 --2- 172.21.15.107:0/1745123993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0b006b360 0x7fb0b019f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0b6575700 1 -- 172.21.15.107:0/1745123993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0b006b7d0 msgr2=0x7fb0b019fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:03.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0b6575700 1 --2- 172.21.15.107:0/1745123993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0b006b7d0 0x7fb0b019fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0b6575700 1 -- 172.21.15.107:0/1745123993 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b019a200 con 0x7fb0b0106830 2024-05-10T10:56:03.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0b6575700 1 --2- 172.21.15.107:0/1745123993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b0106830 0x7fb0b0199aa0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800b550 tx=0x7fb0a800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:03.764 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0a6ffd700 1 -- 172.21.15.107:0/1745123993 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8015020 con 0x7fb0b0106830 2024-05-10T10:56:03.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0b7fd8700 1 -- 172.21.15.107:0/1745123993 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b019a4f0 con 0x7fb0b0106830 2024-05-10T10:56:03.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0a6ffd700 1 -- 172.21.15.107:0/1745123993 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb0a8011d00 con 0x7fb0b0106830 2024-05-10T10:56:03.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.761+0000 7fb0a6ffd700 1 -- 172.21.15.107:0/1745123993 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8010d40 con 0x7fb0b0106830 2024-05-10T10:56:03.765 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.762+0000 7fb0b7fd8700 1 -- 172.21.15.107:0/1745123993 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b01a6830 con 0x7fb0b0106830 2024-05-10T10:56:03.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.764+0000 7fb0a6ffd700 1 -- 172.21.15.107:0/1745123993 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 149704+0+0 (secure 0 0 0) 0x7fb0a8018020 con 0x7fb0b0106830 2024-05-10T10:56:03.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.764+0000 7fb0a6ffd700 1 --2- 172.21.15.107:0/1745123993 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb09c0b2910 0x7fb09c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:03.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.765+0000 7fb0b5d74700 1 --2- 172.21.15.107:0/1745123993 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb09c0b2910 0x7fb09c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:03.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.765+0000 7fb0a6ffd700 1 -- 172.21.15.107:0/1745123993 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fb0a80e17f0 con 0x7fb0b0106830 2024-05-10T10:56:03.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.765+0000 7fb0b5d74700 1 --2- 172.21.15.107:0/1745123993 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb09c0b2910 0x7fb09c0b4dd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac009550 tx=0x7fb0ac0091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:03.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.765+0000 7fb0c286bb80 1 Processor -- start 2024-05-10T10:56:03.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.765+0000 7fb0c286bb80 1 -- start start 2024-05-10T10:56:03.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.765+0000 7fb0c286bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558604757890 0x558604757c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:03.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.765+0000 7fb0c286bb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5586047581b0 0x55860475bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:03.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.765+0000 7fb0c286bb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55860475bff0 0x55860475c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:03.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.765+0000 7fb0c286bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5586046a5810 con 0x558604757890 2024-05-10T10:56:03.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.765+0000 7fb0c286bb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x558604644770 con 0x55860475bff0 2024-05-10T10:56:03.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.765+0000 7fb0c286bb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5586046a17d0 con 0x5586047581b0 2024-05-10T10:56:03.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.766+0000 7fb0b5d74700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558604757890 0x558604757c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:03.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.766+0000 7fb0b5d74700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558604757890 0x558604757c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44528/0 (socket says 172.21.15.107:44528) 2024-05-10T10:56:03.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.766+0000 7fb0b5d74700 1 -- 172.21.15.107:0/236273356 learned_addr learned my addr 172.21.15.107:0/236273356 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:03.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.766+0000 7fb0b5573700 1 --2- 172.21.15.107:0/236273356 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5586047581b0 0x55860475bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:03.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.766+0000 7fb0b6575700 1 --2- 172.21.15.107:0/236273356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55860475bff0 0x55860475c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:03.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.766+0000 7fb0b5d74700 1 -- 172.21.15.107:0/236273356 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5586047581b0 msgr2=0x55860475bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:03.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.766+0000 7fb0b5d74700 1 --2- 172.21.15.107:0/236273356 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5586047581b0 0x55860475bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.766+0000 7fb0b5d74700 1 -- 172.21.15.107:0/236273356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55860475bff0 msgr2=0x55860475c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:03.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.766+0000 7fb0b5d74700 1 --2- 172.21.15.107:0/236273356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55860475bff0 0x55860475c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.766+0000 7fb0b5d74700 1 -- 172.21.15.107:0/236273356 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586045f2880 con 0x558604757890 2024-05-10T10:56:03.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.766+0000 7fb0b5d74700 1 --2- 172.21.15.107:0/236273356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558604757890 0x558604757c70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac004680 tx=0x7fb0ac013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792d9dd75ef6ab56 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:03.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.766+0000 7fb09bfff700 1 -- 172.21.15.107:0/236273356 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac01c050 con 0x558604757890 2024-05-10T10:56:03.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.766+0000 7fb09bfff700 1 -- 172.21.15.107:0/236273356 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb0ac026070 con 0x558604757890 2024-05-10T10:56:03.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.766+0000 7fb09bfff700 1 -- 172.21.15.107:0/236273356 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac015660 con 0x558604757890 2024-05-10T10:56:03.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.767+0000 7fb0c286bb80 1 -- 172.21.15.107:0/236273356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558604757890 msgr2=0x558604757c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:03.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.767+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/236273356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558604757890 0x558604757c70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac004680 tx=0x7fb0ac013000 comp rx=0 tx=0).stop 2024-05-10T10:56:03.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.767+0000 7fb0c286bb80 1 -- 172.21.15.107:0/236273356 shutdown_connections 2024-05-10T10:56:03.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.767+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/236273356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55860475bff0 0x55860475c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.767+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/236273356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558604757890 0x558604757c70 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.767+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/236273356 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5586047581b0 0x55860475bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.770 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.767+0000 7fb0c286bb80 1 -- 172.21.15.107:0/236273356 >> 172.21.15.107:0/236273356 conn(0x55860467f0b0 msgr2=0x55860474dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:03.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.767+0000 7fb0c286bb80 1 -- 172.21.15.107:0/236273356 shutdown_connections 2024-05-10T10:56:03.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.767+0000 7fb0c286bb80 1 -- 172.21.15.107:0/236273356 wait complete. 2024-05-10T10:56:03.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.767+0000 7fb0c286bb80 1 -- start start 2024-05-10T10:56:03.771 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.768+0000 7fb0c286bb80 1 Processor -- start 2024-05-10T10:56:03.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.768+0000 7fb0c286bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558604757890 0x5586047634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:03.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.768+0000 7fb0c286bb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5586047581b0 0x558604760850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:03.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.768+0000 7fb0c286bb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55860475bff0 0x558604760d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:03.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.768+0000 7fb0c286bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558604764220 con 0x558604757890 2024-05-10T10:56:03.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.768+0000 7fb0c286bb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55860460bbe0 con 0x55860475bff0 2024-05-10T10:56:03.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.768+0000 7fb0c286bb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5586047643a0 con 0x5586047581b0 2024-05-10T10:56:03.774 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.768+0000 7fb0c286bb80 10 client.0 _ll_register_callbacks cb 0x55860463d8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:56:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.768+0000 7fb0b5d74700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558604757890 0x5586047634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.768+0000 7fb0b5d74700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558604757890 0x5586047634b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44540/0 (socket says 172.21.15.107:44540) 2024-05-10T10:56:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.768+0000 7fb0b5d74700 1 -- 172.21.15.107:0/3667917702 learned_addr learned my addr 172.21.15.107:0/3667917702 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.768+0000 7fb0b5573700 1 --2- 172.21.15.107:0/3667917702 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5586047581b0 0x558604760850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.768+0000 7fb0b6575700 1 --2- 172.21.15.107:0/3667917702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55860475bff0 0x558604760d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.768+0000 7fb0b5d74700 1 -- 172.21.15.107:0/3667917702 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5586047581b0 msgr2=0x558604760850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.768+0000 7fb0b5d74700 1 --2- 172.21.15.107:0/3667917702 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5586047581b0 0x558604760850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.768+0000 7fb0b5d74700 1 -- 172.21.15.107:0/3667917702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55860475bff0 msgr2=0x558604760d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.768+0000 7fb0b5d74700 1 --2- 172.21.15.107:0/3667917702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55860475bff0 0x558604760d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.768+0000 7fb0b5d74700 1 -- 172.21.15.107:0/3667917702 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558604641640 con 0x558604757890 2024-05-10T10:56:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.769+0000 7fb0b5d74700 1 --2- 172.21.15.107:0/3667917702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558604757890 0x5586047634b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac021770 tx=0x7fb0ac0217a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b36e18df354c4d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.769+0000 7fb0997fa700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:56:03.775 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.769+0000 7fb0997fa700 1 -- 172.21.15.107:0/3667917702 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac02f070 con 0x558604757890 2024-05-10T10:56:03.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.769+0000 7fb0997fa700 1 -- 172.21.15.107:0/3667917702 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fb0ac034660 con 0x558604757890 2024-05-10T10:56:03.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.769+0000 7fb0c286bb80 1 -- 172.21.15.107:0/3667917702 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0ac026070 con 0x558604757890 2024-05-10T10:56:03.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.769+0000 7fb0997fa700 1 -- 172.21.15.107:0/3667917702 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb0ac034860 con 0x558604757890 2024-05-10T10:56:03.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.769+0000 7fb0c286bb80 10 client.15351 fetch_fsmap learned FSMap version 27 2024-05-10T10:56:03.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.769+0000 7fb0c286bb80 1 -- 172.21.15.107:0/3667917702 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55860476ead0 con 0x558604757890 2024-05-10T10:56:03.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.769+0000 7fb0997fa700 1 -- 172.21.15.107:0/3667917702 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb0ac026070 con 0x558604757890 2024-05-10T10:56:03.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.769+0000 7fb0997fa700 1 -- 172.21.15.107:0/3667917702 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb0ac015980 con 0x558604757890 2024-05-10T10:56:03.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.769+0000 7fb0c286bb80 10 client.15351 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:56:03.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.769+0000 7fb0c286bb80 10 client.15351 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-10T10:56:03.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.769+0000 7fb0c286bb80 20 client.15351 populate_metadata read hostname 'smithi107' 2024-05-10T10:56:03.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.769+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/3667917702 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x558604770d60 0x5586047721d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:03.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.769+0000 7fb0c286bb80 4 client.15351 mds_command: new command op to 24449 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:56:03.776 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.769+0000 7fb0c286bb80 1 -- 172.21.15.107:0/3667917702 --> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55860471f600 con 0x558604770d60 2024-05-10T10:56:03.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.770+0000 7fb0b5573700 1 --2- 172.21.15.107:0/3667917702 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x558604770d60 0x5586047721d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:03.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.770+0000 7fb0997fa700 10 client.15351 ms_handle_connect on v2:172.21.15.184:6836/4239260328 2024-05-10T10:56:03.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.770+0000 7fb0b5573700 1 --2- 172.21.15.107:0/3667917702 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x558604770d60 0x5586047721d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=16d4a165e80e328e server_cookie=6a4532d4a105242d in_seq=0 out_seq=0 2024-05-10T10:56:03.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.771+0000 7fb0997fa700 1 -- 172.21.15.107:0/3667917702 <== mds.1 v2:172.21.15.184:6836/4239260328 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55860471f600 con 0x558604770d60 2024-05-10T10:56:03.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.771+0000 7fb0997fa700 10 client.15351 handle_command_reply: tid=0 2024-05-10T10:56:03.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.771+0000 7fb0c286bb80 1 client.15351 shutdown 2024-05-10T10:56:03.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.771+0000 7fb0c286bb80 1 -- 172.21.15.107:0/3667917702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558604757890 msgr2=0x5586047634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:03.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.771+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/3667917702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558604757890 0x5586047634b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac021770 tx=0x7fb0ac0217a0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.771+0000 7fb0c286bb80 1 -- 172.21.15.107:0/3667917702 shutdown_connections 2024-05-10T10:56:03.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.771+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/3667917702 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x558604770d60 0x5586047721d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.771+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/3667917702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55860475bff0 0x558604760d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.777 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.771+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/3667917702 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558604757890 0x5586047634b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.771+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/3667917702 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5586047581b0 0x558604760850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.771+0000 7fb0997fa700 0 client.15351 ms_handle_reset on v2:172.21.15.184:6836/4239260328 2024-05-10T10:56:03.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.771+0000 7fb0c286bb80 1 -- 172.21.15.107:0/3667917702 >> 172.21.15.107:0/3667917702 conn(0x55860467f0b0 msgr2=0x5586047486d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:03.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.771+0000 7fb0c286bb80 1 -- 172.21.15.107:0/3667917702 shutdown_connections 2024-05-10T10:56:03.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.771+0000 7fb0c286bb80 1 -- 172.21.15.107:0/3667917702 wait complete. 2024-05-10T10:56:03.778 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.771+0000 7fb0c286bb80 20 client.15351 trim_cache size 0 max 16384 2024-05-10T10:56:03.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.792+0000 7fb0c286bb80 1 Processor -- start 2024-05-10T10:56:03.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.792+0000 7fb0c286bb80 1 -- start start 2024-05-10T10:56:03.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.792+0000 7fb0c286bb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558604757890 0x55860475e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:03.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.792+0000 7fb0c286bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5586047581b0 0x55860477b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:03.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.792+0000 7fb0c286bb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55860475bff0 0x55860477bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:03.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.792+0000 7fb0c286bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558604770510 con 0x5586047581b0 2024-05-10T10:56:03.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.792+0000 7fb0c286bb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x558604770be0 con 0x558604757890 2024-05-10T10:56:03.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.792+0000 7fb0c286bb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5586047712b0 con 0x55860475bff0 2024-05-10T10:56:03.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.792+0000 7fb0b5573700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5586047581b0 0x55860477b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:03.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.792+0000 7fb0b5573700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5586047581b0 0x55860477b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44548/0 (socket says 172.21.15.107:44548) 2024-05-10T10:56:03.794 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.792+0000 7fb0b5573700 1 -- 172.21.15.107:0/902719442 learned_addr learned my addr 172.21.15.107:0/902719442 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.792+0000 7fb0b5d74700 1 --2- 172.21.15.107:0/902719442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558604757890 0x55860475e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.793+0000 7fb0b5573700 1 -- 172.21.15.107:0/902719442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55860475bff0 msgr2=0x55860477bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.793+0000 7fb0b5573700 1 --2- 172.21.15.107:0/902719442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55860475bff0 0x55860477bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.793+0000 7fb0b5573700 1 -- 172.21.15.107:0/902719442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558604757890 msgr2=0x55860475e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.793+0000 7fb0b5573700 1 --2- 172.21.15.107:0/902719442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558604757890 0x55860475e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.793+0000 7fb0b5573700 1 -- 172.21.15.107:0/902719442 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55860475ee20 con 0x5586047581b0 2024-05-10T10:56:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.793+0000 7fb0b5573700 1 --2- 172.21.15.107:0/902719442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5586047581b0 0x55860477b630 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000b5c0 tx=0x7fb0a001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af61d5e5c2c882f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.793+0000 7fb09b7fe700 1 -- 172.21.15.107:0/902719442 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0003e10 con 0x5586047581b0 2024-05-10T10:56:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.793+0000 7fb09b7fe700 1 -- 172.21.15.107:0/902719442 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb0a002f070 con 0x5586047581b0 2024-05-10T10:56:03.795 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.793+0000 7fb09b7fe700 1 -- 172.21.15.107:0/902719442 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a002a190 con 0x5586047581b0 2024-05-10T10:56:03.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.794+0000 7fb0c286bb80 1 -- 172.21.15.107:0/902719442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5586047581b0 msgr2=0x55860477b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:03.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.794+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/902719442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5586047581b0 0x55860477b630 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000b5c0 tx=0x7fb0a001a040 comp rx=0 tx=0).stop 2024-05-10T10:56:03.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.794+0000 7fb0c286bb80 1 -- 172.21.15.107:0/902719442 shutdown_connections 2024-05-10T10:56:03.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.794+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/902719442 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55860475bff0 0x55860477bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.794+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/902719442 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558604757890 0x55860475e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.794+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/902719442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5586047581b0 0x55860477b630 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.794+0000 7fb0c286bb80 1 -- 172.21.15.107:0/902719442 >> 172.21.15.107:0/902719442 conn(0x55860467f0b0 msgr2=0x55860475dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:03.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.794+0000 7fb0c286bb80 1 -- 172.21.15.107:0/902719442 shutdown_connections 2024-05-10T10:56:03.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.794+0000 7fb0c286bb80 1 -- 172.21.15.107:0/902719442 wait complete. 2024-05-10T10:56:03.799 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.794+0000 7fb0c286bb80 1 -- start start 2024-05-10T10:56:03.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.794+0000 7fb0c286bb80 1 Processor -- start 2024-05-10T10:56:03.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.795+0000 7fb0c286bb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558604757890 0x55860476c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:03.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.795+0000 7fb0c286bb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5586047581b0 0x55860476cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:03.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.795+0000 7fb0c286bb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55860475bff0 0x55860476d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:03.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.795+0000 7fb0c286bb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558604772050 con 0x5586047581b0 2024-05-10T10:56:03.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.795+0000 7fb0c286bb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x558604771980 con 0x558604757890 2024-05-10T10:56:03.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.795+0000 7fb0c286bb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558604772720 con 0x55860475bff0 2024-05-10T10:56:03.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.795+0000 7fb0c286bb80 10 client.0 _ll_register_callbacks cb 0x55860463d8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:56:03.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.795+0000 7fb0b5573700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5586047581b0 0x55860476cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:03.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.795+0000 7fb0b5573700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5586047581b0 0x55860476cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44558/0 (socket says 172.21.15.107:44558) 2024-05-10T10:56:03.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.795+0000 7fb0b5573700 1 -- 172.21.15.107:0/1100525383 learned_addr learned my addr 172.21.15.107:0/1100525383 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:03.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.795+0000 7fb0b5d74700 1 --2- 172.21.15.107:0/1100525383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558604757890 0x55860476c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:03.800 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.795+0000 7fb0b6575700 1 --2- 172.21.15.107:0/1100525383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55860475bff0 0x55860476d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:03.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.795+0000 7fb0b5573700 1 -- 172.21.15.107:0/1100525383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55860475bff0 msgr2=0x55860476d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:03.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.795+0000 7fb0b5573700 1 --2- 172.21.15.107:0/1100525383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55860475bff0 0x55860476d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.795+0000 7fb0b5573700 1 -- 172.21.15.107:0/1100525383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558604757890 msgr2=0x55860476c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:03.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.795+0000 7fb0b5573700 1 --2- 172.21.15.107:0/1100525383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558604757890 0x55860476c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.796+0000 7fb0b5573700 1 -- 172.21.15.107:0/1100525383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558604779d50 con 0x5586047581b0 2024-05-10T10:56:03.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.796+0000 7fb0b6575700 1 --2- 172.21.15.107:0/1100525383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55860475bff0 0x55860476d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:56:03.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.796+0000 7fb0b5d74700 1 --2- 172.21.15.107:0/1100525383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558604757890 0x55860476c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:56:03.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.796+0000 7fb0b5573700 1 --2- 172.21.15.107:0/1100525383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5586047581b0 0x55860476cd40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00098e0 tx=0x7fb0a0005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd13ba48402780d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:03.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.796+0000 7fb0997fa700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:56:03.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.796+0000 7fb0997fa700 1 -- 172.21.15.107:0/1100525383 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a000bc60 con 0x5586047581b0 2024-05-10T10:56:03.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.796+0000 7fb0997fa700 1 -- 172.21.15.107:0/1100525383 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fb0a000be00 con 0x5586047581b0 2024-05-10T10:56:03.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.796+0000 7fb0c286bb80 1 -- 172.21.15.107:0/1100525383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0a002f070 con 0x5586047581b0 2024-05-10T10:56:03.801 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.796+0000 7fb0997fa700 1 -- 172.21.15.107:0/1100525383 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb0a0005020 con 0x5586047581b0 2024-05-10T10:56:03.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.796+0000 7fb0c286bb80 10 client.15357 fetch_fsmap learned FSMap version 27 2024-05-10T10:56:03.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.796+0000 7fb0c286bb80 1 -- 172.21.15.107:0/1100525383 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5586047dc670 con 0x5586047581b0 2024-05-10T10:56:03.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.796+0000 7fb0997fa700 1 -- 172.21.15.107:0/1100525383 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb0a002f070 con 0x5586047581b0 2024-05-10T10:56:03.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.796+0000 7fb0997fa700 1 -- 172.21.15.107:0/1100525383 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb0a0039020 con 0x5586047581b0 2024-05-10T10:56:03.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.797+0000 7fb0c286bb80 10 client.15357 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:56:03.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.797+0000 7fb0c286bb80 10 client.15357 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-10T10:56:03.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.797+0000 7fb0c286bb80 20 client.15357 populate_metadata read hostname 'smithi107' 2024-05-10T10:56:03.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.797+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/1100525383 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x5586047e0cb0 0x5586047df9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:03.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.797+0000 7fb0c286bb80 4 client.15357 mds_command: new command op to 24449 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T10:56:03.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.797+0000 7fb0c286bb80 1 -- 172.21.15.107:0/1100525383 --> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] -- command(tid 0: {"prefix": "status"}) -- 0x5586046b31f0 con 0x5586047e0cb0 2024-05-10T10:56:03.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.797+0000 7fb0b5d74700 1 --2- 172.21.15.107:0/1100525383 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x5586047e0cb0 0x5586047df9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:03.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.797+0000 7fb0b5d74700 1 --2- 172.21.15.107:0/1100525383 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x5586047e0cb0 0x5586047df9c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=362e5ecee3ec0fb6 server_cookie=3e408c07865113d2 in_seq=0 out_seq=0 2024-05-10T10:56:03.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.797+0000 7fb0997fa700 10 client.15357 ms_handle_connect on v2:172.21.15.184:6836/4239260328 2024-05-10T10:56:03.802 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.798+0000 7fb0997fa700 1 -- 172.21.15.107:0/1100525383 <== mds.1 v2:172.21.15.184:6836/4239260328 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5586046b31f0 con 0x5586047e0cb0 2024-05-10T10:56:03.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.798+0000 7fb0997fa700 10 client.15357 handle_command_reply: tid=0 2024-05-10T10:56:03.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.798+0000 7fb0c286bb80 1 client.15357 shutdown 2024-05-10T10:56:03.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.798+0000 7fb0c286bb80 1 -- 172.21.15.107:0/1100525383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5586047581b0 msgr2=0x55860476cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:03.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.798+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/1100525383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5586047581b0 0x55860476cd40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00098e0 tx=0x7fb0a0005970 comp rx=0 tx=0).stop 2024-05-10T10:56:03.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.798+0000 7fb0c286bb80 1 -- 172.21.15.107:0/1100525383 shutdown_connections 2024-05-10T10:56:03.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.798+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/1100525383 >> [v2:172.21.15.184:6836/4239260328,v1:172.21.15.184:6837/4239260328] conn(0x5586047e0cb0 0x5586047df9c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.798+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/1100525383 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55860475bff0 0x55860476d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.798+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/1100525383 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558604757890 0x55860476c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.798+0000 7fb0c286bb80 1 --2- 172.21.15.107:0/1100525383 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5586047581b0 0x55860476cd40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.798+0000 7fb0997fa700 0 client.15357 ms_handle_reset on v2:172.21.15.184:6836/4239260328 2024-05-10T10:56:03.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.798+0000 7fb0c286bb80 1 -- 172.21.15.107:0/1100525383 >> 172.21.15.107:0/1100525383 conn(0x55860467f0b0 msgr2=0x558604747e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:03.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.798+0000 7fb0c286bb80 1 -- 172.21.15.107:0/1100525383 shutdown_connections 2024-05-10T10:56:03.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.798+0000 7fb0c286bb80 1 -- 172.21.15.107:0/1100525383 wait complete. 2024-05-10T10:56:03.803 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.798+0000 7fb0c286bb80 20 client.15357 trim_cache size 0 max 16384 2024-05-10T10:56:03.804 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:56:03.804 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "0ba8a8e4-0eba-11ef-bc98-c7b262605968", 2024-05-10T10:56:03.804 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 1, 2024-05-10T10:56:03.804 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24449, 2024-05-10T10:56:03.804 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2024-05-10T10:56:03.804 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2024-05-10T10:56:03.804 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2024-05-10T10:56:03.804 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 214.017294889, 2024-05-10T10:56:03.804 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 27, 2024-05-10T10:56:03.805 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 82, 2024-05-10T10:56:03.805 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 82, 2024-05-10T10:56:03.805 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 256.16354042299997 2024-05-10T10:56:03.805 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:56:03.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.799+0000 7fb0b7fd8700 1 -- 172.21.15.107:0/1745123993 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb09c0b2910 msgr2=0x7fb09c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:03.805 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.799+0000 7fb0b7fd8700 1 --2- 172.21.15.107:0/1745123993 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb09c0b2910 0x7fb09c0b4dd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac009550 tx=0x7fb0ac0091b0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.799+0000 7fb0b7fd8700 1 -- 172.21.15.107:0/1745123993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b0106830 msgr2=0x7fb0b0199aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:03.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.799+0000 7fb0b7fd8700 1 --2- 172.21.15.107:0/1745123993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b0106830 0x7fb0b0199aa0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800b550 tx=0x7fb0a800b860 comp rx=0 tx=0).stop 2024-05-10T10:56:03.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.799+0000 7fb0b7fd8700 1 -- 172.21.15.107:0/1745123993 shutdown_connections 2024-05-10T10:56:03.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.799+0000 7fb0b7fd8700 1 --2- 172.21.15.107:0/1745123993 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb09c0b2910 0x7fb09c0b4dd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.799+0000 7fb0b7fd8700 1 --2- 172.21.15.107:0/1745123993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb0b006b360 0x7fb0b019f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.799+0000 7fb0b7fd8700 1 --2- 172.21.15.107:0/1745123993 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb0b0106830 0x7fb0b0199aa0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.799+0000 7fb0b7fd8700 1 --2- 172.21.15.107:0/1745123993 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0b006b7d0 0x7fb0b019fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:03.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.799+0000 7fb0b7fd8700 1 -- 172.21.15.107:0/1745123993 >> 172.21.15.107:0/1745123993 conn(0x7fb0b00776c0 msgr2=0x7fb0b0108a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:03.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.799+0000 7fb0b7fd8700 1 -- 172.21.15.107:0/1745123993 shutdown_connections 2024-05-10T10:56:03.806 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:03.799+0000 7fb0b7fd8700 1 -- 172.21.15.107:0/1745123993 wait complete. 2024-05-10T10:56:04.486 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph tell mds.b status 2024-05-10T10:56:04.736 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:56:05.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:05 smithi107 ceph-mon[30373]: pgmap v400: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-10T10:56:05.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:05 smithi196 ceph-mon[34872]: pgmap v400: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-10T10:56:05.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:05 smithi184 ceph-mon[34585]: pgmap v400: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-10T10:56:06.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.332+0000 7f040f96e700 1 -- 172.21.15.107:0/3351211528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0408102540 msgr2=0x7f040810e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:06.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.332+0000 7f040f96e700 1 --2- 172.21.15.107:0/3351211528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0408102540 0x7f040810e9b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f040000c240 tx=0x7f040000c550 comp rx=0 tx=0).stop 2024-05-10T10:56:06.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.332+0000 7f040f96e700 1 -- 172.21.15.107:0/3351211528 shutdown_connections 2024-05-10T10:56:06.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.332+0000 7f040f96e700 1 --2- 172.21.15.107:0/3351211528 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0408102540 0x7f040810e9b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.332+0000 7f040f96e700 1 --2- 172.21.15.107:0/3351211528 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0408107be0 0x7f0408107fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.332+0000 7f040f96e700 1 --2- 172.21.15.107:0/3351211528 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0408101b80 0x7f0408102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.332+0000 7f040f96e700 1 -- 172.21.15.107:0/3351211528 >> 172.21.15.107:0/3351211528 conn(0x7f0408078a10 msgr2=0x7f04080ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:06.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.332+0000 7f040f96e700 1 -- 172.21.15.107:0/3351211528 shutdown_connections 2024-05-10T10:56:06.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.332+0000 7f040f96e700 1 -- 172.21.15.107:0/3351211528 wait complete. 2024-05-10T10:56:06.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.333+0000 7f040f96e700 1 Processor -- start 2024-05-10T10:56:06.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.333+0000 7f040f96e700 1 -- start start 2024-05-10T10:56:06.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.333+0000 7f040f96e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0408101b80 0x7f04081037a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:06.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.333+0000 7f040f96e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0408102540 0x7f0408103ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:06.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.333+0000 7f040f96e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0408107be0 0x7f0408104220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:06.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.333+0000 7f040f96e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0408111590 con 0x7f0408107be0 2024-05-10T10:56:06.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.333+0000 7f040f96e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0408111410 con 0x7f0408102540 2024-05-10T10:56:06.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.333+0000 7f040f96e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0408111710 con 0x7f0408101b80 2024-05-10T10:56:06.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.333+0000 7f040df0b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0408107be0 0x7f0408104220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:06.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.333+0000 7f040df0b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0408107be0 0x7f0408104220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44576/0 (socket says 172.21.15.107:44576) 2024-05-10T10:56:06.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.333+0000 7f040df0b700 1 -- 172.21.15.107:0/147988179 learned_addr learned my addr 172.21.15.107:0/147988179 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:06.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.333+0000 7f040cf09700 1 --2- 172.21.15.107:0/147988179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0408102540 0x7f0408103ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:06.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.334+0000 7f040d70a700 1 --2- 172.21.15.107:0/147988179 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0408101b80 0x7f04081037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:06.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.334+0000 7f040df0b700 1 -- 172.21.15.107:0/147988179 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0408101b80 msgr2=0x7f04081037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:06.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.334+0000 7f040df0b700 1 --2- 172.21.15.107:0/147988179 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0408101b80 0x7f04081037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.334+0000 7f040df0b700 1 -- 172.21.15.107:0/147988179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0408102540 msgr2=0x7f0408103ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:06.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.334+0000 7f040df0b700 1 --2- 172.21.15.107:0/147988179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0408102540 0x7f0408103ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.334+0000 7f040df0b700 1 -- 172.21.15.107:0/147988179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04081a80b0 con 0x7f0408107be0 2024-05-10T10:56:06.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.334+0000 7f040df0b700 1 --2- 172.21.15.107:0/147988179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0408107be0 0x7f0408104220 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f04000085c0 tx=0x7f040000acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:06.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.334+0000 7f03fe7fc700 1 -- 172.21.15.107:0/147988179 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400009da0 con 0x7f0408107be0 2024-05-10T10:56:06.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.334+0000 7f03fe7fc700 1 -- 172.21.15.107:0/147988179 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f04000050d0 con 0x7f0408107be0 2024-05-10T10:56:06.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.334+0000 7f03fe7fc700 1 -- 172.21.15.107:0/147988179 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04000076e0 con 0x7f0408107be0 2024-05-10T10:56:06.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.334+0000 7f040f96e700 1 -- 172.21.15.107:0/147988179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04081a8340 con 0x7f0408107be0 2024-05-10T10:56:06.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.334+0000 7f040f96e700 1 -- 172.21.15.107:0/147988179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04081a8740 con 0x7f0408107be0 2024-05-10T10:56:06.337 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.336+0000 7f03fe7fc700 1 -- 172.21.15.107:0/147988179 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 149704+0+0 (secure 0 0 0) 0x7f0400005280 con 0x7f0408107be0 2024-05-10T10:56:06.346 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.338+0000 7f03fe7fc700 1 --2- 172.21.15.107:0/147988179 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f03f40b2990 0x7f03f40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:06.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.338+0000 7f040d70a700 1 --2- 172.21.15.107:0/147988179 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f03f40b2990 0x7f03f40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:06.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.338+0000 7f03fe7fc700 1 -- 172.21.15.107:0/147988179 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f0400010020 con 0x7f0408107be0 2024-05-10T10:56:06.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.338+0000 7f040d70a700 1 --2- 172.21.15.107:0/147988179 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f03f40b2990 0x7f03f40b4e50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0404005950 tx=0x7f04040058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:06.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.338+0000 7f041a201b80 1 Processor -- start 2024-05-10T10:56:06.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.338+0000 7f041a201b80 1 -- start start 2024-05-10T10:56:06.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.338+0000 7f041a201b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9b480 0x561faab9b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:06.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.338+0000 7f041a201b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9bda0 0x561faab9f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:06.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.338+0000 7f041a201b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 0x561faaba00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:06.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.338+0000 7f041a201b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561faaaed810 con 0x561faab9fc30 2024-05-10T10:56:06.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.338+0000 7f041a201b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561faaa8c770 con 0x561faab9bda0 2024-05-10T10:56:06.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.338+0000 7f041a201b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x561faaae97d0 con 0x561faab9b480 2024-05-10T10:56:06.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.339+0000 7f040df0b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 0x561faaba00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:06.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.339+0000 7f040df0b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 0x561faaba00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44584/0 (socket says 172.21.15.107:44584) 2024-05-10T10:56:06.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.339+0000 7f040df0b700 1 -- 172.21.15.107:0/2178333552 learned_addr learned my addr 172.21.15.107:0/2178333552 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:06.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.339+0000 7f040d70a700 1 --2- 172.21.15.107:0/2178333552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9b480 0x561faab9b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:06.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.339+0000 7f040cf09700 1 --2- 172.21.15.107:0/2178333552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9bda0 0x561faab9f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:06.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.339+0000 7f040df0b700 1 -- 172.21.15.107:0/2178333552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9b480 msgr2=0x561faab9b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:06.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.339+0000 7f040df0b700 1 --2- 172.21.15.107:0/2178333552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9b480 0x561faab9b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.339+0000 7f040df0b700 1 -- 172.21.15.107:0/2178333552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9bda0 msgr2=0x561faab9f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:06.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.339+0000 7f040df0b700 1 --2- 172.21.15.107:0/2178333552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9bda0 0x561faab9f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.339+0000 7f040df0b700 1 -- 172.21.15.107:0/2178333552 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561faaa3a880 con 0x561faab9fc30 2024-05-10T10:56:06.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.339+0000 7f040df0b700 1 --2- 172.21.15.107:0/2178333552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 0x561faaba00b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f04000a6d60 tx=0x7f04000aa580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abfe46c1d5b877b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:06.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.339+0000 7f03f37fe700 1 -- 172.21.15.107:0/2178333552 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04000af090 con 0x561faab9fc30 2024-05-10T10:56:06.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.339+0000 7f03f37fe700 1 -- 172.21.15.107:0/2178333552 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f04000b3ab0 con 0x561faab9fc30 2024-05-10T10:56:06.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.339+0000 7f03f37fe700 1 -- 172.21.15.107:0/2178333552 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04000aaf40 con 0x561faab9fc30 2024-05-10T10:56:06.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.340+0000 7f041a201b80 1 -- 172.21.15.107:0/2178333552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 msgr2=0x561faaba00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:06.348 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.340+0000 7f041a201b80 1 --2- 172.21.15.107:0/2178333552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 0x561faaba00b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f04000a6d60 tx=0x7f04000aa580 comp rx=0 tx=0).stop 2024-05-10T10:56:06.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.340+0000 7f041a201b80 1 -- 172.21.15.107:0/2178333552 shutdown_connections 2024-05-10T10:56:06.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.340+0000 7f041a201b80 1 --2- 172.21.15.107:0/2178333552 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9b480 0x561faab9b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.340+0000 7f041a201b80 1 --2- 172.21.15.107:0/2178333552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 0x561faaba00b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.340+0000 7f041a201b80 1 --2- 172.21.15.107:0/2178333552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9bda0 0x561faab9f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.340+0000 7f041a201b80 1 -- 172.21.15.107:0/2178333552 >> 172.21.15.107:0/2178333552 conn(0x561faaac70b0 msgr2=0x561faab95c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:06.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.340+0000 7f041a201b80 1 -- 172.21.15.107:0/2178333552 shutdown_connections 2024-05-10T10:56:06.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.340+0000 7f041a201b80 1 -- 172.21.15.107:0/2178333552 wait complete. 2024-05-10T10:56:06.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.340+0000 7f041a201b80 1 -- start start 2024-05-10T10:56:06.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.340+0000 7f041a201b80 1 Processor -- start 2024-05-10T10:56:06.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f041a201b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9b480 0x561faaba70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:06.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f041a201b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9bda0 0x561faaba4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:06.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f041a201b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9fc30 0x561faaba49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:06.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f041a201b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561faaba7c00 con 0x561faab9bda0 2024-05-10T10:56:06.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f041a201b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561faaa53be0 con 0x561faab9b480 2024-05-10T10:56:06.349 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f041a201b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x561faaba7d80 con 0x561faab9fc30 2024-05-10T10:56:06.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f041a201b80 10 client.0 _ll_register_callbacks cb 0x561faaa858d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:56:06.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f040cf09700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9bda0 0x561faaba4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:06.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f040cf09700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9bda0 0x561faaba4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44588/0 (socket says 172.21.15.107:44588) 2024-05-10T10:56:06.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f040cf09700 1 -- 172.21.15.107:0/1779698422 learned_addr learned my addr 172.21.15.107:0/1779698422 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:06.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f040d70a700 1 --2- 172.21.15.107:0/1779698422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9b480 0x561faaba70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:06.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f040df0b700 1 --2- 172.21.15.107:0/1779698422 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9fc30 0x561faaba49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:06.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f040cf09700 1 -- 172.21.15.107:0/1779698422 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9fc30 msgr2=0x561faaba49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:06.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f040cf09700 1 --2- 172.21.15.107:0/1779698422 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9fc30 0x561faaba49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f040cf09700 1 -- 172.21.15.107:0/1779698422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9b480 msgr2=0x561faaba70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:06.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f040cf09700 1 --2- 172.21.15.107:0/1779698422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9b480 0x561faaba70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f040cf09700 1 -- 172.21.15.107:0/1779698422 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561faaa89640 con 0x561faab9bda0 2024-05-10T10:56:06.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f040d70a700 1 --2- 172.21.15.107:0/1779698422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9b480 0x561faaba70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:56:06.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f040cf09700 1 --2- 172.21.15.107:0/1779698422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9bda0 0x561faaba4470 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f03f8012840 tx=0x7f03f8012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23884deb8546b052 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:06.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.341+0000 7f03f0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:56:06.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.342+0000 7f03f0ff9700 1 -- 172.21.15.107:0/1779698422 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f800f5e0 con 0x561faab9bda0 2024-05-10T10:56:06.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.342+0000 7f041a201b80 1 -- 172.21.15.107:0/1779698422 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04000b3ab0 con 0x561faab9bda0 2024-05-10T10:56:06.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.342+0000 7f03f0ff9700 1 -- 172.21.15.107:0/1779698422 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f03f800f780 con 0x561faab9bda0 2024-05-10T10:56:06.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.342+0000 7f03f0ff9700 1 -- 172.21.15.107:0/1779698422 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f03f800f980 con 0x561faab9bda0 2024-05-10T10:56:06.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.342+0000 7f041a201b80 10 client.15369 fetch_fsmap learned FSMap version 27 2024-05-10T10:56:06.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.342+0000 7f041a201b80 1 -- 172.21.15.107:0/1779698422 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561faabb2450 con 0x561faab9bda0 2024-05-10T10:56:06.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.342+0000 7f03f0ff9700 1 -- 172.21.15.107:0/1779698422 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f04000b3ab0 con 0x561faab9bda0 2024-05-10T10:56:06.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.342+0000 7f03f0ff9700 1 -- 172.21.15.107:0/1779698422 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f03f8010c40 con 0x561faab9bda0 2024-05-10T10:56:06.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.342+0000 7f041a201b80 10 client.15369 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:56:06.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.342+0000 7f041a201b80 10 client.15369 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T10:56:06.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.342+0000 7f041a201b80 20 client.15369 populate_metadata read hostname 'smithi107' 2024-05-10T10:56:06.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.342+0000 7f041a201b80 1 --2- 172.21.15.107:0/1779698422 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561faabb4a70 0x561faabb5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:06.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.342+0000 7f041a201b80 4 client.15369 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:56:06.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.342+0000 7f041a201b80 1 -- 172.21.15.107:0/1779698422 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561faab67600 con 0x561faabb4a70 2024-05-10T10:56:06.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.343+0000 7f040d70a700 1 --2- 172.21.15.107:0/1779698422 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561faabb4a70 0x561faabb5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:06.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.343+0000 7f03f0ff9700 10 client.15369 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:06.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.343+0000 7f040d70a700 1 --2- 172.21.15.107:0/1779698422 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561faabb4a70 0x561faabb5ee0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ddd9f16ea7daf4 server_cookie=8faefe7814cf559d in_seq=0 out_seq=0 2024-05-10T10:56:06.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.344+0000 7f03f0ff9700 1 -- 172.21.15.107:0/1779698422 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561faab67600 con 0x561faabb4a70 2024-05-10T10:56:06.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.344+0000 7f03f0ff9700 10 client.15369 handle_command_reply: tid=0 2024-05-10T10:56:06.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.344+0000 7f041a201b80 1 client.15369 shutdown 2024-05-10T10:56:06.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.344+0000 7f041a201b80 1 -- 172.21.15.107:0/1779698422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9bda0 msgr2=0x561faaba4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:06.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.344+0000 7f041a201b80 1 --2- 172.21.15.107:0/1779698422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9bda0 0x561faaba4470 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f03f8012840 tx=0x7f03f8012c00 comp rx=0 tx=0).stop 2024-05-10T10:56:06.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.344+0000 7f041a201b80 1 -- 172.21.15.107:0/1779698422 shutdown_connections 2024-05-10T10:56:06.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.344+0000 7f041a201b80 1 --2- 172.21.15.107:0/1779698422 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9fc30 0x561faaba49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.344+0000 7f041a201b80 1 --2- 172.21.15.107:0/1779698422 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561faabb4a70 0x561faabb5ee0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.344+0000 7f041a201b80 1 --2- 172.21.15.107:0/1779698422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9b480 0x561faaba70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.344+0000 7f041a201b80 1 --2- 172.21.15.107:0/1779698422 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9bda0 0x561faaba4470 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.344+0000 7f03f0ff9700 0 client.15369 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:06.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.344+0000 7f041a201b80 1 -- 172.21.15.107:0/1779698422 >> 172.21.15.107:0/1779698422 conn(0x561faaac70b0 msgr2=0x561faab95bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:06.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.344+0000 7f041a201b80 1 -- 172.21.15.107:0/1779698422 shutdown_connections 2024-05-10T10:56:06.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.344+0000 7f041a201b80 1 -- 172.21.15.107:0/1779698422 wait complete. 2024-05-10T10:56:06.353 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.344+0000 7f041a201b80 20 client.15369 trim_cache size 0 max 16384 2024-05-10T10:56:06.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.365+0000 7f041a201b80 1 Processor -- start 2024-05-10T10:56:06.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.365+0000 7f041a201b80 1 -- start start 2024-05-10T10:56:06.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.365+0000 7f041a201b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9b480 0x561faabb0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:06.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.365+0000 7f041a201b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9bda0 0x561faab90550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:06.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.365+0000 7f041a201b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 0x561faabbf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:06.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.365+0000 7f041a201b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561faabb4220 con 0x561faab9fc30 2024-05-10T10:56:06.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.365+0000 7f041a201b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561faabb48f0 con 0x561faab9bda0 2024-05-10T10:56:06.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.365+0000 7f041a201b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x561faabb4fc0 con 0x561faab9b480 2024-05-10T10:56:06.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.365+0000 7f040df0b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 0x561faabbf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:06.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.365+0000 7f040df0b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 0x561faabbf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44604/0 (socket says 172.21.15.107:44604) 2024-05-10T10:56:06.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.365+0000 7f040df0b700 1 -- 172.21.15.107:0/68011417 learned_addr learned my addr 172.21.15.107:0/68011417 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:06.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.365+0000 7f040cf09700 1 --2- 172.21.15.107:0/68011417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9bda0 0x561faab90550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:06.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.365+0000 7f040d70a700 1 --2- 172.21.15.107:0/68011417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9b480 0x561faabb0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:06.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.365+0000 7f040df0b700 1 -- 172.21.15.107:0/68011417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9b480 msgr2=0x561faabb0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:06.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.365+0000 7f040df0b700 1 --2- 172.21.15.107:0/68011417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9b480 0x561faabb0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.365+0000 7f040df0b700 1 -- 172.21.15.107:0/68011417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9bda0 msgr2=0x561faab90550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:06.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.365+0000 7f040df0b700 1 --2- 172.21.15.107:0/68011417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9bda0 0x561faab90550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.365+0000 7f040df0b700 1 -- 172.21.15.107:0/68011417 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561faab974d0 con 0x561faab9fc30 2024-05-10T10:56:06.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.365+0000 7f040d70a700 1 --2- 172.21.15.107:0/68011417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9b480 0x561faabb0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:56:06.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.366+0000 7f040df0b700 1 --2- 172.21.15.107:0/68011417 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 0x561faabbf340 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f040000ab30 tx=0x7f040000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d38bc0bfaa2ec48 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:06.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.366+0000 7f03f2ffd700 1 -- 172.21.15.107:0/68011417 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04000a6ba0 con 0x561faab9fc30 2024-05-10T10:56:06.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.366+0000 7f03f2ffd700 1 -- 172.21.15.107:0/68011417 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f04000b3ab0 con 0x561faab9fc30 2024-05-10T10:56:06.368 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.366+0000 7f03f2ffd700 1 -- 172.21.15.107:0/68011417 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04000c5160 con 0x561faab9fc30 2024-05-10T10:56:06.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.367+0000 7f041a201b80 1 -- 172.21.15.107:0/68011417 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 msgr2=0x561faabbf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:06.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.367+0000 7f041a201b80 1 --2- 172.21.15.107:0/68011417 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 0x561faabbf340 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f040000ab30 tx=0x7f040000c8a0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.367+0000 7f041a201b80 1 -- 172.21.15.107:0/68011417 shutdown_connections 2024-05-10T10:56:06.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.367+0000 7f041a201b80 1 --2- 172.21.15.107:0/68011417 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9b480 0x561faabb0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.367+0000 7f041a201b80 1 --2- 172.21.15.107:0/68011417 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 0x561faabbf340 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.367+0000 7f041a201b80 1 --2- 172.21.15.107:0/68011417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9bda0 0x561faab90550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.367+0000 7f041a201b80 1 -- 172.21.15.107:0/68011417 >> 172.21.15.107:0/68011417 conn(0x561faaac70b0 msgr2=0x561faab8fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:06.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.367+0000 7f041a201b80 1 -- 172.21.15.107:0/68011417 shutdown_connections 2024-05-10T10:56:06.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.367+0000 7f041a201b80 1 -- 172.21.15.107:0/68011417 wait complete. 2024-05-10T10:56:06.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.367+0000 7f041a201b80 1 -- start start 2024-05-10T10:56:06.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.367+0000 7f041a201b80 1 Processor -- start 2024-05-10T10:56:06.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f041a201b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9b480 0x561faabbb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:06.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f041a201b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9bda0 0x561faabbb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:06.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f041a201b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 0x561faac1eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:06.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f041a201b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561faabb5d60 con 0x561faab9fc30 2024-05-10T10:56:06.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f041a201b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561faabb5690 con 0x561faab9b480 2024-05-10T10:56:06.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f041a201b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x561faabb6430 con 0x561faab9bda0 2024-05-10T10:56:06.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f041a201b80 10 client.0 _ll_register_callbacks cb 0x561faaa858d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:56:06.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f040df0b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 0x561faac1eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:06.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f040df0b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 0x561faac1eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44614/0 (socket says 172.21.15.107:44614) 2024-05-10T10:56:06.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f040df0b700 1 -- 172.21.15.107:0/2312305715 learned_addr learned my addr 172.21.15.107:0/2312305715 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:06.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f040cf09700 1 --2- 172.21.15.107:0/2312305715 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9bda0 0x561faabbb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:06.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f040d70a700 1 --2- 172.21.15.107:0/2312305715 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9b480 0x561faabbb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:06.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f040df0b700 1 -- 172.21.15.107:0/2312305715 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9bda0 msgr2=0x561faabbb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:06.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f040df0b700 1 --2- 172.21.15.107:0/2312305715 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9bda0 0x561faabbb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f040df0b700 1 -- 172.21.15.107:0/2312305715 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9b480 msgr2=0x561faabbb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:06.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f040df0b700 1 --2- 172.21.15.107:0/2312305715 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9b480 0x561faabbb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f040df0b700 1 -- 172.21.15.107:0/2312305715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561faab8e280 con 0x561faab9fc30 2024-05-10T10:56:06.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f03f0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:56:06.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f040df0b700 1 --2- 172.21.15.107:0/2312305715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 0x561faac1eee0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f040000c590 tx=0x7f04000a7210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6141f39fdcbcb69c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:06.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f03f0ff9700 1 -- 172.21.15.107:0/2312305715 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04000a6ba0 con 0x561faab9fc30 2024-05-10T10:56:06.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f03f0ff9700 1 -- 172.21.15.107:0/2312305715 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f04000055b0 con 0x561faab9fc30 2024-05-10T10:56:06.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.368+0000 7f041a201b80 1 -- 172.21.15.107:0/2312305715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04000b3ab0 con 0x561faab9fc30 2024-05-10T10:56:06.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.369+0000 7f03f0ff9700 1 -- 172.21.15.107:0/2312305715 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f04000af090 con 0x561faab9fc30 2024-05-10T10:56:06.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.369+0000 7f041a201b80 10 client.15375 fetch_fsmap learned FSMap version 27 2024-05-10T10:56:06.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.369+0000 7f041a201b80 1 -- 172.21.15.107:0/2312305715 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561faac20330 con 0x561faab9fc30 2024-05-10T10:56:06.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.369+0000 7f03f0ff9700 1 -- 172.21.15.107:0/2312305715 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f04000b3ab0 con 0x561faab9fc30 2024-05-10T10:56:06.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.369+0000 7f03f0ff9700 1 -- 172.21.15.107:0/2312305715 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0400012070 con 0x561faab9fc30 2024-05-10T10:56:06.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.369+0000 7f041a201b80 10 client.15375 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:56:06.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.369+0000 7f041a201b80 10 client.15375 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T10:56:06.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.369+0000 7f041a201b80 20 client.15375 populate_metadata read hostname 'smithi107' 2024-05-10T10:56:06.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.369+0000 7f041a201b80 1 --2- 172.21.15.107:0/2312305715 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561faac24a20 0x561faac23730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:06.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.369+0000 7f041a201b80 4 client.15375 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T10:56:06.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.369+0000 7f041a201b80 1 -- 172.21.15.107:0/2312305715 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "status"}) -- 0x561faaafb1f0 con 0x561faac24a20 2024-05-10T10:56:06.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.369+0000 7f040d70a700 1 --2- 172.21.15.107:0/2312305715 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561faac24a20 0x561faac23730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:06.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.370+0000 7f03f0ff9700 10 client.15375 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:06.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.370+0000 7f040d70a700 1 --2- 172.21.15.107:0/2312305715 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561faac24a20 0x561faac23730 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe27b54fc9462ff6 server_cookie=c52a9dbd4d0caa5d in_seq=0 out_seq=0 2024-05-10T10:56:06.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.370+0000 7f03f0ff9700 1 -- 172.21.15.107:0/2312305715 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x561faaafb1f0 con 0x561faac24a20 2024-05-10T10:56:06.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.370+0000 7f03f0ff9700 10 client.15375 handle_command_reply: tid=0 2024-05-10T10:56:06.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.370+0000 7f041a201b80 1 client.15375 shutdown 2024-05-10T10:56:06.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.370+0000 7f041a201b80 1 -- 172.21.15.107:0/2312305715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 msgr2=0x561faac1eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:06.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.370+0000 7f041a201b80 1 --2- 172.21.15.107:0/2312305715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 0x561faac1eee0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f040000c590 tx=0x7f04000a7210 comp rx=0 tx=0).stop 2024-05-10T10:56:06.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.370+0000 7f041a201b80 1 -- 172.21.15.107:0/2312305715 shutdown_connections 2024-05-10T10:56:06.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.370+0000 7f041a201b80 1 --2- 172.21.15.107:0/2312305715 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561faac24a20 0x561faac23730 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.370+0000 7f041a201b80 1 --2- 172.21.15.107:0/2312305715 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561faab9fc30 0x561faac1eee0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.370+0000 7f03f0ff9700 0 client.15375 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:06.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.370+0000 7f041a201b80 1 --2- 172.21.15.107:0/2312305715 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561faab9b480 0x561faabbb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.370+0000 7f041a201b80 1 --2- 172.21.15.107:0/2312305715 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561faab9bda0 0x561faabbb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.370+0000 7f041a201b80 1 -- 172.21.15.107:0/2312305715 >> 172.21.15.107:0/2312305715 conn(0x561faaac70b0 msgr2=0x561faab9a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:06.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.370+0000 7f041a201b80 1 -- 172.21.15.107:0/2312305715 shutdown_connections 2024-05-10T10:56:06.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.370+0000 7f041a201b80 1 -- 172.21.15.107:0/2312305715 wait complete. 2024-05-10T10:56:06.377 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.370+0000 7f041a201b80 20 client.15375 trim_cache size 0 max 16384 2024-05-10T10:56:06.377 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:56:06.377 INFO:teuthology.orchestra.run.smithi107.stdout: "cluster_fsid": "0ba8a8e4-0eba-11ef-bc98-c7b262605968", 2024-05-10T10:56:06.377 INFO:teuthology.orchestra.run.smithi107.stdout: "whoami": 0, 2024-05-10T10:56:06.377 INFO:teuthology.orchestra.run.smithi107.stdout: "id": 24482, 2024-05-10T10:56:06.377 INFO:teuthology.orchestra.run.smithi107.stdout: "want_state": "up:active", 2024-05-10T10:56:06.377 INFO:teuthology.orchestra.run.smithi107.stdout: "state": "up:active", 2024-05-10T10:56:06.377 INFO:teuthology.orchestra.run.smithi107.stdout: "fs_name": "cephfs", 2024-05-10T10:56:06.377 INFO:teuthology.orchestra.run.smithi107.stdout: "rank_uptime": 228.68825790899999, 2024-05-10T10:56:06.377 INFO:teuthology.orchestra.run.smithi107.stdout: "mdsmap_epoch": 27, 2024-05-10T10:56:06.377 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch": 82, 2024-05-10T10:56:06.378 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_epoch_barrier": 82, 2024-05-10T10:56:06.378 INFO:teuthology.orchestra.run.smithi107.stdout: "uptime": 244.24829477200001 2024-05-10T10:56:06.378 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:56:06.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.371+0000 7f040f96e700 1 -- 172.21.15.107:0/147988179 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f03f40b2990 msgr2=0x7f03f40b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:06.378 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.371+0000 7f040f96e700 1 --2- 172.21.15.107:0/147988179 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f03f40b2990 0x7f03f40b4e50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0404005950 tx=0x7f04040058e0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.371+0000 7f040f96e700 1 -- 172.21.15.107:0/147988179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0408107be0 msgr2=0x7f0408104220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:06.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.371+0000 7f040f96e700 1 --2- 172.21.15.107:0/147988179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0408107be0 0x7f0408104220 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f04000085c0 tx=0x7f040000acd0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.371+0000 7f040f96e700 1 -- 172.21.15.107:0/147988179 shutdown_connections 2024-05-10T10:56:06.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.371+0000 7f040f96e700 1 --2- 172.21.15.107:0/147988179 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f03f40b2990 0x7f03f40b4e50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.371+0000 7f040f96e700 1 --2- 172.21.15.107:0/147988179 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0408101b80 0x7f04081037a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.371+0000 7f040f96e700 1 --2- 172.21.15.107:0/147988179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0408107be0 0x7f0408104220 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.371+0000 7f040f96e700 1 --2- 172.21.15.107:0/147988179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0408102540 0x7f0408103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:06.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.371+0000 7f040f96e700 1 -- 172.21.15.107:0/147988179 >> 172.21.15.107:0/147988179 conn(0x7f0408078a10 msgr2=0x7f0408105e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:06.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.371+0000 7f040f96e700 1 -- 172.21.15.107:0/147988179 shutdown_connections 2024-05-10T10:56:06.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:06.371+0000 7f040f96e700 1 -- 172.21.15.107:0/147988179 wait complete. 2024-05-10T10:56:07.047 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-05-10T10:56:07.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:07 smithi107 ceph-mon[30373]: pgmap v401: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-05-10T10:56:07.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:07 smithi196 ceph-mon[34872]: pgmap v401: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-05-10T10:56:07.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:07 smithi184 ceph-mon[34585]: pgmap v401: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-05-10T10:56:09.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:09 smithi196 ceph-mon[34872]: pgmap v402: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-10T10:56:09.388 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:09 smithi184 ceph-mon[34585]: pgmap v402: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-10T10:56:09.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:09 smithi107 ceph-mon[30373]: pgmap v402: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-10T10:56:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.801+0000 7ff5394c5640 1 -- 172.21.15.107:0/3652663921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff534104c40 msgr2=0x7ff534105060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.801+0000 7ff5394c5640 1 --2- 172.21.15.107:0/3652663921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff534104c40 0x7ff534105060 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff524009900 tx=0x7ff52402a410 comp rx=0 tx=0).stop 2024-05-10T10:56:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.801+0000 7ff5394c5640 1 -- 172.21.15.107:0/3652663921 shutdown_connections 2024-05-10T10:56:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.801+0000 7ff5394c5640 1 --2- 172.21.15.107:0/3652663921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5341067f0 0x7ff53410d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.802+0000 7ff5394c5640 1 --2- 172.21.15.107:0/3652663921 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff534105e30 0x7ff5341062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.802+0000 7ff5394c5640 1 --2- 172.21.15.107:0/3652663921 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff534104c40 0x7ff534105060 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.802+0000 7ff5394c5640 1 -- 172.21.15.107:0/3652663921 >> 172.21.15.107:0/3652663921 conn(0x7ff5341001d0 msgr2=0x7ff5341025f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.802+0000 7ff5394c5640 1 -- 172.21.15.107:0/3652663921 shutdown_connections 2024-05-10T10:56:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.802+0000 7ff5394c5640 1 -- 172.21.15.107:0/3652663921 wait complete. 2024-05-10T10:56:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.802+0000 7ff5394c5640 1 Processor -- start 2024-05-10T10:56:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.802+0000 7ff5394c5640 1 -- start start 2024-05-10T10:56:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.803+0000 7ff5394c5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff534104c40 0x7ff53419ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.803+0000 7ff5394c5640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff534105e30 0x7ff53419b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.803+0000 7ff5394c5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5341067f0 0x7ff5341a2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.803+0000 7ff5394c5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341108f0 con 0x7ff5341067f0 2024-05-10T10:56:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.803+0000 7ff5394c5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff534110770 con 0x7ff534104c40 2024-05-10T10:56:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.803+0000 7ff5394c5640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff534110a70 con 0x7ff534105e30 2024-05-10T10:56:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.803+0000 7ff5337fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5341067f0 0x7ff5341a2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.803+0000 7ff5337fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5341067f0 0x7ff5341a2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48786/0 (socket says 172.21.15.107:48786) 2024-05-10T10:56:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.803+0000 7ff532ffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff534104c40 0x7ff53419ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.803+0000 7ff5337fe640 1 -- 172.21.15.107:0/1305973160 learned_addr learned my addr 172.21.15.107:0/1305973160 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.803+0000 7ff52a7fc640 1 --2- 172.21.15.107:0/1305973160 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff534105e30 0x7ff53419b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.803+0000 7ff5337fe640 1 -- 172.21.15.107:0/1305973160 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff534105e30 msgr2=0x7ff53419b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.803+0000 7ff5337fe640 1 --2- 172.21.15.107:0/1305973160 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff534105e30 0x7ff53419b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.803+0000 7ff5337fe640 1 -- 172.21.15.107:0/1305973160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff534104c40 msgr2=0x7ff53419ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.803+0000 7ff5337fe640 1 --2- 172.21.15.107:0/1305973160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff534104c40 0x7ff53419ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.803+0000 7ff5337fe640 1 -- 172.21.15.107:0/1305973160 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5341a2aa0 con 0x7ff5341067f0 2024-05-10T10:56:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.803+0000 7ff5337fe640 1 --2- 172.21.15.107:0/1305973160 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5341067f0 0x7ff5341a2430 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00eaa0 tx=0x7ff52c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:10.806 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.804+0000 7ff530ff9640 1 -- 172.21.15.107:0/1305973160 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c00cdb0 con 0x7ff5341067f0 2024-05-10T10:56:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.804+0000 7ff530ff9640 1 -- 172.21.15.107:0/1305973160 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff52c005020 con 0x7ff5341067f0 2024-05-10T10:56:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.804+0000 7ff5394c5640 1 -- 172.21.15.107:0/1305973160 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5341a2d90 con 0x7ff5341067f0 2024-05-10T10:56:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.804+0000 7ff530ff9640 1 -- 172.21.15.107:0/1305973160 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c0116d0 con 0x7ff5341067f0 2024-05-10T10:56:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.804+0000 7ff5394c5640 1 -- 172.21.15.107:0/1305973160 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5341a3230 con 0x7ff5341067f0 2024-05-10T10:56:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.806+0000 7ff530ff9640 1 -- 172.21.15.107:0/1305973160 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 149704+0+0 (secure 0 0 0) 0x7ff52c0051d0 con 0x7ff5341067f0 2024-05-10T10:56:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.807+0000 7ff53c1d6740 1 Processor -- start 2024-05-10T10:56:10.807 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.807+0000 7ff53c1d6740 1 -- start start 2024-05-10T10:56:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.807+0000 7ff53c1d6740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0bdb0 0x55f872b0c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:10.809 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.807+0000 7ff53c1d6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b0c7a0 0x55f872b112a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.807+0000 7ff53c1d6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b11910 0x55f872b13da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.807+0000 7ff53c1d6740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f872a705d0 con 0x55f872b0bdb0 2024-05-10T10:56:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.807+0000 7ff53c1d6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f872a29890 con 0x55f872b11910 2024-05-10T10:56:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.807+0000 7ff53c1d6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f872a6c590 con 0x55f872b0c7a0 2024-05-10T10:56:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.807+0000 7ff530ff9640 1 --2- 172.21.15.107:0/1305973160 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff5200b2920 0x7ff5200b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.807+0000 7ff52a7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0bdb0 0x55f872b0c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.808+0000 7ff52a7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0bdb0 0x55f872b0c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48790/0 (socket says 172.21.15.107:48790) 2024-05-10T10:56:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.808+0000 7ff52a7fc640 1 -- 172.21.15.107:0/1692676610 learned_addr learned my addr 172.21.15.107:0/1692676610 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.808+0000 7ff532ffd640 1 --2- 172.21.15.107:0/1692676610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b0c7a0 0x55f872b112a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.808+0000 7ff52a7fc640 1 --2- 172.21.15.107:0/1692676610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b11910 0x55f872b13da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.808+0000 7ff5337fe640 1 --2- 172.21.15.107:0/1305973160 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff5200b2920 0x7ff5200b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.808+0000 7ff530ff9640 1 -- 172.21.15.107:0/1305973160 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7ff52c0e2440 con 0x7ff5341067f0 2024-05-10T10:56:10.810 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.808+0000 7ff532ffd640 1 -- 172.21.15.107:0/1692676610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b11910 msgr2=0x55f872b13da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.808+0000 7ff532ffd640 1 --2- 172.21.15.107:0/1692676610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b11910 0x55f872b13da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.808+0000 7ff532ffd640 1 -- 172.21.15.107:0/1692676610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0bdb0 msgr2=0x55f872b0c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.808+0000 7ff532ffd640 1 --2- 172.21.15.107:0/1692676610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0bdb0 0x55f872b0c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.808+0000 7ff532ffd640 1 -- 172.21.15.107:0/1692676610 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f872782210 con 0x55f872b0c7a0 2024-05-10T10:56:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.808+0000 7ff52a7fc640 1 --2- 172.21.15.107:0/1692676610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0bdb0 0x55f872b0c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:56:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.808+0000 7ff532ffd640 1 --2- 172.21.15.107:0/1692676610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b0c7a0 0x55f872b112a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff52402a930 tx=0x7ff524004200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19d09c13362b7445 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.808+0000 7ff5337fe640 1 --2- 172.21.15.107:0/1305973160 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff5200b2920 0x7ff5200b4de0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00efd0 tx=0x7ff52c004930 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.808+0000 7ff5297fa640 1 -- 172.21.15.107:0/1692676610 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524035040 con 0x55f872b0c7a0 2024-05-10T10:56:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.809+0000 7ff5297fa640 1 -- 172.21.15.107:0/1692676610 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff5240044b0 con 0x55f872b0c7a0 2024-05-10T10:56:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.809+0000 7ff5297fa640 1 -- 172.21.15.107:0/1692676610 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524031870 con 0x55f872b0c7a0 2024-05-10T10:56:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.809+0000 7ff53c1d6740 1 -- 172.21.15.107:0/1692676610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b0c7a0 msgr2=0x55f872b112a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:10.811 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.809+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/1692676610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b0c7a0 0x55f872b112a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff52402a930 tx=0x7ff524004200 comp rx=0 tx=0).stop 2024-05-10T10:56:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.809+0000 7ff53c1d6740 1 -- 172.21.15.107:0/1692676610 shutdown_connections 2024-05-10T10:56:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.809+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/1692676610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b11910 0x55f872b13da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.809+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/1692676610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b0c7a0 0x55f872b112a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.809+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/1692676610 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0bdb0 0x55f872b0c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.809+0000 7ff53c1d6740 1 -- 172.21.15.107:0/1692676610 >> 172.21.15.107:0/1692676610 conn(0x55f872b07420 msgr2=0x55f872b07820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.809+0000 7ff53c1d6740 1 -- 172.21.15.107:0/1692676610 shutdown_connections 2024-05-10T10:56:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.809+0000 7ff53c1d6740 1 -- 172.21.15.107:0/1692676610 wait complete. 2024-05-10T10:56:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.810+0000 7ff53c1d6740 1 -- start start 2024-05-10T10:56:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.810+0000 7ff53c1d6740 1 Processor -- start 2024-05-10T10:56:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.810+0000 7ff53c1d6740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0bdb0 0x55f872b15ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.810+0000 7ff53c1d6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b0c7a0 0x55f872b16420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.810+0000 7ff53c1d6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b11910 0x55f872b1d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:10.816 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.810+0000 7ff53c1d6740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f872b14860 con 0x55f872b0bdb0 2024-05-10T10:56:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.810+0000 7ff53c1d6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f872a2d370 con 0x55f872b0c7a0 2024-05-10T10:56:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.810+0000 7ff53c1d6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f872b149e0 con 0x55f872b11910 2024-05-10T10:56:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.810+0000 7ff53c1d6740 10 client.0 _ll_register_callbacks cb 0x55f872781a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:56:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.810+0000 7ff52a7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0bdb0 0x55f872b15ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.810+0000 7ff52a7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0bdb0 0x55f872b15ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48806/0 (socket says 172.21.15.107:48806) 2024-05-10T10:56:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.810+0000 7ff52a7fc640 1 -- 172.21.15.107:0/4255903179 learned_addr learned my addr 172.21.15.107:0/4255903179 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.810+0000 7ff532ffd640 1 --2- 172.21.15.107:0/4255903179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b0c7a0 0x55f872b16420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.810+0000 7ff52a7fc640 1 --2- 172.21.15.107:0/4255903179 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b11910 0x55f872b1d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.811+0000 7ff52a7fc640 1 -- 172.21.15.107:0/4255903179 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b11910 msgr2=0x55f872b1d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.811+0000 7ff52a7fc640 1 --2- 172.21.15.107:0/4255903179 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b11910 0x55f872b1d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.811+0000 7ff52a7fc640 1 -- 172.21.15.107:0/4255903179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b0c7a0 msgr2=0x55f872b16420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.811+0000 7ff52a7fc640 1 --2- 172.21.15.107:0/4255903179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b0c7a0 0x55f872b16420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.811+0000 7ff52a7fc640 1 -- 172.21.15.107:0/4255903179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f87284e620 con 0x55f872b0bdb0 2024-05-10T10:56:10.817 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.811+0000 7ff52a7fc640 1 --2- 172.21.15.107:0/4255903179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0bdb0 0x55f872b15ee0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0116f0 tx=0x7ff51c00a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46936605d40942d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.811+0000 7ff51a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:56:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.811+0000 7ff51a7fc640 1 -- 172.21.15.107:0/4255903179 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c01c040 con 0x55f872b0bdb0 2024-05-10T10:56:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.811+0000 7ff53c1d6740 1 -- 172.21.15.107:0/4255903179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5240044b0 con 0x55f872b0bdb0 2024-05-10T10:56:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.811+0000 7ff51a7fc640 1 -- 172.21.15.107:0/4255903179 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7ff51c015170 con 0x55f872b0bdb0 2024-05-10T10:56:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.811+0000 7ff51a7fc640 1 -- 172.21.15.107:0/4255903179 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff51c011c70 con 0x55f872b0bdb0 2024-05-10T10:56:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.811+0000 7ff53c1d6740 10 client.15387 fetch_fsmap learned FSMap version 27 2024-05-10T10:56:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.811+0000 7ff53c1d6740 1 -- 172.21.15.107:0/4255903179 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f872b20500 con 0x55f872b0bdb0 2024-05-10T10:56:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.811+0000 7ff51a7fc640 1 -- 172.21.15.107:0/4255903179 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff5240044b0 con 0x55f872b0bdb0 2024-05-10T10:56:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.812+0000 7ff51a7fc640 1 -- 172.21.15.107:0/4255903179 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff51c005430 con 0x55f872b0bdb0 2024-05-10T10:56:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.812+0000 7ff53c1d6740 10 client.15387 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:56:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.812+0000 7ff53c1d6740 10 client.15387 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:56:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.812+0000 7ff53c1d6740 20 client.15387 populate_metadata read hostname 'smithi107' 2024-05-10T10:56:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.812+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/4255903179 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f872b21b30 0x55f872b23fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:10.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.812+0000 7ff53c1d6740 4 client.15387 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:56:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.812+0000 7ff53c1d6740 1 -- 172.21.15.107:0/4255903179 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f872a7e1e0 con 0x55f872b21b30 2024-05-10T10:56:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.812+0000 7ff532ffd640 1 --2- 172.21.15.107:0/4255903179 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f872b21b30 0x55f872b23fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.812+0000 7ff51a7fc640 10 client.15387 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.812+0000 7ff532ffd640 1 --2- 172.21.15.107:0/4255903179 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f872b21b30 0x55f872b23fa0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19e1e9f01603cb93 server_cookie=9dc6f4eceada80e4 in_seq=0 out_seq=0 2024-05-10T10:56:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.813+0000 7ff51a7fc640 1 -- 172.21.15.107:0/4255903179 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f872a7e1e0 con 0x55f872b21b30 2024-05-10T10:56:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.813+0000 7ff51a7fc640 10 client.15387 handle_command_reply: tid=0 2024-05-10T10:56:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.813+0000 7ff53c1d6740 1 client.15387 shutdown 2024-05-10T10:56:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.813+0000 7ff53c1d6740 1 -- 172.21.15.107:0/4255903179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0bdb0 msgr2=0x55f872b15ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.813+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/4255903179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0bdb0 0x55f872b15ee0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0116f0 tx=0x7ff51c00a2d0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.813+0000 7ff53c1d6740 1 -- 172.21.15.107:0/4255903179 shutdown_connections 2024-05-10T10:56:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.813+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/4255903179 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f872b21b30 0x55f872b23fa0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.813+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/4255903179 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b11910 0x55f872b1d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.813+0000 7ff51a7fc640 0 client.15387 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:10.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.813+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/4255903179 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b0c7a0 0x55f872b16420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.820 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.813+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/4255903179 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0bdb0 0x55f872b15ee0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.820 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.813+0000 7ff53c1d6740 1 -- 172.21.15.107:0/4255903179 >> 172.21.15.107:0/4255903179 conn(0x55f872b07420 msgr2=0x55f872b06580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:10.820 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.814+0000 7ff53c1d6740 1 -- 172.21.15.107:0/4255903179 shutdown_connections 2024-05-10T10:56:10.820 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.814+0000 7ff53c1d6740 1 -- 172.21.15.107:0/4255903179 wait complete. 2024-05-10T10:56:10.820 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.814+0000 7ff53c1d6740 20 client.15387 trim_cache size 0 max 16384 2024-05-10T10:56:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.830+0000 7ff53c1d6740 1 Processor -- start 2024-05-10T10:56:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.830+0000 7ff53c1d6740 1 -- start start 2024-05-10T10:56:10.830 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.830+0000 7ff53c1d6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b0bdb0 0x55f872b16200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.830+0000 7ff53c1d6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b0c7a0 0x55f872b1d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.830+0000 7ff53c1d6740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b11910 0x55f872b288f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.830+0000 7ff53c1d6740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341abec0 con 0x55f872b11910 2024-05-10T10:56:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.830+0000 7ff53c1d6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341ada00 con 0x55f872b0c7a0 2024-05-10T10:56:10.831 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.830+0000 7ff53c1d6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341ac590 con 0x55f872b0bdb0 2024-05-10T10:56:10.835 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.830+0000 7ff52a7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b11910 0x55f872b288f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:10.835 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.830+0000 7ff52a7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b11910 0x55f872b288f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48822/0 (socket says 172.21.15.107:48822) 2024-05-10T10:56:10.835 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.830+0000 7ff52a7fc640 1 -- 172.21.15.107:0/3671071802 learned_addr learned my addr 172.21.15.107:0/3671071802 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.830+0000 7ff532ffd640 1 --2- 172.21.15.107:0/3671071802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b0c7a0 0x55f872b1d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.830+0000 7ff52a7fc640 1 --2- 172.21.15.107:0/3671071802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b0bdb0 0x55f872b16200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.831+0000 7ff52a7fc640 1 -- 172.21.15.107:0/3671071802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b0bdb0 msgr2=0x55f872b16200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.831+0000 7ff52a7fc640 1 --2- 172.21.15.107:0/3671071802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b0bdb0 0x55f872b16200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.831+0000 7ff52a7fc640 1 -- 172.21.15.107:0/3671071802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b0c7a0 msgr2=0x55f872b1d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.831+0000 7ff52a7fc640 1 --2- 172.21.15.107:0/3671071802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b0c7a0 0x55f872b1d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.831+0000 7ff52a7fc640 1 -- 172.21.15.107:0/3671071802 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f872b14fb0 con 0x55f872b11910 2024-05-10T10:56:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.831+0000 7ff532ffd640 1 --2- 172.21.15.107:0/3671071802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b0c7a0 0x55f872b1d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:56:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.831+0000 7ff52a7fc640 1 --2- 172.21.15.107:0/3671071802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b11910 0x55f872b288f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00a3f0 tx=0x7ff51c015b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce92d882db46244 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.831+0000 7ff528ff9640 1 -- 172.21.15.107:0/3671071802 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c011e10 con 0x55f872b11910 2024-05-10T10:56:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.831+0000 7ff528ff9640 1 -- 172.21.15.107:0/3671071802 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff51c015170 con 0x55f872b11910 2024-05-10T10:56:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.831+0000 7ff528ff9640 1 -- 172.21.15.107:0/3671071802 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c004de0 con 0x55f872b11910 2024-05-10T10:56:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.832+0000 7ff53c1d6740 1 -- 172.21.15.107:0/3671071802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b11910 msgr2=0x55f872b288f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:10.836 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.832+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/3671071802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b11910 0x55f872b288f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00a3f0 tx=0x7ff51c015b70 comp rx=0 tx=0).stop 2024-05-10T10:56:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.832+0000 7ff53c1d6740 1 -- 172.21.15.107:0/3671071802 shutdown_connections 2024-05-10T10:56:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.832+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/3671071802 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b11910 0x55f872b288f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.832+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/3671071802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b0c7a0 0x55f872b1d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.832+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/3671071802 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b0bdb0 0x55f872b16200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.832+0000 7ff53c1d6740 1 -- 172.21.15.107:0/3671071802 >> 172.21.15.107:0/3671071802 conn(0x55f872b07420 msgr2=0x55f872b15af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.832+0000 7ff53c1d6740 1 -- 172.21.15.107:0/3671071802 shutdown_connections 2024-05-10T10:56:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.832+0000 7ff53c1d6740 1 -- 172.21.15.107:0/3671071802 wait complete. 2024-05-10T10:56:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.832+0000 7ff53c1d6740 1 -- start start 2024-05-10T10:56:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.832+0000 7ff53c1d6740 1 Processor -- start 2024-05-10T10:56:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff53c1d6740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b0bdb0 0x55f872b1b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff53c1d6740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0c7a0 0x55f872b1b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff53c1d6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b11910 0x55f872b1c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff53c1d6740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341ad330 con 0x55f872b0c7a0 2024-05-10T10:56:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff53c1d6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341acc60 con 0x55f872b11910 2024-05-10T10:56:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff53c1d6740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341a9ec0 con 0x55f872b0bdb0 2024-05-10T10:56:10.837 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff53c1d6740 10 client.0 _ll_register_callbacks cb 0x7ff51c015ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:56:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff532ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0c7a0 0x55f872b1b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff532ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0c7a0 0x55f872b1b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48828/0 (socket says 172.21.15.107:48828) 2024-05-10T10:56:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff532ffd640 1 -- 172.21.15.107:0/1420831176 learned_addr learned my addr 172.21.15.107:0/1420831176 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff52a7fc640 1 --2- 172.21.15.107:0/1420831176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b11910 0x55f872b1c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff52a7fc640 1 --2- 172.21.15.107:0/1420831176 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b0bdb0 0x55f872b1b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff532ffd640 1 -- 172.21.15.107:0/1420831176 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b0bdb0 msgr2=0x55f872b1b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff532ffd640 1 --2- 172.21.15.107:0/1420831176 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b0bdb0 0x55f872b1b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff532ffd640 1 -- 172.21.15.107:0/1420831176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b11910 msgr2=0x55f872b1c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff532ffd640 1 --2- 172.21.15.107:0/1420831176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b11910 0x55f872b1c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff532ffd640 1 -- 172.21.15.107:0/1420831176 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f872b1cc80 con 0x55f872b0c7a0 2024-05-10T10:56:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff52a7fc640 1 --2- 172.21.15.107:0/1420831176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b11910 0x55f872b1c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:56:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff532ffd640 1 --2- 172.21.15.107:0/1420831176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0c7a0 0x55f872b1b680 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff52402a930 tx=0x7ff524031530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9035edf948885a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff51a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:56:10.838 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff51a7fc640 1 -- 172.21.15.107:0/1420831176 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524035040 con 0x55f872b0c7a0 2024-05-10T10:56:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff53c1d6740 1 -- 172.21.15.107:0/1420831176 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff51c015170 con 0x55f872b0c7a0 2024-05-10T10:56:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.833+0000 7ff51a7fc640 1 -- 172.21.15.107:0/1420831176 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7ff524031a20 con 0x55f872b0c7a0 2024-05-10T10:56:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.834+0000 7ff51a7fc640 1 -- 172.21.15.107:0/1420831176 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff524031c20 con 0x55f872b0c7a0 2024-05-10T10:56:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.834+0000 7ff53c1d6740 10 client.15393 fetch_fsmap learned FSMap version 27 2024-05-10T10:56:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.834+0000 7ff53c1d6740 1 -- 172.21.15.107:0/1420831176 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f872b8cac0 con 0x55f872b0c7a0 2024-05-10T10:56:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.834+0000 7ff51a7fc640 1 -- 172.21.15.107:0/1420831176 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff51c015170 con 0x55f872b0c7a0 2024-05-10T10:56:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.834+0000 7ff51a7fc640 1 -- 172.21.15.107:0/1420831176 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff52405b030 con 0x55f872b0c7a0 2024-05-10T10:56:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.834+0000 7ff53c1d6740 10 client.15393 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:56:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.834+0000 7ff53c1d6740 10 client.15393 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:56:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.834+0000 7ff53c1d6740 20 client.15393 populate_metadata read hostname 'smithi107' 2024-05-10T10:56:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.834+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/1420831176 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f872b8d140 0x55f872b8f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.834+0000 7ff53c1d6740 4 client.15393 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T10:56:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.834+0000 7ff53c1d6740 1 -- 172.21.15.107:0/1420831176 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f872a78050 con 0x55f872b8d140 2024-05-10T10:56:10.839 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.834+0000 7ff52a7fc640 1 --2- 172.21.15.107:0/1420831176 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f872b8d140 0x55f872b8f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.835+0000 7ff52a7fc640 1 --2- 172.21.15.107:0/1420831176 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f872b8d140 0x55f872b8f530 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef0703aa2eead475 server_cookie=f037c8167b87228b in_seq=0 out_seq=0 2024-05-10T10:56:10.840 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.835+0000 7ff51a7fc640 10 client.15393 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.838+0000 7ff51a7fc640 1 -- 172.21.15.107:0/1420831176 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f872a78050 con 0x55f872b8d140 2024-05-10T10:56:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.838+0000 7ff51a7fc640 10 client.15393 handle_command_reply: tid=0 2024-05-10T10:56:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.838+0000 7ff53c1d6740 1 client.15393 shutdown 2024-05-10T10:56:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.838+0000 7ff53c1d6740 1 -- 172.21.15.107:0/1420831176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0c7a0 msgr2=0x55f872b1b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.838+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/1420831176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0c7a0 0x55f872b1b680 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff52402a930 tx=0x7ff524031530 comp rx=0 tx=0).stop 2024-05-10T10:56:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff53c1d6740 1 -- 172.21.15.107:0/1420831176 shutdown_connections 2024-05-10T10:56:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/1420831176 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f872b8d140 0x55f872b8f530 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/1420831176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f872b11910 0x55f872b1c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/1420831176 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f872b0c7a0 0x55f872b1b680 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff53c1d6740 1 --2- 172.21.15.107:0/1420831176 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f872b0bdb0 0x55f872b1b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff51a7fc640 0 client.15393 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff53c1d6740 1 -- 172.21.15.107:0/1420831176 >> 172.21.15.107:0/1420831176 conn(0x55f872b07420 msgr2=0x55f872b05cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:10.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff53c1d6740 1 -- 172.21.15.107:0/1420831176 shutdown_connections 2024-05-10T10:56:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff53c1d6740 1 -- 172.21.15.107:0/1420831176 wait complete. 2024-05-10T10:56:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff53c1d6740 20 client.15393 trim_cache size 0 max 16384 2024-05-10T10:56:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:{ 2024-05-10T10:56:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "message": "", 2024-05-10T10:56:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "return_code": 0 2024-05-10T10:56:10.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:} 2024-05-10T10:56:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff5394c5640 1 -- 172.21.15.107:0/1305973160 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff5200b2920 msgr2=0x7ff5200b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff5394c5640 1 --2- 172.21.15.107:0/1305973160 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff5200b2920 0x7ff5200b4de0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00efd0 tx=0x7ff52c004930 comp rx=0 tx=0).stop 2024-05-10T10:56:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff5394c5640 1 -- 172.21.15.107:0/1305973160 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5341067f0 msgr2=0x7ff5341a2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff5394c5640 1 --2- 172.21.15.107:0/1305973160 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5341067f0 0x7ff5341a2430 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00eaa0 tx=0x7ff52c00ef60 comp rx=0 tx=0).stop 2024-05-10T10:56:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff5394c5640 1 -- 172.21.15.107:0/1305973160 shutdown_connections 2024-05-10T10:56:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff5394c5640 1 --2- 172.21.15.107:0/1305973160 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff5200b2920 0x7ff5200b4de0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff5394c5640 1 --2- 172.21.15.107:0/1305973160 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff5341067f0 0x7ff5341a2430 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff5394c5640 1 --2- 172.21.15.107:0/1305973160 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff534105e30 0x7ff53419b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff5394c5640 1 --2- 172.21.15.107:0/1305973160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff534104c40 0x7ff53419ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.839+0000 7ff5394c5640 1 -- 172.21.15.107:0/1305973160 >> 172.21.15.107:0/1305973160 conn(0x7ff5341001d0 msgr2=0x7ff5341090d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:10.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.840+0000 7ff5394c5640 1 -- 172.21.15.107:0/1305973160 shutdown_connections 2024-05-10T10:56:10.844 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:10.840+0000 7ff5394c5640 1 -- 172.21.15.107:0/1305973160 wait complete. 2024-05-10T10:56:11.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:11 smithi107 ceph-mon[30373]: pgmap v403: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-10T10:56:11.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:11 smithi196 ceph-mon[34872]: pgmap v403: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-10T10:56:11.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:11 smithi184 ceph-mon[34585]: pgmap v403: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-10T10:56:13.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:13 smithi196 ceph-mon[34872]: pgmap v404: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-10T10:56:13.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:13 smithi184 ceph-mon[34585]: pgmap v404: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-10T10:56:13.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:13 smithi107 ceph-mon[30373]: pgmap v404: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-10T10:56:15.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:15 smithi184 ceph-mon[34585]: pgmap v405: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-10T10:56:15.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:15 smithi107 ceph-mon[30373]: pgmap v405: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-10T10:56:15.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:15 smithi196 ceph-mon[34872]: pgmap v405: 97 pgs: 97 active+clean; 666 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-10T10:56:17.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:17 smithi184 ceph-mon[34585]: pgmap v406: 97 pgs: 97 active+clean; 667 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-10T10:56:17.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:17 smithi107 ceph-mon[30373]: pgmap v406: 97 pgs: 97 active+clean; 667 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-10T10:56:17.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:17 smithi196 ceph-mon[34872]: pgmap v406: 97 pgs: 97 active+clean; 667 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-10T10:56:19.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:19 smithi184 ceph-mon[34585]: pgmap v407: 97 pgs: 97 active+clean; 667 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:56:19.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:19 smithi107 ceph-mon[30373]: pgmap v407: 97 pgs: 97 active+clean; 667 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:56:19.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:19 smithi196 ceph-mon[34872]: pgmap v407: 97 pgs: 97 active+clean; 667 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:56:21.365 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:21 smithi196 ceph-mon[34872]: pgmap v408: 97 pgs: 97 active+clean; 667 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:56:21.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:21 smithi184 ceph-mon[34585]: pgmap v408: 97 pgs: 97 active+clean; 667 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:56:21.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:21 smithi107 ceph-mon[30373]: pgmap v408: 97 pgs: 97 active+clean; 667 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:56:22.049 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-05-10T10:56:22.049 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:56:22.306 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:56:23.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:23 smithi184 ceph-mon[34585]: pgmap v409: 97 pgs: 97 active+clean; 667 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T10:56:23.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:23 smithi107 ceph-mon[30373]: pgmap v409: 97 pgs: 97 active+clean; 667 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T10:56:23.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:23 smithi196 ceph-mon[34872]: pgmap v409: 97 pgs: 97 active+clean; 667 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T10:56:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.934+0000 7f930591c640 1 -- 172.21.15.107:0/149719611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9300102b00 msgr2=0x7f9300102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.934+0000 7f930591c640 1 --2- 172.21.15.107:0/149719611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9300102b00 0x7f9300102f80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f92e8009900 tx=0x7f92e802a410 comp rx=0 tx=0).stop 2024-05-10T10:56:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.934+0000 7f930591c640 1 -- 172.21.15.107:0/149719611 shutdown_connections 2024-05-10T10:56:23.936 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.934+0000 7f930591c640 1 --2- 172.21.15.107:0/149719611 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93001034c0 0x7f9300109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.936 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.934+0000 7f930591c640 1 --2- 172.21.15.107:0/149719611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9300102b00 0x7f9300102f80 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.936 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.934+0000 7f930591c640 1 --2- 172.21.15.107:0/149719611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9300101910 0x7f9300101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.936 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.934+0000 7f930591c640 1 -- 172.21.15.107:0/149719611 >> 172.21.15.107:0/149719611 conn(0x7f93000fce80 msgr2=0x7f93000ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:23.936 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.934+0000 7f930591c640 1 -- 172.21.15.107:0/149719611 shutdown_connections 2024-05-10T10:56:23.936 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.934+0000 7f930591c640 1 -- 172.21.15.107:0/149719611 wait complete. 2024-05-10T10:56:23.936 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.935+0000 7f930591c640 1 Processor -- start 2024-05-10T10:56:23.936 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.935+0000 7f930591c640 1 -- start start 2024-05-10T10:56:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.935+0000 7f930591c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9300101910 0x7f9300198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.935+0000 7f930591c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9300102b00 0x7f93001991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.935+0000 7f930591c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93001034c0 0x7f93001a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.935+0000 7f930591c640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f930010d570 con 0x7f9300101910 2024-05-10T10:56:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.935+0000 7f930591c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f930010d3f0 con 0x7f93001034c0 2024-05-10T10:56:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.935+0000 7f930591c640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f930010d6f0 con 0x7f9300102b00 2024-05-10T10:56:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.935+0000 7f92feffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9300101910 0x7f9300198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:23.939 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.935+0000 7f92feffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9300101910 0x7f9300198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44654/0 (socket says 172.21.15.107:44654) 2024-05-10T10:56:23.939 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.935+0000 7f92feffd640 1 -- 172.21.15.107:0/328489241 learned_addr learned my addr 172.21.15.107:0/328489241 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:23.939 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.936+0000 7f92ff7fe640 1 --2- 172.21.15.107:0/328489241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93001034c0 0x7f93001a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:23.939 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.936+0000 7f92f7fff640 1 --2- 172.21.15.107:0/328489241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9300102b00 0x7f93001991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:23.939 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.936+0000 7f92feffd640 1 -- 172.21.15.107:0/328489241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9300102b00 msgr2=0x7f93001991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:23.939 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.936+0000 7f92feffd640 1 --2- 172.21.15.107:0/328489241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9300102b00 0x7f93001991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.939 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.936+0000 7f92feffd640 1 -- 172.21.15.107:0/328489241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93001034c0 msgr2=0x7f93001a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:23.939 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.936+0000 7f92feffd640 1 --2- 172.21.15.107:0/328489241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93001034c0 0x7f93001a01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.939 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.936+0000 7f92feffd640 1 -- 172.21.15.107:0/328489241 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93001a0880 con 0x7f9300101910 2024-05-10T10:56:23.939 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.936+0000 7f92ff7fe640 1 --2- 172.21.15.107:0/328489241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93001034c0 0x7f93001a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:56:23.939 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.936+0000 7f92f7fff640 1 --2- 172.21.15.107:0/328489241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9300102b00 0x7f93001991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:56:23.939 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.936+0000 7f92feffd640 1 --2- 172.21.15.107:0/328489241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9300101910 0x7f9300198c70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f92f000d770 tx=0x7f92f000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:23.939 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.936+0000 7f930491a640 1 -- 172.21.15.107:0/328489241 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0017070 con 0x7f9300101910 2024-05-10T10:56:23.939 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.936+0000 7f930491a640 1 -- 172.21.15.107:0/328489241 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f92f0009c30 con 0x7f9300101910 2024-05-10T10:56:23.940 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.936+0000 7f930591c640 1 -- 172.21.15.107:0/328489241 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93001a0b70 con 0x7f9300101910 2024-05-10T10:56:23.940 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.936+0000 7f930491a640 1 -- 172.21.15.107:0/328489241 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0003d70 con 0x7f9300101910 2024-05-10T10:56:23.940 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.936+0000 7f930591c640 1 -- 172.21.15.107:0/328489241 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93001a10c0 con 0x7f9300101910 2024-05-10T10:56:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.939+0000 7f9308630740 1 Processor -- start 2024-05-10T10:56:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.939+0000 7f930491a640 1 -- 172.21.15.107:0/328489241 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 149704+0+0 (secure 0 0 0) 0x7f92f0003f10 con 0x7f9300101910 2024-05-10T10:56:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.940+0000 7f9308630740 1 -- start start 2024-05-10T10:56:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.940+0000 7f9308630740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175b5db0 0x558a175b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.940+0000 7f9308630740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b67a0 0x558a175bb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.940+0000 7f9308630740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175bb910 0x558a175bdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.940+0000 7f9308630740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558a1751a5d0 con 0x558a175bb910 2024-05-10T10:56:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.940+0000 7f9308630740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x558a174d3890 con 0x558a175b5db0 2024-05-10T10:56:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.940+0000 7f9308630740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558a17516590 con 0x558a175b67a0 2024-05-10T10:56:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.940+0000 7f92ff7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175b5db0 0x558a175b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.940+0000 7f92f7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175bb910 0x558a175bdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.940+0000 7f92ff7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175b5db0 0x558a175b61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.107:45926/0 (socket says 172.21.15.107:45926) 2024-05-10T10:56:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.940+0000 7f92ff7fe640 1 -- 172.21.15.107:0/2392100135 learned_addr learned my addr 172.21.15.107:0/2392100135 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.940+0000 7f92f7fff640 1 --2- 172.21.15.107:0/2392100135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175bb910 0x558a175bdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44670/0 (socket says 172.21.15.107:44670) 2024-05-10T10:56:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.940+0000 7f92feffd640 1 --2- 172.21.15.107:0/2392100135 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b67a0 0x558a175bb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.941+0000 7f92ff7fe640 1 -- 172.21.15.107:0/2392100135 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b67a0 msgr2=0x558a175bb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.941+0000 7f92ff7fe640 1 --2- 172.21.15.107:0/2392100135 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b67a0 0x558a175bb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.941+0000 7f92ff7fe640 1 -- 172.21.15.107:0/2392100135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175bb910 msgr2=0x558a175bdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.941+0000 7f92ff7fe640 1 --2- 172.21.15.107:0/2392100135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175bb910 0x558a175bdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.941+0000 7f92ff7fe640 1 -- 172.21.15.107:0/2392100135 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a1722c210 con 0x558a175b5db0 2024-05-10T10:56:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.941+0000 7f92ff7fe640 1 --2- 172.21.15.107:0/2392100135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175b5db0 0x558a175b61d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009fb0 tx=0x7f92f8010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f37ec01dbef6ae93 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.941+0000 7f930491a640 1 --2- 172.21.15.107:0/328489241 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f92ec0b2920 0x7f92ec0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.941+0000 7f92feffd640 1 --2- 172.21.15.107:0/328489241 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f92ec0b2920 0x7f92ec0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.941+0000 7f92f5ffb640 1 -- 172.21.15.107:0/2392100135 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8016070 con 0x558a175b5db0 2024-05-10T10:56:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.941+0000 7f92f5ffb640 1 -- 172.21.15.107:0/2392100135 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f92f8012be0 con 0x558a175b5db0 2024-05-10T10:56:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.941+0000 7f92f5ffb640 1 -- 172.21.15.107:0/2392100135 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f801bd00 con 0x558a175b5db0 2024-05-10T10:56:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.941+0000 7f930491a640 1 -- 172.21.15.107:0/328489241 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f92f00e1d90 con 0x7f9300101910 2024-05-10T10:56:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.942+0000 7f9308630740 1 -- 172.21.15.107:0/2392100135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175b5db0 msgr2=0x558a175b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.942+0000 7f92feffd640 1 --2- 172.21.15.107:0/328489241 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f92ec0b2920 0x7f92ec0b4de0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x558a175b7210 tx=0x7f92f00e7040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.942+0000 7f9308630740 1 --2- 172.21.15.107:0/2392100135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175b5db0 0x558a175b61d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009fb0 tx=0x7f92f8010800 comp rx=0 tx=0).stop 2024-05-10T10:56:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.942+0000 7f9308630740 1 -- 172.21.15.107:0/2392100135 shutdown_connections 2024-05-10T10:56:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.942+0000 7f9308630740 1 --2- 172.21.15.107:0/2392100135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175bb910 0x558a175bdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.942+0000 7f9308630740 1 --2- 172.21.15.107:0/2392100135 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b67a0 0x558a175bb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.942+0000 7f9308630740 1 --2- 172.21.15.107:0/2392100135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175b5db0 0x558a175b61d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.942+0000 7f9308630740 1 -- 172.21.15.107:0/2392100135 >> 172.21.15.107:0/2392100135 conn(0x558a175b1420 msgr2=0x558a175b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.942+0000 7f9308630740 1 -- 172.21.15.107:0/2392100135 shutdown_connections 2024-05-10T10:56:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.942+0000 7f9308630740 1 -- 172.21.15.107:0/2392100135 wait complete. 2024-05-10T10:56:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.942+0000 7f9308630740 1 -- start start 2024-05-10T10:56:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f9308630740 1 Processor -- start 2024-05-10T10:56:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f9308630740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b5db0 0x558a175c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f9308630740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b67a0 0x558a175c4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f9308630740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175bb910 0x558a175cb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f9308630740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x558a175be8c0 con 0x558a175b5db0 2024-05-10T10:56:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f9308630740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x558a174d7370 con 0x558a175bb910 2024-05-10T10:56:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f9308630740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x558a175bea40 con 0x558a175b67a0 2024-05-10T10:56:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f9308630740 10 client.0 _ll_register_callbacks cb 0x558a1722ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:56:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f92ff7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b5db0 0x558a175c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f92ff7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b5db0 0x558a175c43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44680/0 (socket says 172.21.15.107:44680) 2024-05-10T10:56:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f92ff7fe640 1 -- 172.21.15.107:0/4214740557 learned_addr learned my addr 172.21.15.107:0/4214740557 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f92f7fff640 1 --2- 172.21.15.107:0/4214740557 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b67a0 0x558a175c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f92ff7fe640 1 --2- 172.21.15.107:0/4214740557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175bb910 0x558a175cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f92ff7fe640 1 -- 172.21.15.107:0/4214740557 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b67a0 msgr2=0x558a175c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f92ff7fe640 1 --2- 172.21.15.107:0/4214740557 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b67a0 0x558a175c4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f92ff7fe640 1 -- 172.21.15.107:0/4214740557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175bb910 msgr2=0x558a175cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f92ff7fe640 1 --2- 172.21.15.107:0/4214740557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175bb910 0x558a175cb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.949 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f92ff7fe640 1 -- 172.21.15.107:0/4214740557 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a172f8620 con 0x558a175b5db0 2024-05-10T10:56:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f92ff7fe640 1 --2- 172.21.15.107:0/4214740557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b5db0 0x558a175c43c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f92f8013ef0 tx=0x7f92f801b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be923f926cd12884 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.943+0000 7f92deffd640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:56:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.944+0000 7f92deffd640 1 -- 172.21.15.107:0/4214740557 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8016050 con 0x558a175b5db0 2024-05-10T10:56:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.944+0000 7f92deffd640 1 -- 172.21.15.107:0/4214740557 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f92f8004a40 con 0x558a175b5db0 2024-05-10T10:56:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.944+0000 7f9308630740 1 -- 172.21.15.107:0/4214740557 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92f8012be0 con 0x558a175b5db0 2024-05-10T10:56:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.944+0000 7f92deffd640 1 -- 172.21.15.107:0/4214740557 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f92f8004c40 con 0x558a175b5db0 2024-05-10T10:56:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.944+0000 7f9308630740 10 client.15405 fetch_fsmap learned FSMap version 27 2024-05-10T10:56:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.944+0000 7f9308630740 1 -- 172.21.15.107:0/4214740557 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558a175ce990 con 0x558a175b5db0 2024-05-10T10:56:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.944+0000 7f92deffd640 1 -- 172.21.15.107:0/4214740557 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f92f8012be0 con 0x558a175b5db0 2024-05-10T10:56:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.944+0000 7f92deffd640 1 -- 172.21.15.107:0/4214740557 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f92f8028020 con 0x558a175b5db0 2024-05-10T10:56:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.944+0000 7f9308630740 10 client.15405 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:56:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.944+0000 7f9308630740 10 client.15405 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:56:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.944+0000 7f9308630740 20 client.15405 populate_metadata read hostname 'smithi107' 2024-05-10T10:56:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.944+0000 7f9308630740 1 --2- 172.21.15.107:0/4214740557 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x558a175cfd90 0x558a175d2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.944+0000 7f9308630740 4 client.15405 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:56:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.944+0000 7f9308630740 1 -- 172.21.15.107:0/4214740557 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a175281e0 con 0x558a175cfd90 2024-05-10T10:56:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.944+0000 7f92f7fff640 1 --2- 172.21.15.107:0/4214740557 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x558a175cfd90 0x558a175d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.945+0000 7f92deffd640 10 client.15405 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:23.951 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.945+0000 7f92f7fff640 1 --2- 172.21.15.107:0/4214740557 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x558a175cfd90 0x558a175d2180 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fba5312745eb402e server_cookie=db41f9eda3fa7a31 in_seq=0 out_seq=0 2024-05-10T10:56:23.952 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.945+0000 7f92deffd640 1 -- 172.21.15.107:0/4214740557 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558a175281e0 con 0x558a175cfd90 2024-05-10T10:56:23.952 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.945+0000 7f92deffd640 10 client.15405 handle_command_reply: tid=0 2024-05-10T10:56:23.952 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.946+0000 7f9308630740 1 client.15405 shutdown 2024-05-10T10:56:23.952 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.946+0000 7f9308630740 1 -- 172.21.15.107:0/4214740557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b5db0 msgr2=0x558a175c43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:23.952 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.946+0000 7f9308630740 1 --2- 172.21.15.107:0/4214740557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b5db0 0x558a175c43c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f92f8013ef0 tx=0x7f92f801b720 comp rx=0 tx=0).stop 2024-05-10T10:56:23.952 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.946+0000 7f9308630740 1 -- 172.21.15.107:0/4214740557 shutdown_connections 2024-05-10T10:56:23.952 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.946+0000 7f9308630740 1 --2- 172.21.15.107:0/4214740557 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x558a175cfd90 0x558a175d2180 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.952 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.946+0000 7f9308630740 1 --2- 172.21.15.107:0/4214740557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175bb910 0x558a175cb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.946+0000 7f9308630740 1 --2- 172.21.15.107:0/4214740557 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b67a0 0x558a175c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.946+0000 7f92deffd640 0 client.15405 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.946+0000 7f9308630740 1 --2- 172.21.15.107:0/4214740557 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b5db0 0x558a175c43c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.946+0000 7f9308630740 1 -- 172.21.15.107:0/4214740557 >> 172.21.15.107:0/4214740557 conn(0x558a175b1420 msgr2=0x558a175b0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.946+0000 7f9308630740 1 -- 172.21.15.107:0/4214740557 shutdown_connections 2024-05-10T10:56:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.946+0000 7f9308630740 1 -- 172.21.15.107:0/4214740557 wait complete. 2024-05-10T10:56:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.946+0000 7f9308630740 20 client.15405 trim_cache size 0 max 16384 2024-05-10T10:56:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.963+0000 7f9308630740 1 Processor -- start 2024-05-10T10:56:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.963+0000 7f9308630740 1 -- start start 2024-05-10T10:56:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.963+0000 7f9308630740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b5db0 0x558a175b4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.963+0000 7f9308630740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b67a0 0x558a175b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.963+0000 7f9308630740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175bb910 0x558a175c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.963+0000 7f9308630740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f93001a7b60 con 0x558a175b67a0 2024-05-10T10:56:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.963+0000 7f9308630740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f93001a96a0 con 0x558a175bb910 2024-05-10T10:56:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.963+0000 7f9308630740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f93001a8230 con 0x558a175b5db0 2024-05-10T10:56:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.963+0000 7f92f7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b67a0 0x558a175b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.963+0000 7f92f7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b67a0 0x558a175b0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44682/0 (socket says 172.21.15.107:44682) 2024-05-10T10:56:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.963+0000 7f92f7fff640 1 -- 172.21.15.107:0/3259960752 learned_addr learned my addr 172.21.15.107:0/3259960752 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:23.966 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.964+0000 7f92ff7fe640 1 --2- 172.21.15.107:0/3259960752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175bb910 0x558a175c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:23.967 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.964+0000 7f92ff7fe640 1 --2- 172.21.15.107:0/3259960752 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b5db0 0x558a175b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:23.967 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.964+0000 7f92f7fff640 1 -- 172.21.15.107:0/3259960752 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b5db0 msgr2=0x558a175b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:23.967 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.964+0000 7f92f7fff640 1 --2- 172.21.15.107:0/3259960752 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b5db0 0x558a175b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.967 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.964+0000 7f92f7fff640 1 -- 172.21.15.107:0/3259960752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175bb910 msgr2=0x558a175c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:23.967 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.964+0000 7f92f7fff640 1 --2- 172.21.15.107:0/3259960752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175bb910 0x558a175c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.967 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.964+0000 7f92f7fff640 1 -- 172.21.15.107:0/3259960752 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a175b1240 con 0x558a175b67a0 2024-05-10T10:56:23.967 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.964+0000 7f92ff7fe640 1 --2- 172.21.15.107:0/3259960752 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b5db0 0x558a175b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:56:23.967 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.964+0000 7f92f7fff640 1 --2- 172.21.15.107:0/3259960752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b67a0 0x558a175b0d00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f92e8009230 tx=0x7f92e8005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1659c64c66d802 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:23.967 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.964+0000 7f92f57fa640 1 -- 172.21.15.107:0/3259960752 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8035040 con 0x558a175b67a0 2024-05-10T10:56:23.967 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.964+0000 7f92f57fa640 1 -- 172.21.15.107:0/3259960752 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f92e8049070 con 0x558a175b67a0 2024-05-10T10:56:23.967 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.964+0000 7f92f57fa640 1 -- 172.21.15.107:0/3259960752 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e80055b0 con 0x558a175b67a0 2024-05-10T10:56:23.967 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.965+0000 7f9308630740 1 -- 172.21.15.107:0/3259960752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b67a0 msgr2=0x558a175b0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:23.967 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.965+0000 7f9308630740 1 --2- 172.21.15.107:0/3259960752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b67a0 0x558a175b0d00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f92e8009230 tx=0x7f92e8005a20 comp rx=0 tx=0).stop 2024-05-10T10:56:23.967 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.965+0000 7f9308630740 1 -- 172.21.15.107:0/3259960752 shutdown_connections 2024-05-10T10:56:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.965+0000 7f9308630740 1 --2- 172.21.15.107:0/3259960752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175bb910 0x558a175c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.965+0000 7f9308630740 1 --2- 172.21.15.107:0/3259960752 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b67a0 0x558a175b0d00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.965+0000 7f9308630740 1 --2- 172.21.15.107:0/3259960752 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b5db0 0x558a175b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.965+0000 7f9308630740 1 -- 172.21.15.107:0/3259960752 >> 172.21.15.107:0/3259960752 conn(0x558a175b1420 msgr2=0x558a175b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.965+0000 7f9308630740 1 -- 172.21.15.107:0/3259960752 shutdown_connections 2024-05-10T10:56:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.965+0000 7f9308630740 1 -- 172.21.15.107:0/3259960752 wait complete. 2024-05-10T10:56:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.965+0000 7f9308630740 1 -- start start 2024-05-10T10:56:23.968 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f9308630740 1 Processor -- start 2024-05-10T10:56:23.971 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f9308630740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b5db0 0x558a175c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:23.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f9308630740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b67a0 0x558a175c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:23.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f9308630740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175bb910 0x558a175ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:23.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f9308630740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f93001a8fd0 con 0x558a175b67a0 2024-05-10T10:56:23.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f9308630740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f93001a8900 con 0x558a175bb910 2024-05-10T10:56:23.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f9308630740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f93001a5b40 con 0x558a175b5db0 2024-05-10T10:56:23.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f9308630740 10 client.0 _ll_register_callbacks cb 0x7f92e8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:56:23.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f92f7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b67a0 0x558a175c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:23.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f92f7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b67a0 0x558a175c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44698/0 (socket says 172.21.15.107:44698) 2024-05-10T10:56:23.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f92f7fff640 1 -- 172.21.15.107:0/2295414263 learned_addr learned my addr 172.21.15.107:0/2295414263 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:23.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f92ff7fe640 1 --2- 172.21.15.107:0/2295414263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175bb910 0x558a175ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:23.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f92ff7fe640 1 --2- 172.21.15.107:0/2295414263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b5db0 0x558a175c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:23.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f92f7fff640 1 -- 172.21.15.107:0/2295414263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b5db0 msgr2=0x558a175c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f92f7fff640 1 --2- 172.21.15.107:0/2295414263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b5db0 0x558a175c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f92f7fff640 1 -- 172.21.15.107:0/2295414263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175bb910 msgr2=0x558a175ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f92f7fff640 1 --2- 172.21.15.107:0/2295414263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175bb910 0x558a175ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f92f7fff640 1 -- 172.21.15.107:0/2295414263 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a175ca7a0 con 0x558a175b67a0 2024-05-10T10:56:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f92ff7fe640 1 --2- 172.21.15.107:0/2295414263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175bb910 0x558a175ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:56:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f92f7fff640 1 --2- 172.21.15.107:0/2295414263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b67a0 0x558a175c91a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f92e8000c00 tx=0x7f92e8032a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349615ec809b151a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f92deffd640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:56:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f92deffd640 1 -- 172.21.15.107:0/2295414263 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8035040 con 0x558a175b67a0 2024-05-10T10:56:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f92deffd640 1 -- 172.21.15.107:0/2295414263 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f92e8004050 con 0x558a175b67a0 2024-05-10T10:56:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.966+0000 7f9308630740 1 -- 172.21.15.107:0/2295414263 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92e8049070 con 0x558a175b67a0 2024-05-10T10:56:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.967+0000 7f92deffd640 1 -- 172.21.15.107:0/2295414263 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f92e8004250 con 0x558a175b67a0 2024-05-10T10:56:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.967+0000 7f9308630740 10 client.15411 fetch_fsmap learned FSMap version 27 2024-05-10T10:56:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.967+0000 7f9308630740 1 -- 172.21.15.107:0/2295414263 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558a1763aa10 con 0x558a175b67a0 2024-05-10T10:56:23.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.967+0000 7f92deffd640 1 -- 172.21.15.107:0/2295414263 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f92e8049070 con 0x558a175b67a0 2024-05-10T10:56:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.967+0000 7f92deffd640 1 -- 172.21.15.107:0/2295414263 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f92e8044ce0 con 0x558a175b67a0 2024-05-10T10:56:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.967+0000 7f9308630740 10 client.15411 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:56:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.967+0000 7f9308630740 10 client.15411 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:56:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.967+0000 7f9308630740 20 client.15411 populate_metadata read hostname 'smithi107' 2024-05-10T10:56:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.967+0000 7f9308630740 1 --2- 172.21.15.107:0/2295414263 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x558a1763b440 0x558a1763d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.967+0000 7f9308630740 4 client.15411 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T10:56:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.967+0000 7f9308630740 1 -- 172.21.15.107:0/2295414263 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558a17522050 con 0x558a1763b440 2024-05-10T10:56:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.967+0000 7f92ff7fe640 1 --2- 172.21.15.107:0/2295414263 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x558a1763b440 0x558a1763d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.968+0000 7f92deffd640 10 client.15411 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:23.974 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.968+0000 7f92ff7fe640 1 --2- 172.21.15.107:0/2295414263 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x558a1763b440 0x558a1763d860 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c145aaac847cf21a server_cookie=a13d3ed572dddb26 in_seq=0 out_seq=0 2024-05-10T10:56:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.974+0000 7f92deffd640 1 -- 172.21.15.107:0/2295414263 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558a17522050 con 0x558a1763b440 2024-05-10T10:56:23.975 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.974+0000 7f92deffd640 10 client.15411 handle_command_reply: tid=0 2024-05-10T10:56:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.974+0000 7f9308630740 1 client.15411 shutdown 2024-05-10T10:56:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.974+0000 7f9308630740 1 -- 172.21.15.107:0/2295414263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b67a0 msgr2=0x558a175c91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.974+0000 7f9308630740 1 --2- 172.21.15.107:0/2295414263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b67a0 0x558a175c91a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f92e8000c00 tx=0x7f92e8032a40 comp rx=0 tx=0).stop 2024-05-10T10:56:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.974+0000 7f9308630740 1 -- 172.21.15.107:0/2295414263 shutdown_connections 2024-05-10T10:56:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.974+0000 7f9308630740 1 --2- 172.21.15.107:0/2295414263 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x558a1763b440 0x558a1763d860 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.974+0000 7f9308630740 1 --2- 172.21.15.107:0/2295414263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558a175bb910 0x558a175ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.974+0000 7f9308630740 1 --2- 172.21.15.107:0/2295414263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x558a175b67a0 0x558a175c91a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.974+0000 7f9308630740 1 --2- 172.21.15.107:0/2295414263 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x558a175b5db0 0x558a175c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.974+0000 7f92deffd640 0 client.15411 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.974+0000 7f9308630740 1 -- 172.21.15.107:0/2295414263 >> 172.21.15.107:0/2295414263 conn(0x558a175b1420 msgr2=0x558a175c3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.975+0000 7f9308630740 1 -- 172.21.15.107:0/2295414263 shutdown_connections 2024-05-10T10:56:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.975+0000 7f9308630740 1 -- 172.21.15.107:0/2295414263 wait complete. 2024-05-10T10:56:23.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.975+0000 7f9308630740 20 client.15411 trim_cache size 0 max 16384 2024-05-10T10:56:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:{ 2024-05-10T10:56:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "message": "", 2024-05-10T10:56:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "return_code": 0 2024-05-10T10:56:23.977 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:} 2024-05-10T10:56:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.975+0000 7f930591c640 1 -- 172.21.15.107:0/328489241 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f92ec0b2920 msgr2=0x7f92ec0b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.975+0000 7f930591c640 1 --2- 172.21.15.107:0/328489241 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f92ec0b2920 0x7f92ec0b4de0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x558a175b7210 tx=0x7f92f00e7040 comp rx=0 tx=0).stop 2024-05-10T10:56:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.975+0000 7f930591c640 1 -- 172.21.15.107:0/328489241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9300101910 msgr2=0x7f9300198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.975+0000 7f930591c640 1 --2- 172.21.15.107:0/328489241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9300101910 0x7f9300198c70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f92f000d770 tx=0x7f92f000dc30 comp rx=0 tx=0).stop 2024-05-10T10:56:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.975+0000 7f930591c640 1 -- 172.21.15.107:0/328489241 shutdown_connections 2024-05-10T10:56:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.975+0000 7f930591c640 1 --2- 172.21.15.107:0/328489241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93001034c0 0x7f93001a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.975+0000 7f930591c640 1 --2- 172.21.15.107:0/328489241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9300102b00 0x7f93001991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.975+0000 7f930591c640 1 --2- 172.21.15.107:0/328489241 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f92ec0b2920 0x7f92ec0b4de0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.975+0000 7f930591c640 1 --2- 172.21.15.107:0/328489241 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9300101910 0x7f9300198c70 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.975+0000 7f930591c640 1 -- 172.21.15.107:0/328489241 >> 172.21.15.107:0/328489241 conn(0x7f93000fce80 msgr2=0x7f93000fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.975+0000 7f930591c640 1 -- 172.21.15.107:0/328489241 shutdown_connections 2024-05-10T10:56:23.978 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:23.975+0000 7f930591c640 1 -- 172.21.15.107:0/328489241 wait complete. 2024-05-10T10:56:24.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.237+0000 7f15ddb40700 1 -- 172.21.15.107:0/2782955114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15d8103eb0 msgr2=0x7f15d8110390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:24.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.237+0000 7f15ddb40700 1 --2- 172.21.15.107:0/2782955114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15d8103eb0 0x7f15d8110390 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f15d000b0a0 tx=0x7f15d000b3b0 comp rx=0 tx=0).stop 2024-05-10T10:56:24.239 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.237+0000 7f15ddb40700 1 -- 172.21.15.107:0/2782955114 shutdown_connections 2024-05-10T10:56:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.237+0000 7f15ddb40700 1 --2- 172.21.15.107:0/2782955114 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15d8109600 0x7f15d81099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.237+0000 7f15ddb40700 1 --2- 172.21.15.107:0/2782955114 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15d8103eb0 0x7f15d8110390 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.237+0000 7f15ddb40700 1 --2- 172.21.15.107:0/2782955114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d81034f0 0x7f15d8103970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.237+0000 7f15ddb40700 1 -- 172.21.15.107:0/2782955114 >> 172.21.15.107:0/2782955114 conn(0x7f15d807a650 msgr2=0x7f15d807aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.237+0000 7f15ddb40700 1 -- 172.21.15.107:0/2782955114 shutdown_connections 2024-05-10T10:56:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.237+0000 7f15ddb40700 1 -- 172.21.15.107:0/2782955114 wait complete. 2024-05-10T10:56:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.238+0000 7f15ddb40700 1 Processor -- start 2024-05-10T10:56:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.238+0000 7f15ddb40700 1 -- start start 2024-05-10T10:56:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.238+0000 7f15ddb40700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d81034f0 0x7f15d819f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.238+0000 7f15ddb40700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15d8103eb0 0x7f15d819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.238+0000 7f15ddb40700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15d8109600 0x7f15d81999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.238+0000 7f15ddb40700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f15d81137c0 con 0x7f15d8109600 2024-05-10T10:56:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.238+0000 7f15ddb40700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f15d8113640 con 0x7f15d81034f0 2024-05-10T10:56:24.240 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.238+0000 7f15ddb40700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f15d8113940 con 0x7f15d8103eb0 2024-05-10T10:56:24.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.238+0000 7f15d7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15d8109600 0x7f15d81999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:24.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.238+0000 7f15d7fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15d8109600 0x7f15d81999c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:44716/0 (socket says 172.21.15.107:44716) 2024-05-10T10:56:24.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.238+0000 7f15d7fff700 1 -- 172.21.15.107:0/122567167 learned_addr learned my addr 172.21.15.107:0/122567167 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:24.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.238+0000 7f15d77fe700 1 --2- 172.21.15.107:0/122567167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d81034f0 0x7f15d819f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:24.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.238+0000 7f15ceffd700 1 --2- 172.21.15.107:0/122567167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15d8103eb0 0x7f15d819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:24.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.239+0000 7f15d7fff700 1 -- 172.21.15.107:0/122567167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15d8103eb0 msgr2=0x7f15d819fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:24.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.239+0000 7f15d7fff700 1 --2- 172.21.15.107:0/122567167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15d8103eb0 0x7f15d819fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:24.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.239+0000 7f15d7fff700 1 -- 172.21.15.107:0/122567167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d81034f0 msgr2=0x7f15d819f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:24.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.239+0000 7f15d7fff700 1 --2- 172.21.15.107:0/122567167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d81034f0 0x7f15d819f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:24.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.239+0000 7f15d7fff700 1 -- 172.21.15.107:0/122567167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d819a120 con 0x7f15d8109600 2024-05-10T10:56:24.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.239+0000 7f15d7fff700 1 --2- 172.21.15.107:0/122567167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15d8109600 0x7f15d81999c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f15d000b070 tx=0x7f15d0007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:24.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.239+0000 7f15d57fa700 1 -- 172.21.15.107:0/122567167 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d0021020 con 0x7f15d8109600 2024-05-10T10:56:24.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.239+0000 7f15d57fa700 1 -- 172.21.15.107:0/122567167 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f15d0004c50 con 0x7f15d8109600 2024-05-10T10:56:24.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.239+0000 7f15ddb40700 1 -- 172.21.15.107:0/122567167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d819a3b0 con 0x7f15d8109600 2024-05-10T10:56:24.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.239+0000 7f15d57fa700 1 -- 172.21.15.107:0/122567167 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d0005380 con 0x7f15d8109600 2024-05-10T10:56:24.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.239+0000 7f15ddb40700 1 -- 172.21.15.107:0/122567167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d81a66d0 con 0x7f15d8109600 2024-05-10T10:56:24.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.240+0000 7f15ddb40700 1 -- 172.21.15.107:0/122567167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d806a190 con 0x7f15d8109600 2024-05-10T10:56:24.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.241+0000 7f15d57fa700 1 -- 172.21.15.107:0/122567167 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 149704+0+0 (secure 0 0 0) 0x7f15d0024020 con 0x7f15d8109600 2024-05-10T10:56:24.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.242+0000 7f15d57fa700 1 --2- 172.21.15.107:0/122567167 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f15c40b2910 0x7f15c40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:24.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.242+0000 7f15d77fe700 1 --2- 172.21.15.107:0/122567167 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f15c40b2910 0x7f15c40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:24.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.242+0000 7f15d57fa700 1 -- 172.21.15.107:0/122567167 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f15d000f020 con 0x7f15d8109600 2024-05-10T10:56:24.243 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.242+0000 7f15d77fe700 1 --2- 172.21.15.107:0/122567167 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f15c40b2910 0x7f15c40b4dd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f15c8005fd0 tx=0x7f15c8005d90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:24.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.245+0000 7f15d57fa700 1 -- 172.21.15.107:0/122567167 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f15d00ab970 con 0x7f15d8109600 2024-05-10T10:56:24.494 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.493+0000 7f15ddb40700 1 -- 172.21.15.107:0/122567167 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15d81a68a0 con 0x7f15d8109600 2024-05-10T10:56:24.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.494+0000 7f15d57fa700 1 -- 172.21.15.107:0/122567167 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11951 (secure 0 0 0) 0x7f15d00ab270 con 0x7f15d8109600 2024-05-10T10:56:24.495 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:56:24.496 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T10:52:17.367732+0000","modified":"2024-05-10T10:55:30.125781+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24482,"mds_1":24449,"mds_2":24442,"mds_3":24431,"mds_4":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/2332963094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":2332963094},{"type":"v1","addr":"172.21.15.107:6841","nonce":2332963094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.184:6839/16501252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":16501252},{"type":"v1","addr":"172.21.15.184:6839","nonce":16501252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24430,24431,24482,24449,24442]},"id":1}]} 2024-05-10T10:56:24.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.496+0000 7f15ddb40700 1 -- 172.21.15.107:0/122567167 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f15c40b2910 msgr2=0x7f15c40b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:24.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.496+0000 7f15ddb40700 1 --2- 172.21.15.107:0/122567167 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f15c40b2910 0x7f15c40b4dd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f15c8005fd0 tx=0x7f15c8005d90 comp rx=0 tx=0).stop 2024-05-10T10:56:24.497 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.496+0000 7f15ddb40700 1 -- 172.21.15.107:0/122567167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15d8109600 msgr2=0x7f15d81999c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:24.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.496+0000 7f15ddb40700 1 --2- 172.21.15.107:0/122567167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15d8109600 0x7f15d81999c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f15d000b070 tx=0x7f15d0007a50 comp rx=0 tx=0).stop 2024-05-10T10:56:24.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.497+0000 7f15ddb40700 1 -- 172.21.15.107:0/122567167 shutdown_connections 2024-05-10T10:56:24.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.497+0000 7f15ddb40700 1 --2- 172.21.15.107:0/122567167 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f15c40b2910 0x7f15c40b4dd0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:24.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.497+0000 7f15ddb40700 1 --2- 172.21.15.107:0/122567167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f15d8109600 0x7f15d81999c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:24.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.497+0000 7f15ddb40700 1 --2- 172.21.15.107:0/122567167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d81034f0 0x7f15d819f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:24.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.497+0000 7f15ddb40700 1 --2- 172.21.15.107:0/122567167 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f15d8103eb0 0x7f15d819fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:24.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.497+0000 7f15ddb40700 1 -- 172.21.15.107:0/122567167 >> 172.21.15.107:0/122567167 conn(0x7f15d807a650 msgr2=0x7f15d8101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:24.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.497+0000 7f15ddb40700 1 -- 172.21.15.107:0/122567167 shutdown_connections 2024-05-10T10:56:24.498 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:24.497+0000 7f15ddb40700 1 -- 172.21.15.107:0/122567167 wait complete. 2024-05-10T10:56:24.498 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 27 2024-05-10T10:56:25.132 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:25 smithi107 ceph-mon[30373]: pgmap v410: 97 pgs: 97 active+clean; 667 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:56:25.132 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:25 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/122567167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:56:25.159 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24482 quiesce db / --timeout 60 --expiration 70 --await-for 42.0' 2024-05-10T10:56:25.160 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24482 quiesce db / --timeout 60 --expiration 70 --await-for 42.0 2024-05-10T10:56:25.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:25 smithi184 ceph-mon[34585]: pgmap v410: 97 pgs: 97 active+clean; 667 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:56:25.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:25 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/122567167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:56:25.403 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:56:25.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:25 smithi196 ceph-mon[34872]: pgmap v410: 97 pgs: 97 active+clean; 667 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:56:25.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:25 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/122567167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:56:27.261 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:27 smithi107 ceph-mon[30373]: pgmap v411: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-10T10:56:27.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.275+0000 7fb432da7700 1 -- 172.21.15.107:0/1830806498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb42c108460 msgr2=0x7fb42c108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:27.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.275+0000 7fb432da7700 1 --2- 172.21.15.107:0/1830806498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb42c108460 0x7fb42c108840 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb424009990 tx=0x7fb424009ca0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.276+0000 7fb432da7700 1 -- 172.21.15.107:0/1830806498 shutdown_connections 2024-05-10T10:56:27.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.276+0000 7fb432da7700 1 --2- 172.21.15.107:0/1830806498 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb42c102d90 0x7fb42c10f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.276+0000 7fb432da7700 1 --2- 172.21.15.107:0/1830806498 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb42c108460 0x7fb42c108840 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.276+0000 7fb432da7700 1 --2- 172.21.15.107:0/1830806498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb42c1023d0 0x7fb42c102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.276+0000 7fb432da7700 1 -- 172.21.15.107:0/1830806498 >> 172.21.15.107:0/1830806498 conn(0x7fb42c0793f0 msgr2=0x7fb42c079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:27.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.276+0000 7fb432da7700 1 -- 172.21.15.107:0/1830806498 shutdown_connections 2024-05-10T10:56:27.277 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.276+0000 7fb432da7700 1 -- 172.21.15.107:0/1830806498 wait complete. 2024-05-10T10:56:27.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.276+0000 7fb432da7700 1 Processor -- start 2024-05-10T10:56:27.278 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.276+0000 7fb432da7700 1 -- start start 2024-05-10T10:56:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.276+0000 7fb432da7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb42c1023d0 0x7fb42c104030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.276+0000 7fb432da7700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb42c102d90 0x7fb42c104570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.276+0000 7fb432da7700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb42c108460 0x7fb42c104ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.276+0000 7fb432da7700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c112730 con 0x7fb42c102d90 2024-05-10T10:56:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.276+0000 7fb432da7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c1125b0 con 0x7fb42c1023d0 2024-05-10T10:56:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.276+0000 7fb432da7700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c1128b0 con 0x7fb42c108460 2024-05-10T10:56:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.277+0000 7fb42bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb42c102d90 0x7fb42c104570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.277+0000 7fb42bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb42c102d90 0x7fb42c104570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47808/0 (socket says 172.21.15.107:47808) 2024-05-10T10:56:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.277+0000 7fb42bfff700 1 -- 172.21.15.107:0/3143852980 learned_addr learned my addr 172.21.15.107:0/3143852980 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.277+0000 7fb430b43700 1 --2- 172.21.15.107:0/3143852980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb42c1023d0 0x7fb42c104030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.277+0000 7fb431344700 1 --2- 172.21.15.107:0/3143852980 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb42c108460 0x7fb42c104ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.277+0000 7fb42bfff700 1 -- 172.21.15.107:0/3143852980 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb42c108460 msgr2=0x7fb42c104ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.277+0000 7fb42bfff700 1 --2- 172.21.15.107:0/3143852980 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb42c108460 0x7fb42c104ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.279 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.277+0000 7fb42bfff700 1 -- 172.21.15.107:0/3143852980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb42c1023d0 msgr2=0x7fb42c104030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:27.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.277+0000 7fb42bfff700 1 --2- 172.21.15.107:0/3143852980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb42c1023d0 0x7fb42c104030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.277+0000 7fb42bfff700 1 -- 172.21.15.107:0/3143852980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42c1a8190 con 0x7fb42c102d90 2024-05-10T10:56:27.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.277+0000 7fb430b43700 1 --2- 172.21.15.107:0/3143852980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb42c1023d0 0x7fb42c104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:56:27.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.277+0000 7fb42bfff700 1 --2- 172.21.15.107:0/3143852980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb42c102d90 0x7fb42c104570 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb41c007e20 tx=0x7fb41c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:27.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.277+0000 7fb429ffb700 1 -- 172.21.15.107:0/3143852980 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c016020 con 0x7fb42c102d90 2024-05-10T10:56:27.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.277+0000 7fb429ffb700 1 -- 172.21.15.107:0/3143852980 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb41c00ae00 con 0x7fb42c102d90 2024-05-10T10:56:27.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.277+0000 7fb432da7700 1 -- 172.21.15.107:0/3143852980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb42c1a8480 con 0x7fb42c102d90 2024-05-10T10:56:27.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.277+0000 7fb429ffb700 1 -- 172.21.15.107:0/3143852980 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c011760 con 0x7fb42c102d90 2024-05-10T10:56:27.280 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.278+0000 7fb432da7700 1 -- 172.21.15.107:0/3143852980 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb42c1a89c0 con 0x7fb42c102d90 2024-05-10T10:56:27.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.280+0000 7fb429ffb700 1 -- 172.21.15.107:0/3143852980 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 149704+0+0 (secure 0 0 0) 0x7fb41c019020 con 0x7fb42c102d90 2024-05-10T10:56:27.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.281+0000 7fb429ffb700 1 --2- 172.21.15.107:0/3143852980 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4180b29b0 0x7fb4180b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:27.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.281+0000 7fb430b43700 1 --2- 172.21.15.107:0/3143852980 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4180b29b0 0x7fb4180b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:27.281 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.281+0000 7fb429ffb700 1 -- 172.21.15.107:0/3143852980 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fb41c0e20a0 con 0x7fb42c102d90 2024-05-10T10:56:27.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.281+0000 7fb430b43700 1 --2- 172.21.15.107:0/3143852980 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4180b29b0 0x7fb4180b4e70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb424006010 tx=0x7fb42400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:27.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.281+0000 7fb43d63ab80 1 Processor -- start 2024-05-10T10:56:27.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.281+0000 7fb43d63ab80 1 -- start start 2024-05-10T10:56:27.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.282+0000 7fb43d63ab80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556349353850 0x556349353c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:27.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.282+0000 7fb43d63ab80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55634934db00 0x55634934df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:27.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.282+0000 7fb43d63ab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934e4c0 0x55634935a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:27.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.282+0000 7fb43d63ab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55634929fad0 con 0x55634934e4c0 2024-05-10T10:56:27.284 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.282+0000 7fb43d63ab80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556349204f30 con 0x55634934db00 2024-05-10T10:56:27.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.282+0000 7fb43d63ab80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55634929ba90 con 0x556349353850 2024-05-10T10:56:27.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.282+0000 7fb431344700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934e4c0 0x55634935a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:27.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.282+0000 7fb431344700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934e4c0 0x55634935a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47824/0 (socket says 172.21.15.107:47824) 2024-05-10T10:56:27.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.282+0000 7fb431344700 1 -- 172.21.15.107:0/1449427905 learned_addr learned my addr 172.21.15.107:0/1449427905 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:27.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.282+0000 7fb42bfff700 1 --2- 172.21.15.107:0/1449427905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55634934db00 0x55634934df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:27.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.282+0000 7fb430b43700 1 --2- 172.21.15.107:0/1449427905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556349353850 0x556349353c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:27.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.282+0000 7fb431344700 1 -- 172.21.15.107:0/1449427905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556349353850 msgr2=0x556349353c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:27.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.282+0000 7fb431344700 1 --2- 172.21.15.107:0/1449427905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556349353850 0x556349353c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.282+0000 7fb431344700 1 -- 172.21.15.107:0/1449427905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55634934db00 msgr2=0x55634934df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:27.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.282+0000 7fb431344700 1 --2- 172.21.15.107:0/1449427905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55634934db00 0x55634934df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.282+0000 7fb431344700 1 -- 172.21.15.107:0/1449427905 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563491eca60 con 0x55634934e4c0 2024-05-10T10:56:27.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.282+0000 7fb431344700 1 --2- 172.21.15.107:0/1449427905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934e4c0 0x55634935a610 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb41400b810 tx=0x7fb41400bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46caf68bd2d5f609 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:27.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.282+0000 7fb422ffd700 1 -- 172.21.15.107:0/1449427905 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb414014620 con 0x55634934e4c0 2024-05-10T10:56:27.285 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.283+0000 7fb422ffd700 1 -- 172.21.15.107:0/1449427905 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb414014c90 con 0x55634934e4c0 2024-05-10T10:56:27.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.283+0000 7fb422ffd700 1 -- 172.21.15.107:0/1449427905 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb414012e00 con 0x55634934e4c0 2024-05-10T10:56:27.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.283+0000 7fb43d63ab80 1 -- 172.21.15.107:0/1449427905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934e4c0 msgr2=0x55634935a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:27.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.283+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/1449427905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934e4c0 0x55634935a610 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb41400b810 tx=0x7fb41400bb20 comp rx=0 tx=0).stop 2024-05-10T10:56:27.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.283+0000 7fb43d63ab80 1 -- 172.21.15.107:0/1449427905 shutdown_connections 2024-05-10T10:56:27.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.283+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/1449427905 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556349353850 0x556349353c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.283+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/1449427905 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934e4c0 0x55634935a610 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.283+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/1449427905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55634934db00 0x55634934df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.283+0000 7fb43d63ab80 1 -- 172.21.15.107:0/1449427905 >> 172.21.15.107:0/1449427905 conn(0x556349279d00 msgr2=0x556349348880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:27.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.283+0000 7fb43d63ab80 1 -- 172.21.15.107:0/1449427905 shutdown_connections 2024-05-10T10:56:27.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.283+0000 7fb43d63ab80 1 -- 172.21.15.107:0/1449427905 wait complete. 2024-05-10T10:56:27.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.284+0000 7fb43d63ab80 1 -- start start 2024-05-10T10:56:27.286 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.284+0000 7fb43d63ab80 1 Processor -- start 2024-05-10T10:56:27.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.284+0000 7fb43d63ab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934db00 0x55634935a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:27.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.284+0000 7fb43d63ab80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55634934e4c0 0x556349357550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:27.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.284+0000 7fb43d63ab80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556349353850 0x556349357a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:27.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.284+0000 7fb43d63ab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55634935ab50 con 0x55634934db00 2024-05-10T10:56:27.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.284+0000 7fb43d63ab80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556349259060 con 0x55634934e4c0 2024-05-10T10:56:27.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.284+0000 7fb43d63ab80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55634935acd0 con 0x556349353850 2024-05-10T10:56:27.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.284+0000 7fb43d63ab80 10 client.0 _ll_register_callbacks cb 0x556349233740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:56:27.290 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.284+0000 7fb430b43700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934db00 0x55634935a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:27.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.284+0000 7fb430b43700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934db00 0x55634935a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47836/0 (socket says 172.21.15.107:47836) 2024-05-10T10:56:27.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.284+0000 7fb430b43700 1 -- 172.21.15.107:0/3389490765 learned_addr learned my addr 172.21.15.107:0/3389490765 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:27.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.284+0000 7fb42bfff700 1 --2- 172.21.15.107:0/3389490765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55634934e4c0 0x556349357550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:27.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.285+0000 7fb431344700 1 --2- 172.21.15.107:0/3389490765 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556349353850 0x556349357a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:27.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.285+0000 7fb430b43700 1 -- 172.21.15.107:0/3389490765 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556349353850 msgr2=0x556349357a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:27.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.285+0000 7fb430b43700 1 --2- 172.21.15.107:0/3389490765 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556349353850 0x556349357a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.285+0000 7fb430b43700 1 -- 172.21.15.107:0/3389490765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55634934e4c0 msgr2=0x556349357550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:27.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.285+0000 7fb430b43700 1 --2- 172.21.15.107:0/3389490765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55634934e4c0 0x556349357550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.285+0000 7fb430b43700 1 -- 172.21.15.107:0/3389490765 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563492568f0 con 0x55634934db00 2024-05-10T10:56:27.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.285+0000 7fb430b43700 1 --2- 172.21.15.107:0/3389490765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934db00 0x55634935a1b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb424009990 tx=0x7fb42401a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cffbc28673547435 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:27.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.285+0000 7fb40bfff700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:56:27.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.285+0000 7fb40bfff700 1 -- 172.21.15.107:0/3389490765 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb424003ad0 con 0x55634934db00 2024-05-10T10:56:27.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.285+0000 7fb40bfff700 1 -- 172.21.15.107:0/3389490765 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fb424003c70 con 0x55634934db00 2024-05-10T10:56:27.291 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.285+0000 7fb43d63ab80 1 -- 172.21.15.107:0/3389490765 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb414014c90 con 0x55634934db00 2024-05-10T10:56:27.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.285+0000 7fb40bfff700 1 -- 172.21.15.107:0/3389490765 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb42400fe30 con 0x55634934db00 2024-05-10T10:56:27.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.285+0000 7fb43d63ab80 10 client.15429 fetch_fsmap learned FSMap version 27 2024-05-10T10:56:27.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.285+0000 7fb43d63ab80 1 -- 172.21.15.107:0/3389490765 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556349365230 con 0x55634934db00 2024-05-10T10:56:27.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.285+0000 7fb40bfff700 1 -- 172.21.15.107:0/3389490765 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb414014c90 con 0x55634934db00 2024-05-10T10:56:27.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.286+0000 7fb40bfff700 1 -- 172.21.15.107:0/3389490765 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb4240317f0 con 0x55634934db00 2024-05-10T10:56:27.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.286+0000 7fb43d63ab80 10 client.15429 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:56:27.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.286+0000 7fb43d63ab80 10 client.15429 resolve_mds: validated gid 24482 aka daemon mds.b 2024-05-10T10:56:27.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.286+0000 7fb43d63ab80 20 client.15429 populate_metadata read hostname 'smithi107' 2024-05-10T10:56:27.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.286+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/3389490765 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x556349367810 0x556349369c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:27.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.286+0000 7fb43d63ab80 4 client.15429 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:56:27.292 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.286+0000 7fb43d63ab80 1 -- 172.21.15.107:0/3389490765 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563492ad4b0 con 0x556349367810 2024-05-10T10:56:27.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.286+0000 7fb42bfff700 1 --2- 172.21.15.107:0/3389490765 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x556349367810 0x556349369c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:27.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.286+0000 7fb40bfff700 10 client.15429 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:27.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.286+0000 7fb42bfff700 1 --2- 172.21.15.107:0/3389490765 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x556349367810 0x556349369c60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2f7a900d715d697 server_cookie=5a18605d845d168a in_seq=0 out_seq=0 2024-05-10T10:56:27.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.287+0000 7fb40bfff700 1 -- 172.21.15.107:0/3389490765 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5563492ad4b0 con 0x556349367810 2024-05-10T10:56:27.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.287+0000 7fb40bfff700 10 client.15429 handle_command_reply: tid=0 2024-05-10T10:56:27.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.287+0000 7fb43d63ab80 1 client.15429 shutdown 2024-05-10T10:56:27.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.287+0000 7fb43d63ab80 1 -- 172.21.15.107:0/3389490765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934db00 msgr2=0x55634935a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:27.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.287+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/3389490765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934db00 0x55634935a1b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb424009990 tx=0x7fb42401a050 comp rx=0 tx=0).stop 2024-05-10T10:56:27.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.287+0000 7fb43d63ab80 1 -- 172.21.15.107:0/3389490765 shutdown_connections 2024-05-10T10:56:27.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.287+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/3389490765 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556349353850 0x556349357a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.287+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/3389490765 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x556349367810 0x556349369c60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.287+0000 7fb40bfff700 0 client.15429 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:27.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.287+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/3389490765 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934db00 0x55634935a1b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.293 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.287+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/3389490765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55634934e4c0 0x556349357550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.287+0000 7fb43d63ab80 1 -- 172.21.15.107:0/3389490765 >> 172.21.15.107:0/3389490765 conn(0x556349279d00 msgr2=0x556349352bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:27.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.288+0000 7fb43d63ab80 1 -- 172.21.15.107:0/3389490765 shutdown_connections 2024-05-10T10:56:27.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.288+0000 7fb43d63ab80 1 -- 172.21.15.107:0/3389490765 wait complete. 2024-05-10T10:56:27.294 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.288+0000 7fb43d63ab80 20 client.15429 trim_cache size 0 max 16384 2024-05-10T10:56:27.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.307+0000 7fb43d63ab80 1 Processor -- start 2024-05-10T10:56:27.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.307+0000 7fb43d63ab80 1 -- start start 2024-05-10T10:56:27.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.307+0000 7fb43d63ab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934db00 0x55634936f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:27.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.307+0000 7fb43d63ab80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55634934e4c0 0x55634936fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:27.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.307+0000 7fb43d63ab80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556349353850 0x55634935ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:27.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.307+0000 7fb43d63ab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c1afb10 con 0x55634934db00 2024-05-10T10:56:27.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.307+0000 7fb43d63ab80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c1b1650 con 0x55634934e4c0 2024-05-10T10:56:27.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.307+0000 7fb43d63ab80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c1b01e0 con 0x556349353850 2024-05-10T10:56:27.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.307+0000 7fb430b43700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934db00 0x55634936f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:27.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.307+0000 7fb430b43700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934db00 0x55634936f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47848/0 (socket says 172.21.15.107:47848) 2024-05-10T10:56:27.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.307+0000 7fb430b43700 1 -- 172.21.15.107:0/592012716 learned_addr learned my addr 172.21.15.107:0/592012716 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:27.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.307+0000 7fb430b43700 1 -- 172.21.15.107:0/592012716 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556349353850 msgr2=0x55634935ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:27.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.307+0000 7fb430b43700 1 --2- 172.21.15.107:0/592012716 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556349353850 0x55634935ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.308+0000 7fb430b43700 1 -- 172.21.15.107:0/592012716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55634934e4c0 msgr2=0x55634936fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:27.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.308+0000 7fb430b43700 1 --2- 172.21.15.107:0/592012716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55634934e4c0 0x55634936fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.308+0000 7fb430b43700 1 -- 172.21.15.107:0/592012716 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563493450a0 con 0x55634934db00 2024-05-10T10:56:27.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.308+0000 7fb430b43700 1 --2- 172.21.15.107:0/592012716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934db00 0x55634936f530 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb4240098e0 tx=0x7fb4240059c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f29fdd2ff07c034 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:27.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.308+0000 7fb4227fc700 1 -- 172.21.15.107:0/592012716 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb424049070 con 0x55634934db00 2024-05-10T10:56:27.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.308+0000 7fb4227fc700 1 -- 172.21.15.107:0/592012716 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb4240050d0 con 0x55634934db00 2024-05-10T10:56:27.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.308+0000 7fb4227fc700 1 -- 172.21.15.107:0/592012716 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb424040040 con 0x55634934db00 2024-05-10T10:56:27.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.308+0000 7fb43d63ab80 1 -- 172.21.15.107:0/592012716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934db00 msgr2=0x55634936f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:27.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.308+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/592012716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934db00 0x55634936f530 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb4240098e0 tx=0x7fb4240059c0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.308+0000 7fb43d63ab80 1 -- 172.21.15.107:0/592012716 shutdown_connections 2024-05-10T10:56:27.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.308+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/592012716 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x556349353850 0x55634935ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.308+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/592012716 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934db00 0x55634936f530 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.308+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/592012716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55634934e4c0 0x55634936fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.308+0000 7fb43d63ab80 1 -- 172.21.15.107:0/592012716 >> 172.21.15.107:0/592012716 conn(0x556349279d00 msgr2=0x556349359490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:27.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.309+0000 7fb43d63ab80 1 -- 172.21.15.107:0/592012716 shutdown_connections 2024-05-10T10:56:27.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.309+0000 7fb43d63ab80 1 -- 172.21.15.107:0/592012716 wait complete. 2024-05-10T10:56:27.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.309+0000 7fb43d63ab80 1 -- start start 2024-05-10T10:56:27.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.309+0000 7fb43d63ab80 1 Processor -- start 2024-05-10T10:56:27.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.309+0000 7fb43d63ab80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55634934db00 0x55634935e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:27.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.309+0000 7fb43d63ab80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934e4c0 0x55634935e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:27.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.309+0000 7fb43d63ab80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556349353850 0x5563493cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:27.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.309+0000 7fb43d63ab80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c1b0f80 con 0x55634934e4c0 2024-05-10T10:56:27.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.309+0000 7fb43d63ab80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c1b08b0 con 0x556349353850 2024-05-10T10:56:27.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.309+0000 7fb43d63ab80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c1adb10 con 0x55634934db00 2024-05-10T10:56:27.317 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.309+0000 7fb43d63ab80 10 client.0 _ll_register_callbacks cb 0x556349233740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:56:27.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.309+0000 7fb42bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934e4c0 0x55634935e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:27.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.309+0000 7fb42bfff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934e4c0 0x55634935e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47864/0 (socket says 172.21.15.107:47864) 2024-05-10T10:56:27.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.309+0000 7fb42bfff700 1 -- 172.21.15.107:0/941160900 learned_addr learned my addr 172.21.15.107:0/941160900 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:27.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.310+0000 7fb430b43700 1 --2- 172.21.15.107:0/941160900 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55634934db00 0x55634935e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:27.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.310+0000 7fb431344700 1 --2- 172.21.15.107:0/941160900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556349353850 0x5563493cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:27.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.310+0000 7fb42bfff700 1 -- 172.21.15.107:0/941160900 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55634934db00 msgr2=0x55634935e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:27.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.310+0000 7fb42bfff700 1 --2- 172.21.15.107:0/941160900 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55634934db00 0x55634935e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.310+0000 7fb42bfff700 1 -- 172.21.15.107:0/941160900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556349353850 msgr2=0x5563493cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:27.318 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.310+0000 7fb42bfff700 1 --2- 172.21.15.107:0/941160900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556349353850 0x5563493cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.310+0000 7fb42bfff700 1 -- 172.21.15.107:0/941160900 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563493cb720 con 0x55634934e4c0 2024-05-10T10:56:27.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.310+0000 7fb431344700 1 --2- 172.21.15.107:0/941160900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556349353850 0x5563493cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:56:27.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.310+0000 7fb42bfff700 1 --2- 172.21.15.107:0/941160900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934e4c0 0x55634935e8d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0a9370 tx=0x7fb41c0a8fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71d704bfefc22fd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:27.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.310+0000 7fb40bfff700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:56:27.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.310+0000 7fb40bfff700 1 -- 172.21.15.107:0/941160900 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c019310 con 0x55634934e4c0 2024-05-10T10:56:27.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.310+0000 7fb40bfff700 1 -- 172.21.15.107:0/941160900 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fb41c0194b0 con 0x55634934e4c0 2024-05-10T10:56:27.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.310+0000 7fb43d63ab80 1 -- 172.21.15.107:0/941160900 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4240050d0 con 0x55634934e4c0 2024-05-10T10:56:27.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.310+0000 7fb40bfff700 1 -- 172.21.15.107:0/941160900 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb41c08fbe0 con 0x55634934e4c0 2024-05-10T10:56:27.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.310+0000 7fb43d63ab80 10 client.15435 fetch_fsmap learned FSMap version 27 2024-05-10T10:56:27.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.310+0000 7fb43d63ab80 1 -- 172.21.15.107:0/941160900 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5563493d2b00 con 0x55634934e4c0 2024-05-10T10:56:27.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.310+0000 7fb40bfff700 1 -- 172.21.15.107:0/941160900 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb4240050d0 con 0x55634934e4c0 2024-05-10T10:56:27.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.311+0000 7fb40bfff700 1 -- 172.21.15.107:0/941160900 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fb41c023060 con 0x55634934e4c0 2024-05-10T10:56:27.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.311+0000 7fb43d63ab80 10 client.15435 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:56:27.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.311+0000 7fb43d63ab80 10 client.15435 resolve_mds: validated gid 24482 aka daemon mds.b 2024-05-10T10:56:27.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.311+0000 7fb43d63ab80 20 client.15435 populate_metadata read hostname 'smithi107' 2024-05-10T10:56:27.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.311+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/941160900 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x556349367810 0x5563493d52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:27.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.311+0000 7fb43d63ab80 4 client.15435 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}] 2024-05-10T10:56:27.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.311+0000 7fb43d63ab80 1 -- 172.21.15.107:0/941160900 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}) -- 0x5563492a7550 con 0x556349367810 2024-05-10T10:56:27.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.311+0000 7fb430b43700 1 --2- 172.21.15.107:0/941160900 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x556349367810 0x5563493d52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:27.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.311+0000 7fb430b43700 1 --2- 172.21.15.107:0/941160900 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x556349367810 0x5563493d52c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43b9d56d2befc493 server_cookie=f7c1ebb759b0d9d1 in_seq=0 out_seq=0 2024-05-10T10:56:27.321 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.311+0000 7fb40bfff700 10 client.15435 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:27.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.322+0000 7fb40bfff700 1 -- 172.21.15.107:0/941160900 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5563492a7550 con 0x556349367810 2024-05-10T10:56:27.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.322+0000 7fb40bfff700 10 client.15435 handle_command_reply: tid=0 2024-05-10T10:56:27.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.322+0000 7fb43d63ab80 1 client.15435 shutdown 2024-05-10T10:56:27.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.322+0000 7fb43d63ab80 1 -- 172.21.15.107:0/941160900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934e4c0 msgr2=0x55634935e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:27.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.322+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/941160900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934e4c0 0x55634935e8d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0a9370 tx=0x7fb41c0a8fc0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.322+0000 7fb43d63ab80 1 -- 172.21.15.107:0/941160900 shutdown_connections 2024-05-10T10:56:27.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.322+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/941160900 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55634934db00 0x55634935e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.322+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/941160900 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x556349367810 0x5563493d52c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.322+0000 7fb40bfff700 0 client.15435 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:27.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.322+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/941160900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556349353850 0x5563493cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.324 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.322+0000 7fb43d63ab80 1 --2- 172.21.15.107:0/941160900 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55634934e4c0 0x55634935e8d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.322+0000 7fb43d63ab80 1 -- 172.21.15.107:0/941160900 >> 172.21.15.107:0/941160900 conn(0x556349279d00 msgr2=0x556349356dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:27.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.322+0000 7fb43d63ab80 1 -- 172.21.15.107:0/941160900 shutdown_connections 2024-05-10T10:56:27.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.322+0000 7fb43d63ab80 1 -- 172.21.15.107:0/941160900 wait complete. 2024-05-10T10:56:27.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.322+0000 7fb43d63ab80 20 client.15435 trim_cache size 0 max 16384 2024-05-10T10:56:27.325 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:56:27.325 INFO:teuthology.orchestra.run.smithi107.stdout: "epoch": 27, 2024-05-10T10:56:27.326 INFO:teuthology.orchestra.run.smithi107.stdout: "leader": 24482, 2024-05-10T10:56:27.326 INFO:teuthology.orchestra.run.smithi107.stdout: "set_version": 2, 2024-05-10T10:56:27.326 INFO:teuthology.orchestra.run.smithi107.stdout: "sets": { 2024-05-10T10:56:27.326 INFO:teuthology.orchestra.run.smithi107.stdout: "11076300": { 2024-05-10T10:56:27.326 INFO:teuthology.orchestra.run.smithi107.stdout: "version": 2, 2024-05-10T10:56:27.326 INFO:teuthology.orchestra.run.smithi107.stdout: "age_ref": 0.0, 2024-05-10T10:56:27.326 INFO:teuthology.orchestra.run.smithi107.stdout: "state": { 2024-05-10T10:56:27.326 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "QUIESCED", 2024-05-10T10:56:27.327 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0 2024-05-10T10:56:27.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T10:56:27.327 INFO:teuthology.orchestra.run.smithi107.stdout: "timeout": 60.0, 2024-05-10T10:56:27.327 INFO:teuthology.orchestra.run.smithi107.stdout: "expiration": 70.0, 2024-05-10T10:56:27.327 INFO:teuthology.orchestra.run.smithi107.stdout: "members": { 2024-05-10T10:56:27.327 INFO:teuthology.orchestra.run.smithi107.stdout: "file:/": { 2024-05-10T10:56:27.327 INFO:teuthology.orchestra.run.smithi107.stdout: "excluded": false, 2024-05-10T10:56:27.327 INFO:teuthology.orchestra.run.smithi107.stdout: "state": { 2024-05-10T10:56:27.327 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "QUIESCED", 2024-05-10T10:56:27.328 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0 2024-05-10T10:56:27.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:56:27.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:56:27.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:56:27.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:56:27.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:56:27.328 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:56:27.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.323+0000 7fb432da7700 1 -- 172.21.15.107:0/3143852980 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4180b29b0 msgr2=0x7fb4180b4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:27.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.323+0000 7fb432da7700 1 --2- 172.21.15.107:0/3143852980 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4180b29b0 0x7fb4180b4e70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb424006010 tx=0x7fb42400b540 comp rx=0 tx=0).stop 2024-05-10T10:56:27.329 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.323+0000 7fb432da7700 1 -- 172.21.15.107:0/3143852980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb42c102d90 msgr2=0x7fb42c104570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:27.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.323+0000 7fb432da7700 1 --2- 172.21.15.107:0/3143852980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb42c102d90 0x7fb42c104570 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb41c007e20 tx=0x7fb41c00a340 comp rx=0 tx=0).stop 2024-05-10T10:56:27.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.323+0000 7fb432da7700 1 -- 172.21.15.107:0/3143852980 shutdown_connections 2024-05-10T10:56:27.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.323+0000 7fb432da7700 1 --2- 172.21.15.107:0/3143852980 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb4180b29b0 0x7fb4180b4e70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.323+0000 7fb432da7700 1 --2- 172.21.15.107:0/3143852980 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb42c108460 0x7fb42c104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.323+0000 7fb432da7700 1 --2- 172.21.15.107:0/3143852980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb42c1023d0 0x7fb42c104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.323+0000 7fb432da7700 1 --2- 172.21.15.107:0/3143852980 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb42c102d90 0x7fb42c104570 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:27.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.323+0000 7fb432da7700 1 -- 172.21.15.107:0/3143852980 >> 172.21.15.107:0/3143852980 conn(0x7fb42c0793f0 msgr2=0x7fb42c06be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:27.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.323+0000 7fb432da7700 1 -- 172.21.15.107:0/3143852980 shutdown_connections 2024-05-10T10:56:27.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:27.323+0000 7fb432da7700 1 -- 172.21.15.107:0/3143852980 wait complete. 2024-05-10T10:56:27.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:27 smithi184 ceph-mon[34585]: pgmap v411: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-10T10:56:27.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:27 smithi196 ceph-mon[34872]: pgmap v411: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-10T10:56:28.186 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '11076300', quiesce took 6.1 seconds. Will release after: 10 2024-05-10T10:56:29.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:29 smithi184 ceph-mon[34585]: pgmap v412: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-10T10:56:29.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:29 smithi107 ceph-mon[30373]: pgmap v412: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-10T10:56:29.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:29 smithi196 ceph-mon[34872]: pgmap v412: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-10T10:56:31.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:31 smithi184 ceph-mon[34585]: pgmap v413: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-10T10:56:31.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:56:31.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:56:31.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:56:31.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:56:31.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:31 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:56:31.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:31 smithi107 ceph-mon[30373]: pgmap v413: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-10T10:56:31.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:56:31.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:56:31.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:56:31.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:56:31.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:31 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:56:31.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:31 smithi196 ceph-mon[34872]: pgmap v413: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-10T10:56:31.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:56:31.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:56:31.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:56:31.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:56:31.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:31 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:56:32.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:32 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:56:32.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:32 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:56:32.390 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:32 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:56:32.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:32 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:56:32.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:32 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:56:32.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:32 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:56:32.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:32 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:56:32.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:32 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:56:32.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:32 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:56:33.388 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:33 smithi184 ceph-mon[34585]: pgmap v414: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T10:56:33.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:33 smithi107 ceph-mon[30373]: pgmap v414: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T10:56:33.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:33 smithi196 ceph-mon[34872]: pgmap v414: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T10:56:35.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:35 smithi184 ceph-mon[34585]: pgmap v415: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-05-10T10:56:35.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:35 smithi107 ceph-mon[30373]: pgmap v415: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-05-10T10:56:35.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:35 smithi196 ceph-mon[34872]: pgmap v415: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-05-10T10:56:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.067+0000 7fef60e85640 1 -- 172.21.15.107:0/933373152 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c102b00 msgr2=0x7fef5c102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.067+0000 7fef60e85640 1 --2- 172.21.15.107:0/933373152 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c102b00 0x7fef5c102f80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fef44009900 tx=0x7fef4402a410 comp rx=0 tx=0).stop 2024-05-10T10:56:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.067+0000 7fef60e85640 1 -- 172.21.15.107:0/933373152 shutdown_connections 2024-05-10T10:56:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.067+0000 7fef60e85640 1 --2- 172.21.15.107:0/933373152 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef5c1034c0 0x7fef5c109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.067+0000 7fef60e85640 1 --2- 172.21.15.107:0/933373152 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c102b00 0x7fef5c102f80 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.067+0000 7fef60e85640 1 --2- 172.21.15.107:0/933373152 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef5c101910 0x7fef5c101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.067+0000 7fef60e85640 1 -- 172.21.15.107:0/933373152 >> 172.21.15.107:0/933373152 conn(0x7fef5c0fce80 msgr2=0x7fef5c0ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.067+0000 7fef60e85640 1 -- 172.21.15.107:0/933373152 shutdown_connections 2024-05-10T10:56:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.067+0000 7fef60e85640 1 -- 172.21.15.107:0/933373152 wait complete. 2024-05-10T10:56:37.070 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.068+0000 7fef60e85640 1 Processor -- start 2024-05-10T10:56:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.068+0000 7fef60e85640 1 -- start start 2024-05-10T10:56:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.068+0000 7fef60e85640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c101910 0x7fef5c06abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.068+0000 7fef60e85640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef5c102b00 0x7fef5c19fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.068+0000 7fef60e85640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef5c1034c0 0x7fef5c1a2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.068+0000 7fef60e85640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c10d570 con 0x7fef5c101910 2024-05-10T10:56:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.068+0000 7fef60e85640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c10d3f0 con 0x7fef5c1034c0 2024-05-10T10:56:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.068+0000 7fef60e85640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c10d6f0 con 0x7fef5c102b00 2024-05-10T10:56:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.068+0000 7fef5259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c101910 0x7fef5c06abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.068+0000 7fef5259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c101910 0x7fef5c06abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48928/0 (socket says 172.21.15.107:48928) 2024-05-10T10:56:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.068+0000 7fef5259c640 1 -- 172.21.15.107:0/3723614410 learned_addr learned my addr 172.21.15.107:0/3723614410 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.068+0000 7fef5a59c640 1 --2- 172.21.15.107:0/3723614410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef5c102b00 0x7fef5c19fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.068+0000 7fef5ad9d640 1 --2- 172.21.15.107:0/3723614410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef5c1034c0 0x7fef5c1a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:37.071 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.068+0000 7fef5259c640 1 -- 172.21.15.107:0/3723614410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef5c102b00 msgr2=0x7fef5c19fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.068+0000 7fef5259c640 1 --2- 172.21.15.107:0/3723614410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef5c102b00 0x7fef5c19fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.068+0000 7fef5259c640 1 -- 172.21.15.107:0/3723614410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef5c1034c0 msgr2=0x7fef5c1a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.068+0000 7fef5259c640 1 --2- 172.21.15.107:0/3723614410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef5c1034c0 0x7fef5c1a2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.069+0000 7fef5259c640 1 -- 172.21.15.107:0/3723614410 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5c1a2af0 con 0x7fef5c101910 2024-05-10T10:56:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.069+0000 7fef5259c640 1 --2- 172.21.15.107:0/3723614410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c101910 0x7fef5c06abd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00d950 tx=0x7fef4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.069+0000 7fef53fff640 1 -- 172.21.15.107:0/3723614410 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c017020 con 0x7fef5c101910 2024-05-10T10:56:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.069+0000 7fef60e85640 1 -- 172.21.15.107:0/3723614410 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef5c1a2d80 con 0x7fef5c101910 2024-05-10T10:56:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.069+0000 7fef53fff640 1 -- 172.21.15.107:0/3723614410 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fef4c009c30 con 0x7fef5c101910 2024-05-10T10:56:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.069+0000 7fef53fff640 1 -- 172.21.15.107:0/3723614410 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c00f740 con 0x7fef5c101910 2024-05-10T10:56:37.072 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.069+0000 7fef60e85640 1 -- 172.21.15.107:0/3723614410 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef5c1a31e0 con 0x7fef5c101910 2024-05-10T10:56:37.079 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.071+0000 7fef53fff640 1 -- 172.21.15.107:0/3723614410 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 19) ==== 149704+0+0 (secure 0 0 0) 0x7fef4c01a020 con 0x7fef5c101910 2024-05-10T10:56:37.079 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.072+0000 7fef53fff640 1 --2- 172.21.15.107:0/3723614410 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fef480b2960 0x7fef480b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:37.079 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.072+0000 7fef5a59c640 1 --2- 172.21.15.107:0/3723614410 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fef480b2960 0x7fef480b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.072+0000 7fef53fff640 1 -- 172.21.15.107:0/3723614410 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fef4c0e1ca0 con 0x7fef5c101910 2024-05-10T10:56:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.072+0000 7fef63ba0740 1 Processor -- start 2024-05-10T10:56:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef63ba0740 1 -- start start 2024-05-10T10:56:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef63ba0740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e19db0 0x55f4a2e1a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef5a59c640 1 --2- 172.21.15.107:0/3723614410 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fef480b2960 0x7fef480b4e20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fef44000c00 tx=0x7fef44031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef63ba0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e1f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef63ba0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e1f910 0x55f4a2e21da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef63ba0740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f4a2d7e5d0 con 0x55f4a2e19db0 2024-05-10T10:56:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef63ba0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f4a2d37890 con 0x55f4a2e1f910 2024-05-10T10:56:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef63ba0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f4a2d7a590 con 0x55f4a2e1a7a0 2024-05-10T10:56:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef5259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e19db0 0x55f4a2e1a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef5259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e19db0 0x55f4a2e1a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48938/0 (socket says 172.21.15.107:48938) 2024-05-10T10:56:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef5259c640 1 -- 172.21.15.107:0/4166161933 learned_addr learned my addr 172.21.15.107:0/4166161933 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:37.080 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef5ad9d640 1 --2- 172.21.15.107:0/4166161933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e1f910 0x55f4a2e21da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef5a59c640 1 --2- 172.21.15.107:0/4166161933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e1f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef5259c640 1 -- 172.21.15.107:0/4166161933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1a7a0 msgr2=0x55f4a2e1f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef5259c640 1 --2- 172.21.15.107:0/4166161933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e1f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef5259c640 1 -- 172.21.15.107:0/4166161933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e1f910 msgr2=0x55f4a2e21da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef5259c640 1 --2- 172.21.15.107:0/4166161933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e1f910 0x55f4a2e21da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef5259c640 1 -- 172.21.15.107:0/4166161933 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4a2a90210 con 0x55f4a2e19db0 2024-05-10T10:56:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef5a59c640 1 --2- 172.21.15.107:0/4166161933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e1f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:56:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.073+0000 7fef5259c640 1 --2- 172.21.15.107:0/4166161933 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e19db0 0x55f4a2e1a1d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009610 tx=0x7fef4c0a91e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bf6d5c7c4e4a0d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.074+0000 7fef50d99640 1 -- 172.21.15.107:0/4166161933 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c0b2040 con 0x55f4a2e19db0 2024-05-10T10:56:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.074+0000 7fef50d99640 1 -- 172.21.15.107:0/4166161933 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fef4c0a5470 con 0x55f4a2e19db0 2024-05-10T10:56:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.074+0000 7fef50d99640 1 -- 172.21.15.107:0/4166161933 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c0a4b50 con 0x55f4a2e19db0 2024-05-10T10:56:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.074+0000 7fef63ba0740 1 -- 172.21.15.107:0/4166161933 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e19db0 msgr2=0x55f4a2e1a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.074+0000 7fef63ba0740 1 --2- 172.21.15.107:0/4166161933 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e19db0 0x55f4a2e1a1d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fef4c009610 tx=0x7fef4c0a91e0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.081 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.074+0000 7fef63ba0740 1 -- 172.21.15.107:0/4166161933 shutdown_connections 2024-05-10T10:56:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.074+0000 7fef63ba0740 1 --2- 172.21.15.107:0/4166161933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e1f910 0x55f4a2e21da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.074+0000 7fef63ba0740 1 --2- 172.21.15.107:0/4166161933 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e1f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.074+0000 7fef63ba0740 1 --2- 172.21.15.107:0/4166161933 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e19db0 0x55f4a2e1a1d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.074+0000 7fef63ba0740 1 -- 172.21.15.107:0/4166161933 >> 172.21.15.107:0/4166161933 conn(0x55f4a2e15420 msgr2=0x55f4a2e15820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.075+0000 7fef63ba0740 1 -- 172.21.15.107:0/4166161933 shutdown_connections 2024-05-10T10:56:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.075+0000 7fef63ba0740 1 -- 172.21.15.107:0/4166161933 wait complete. 2024-05-10T10:56:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.075+0000 7fef63ba0740 1 -- start start 2024-05-10T10:56:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.075+0000 7fef63ba0740 1 Processor -- start 2024-05-10T10:56:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.075+0000 7fef63ba0740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e19db0 0x55f4a2e23fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.075+0000 7fef63ba0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e24500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.075+0000 7fef63ba0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1f910 0x55f4a2e2b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.075+0000 7fef63ba0740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f4a2e228c0 con 0x55f4a2e19db0 2024-05-10T10:56:37.082 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.075+0000 7fef63ba0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f4a2d3b370 con 0x55f4a2e1a7a0 2024-05-10T10:56:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.075+0000 7fef63ba0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f4a2e22a40 con 0x55f4a2e1f910 2024-05-10T10:56:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.075+0000 7fef63ba0740 10 client.0 _ll_register_callbacks cb 0x55f4a2a8fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:56:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.075+0000 7fef5259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e19db0 0x55f4a2e23fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.075+0000 7fef5259c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e19db0 0x55f4a2e23fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48950/0 (socket says 172.21.15.107:48950) 2024-05-10T10:56:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.075+0000 7fef5259c640 1 -- 172.21.15.107:0/788271681 learned_addr learned my addr 172.21.15.107:0/788271681 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.076+0000 7fef5ad9d640 1 --2- 172.21.15.107:0/788271681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1f910 0x55f4a2e2b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.076+0000 7fef5a59c640 1 --2- 172.21.15.107:0/788271681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e24500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.076+0000 7fef5259c640 1 -- 172.21.15.107:0/788271681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1f910 msgr2=0x55f4a2e2b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.076+0000 7fef5259c640 1 --2- 172.21.15.107:0/788271681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1f910 0x55f4a2e2b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.076+0000 7fef5259c640 1 -- 172.21.15.107:0/788271681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e1a7a0 msgr2=0x55f4a2e24500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.076+0000 7fef5259c640 1 --2- 172.21.15.107:0/788271681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e24500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.076+0000 7fef5259c640 1 -- 172.21.15.107:0/788271681 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4a2b5c620 con 0x55f4a2e19db0 2024-05-10T10:56:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.076+0000 7fef5a59c640 1 --2- 172.21.15.107:0/788271681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e24500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:56:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.076+0000 7fef5259c640 1 --2- 172.21.15.107:0/788271681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e19db0 0x55f4a2e23fc0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0a5260 tx=0x7fef4c0a5170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e265a1d7734de5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:37.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.076+0000 7fef41ffb640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:56:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.076+0000 7fef41ffb640 1 -- 172.21.15.107:0/788271681 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c06d060 con 0x55f4a2e19db0 2024-05-10T10:56:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.076+0000 7fef41ffb640 1 -- 172.21.15.107:0/788271681 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fef4c0a57d0 con 0x55f4a2e19db0 2024-05-10T10:56:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.076+0000 7fef63ba0740 1 -- 172.21.15.107:0/788271681 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef4c0a5470 con 0x55f4a2e19db0 2024-05-10T10:56:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.076+0000 7fef41ffb640 1 -- 172.21.15.107:0/788271681 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fef4c0b2040 con 0x55f4a2e19db0 2024-05-10T10:56:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.076+0000 7fef63ba0740 10 client.15447 fetch_fsmap learned FSMap version 27 2024-05-10T10:56:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.076+0000 7fef63ba0740 1 -- 172.21.15.107:0/788271681 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f4a2e228c0 con 0x55f4a2e19db0 2024-05-10T10:56:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.076+0000 7fef41ffb640 1 -- 172.21.15.107:0/788271681 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fef4c0a5470 con 0x55f4a2e19db0 2024-05-10T10:56:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.077+0000 7fef41ffb640 1 -- 172.21.15.107:0/788271681 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fef4c0ae720 con 0x55f4a2e19db0 2024-05-10T10:56:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.077+0000 7fef63ba0740 10 client.15447 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:56:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.077+0000 7fef63ba0740 10 client.15447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:56:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.077+0000 7fef63ba0740 20 client.15447 populate_metadata read hostname 'smithi107' 2024-05-10T10:56:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.077+0000 7fef63ba0740 1 --2- 172.21.15.107:0/788271681 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f4a2e2f660 0x55f4a2e31a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.077+0000 7fef63ba0740 4 client.15447 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:56:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.077+0000 7fef63ba0740 1 -- 172.21.15.107:0/788271681 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4a2d8c1e0 con 0x55f4a2e2f660 2024-05-10T10:56:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.077+0000 7fef5a59c640 1 --2- 172.21.15.107:0/788271681 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f4a2e2f660 0x55f4a2e31a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.077+0000 7fef5a59c640 1 --2- 172.21.15.107:0/788271681 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f4a2e2f660 0x55f4a2e31a50 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3626638f4c420cb server_cookie=ed13c5cca5f297ee in_seq=0 out_seq=0 2024-05-10T10:56:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.077+0000 7fef41ffb640 10 client.15447 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.078+0000 7fef41ffb640 1 -- 172.21.15.107:0/788271681 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f4a2d8c1e0 con 0x55f4a2e2f660 2024-05-10T10:56:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.078+0000 7fef41ffb640 10 client.15447 handle_command_reply: tid=0 2024-05-10T10:56:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.078+0000 7fef63ba0740 1 client.15447 shutdown 2024-05-10T10:56:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.078+0000 7fef63ba0740 1 -- 172.21.15.107:0/788271681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e19db0 msgr2=0x55f4a2e23fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.078+0000 7fef63ba0740 1 --2- 172.21.15.107:0/788271681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e19db0 0x55f4a2e23fc0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0a5260 tx=0x7fef4c0a5170 comp rx=0 tx=0).stop 2024-05-10T10:56:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.078+0000 7fef63ba0740 1 -- 172.21.15.107:0/788271681 shutdown_connections 2024-05-10T10:56:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.078+0000 7fef63ba0740 1 --2- 172.21.15.107:0/788271681 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f4a2e2f660 0x55f4a2e31a50 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.078+0000 7fef63ba0740 1 --2- 172.21.15.107:0/788271681 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1f910 0x55f4a2e2b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.078+0000 7fef41ffb640 0 client.15447 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.078+0000 7fef63ba0740 1 --2- 172.21.15.107:0/788271681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e24500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.078+0000 7fef63ba0740 1 --2- 172.21.15.107:0/788271681 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e19db0 0x55f4a2e23fc0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.078+0000 7fef63ba0740 1 -- 172.21.15.107:0/788271681 >> 172.21.15.107:0/788271681 conn(0x55f4a2e15420 msgr2=0x55f4a2e14580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:37.086 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.078+0000 7fef63ba0740 1 -- 172.21.15.107:0/788271681 shutdown_connections 2024-05-10T10:56:37.086 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.078+0000 7fef63ba0740 1 -- 172.21.15.107:0/788271681 wait complete. 2024-05-10T10:56:37.086 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.078+0000 7fef63ba0740 20 client.15447 trim_cache size 0 max 16384 2024-05-10T10:56:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.096+0000 7fef63ba0740 1 Processor -- start 2024-05-10T10:56:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.096+0000 7fef63ba0740 1 -- start start 2024-05-10T10:56:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.096+0000 7fef63ba0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e19db0 0x55f4a2e18330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.096+0000 7fef63ba0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e18870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.096+0000 7fef63ba0740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e1f910 0x55f4a2e23bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.096+0000 7fef63ba0740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c1abf50 con 0x55f4a2e1f910 2024-05-10T10:56:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.096+0000 7fef63ba0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c1ada90 con 0x55f4a2e19db0 2024-05-10T10:56:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.096+0000 7fef63ba0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c1ac620 con 0x55f4a2e1a7a0 2024-05-10T10:56:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.096+0000 7fef5ad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e1f910 0x55f4a2e23bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.096+0000 7fef5a59c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e18870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.096+0000 7fef5259c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e19db0 0x55f4a2e18330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.096+0000 7fef5a59c640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e18870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.107:32818/0 (socket says 172.21.15.107:32818) 2024-05-10T10:56:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.096+0000 7fef5ad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e1f910 0x55f4a2e23bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48964/0 (socket says 172.21.15.107:48964) 2024-05-10T10:56:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.096+0000 7fef5a59c640 1 -- 172.21.15.107:0/1452464018 learned_addr learned my addr 172.21.15.107:0/1452464018 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.096+0000 7fef5a59c640 1 -- 172.21.15.107:0/1452464018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e19db0 msgr2=0x55f4a2e18330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.097+0000 7fef5a59c640 1 --2- 172.21.15.107:0/1452464018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e19db0 0x55f4a2e18330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.097+0000 7fef5a59c640 1 -- 172.21.15.107:0/1452464018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e1f910 msgr2=0x55f4a2e23bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.097+0000 7fef5a59c640 1 --2- 172.21.15.107:0/1452464018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e1f910 0x55f4a2e23bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.097+0000 7fef5a59c640 1 -- 172.21.15.107:0/1452464018 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4a2e32080 con 0x55f4a2e1a7a0 2024-05-10T10:56:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.097+0000 7fef5ad9d640 1 --2- 172.21.15.107:0/1452464018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e1f910 0x55f4a2e23bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:56:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.097+0000 7fef5a59c640 1 --2- 172.21.15.107:0/1452464018 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e18870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fef44031ac0 tx=0x7fef44040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca2ffabb7f2fcc95 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.098+0000 7fef43fff640 1 -- 172.21.15.107:0/1452464018 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44035040 con 0x55f4a2e1a7a0 2024-05-10T10:56:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.098+0000 7fef43fff640 1 -- 172.21.15.107:0/1452464018 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fef44057070 con 0x55f4a2e1a7a0 2024-05-10T10:56:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.098+0000 7fef43fff640 1 -- 172.21.15.107:0/1452464018 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44003a10 con 0x55f4a2e1a7a0 2024-05-10T10:56:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.099+0000 7fef63ba0740 1 -- 172.21.15.107:0/1452464018 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1a7a0 msgr2=0x55f4a2e18870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.099+0000 7fef63ba0740 1 --2- 172.21.15.107:0/1452464018 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e18870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fef44031ac0 tx=0x7fef44040000 comp rx=0 tx=0).stop 2024-05-10T10:56:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.099+0000 7fef63ba0740 1 -- 172.21.15.107:0/1452464018 shutdown_connections 2024-05-10T10:56:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.099+0000 7fef63ba0740 1 --2- 172.21.15.107:0/1452464018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e1f910 0x55f4a2e23bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.099+0000 7fef63ba0740 1 --2- 172.21.15.107:0/1452464018 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e18870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.099+0000 7fef63ba0740 1 --2- 172.21.15.107:0/1452464018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e19db0 0x55f4a2e18330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.099+0000 7fef63ba0740 1 -- 172.21.15.107:0/1452464018 >> 172.21.15.107:0/1452464018 conn(0x55f4a2e15420 msgr2=0x55f4a2e103e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.099+0000 7fef63ba0740 1 -- 172.21.15.107:0/1452464018 shutdown_connections 2024-05-10T10:56:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.099+0000 7fef63ba0740 1 -- 172.21.15.107:0/1452464018 wait complete. 2024-05-10T10:56:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.099+0000 7fef63ba0740 1 -- start start 2024-05-10T10:56:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef63ba0740 1 Processor -- start 2024-05-10T10:56:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef63ba0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e19db0 0x55f4a2e28630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef63ba0740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e28b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef63ba0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1f910 0x55f4a2e29b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef63ba0740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c1ad3c0 con 0x55f4a2e1a7a0 2024-05-10T10:56:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef63ba0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c1accf0 con 0x55f4a2e19db0 2024-05-10T10:56:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef63ba0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c1a9f30 con 0x55f4a2e1f910 2024-05-10T10:56:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef63ba0740 10 client.0 _ll_register_callbacks cb 0x7fef4c0a8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:56:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef5a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e28b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef5a59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e28b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48968/0 (socket says 172.21.15.107:48968) 2024-05-10T10:56:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef5a59c640 1 -- 172.21.15.107:0/66070729 learned_addr learned my addr 172.21.15.107:0/66070729 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef5259c640 1 --2- 172.21.15.107:0/66070729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e19db0 0x55f4a2e28630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef5ad9d640 1 --2- 172.21.15.107:0/66070729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1f910 0x55f4a2e29b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef5a59c640 1 -- 172.21.15.107:0/66070729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1f910 msgr2=0x55f4a2e29b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef5a59c640 1 --2- 172.21.15.107:0/66070729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1f910 0x55f4a2e29b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef5a59c640 1 -- 172.21.15.107:0/66070729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e19db0 msgr2=0x55f4a2e28630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef5a59c640 1 --2- 172.21.15.107:0/66070729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e19db0 0x55f4a2e28630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef5a59c640 1 -- 172.21.15.107:0/66070729 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4a2e15250 con 0x55f4a2e1a7a0 2024-05-10T10:56:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef5a59c640 1 --2- 172.21.15.107:0/66070729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e28b70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fef44051cb0 tx=0x7fef44005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde015922dd355de server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef41ffb640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:56:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.100+0000 7fef41ffb640 1 -- 172.21.15.107:0/66070729 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44035070 con 0x55f4a2e1a7a0 2024-05-10T10:56:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.101+0000 7fef41ffb640 1 -- 172.21.15.107:0/66070729 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fef44051310 con 0x55f4a2e1a7a0 2024-05-10T10:56:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.101+0000 7fef63ba0740 1 -- 172.21.15.107:0/66070729 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef44057070 con 0x55f4a2e1a7a0 2024-05-10T10:56:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.101+0000 7fef41ffb640 1 -- 172.21.15.107:0/66070729 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fef44051510 con 0x55f4a2e1a7a0 2024-05-10T10:56:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.101+0000 7fef63ba0740 10 client.15453 fetch_fsmap learned FSMap version 27 2024-05-10T10:56:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.101+0000 7fef63ba0740 1 -- 172.21.15.107:0/66070729 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f4a2e99f80 con 0x55f4a2e1a7a0 2024-05-10T10:56:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.101+0000 7fef41ffb640 1 -- 172.21.15.107:0/66070729 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fef44057070 con 0x55f4a2e1a7a0 2024-05-10T10:56:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.101+0000 7fef41ffb640 1 -- 172.21.15.107:0/66070729 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fef44051ce0 con 0x55f4a2e1a7a0 2024-05-10T10:56:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.101+0000 7fef63ba0740 10 client.15453 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:56:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.101+0000 7fef63ba0740 10 client.15453 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:56:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.101+0000 7fef63ba0740 20 client.15453 populate_metadata read hostname 'smithi107' 2024-05-10T10:56:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.101+0000 7fef63ba0740 1 --2- 172.21.15.107:0/66070729 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f4a2e9a9b0 0x55f4a2e9cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.101+0000 7fef63ba0740 4 client.15453 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T10:56:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.101+0000 7fef63ba0740 1 -- 172.21.15.107:0/66070729 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f4a2d86050 con 0x55f4a2e9a9b0 2024-05-10T10:56:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.101+0000 7fef5259c640 1 --2- 172.21.15.107:0/66070729 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f4a2e9a9b0 0x55f4a2e9cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.102+0000 7fef41ffb640 10 client.15453 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.102+0000 7fef5259c640 1 --2- 172.21.15.107:0/66070729 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f4a2e9a9b0 0x55f4a2e9cdd0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=875c8801fa5aacf8 server_cookie=1aeccdc975c1f604 in_seq=0 out_seq=0 2024-05-10T10:56:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.105+0000 7fef41ffb640 1 -- 172.21.15.107:0/66070729 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f4a2d86050 con 0x55f4a2e9a9b0 2024-05-10T10:56:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.105+0000 7fef41ffb640 10 client.15453 handle_command_reply: tid=0 2024-05-10T10:56:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.105+0000 7fef63ba0740 1 client.15453 shutdown 2024-05-10T10:56:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef63ba0740 1 -- 172.21.15.107:0/66070729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e1a7a0 msgr2=0x55f4a2e28b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef63ba0740 1 --2- 172.21.15.107:0/66070729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e28b70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fef44051cb0 tx=0x7fef44005b50 comp rx=0 tx=0).stop 2024-05-10T10:56:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef63ba0740 1 -- 172.21.15.107:0/66070729 shutdown_connections 2024-05-10T10:56:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef63ba0740 1 --2- 172.21.15.107:0/66070729 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f4a2e9a9b0 0x55f4a2e9cdd0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef63ba0740 1 --2- 172.21.15.107:0/66070729 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f4a2e1f910 0x55f4a2e29b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef41ffb640 0 client.15453 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef63ba0740 1 --2- 172.21.15.107:0/66070729 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f4a2e1a7a0 0x55f4a2e28b70 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef63ba0740 1 --2- 172.21.15.107:0/66070729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4a2e19db0 0x55f4a2e28630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef63ba0740 1 -- 172.21.15.107:0/66070729 >> 172.21.15.107:0/66070729 conn(0x55f4a2e15420 msgr2=0x55f4a2e18330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef63ba0740 1 -- 172.21.15.107:0/66070729 shutdown_connections 2024-05-10T10:56:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef63ba0740 1 -- 172.21.15.107:0/66070729 wait complete. 2024-05-10T10:56:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef63ba0740 20 client.15453 trim_cache size 0 max 16384 2024-05-10T10:56:37.109 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:{ 2024-05-10T10:56:37.109 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "message": "", 2024-05-10T10:56:37.109 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "return_code": 0 2024-05-10T10:56:37.109 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:} 2024-05-10T10:56:37.110 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef60e85640 1 -- 172.21.15.107:0/3723614410 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fef480b2960 msgr2=0x7fef480b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:37.110 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef60e85640 1 --2- 172.21.15.107:0/3723614410 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fef480b2960 0x7fef480b4e20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fef44000c00 tx=0x7fef44031510 comp rx=0 tx=0).stop 2024-05-10T10:56:37.110 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef60e85640 1 -- 172.21.15.107:0/3723614410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c101910 msgr2=0x7fef5c06abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:37.110 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef60e85640 1 --2- 172.21.15.107:0/3723614410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c101910 0x7fef5c06abd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00d950 tx=0x7fef4c00de10 comp rx=0 tx=0).stop 2024-05-10T10:56:37.110 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef60e85640 1 -- 172.21.15.107:0/3723614410 shutdown_connections 2024-05-10T10:56:37.110 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef60e85640 1 --2- 172.21.15.107:0/3723614410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fef5c1034c0 0x7fef5c1a2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.110 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef60e85640 1 --2- 172.21.15.107:0/3723614410 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fef5c102b00 0x7fef5c19fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.110 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef60e85640 1 --2- 172.21.15.107:0/3723614410 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fef480b2960 0x7fef480b4e20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.110 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef60e85640 1 --2- 172.21.15.107:0/3723614410 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fef5c101910 0x7fef5c06abd0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:37.110 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef60e85640 1 -- 172.21.15.107:0/3723614410 >> 172.21.15.107:0/3723614410 conn(0x7fef5c0fce80 msgr2=0x7fef5c105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:37.111 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef60e85640 1 -- 172.21.15.107:0/3723614410 shutdown_connections 2024-05-10T10:56:37.111 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:37.106+0000 7fef60e85640 1 -- 172.21.15.107:0/3723614410 wait complete. 2024-05-10T10:56:37.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:37 smithi184 ceph-mon[34585]: pgmap v416: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-10T10:56:37.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:37 smithi107 ceph-mon[30373]: pgmap v416: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-10T10:56:37.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:37 smithi196 ceph-mon[34872]: pgmap v416: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-05-10T10:56:38.187 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:56:38.444 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:56:39.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:39 smithi107 ceph-mon[30373]: pgmap v417: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-10T10:56:39.175 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:39 smithi107 ceph-mon[30373]: mgrmap e20: x(active, since 11m), standbys: z, y 2024-05-10T10:56:39.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:39 smithi184 ceph-mon[34585]: pgmap v417: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-10T10:56:39.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:39 smithi184 ceph-mon[34585]: mgrmap e20: x(active, since 11m), standbys: z, y 2024-05-10T10:56:39.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:39 smithi196 ceph-mon[34872]: pgmap v417: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-10T10:56:39.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:39 smithi196 ceph-mon[34872]: mgrmap e20: x(active, since 11m), standbys: z, y 2024-05-10T10:56:40.354 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.351+0000 7f467dd6e700 1 -- 172.21.15.107:0/2929025751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4678102d50 msgr2=0x7f467810f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:40.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.351+0000 7f467dd6e700 1 --2- 172.21.15.107:0/2929025751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4678102d50 0x7f467810f240 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f467000b0a0 tx=0x7f467000b3b0 comp rx=0 tx=0).stop 2024-05-10T10:56:40.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.351+0000 7f467dd6e700 1 -- 172.21.15.107:0/2929025751 shutdown_connections 2024-05-10T10:56:40.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.351+0000 7f467dd6e700 1 --2- 172.21.15.107:0/2929025751 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4678102d50 0x7f467810f240 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:40.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.351+0000 7f467dd6e700 1 --2- 172.21.15.107:0/2929025751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4678108400 0x7f46781087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:40.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.351+0000 7f467dd6e700 1 --2- 172.21.15.107:0/2929025751 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4678102390 0x7f4678102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:40.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.351+0000 7f467dd6e700 1 -- 172.21.15.107:0/2929025751 >> 172.21.15.107:0/2929025751 conn(0x7f4678079310 msgr2=0x7f4678079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:40.355 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.351+0000 7f467dd6e700 1 -- 172.21.15.107:0/2929025751 shutdown_connections 2024-05-10T10:56:40.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.351+0000 7f467dd6e700 1 -- 172.21.15.107:0/2929025751 wait complete. 2024-05-10T10:56:40.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.351+0000 7f467dd6e700 1 Processor -- start 2024-05-10T10:56:40.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.352+0000 7f467dd6e700 1 -- start start 2024-05-10T10:56:40.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.352+0000 7f467dd6e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4678102390 0x7f467819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:40.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.352+0000 7f467dd6e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4678102d50 0x7f467819af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:40.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.352+0000 7f467dd6e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4678108400 0x7f46781a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:40.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.352+0000 7f467dd6e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4678112660 con 0x7f4678102d50 2024-05-10T10:56:40.356 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.352+0000 7f467dd6e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f46781124e0 con 0x7f4678108400 2024-05-10T10:56:40.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.352+0000 7f467dd6e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f46781127e0 con 0x7f4678102390 2024-05-10T10:56:40.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.352+0000 7f4676ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4678102d50 0x7f467819af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:40.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.352+0000 7f4676ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4678102d50 0x7f467819af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:48996/0 (socket says 172.21.15.107:48996) 2024-05-10T10:56:40.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.352+0000 7f4676ffd700 1 -- 172.21.15.107:0/2126536288 learned_addr learned my addr 172.21.15.107:0/2126536288 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:40.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.352+0000 7f4677fff700 1 --2- 172.21.15.107:0/2126536288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4678108400 0x7f46781a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:40.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.352+0000 7f46777fe700 1 --2- 172.21.15.107:0/2126536288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4678102390 0x7f467819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:40.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.352+0000 7f4676ffd700 1 -- 172.21.15.107:0/2126536288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4678102390 msgr2=0x7f467819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:40.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.352+0000 7f4676ffd700 1 --2- 172.21.15.107:0/2126536288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4678102390 0x7f467819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:40.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.352+0000 7f4676ffd700 1 -- 172.21.15.107:0/2126536288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4678108400 msgr2=0x7f46781a5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:40.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.352+0000 7f4676ffd700 1 --2- 172.21.15.107:0/2126536288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4678108400 0x7f46781a5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:40.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.352+0000 7f4676ffd700 1 -- 172.21.15.107:0/2126536288 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46781a5fa0 con 0x7f4678102d50 2024-05-10T10:56:40.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.353+0000 7f4676ffd700 1 --2- 172.21.15.107:0/2126536288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4678102d50 0x7f467819af20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f466c00c9b0 tx=0x7f466c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:40.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.353+0000 7f4674ff9700 1 -- 172.21.15.107:0/2126536288 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c007b00 con 0x7f4678102d50 2024-05-10T10:56:40.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.353+0000 7f467dd6e700 1 -- 172.21.15.107:0/2126536288 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46781a61d0 con 0x7f4678102d50 2024-05-10T10:56:40.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.353+0000 7f4674ff9700 1 -- 172.21.15.107:0/2126536288 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f466c007ca0 con 0x7f4678102d50 2024-05-10T10:56:40.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.353+0000 7f4674ff9700 1 -- 172.21.15.107:0/2126536288 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c018640 con 0x7f4678102d50 2024-05-10T10:56:40.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.353+0000 7f467dd6e700 1 -- 172.21.15.107:0/2126536288 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46781a6730 con 0x7f4678102d50 2024-05-10T10:56:40.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.354+0000 7f467dd6e700 1 -- 172.21.15.107:0/2126536288 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f467806a190 con 0x7f4678102d50 2024-05-10T10:56:40.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.355+0000 7f4674ff9700 1 -- 172.21.15.107:0/2126536288 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f466c0188a0 con 0x7f4678102d50 2024-05-10T10:56:40.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.356+0000 7f4674ff9700 1 --2- 172.21.15.107:0/2126536288 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f46600b2880 0x7f46600b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:40.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.356+0000 7f46777fe700 1 --2- 172.21.15.107:0/2126536288 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f46600b2880 0x7f46600b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:40.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.356+0000 7f4674ff9700 1 -- 172.21.15.107:0/2126536288 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f466c0e2210 con 0x7f4678102d50 2024-05-10T10:56:40.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.357+0000 7f46777fe700 1 --2- 172.21.15.107:0/2126536288 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f46600b2880 0x7f46600b4d40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4668005950 tx=0x7f46680058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:40.361 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.360+0000 7f4674ff9700 1 -- 172.21.15.107:0/2126536288 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f466c014030 con 0x7f4678102d50 2024-05-10T10:56:40.637 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.637+0000 7f467dd6e700 1 -- 172.21.15.107:0/2126536288 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f467802e510 con 0x7f4678102d50 2024-05-10T10:56:40.638 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.638+0000 7f4674ff9700 1 -- 172.21.15.107:0/2126536288 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11951 (secure 0 0 0) 0x7f466c0a9f30 con 0x7f4678102d50 2024-05-10T10:56:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:56:40.639 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T10:52:17.367732+0000","modified":"2024-05-10T10:55:30.125781+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24482,"mds_1":24449,"mds_2":24442,"mds_3":24431,"mds_4":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/2332963094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":2332963094},{"type":"v1","addr":"172.21.15.107:6841","nonce":2332963094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.184:6839/16501252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":16501252},{"type":"v1","addr":"172.21.15.184:6839","nonce":16501252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24430,24431,24482,24449,24442]},"id":1}]} 2024-05-10T10:56:40.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.640+0000 7f467dd6e700 1 -- 172.21.15.107:0/2126536288 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f46600b2880 msgr2=0x7f46600b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:40.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.640+0000 7f467dd6e700 1 --2- 172.21.15.107:0/2126536288 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f46600b2880 0x7f46600b4d40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4668005950 tx=0x7f46680058e0 comp rx=0 tx=0).stop 2024-05-10T10:56:40.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.640+0000 7f467dd6e700 1 -- 172.21.15.107:0/2126536288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4678102d50 msgr2=0x7f467819af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:40.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.640+0000 7f467dd6e700 1 --2- 172.21.15.107:0/2126536288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4678102d50 0x7f467819af20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f466c00c9b0 tx=0x7f466c00ccc0 comp rx=0 tx=0).stop 2024-05-10T10:56:40.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.640+0000 7f467dd6e700 1 -- 172.21.15.107:0/2126536288 shutdown_connections 2024-05-10T10:56:40.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.640+0000 7f467dd6e700 1 --2- 172.21.15.107:0/2126536288 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f46600b2880 0x7f46600b4d40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:40.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.640+0000 7f467dd6e700 1 --2- 172.21.15.107:0/2126536288 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4678102390 0x7f467819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:40.641 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.640+0000 7f467dd6e700 1 --2- 172.21.15.107:0/2126536288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4678108400 0x7f46781a5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:40.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.640+0000 7f467dd6e700 1 --2- 172.21.15.107:0/2126536288 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4678102d50 0x7f467819af20 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:40.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.640+0000 7f467dd6e700 1 -- 172.21.15.107:0/2126536288 >> 172.21.15.107:0/2126536288 conn(0x7f4678079310 msgr2=0x7f4678100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:40.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.641+0000 7f467dd6e700 1 -- 172.21.15.107:0/2126536288 shutdown_connections 2024-05-10T10:56:40.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:40.641+0000 7f467dd6e700 1 -- 172.21.15.107:0/2126536288 wait complete. 2024-05-10T10:56:40.642 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 27 2024-05-10T10:56:41.326 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:41 smithi107 ceph-mon[30373]: pgmap v418: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-10T10:56:41.326 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:41 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2126536288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:56:41.352 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24482 quiesce db --set-id 11076300 --release --await' 2024-05-10T10:56:41.352 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24482 quiesce db --set-id 11076300 --release --await 2024-05-10T10:56:41.388 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:41 smithi184 ceph-mon[34585]: pgmap v418: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-10T10:56:41.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:41 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/2126536288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:56:41.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:41 smithi196 ceph-mon[34872]: pgmap v418: 97 pgs: 97 active+clean; 677 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-10T10:56:41.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:41 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/2126536288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:56:41.611 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:56:43.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:43 smithi107 ceph-mon[30373]: pgmap v419: 97 pgs: 97 active+clean; 678 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-10T10:56:43.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:43 smithi184 ceph-mon[34585]: pgmap v419: 97 pgs: 97 active+clean; 678 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-10T10:56:43.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:43 smithi196 ceph-mon[34872]: pgmap v419: 97 pgs: 97 active+clean; 678 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-10T10:56:45.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:45 smithi184 ceph-mon[34585]: pgmap v420: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 853 B/s wr, 10 op/s 2024-05-10T10:56:45.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:45 smithi107 ceph-mon[30373]: pgmap v420: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 853 B/s wr, 10 op/s 2024-05-10T10:56:45.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:45 smithi196 ceph-mon[34872]: pgmap v420: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 853 B/s wr, 10 op/s 2024-05-10T10:56:46.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.915+0000 7f65333b0700 1 -- 172.21.15.107:0/1719112038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f652c102390 msgr2=0x7f652c102810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:46.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.915+0000 7f65333b0700 1 --2- 172.21.15.107:0/1719112038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f652c102390 0x7f652c102810 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f651c009990 tx=0x7f651c009ca0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.915+0000 7f65333b0700 1 -- 172.21.15.107:0/1719112038 shutdown_connections 2024-05-10T10:56:46.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.915+0000 7f65333b0700 1 --2- 172.21.15.107:0/1719112038 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f652c102d50 0x7f652c10f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.915+0000 7f65333b0700 1 --2- 172.21.15.107:0/1719112038 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f652c108400 0x7f652c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.915+0000 7f65333b0700 1 --2- 172.21.15.107:0/1719112038 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f652c102390 0x7f652c102810 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.915+0000 7f65333b0700 1 -- 172.21.15.107:0/1719112038 >> 172.21.15.107:0/1719112038 conn(0x7f652c079310 msgr2=0x7f652c079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:46.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.916+0000 7f65333b0700 1 -- 172.21.15.107:0/1719112038 shutdown_connections 2024-05-10T10:56:46.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.916+0000 7f65333b0700 1 -- 172.21.15.107:0/1719112038 wait complete. 2024-05-10T10:56:46.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.916+0000 7f65333b0700 1 Processor -- start 2024-05-10T10:56:46.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.916+0000 7f65333b0700 1 -- start start 2024-05-10T10:56:46.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.917+0000 7f65333b0700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f652c102390 0x7f652c19fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:46.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.917+0000 7f65333b0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f652c102d50 0x7f652c19ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:46.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.917+0000 7f65333b0700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f652c108400 0x7f652c199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:46.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.917+0000 7f65333b0700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f652c112690 con 0x7f652c108400 2024-05-10T10:56:46.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.917+0000 7f65333b0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f652c112510 con 0x7f652c102d50 2024-05-10T10:56:46.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.917+0000 7f65333b0700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f652c112810 con 0x7f652c102390 2024-05-10T10:56:46.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.917+0000 7f653194d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f652c108400 0x7f652c199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:46.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.917+0000 7f653194d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f652c108400 0x7f652c199b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49006/0 (socket says 172.21.15.107:49006) 2024-05-10T10:56:46.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.917+0000 7f653194d700 1 -- 172.21.15.107:0/1827808298 learned_addr learned my addr 172.21.15.107:0/1827808298 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:46.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.917+0000 7f653114c700 1 --2- 172.21.15.107:0/1827808298 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f652c102390 0x7f652c19fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:46.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.917+0000 7f653094b700 1 --2- 172.21.15.107:0/1827808298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f652c102d50 0x7f652c19ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:46.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.917+0000 7f653194d700 1 -- 172.21.15.107:0/1827808298 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f652c102390 msgr2=0x7f652c19fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:46.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.917+0000 7f653194d700 1 --2- 172.21.15.107:0/1827808298 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f652c102390 0x7f652c19fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.917+0000 7f653194d700 1 -- 172.21.15.107:0/1827808298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f652c102d50 msgr2=0x7f652c19ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:46.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.917+0000 7f653194d700 1 --2- 172.21.15.107:0/1827808298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f652c102d50 0x7f652c19ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.917+0000 7f653194d700 1 -- 172.21.15.107:0/1827808298 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c19a440 con 0x7f652c108400 2024-05-10T10:56:46.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.917+0000 7f653094b700 1 --2- 172.21.15.107:0/1827808298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f652c102d50 0x7f652c19ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:56:46.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.918+0000 7f653194d700 1 --2- 172.21.15.107:0/1827808298 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f652c108400 0x7f652c199b60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6524007ee0 tx=0x7f652400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:46.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.918+0000 7f65227fc700 1 -- 172.21.15.107:0/1827808298 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652400dbd0 con 0x7f652c108400 2024-05-10T10:56:46.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.918+0000 7f65333b0700 1 -- 172.21.15.107:0/1827808298 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652c19a730 con 0x7f652c108400 2024-05-10T10:56:46.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.918+0000 7f65227fc700 1 -- 172.21.15.107:0/1827808298 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f652400dd70 con 0x7f652c108400 2024-05-10T10:56:46.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.918+0000 7f65227fc700 1 -- 172.21.15.107:0/1827808298 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524005a50 con 0x7f652c108400 2024-05-10T10:56:46.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.918+0000 7f65333b0700 1 -- 172.21.15.107:0/1827808298 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f652c1a69c0 con 0x7f652c108400 2024-05-10T10:56:46.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.921+0000 7f65227fc700 1 -- 172.21.15.107:0/1827808298 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f652401a020 con 0x7f652c108400 2024-05-10T10:56:46.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.922+0000 7f65227fc700 1 --2- 172.21.15.107:0/1827808298 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f65180b2aa0 0x7f65180b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:46.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.922+0000 7f65227fc700 1 -- 172.21.15.107:0/1827808298 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f65240e19b0 con 0x7f652c108400 2024-05-10T10:56:46.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.922+0000 7f653114c700 1 --2- 172.21.15.107:0/1827808298 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f65180b2aa0 0x7f65180b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:46.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.923+0000 7f653114c700 1 --2- 172.21.15.107:0/1827808298 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f65180b2aa0 0x7f65180b4f60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6528007b60 tx=0x7f65280073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:46.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.923+0000 7f653dc43b80 1 Processor -- start 2024-05-10T10:56:46.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.923+0000 7f653dc43b80 1 -- start start 2024-05-10T10:56:46.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.924+0000 7f653dc43b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55998425b7c0 0x55998425bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:46.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.924+0000 7f653dc43b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984255a70 0x559984255ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:46.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.924+0000 7f653dc43b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559984256430 0x559984262580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:46.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.924+0000 7f653dc43b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5599841a7a40 con 0x559984255a70 2024-05-10T10:56:46.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.924+0000 7f653dc43b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55998410cea0 con 0x559984256430 2024-05-10T10:56:46.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.924+0000 7f653dc43b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5599841a3a00 con 0x55998425b7c0 2024-05-10T10:56:46.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.924+0000 7f653194d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559984256430 0x559984262580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:46.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.924+0000 7f653194d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559984256430 0x559984262580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.107:44252/0 (socket says 172.21.15.107:44252) 2024-05-10T10:56:46.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.924+0000 7f653194d700 1 -- 172.21.15.107:0/1544251031 learned_addr learned my addr 172.21.15.107:0/1544251031 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:46.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.924+0000 7f653114c700 1 --2- 172.21.15.107:0/1544251031 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55998425b7c0 0x55998425bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:46.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.924+0000 7f653094b700 1 --2- 172.21.15.107:0/1544251031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984255a70 0x559984255ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:46.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.924+0000 7f653114c700 1 -- 172.21.15.107:0/1544251031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559984256430 msgr2=0x559984262580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:46.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.924+0000 7f653114c700 1 --2- 172.21.15.107:0/1544251031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559984256430 0x559984262580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.924+0000 7f653114c700 1 -- 172.21.15.107:0/1544251031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984255a70 msgr2=0x559984255ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:46.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.924+0000 7f653114c700 1 --2- 172.21.15.107:0/1544251031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984255a70 0x559984255ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.924+0000 7f653114c700 1 -- 172.21.15.107:0/1544251031 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599840f49d0 con 0x55998425b7c0 2024-05-10T10:56:46.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.924+0000 7f653194d700 1 --2- 172.21.15.107:0/1544251031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559984256430 0x559984262580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:56:46.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.924+0000 7f653114c700 1 --2- 172.21.15.107:0/1544251031 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55998425b7c0 0x55998425bba0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6528010cd0 tx=0x7f6528013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ce1dc23ecf06daf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:46.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.925+0000 7f65177fe700 1 -- 172.21.15.107:0/1544251031 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6528004220 con 0x55998425b7c0 2024-05-10T10:56:46.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.925+0000 7f65177fe700 1 -- 172.21.15.107:0/1544251031 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6528011da0 con 0x55998425b7c0 2024-05-10T10:56:46.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.926+0000 7f65177fe700 1 -- 172.21.15.107:0/1544251031 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652801e420 con 0x55998425b7c0 2024-05-10T10:56:46.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.926+0000 7f653dc43b80 1 -- 172.21.15.107:0/1544251031 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55998425b7c0 msgr2=0x55998425bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:46.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.926+0000 7f653dc43b80 1 --2- 172.21.15.107:0/1544251031 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55998425b7c0 0x55998425bba0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6528010cd0 tx=0x7f6528013000 comp rx=0 tx=0).stop 2024-05-10T10:56:46.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.926+0000 7f653dc43b80 1 -- 172.21.15.107:0/1544251031 shutdown_connections 2024-05-10T10:56:46.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.926+0000 7f653dc43b80 1 --2- 172.21.15.107:0/1544251031 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55998425b7c0 0x55998425bba0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.926+0000 7f653dc43b80 1 --2- 172.21.15.107:0/1544251031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559984256430 0x559984262580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.926+0000 7f653dc43b80 1 --2- 172.21.15.107:0/1544251031 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984255a70 0x559984255ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.926+0000 7f653dc43b80 1 -- 172.21.15.107:0/1544251031 >> 172.21.15.107:0/1544251031 conn(0x559984181c70 msgr2=0x5599842507f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:46.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.926+0000 7f653dc43b80 1 -- 172.21.15.107:0/1544251031 shutdown_connections 2024-05-10T10:56:46.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.926+0000 7f653dc43b80 1 -- 172.21.15.107:0/1544251031 wait complete. 2024-05-10T10:56:46.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.926+0000 7f653dc43b80 1 -- start start 2024-05-10T10:56:46.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.926+0000 7f653dc43b80 1 Processor -- start 2024-05-10T10:56:46.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.927+0000 7f653dc43b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984255a70 0x559984262000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:46.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.927+0000 7f653dc43b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559984256430 0x559984262540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:46.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.927+0000 7f653dc43b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55998425b7c0 0x55998425f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:46.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.927+0000 7f653dc43b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x559984262ac0 con 0x559984255a70 2024-05-10T10:56:46.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.927+0000 7f653dc43b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559984160fd0 con 0x55998425b7c0 2024-05-10T10:56:46.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.927+0000 7f653dc43b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x559984262c40 con 0x559984256430 2024-05-10T10:56:46.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.927+0000 7f653dc43b80 10 client.0 _ll_register_callbacks cb 0x55998413b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:56:46.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.927+0000 7f653114c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984255a70 0x559984262000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:46.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.927+0000 7f653194d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55998425b7c0 0x55998425f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:46.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.927+0000 7f653114c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984255a70 0x559984262000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49020/0 (socket says 172.21.15.107:49020) 2024-05-10T10:56:46.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.927+0000 7f653114c700 1 -- 172.21.15.107:0/1206781194 learned_addr learned my addr 172.21.15.107:0/1206781194 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:46.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.927+0000 7f653094b700 1 --2- 172.21.15.107:0/1206781194 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559984256430 0x559984262540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:46.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.928+0000 7f653194d700 1 -- 172.21.15.107:0/1206781194 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559984256430 msgr2=0x559984262540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:46.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.928+0000 7f653194d700 1 --2- 172.21.15.107:0/1206781194 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559984256430 0x559984262540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.928+0000 7f653194d700 1 -- 172.21.15.107:0/1206781194 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984255a70 msgr2=0x559984262000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:46.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.928+0000 7f653194d700 1 --2- 172.21.15.107:0/1206781194 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984255a70 0x559984262000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.928+0000 7f653194d700 1 -- 172.21.15.107:0/1206781194 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55998415e860 con 0x55998425b7c0 2024-05-10T10:56:46.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.928+0000 7f653114c700 1 --2- 172.21.15.107:0/1206781194 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984255a70 0x559984262000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:56:46.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.928+0000 7f653194d700 1 --2- 172.21.15.107:0/1206781194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55998425b7c0 0x55998425f5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f65240a8cd0 tx=0x7f65240a9530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a33e50811337fced server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:46.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.928+0000 7f6514ff9700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-05-10T10:56:46.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.928+0000 7f6514ff9700 1 -- 172.21.15.107:0/1206781194 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652406d060 con 0x55998425b7c0 2024-05-10T10:56:46.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.928+0000 7f653dc43b80 1 -- 172.21.15.107:0/1206781194 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6528011da0 con 0x55998425b7c0 2024-05-10T10:56:46.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.928+0000 7f6514ff9700 1 -- 172.21.15.107:0/1206781194 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f65240a8440 con 0x55998425b7c0 2024-05-10T10:56:46.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.928+0000 7f6514ff9700 1 -- 172.21.15.107:0/1206781194 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f65240a96d0 con 0x55998425b7c0 2024-05-10T10:56:46.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.928+0000 7f653dc43b80 10 client.25058 fetch_fsmap learned FSMap version 27 2024-05-10T10:56:46.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.928+0000 7f653dc43b80 1 -- 172.21.15.107:0/1206781194 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55998426d1a0 con 0x55998425b7c0 2024-05-10T10:56:46.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.929+0000 7f6514ff9700 1 -- 172.21.15.107:0/1206781194 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6528011da0 con 0x55998425b7c0 2024-05-10T10:56:46.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.929+0000 7f6514ff9700 1 -- 172.21.15.107:0/1206781194 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f65240a7ca0 con 0x55998425b7c0 2024-05-10T10:56:46.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.929+0000 7f653dc43b80 10 client.25058 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:56:46.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.929+0000 7f653dc43b80 10 client.25058 resolve_mds: validated gid 24482 aka daemon mds.b 2024-05-10T10:56:46.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.929+0000 7f653dc43b80 20 client.25058 populate_metadata read hostname 'smithi107' 2024-05-10T10:56:46.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.929+0000 7f653dc43b80 1 --2- 172.21.15.107:0/1206781194 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55998426f670 0x559984271a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:46.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.929+0000 7f653dc43b80 4 client.25058 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:56:46.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.929+0000 7f653dc43b80 1 -- 172.21.15.107:0/1206781194 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599841b5420 con 0x55998426f670 2024-05-10T10:56:46.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.929+0000 7f653114c700 1 --2- 172.21.15.107:0/1206781194 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55998426f670 0x559984271a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:46.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.930+0000 7f6514ff9700 10 client.25058 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:46.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.930+0000 7f653114c700 1 --2- 172.21.15.107:0/1206781194 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55998426f670 0x559984271a60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1319059f531c93d9 server_cookie=eb4b980bb2ab9950 in_seq=0 out_seq=0 2024-05-10T10:56:46.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.931+0000 7f6514ff9700 1 -- 172.21.15.107:0/1206781194 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5599841b5420 con 0x55998426f670 2024-05-10T10:56:46.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.931+0000 7f6514ff9700 10 client.25058 handle_command_reply: tid=0 2024-05-10T10:56:46.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.931+0000 7f653dc43b80 1 client.25058 shutdown 2024-05-10T10:56:46.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.931+0000 7f653dc43b80 1 -- 172.21.15.107:0/1206781194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55998425b7c0 msgr2=0x55998425f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:46.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.931+0000 7f653dc43b80 1 --2- 172.21.15.107:0/1206781194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55998425b7c0 0x55998425f5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f65240a8cd0 tx=0x7f65240a9530 comp rx=0 tx=0).stop 2024-05-10T10:56:46.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.931+0000 7f653dc43b80 1 -- 172.21.15.107:0/1206781194 shutdown_connections 2024-05-10T10:56:46.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.931+0000 7f653dc43b80 1 --2- 172.21.15.107:0/1206781194 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55998426f670 0x559984271a60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.931+0000 7f6514ff9700 0 client.25058 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:46.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.931+0000 7f653dc43b80 1 --2- 172.21.15.107:0/1206781194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55998425b7c0 0x55998425f5a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.931+0000 7f653dc43b80 1 --2- 172.21.15.107:0/1206781194 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984255a70 0x559984262000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.931+0000 7f653dc43b80 1 --2- 172.21.15.107:0/1206781194 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559984256430 0x559984262540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.931+0000 7f653dc43b80 1 -- 172.21.15.107:0/1206781194 >> 172.21.15.107:0/1206781194 conn(0x559984181c70 msgr2=0x55998425ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:46.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.932+0000 7f653dc43b80 1 -- 172.21.15.107:0/1206781194 shutdown_connections 2024-05-10T10:56:46.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.932+0000 7f653dc43b80 1 -- 172.21.15.107:0/1206781194 wait complete. 2024-05-10T10:56:46.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.932+0000 7f653dc43b80 20 client.25058 trim_cache size 0 max 16384 2024-05-10T10:56:46.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.951+0000 7f653dc43b80 1 Processor -- start 2024-05-10T10:56:46.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.952+0000 7f653dc43b80 1 -- start start 2024-05-10T10:56:46.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.952+0000 7f653dc43b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559984255a70 0x559984255170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:46.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.952+0000 7f653dc43b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984256430 0x5599842772c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:46.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.952+0000 7f653dc43b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55998425b7c0 0x559984277800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:46.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.952+0000 7f653dc43b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f652c1aba90 con 0x559984256430 2024-05-10T10:56:46.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.952+0000 7f653dc43b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f652c1ad5d0 con 0x55998425b7c0 2024-05-10T10:56:46.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.952+0000 7f653dc43b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f652c1ac160 con 0x559984255a70 2024-05-10T10:56:46.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.952+0000 7f653094b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984256430 0x5599842772c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:46.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.952+0000 7f653094b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984256430 0x5599842772c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49036/0 (socket says 172.21.15.107:49036) 2024-05-10T10:56:46.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.952+0000 7f653094b700 1 -- 172.21.15.107:0/1239521266 learned_addr learned my addr 172.21.15.107:0/1239521266 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:46.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.952+0000 7f653194d700 1 --2- 172.21.15.107:0/1239521266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55998425b7c0 0x559984277800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:46.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.952+0000 7f653114c700 1 --2- 172.21.15.107:0/1239521266 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559984255a70 0x559984255170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:46.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.952+0000 7f653094b700 1 -- 172.21.15.107:0/1239521266 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559984255a70 msgr2=0x559984255170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:46.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.952+0000 7f653094b700 1 --2- 172.21.15.107:0/1239521266 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559984255a70 0x559984255170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.952+0000 7f653094b700 1 -- 172.21.15.107:0/1239521266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55998425b7c0 msgr2=0x559984277800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:46.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.952+0000 7f653094b700 1 --2- 172.21.15.107:0/1239521266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55998425b7c0 0x559984277800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.952+0000 7f653094b700 1 -- 172.21.15.107:0/1239521266 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55998425d930 con 0x559984256430 2024-05-10T10:56:46.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.953+0000 7f653094b700 1 --2- 172.21.15.107:0/1239521266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984256430 0x5599842772c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f651c0059d0 tx=0x7f651c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2711c8ff653bc72 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:46.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.953+0000 7f6516ffd700 1 -- 172.21.15.107:0/1239521266 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c029020 con 0x559984256430 2024-05-10T10:56:46.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.953+0000 7f6516ffd700 1 -- 172.21.15.107:0/1239521266 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f651c0055a0 con 0x559984256430 2024-05-10T10:56:46.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.953+0000 7f6516ffd700 1 -- 172.21.15.107:0/1239521266 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c00be20 con 0x559984256430 2024-05-10T10:56:46.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.954+0000 7f653dc43b80 1 -- 172.21.15.107:0/1239521266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984256430 msgr2=0x5599842772c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:46.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.954+0000 7f653dc43b80 1 --2- 172.21.15.107:0/1239521266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984256430 0x5599842772c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f651c0059d0 tx=0x7f651c0095c0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.954+0000 7f653dc43b80 1 -- 172.21.15.107:0/1239521266 shutdown_connections 2024-05-10T10:56:46.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.954+0000 7f653dc43b80 1 --2- 172.21.15.107:0/1239521266 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559984255a70 0x559984255170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.954+0000 7f653dc43b80 1 --2- 172.21.15.107:0/1239521266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55998425b7c0 0x559984277800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.954+0000 7f653dc43b80 1 --2- 172.21.15.107:0/1239521266 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984256430 0x5599842772c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.954+0000 7f653dc43b80 1 -- 172.21.15.107:0/1239521266 >> 172.21.15.107:0/1239521266 conn(0x559984181c70 msgr2=0x559984254a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:46.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.954+0000 7f653dc43b80 1 -- 172.21.15.107:0/1239521266 shutdown_connections 2024-05-10T10:56:46.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.954+0000 7f653dc43b80 1 -- 172.21.15.107:0/1239521266 wait complete. 2024-05-10T10:56:46.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.954+0000 7f653dc43b80 1 -- start start 2024-05-10T10:56:46.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.954+0000 7f653dc43b80 1 Processor -- start 2024-05-10T10:56:46.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.955+0000 7f653dc43b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984255a70 0x559984267cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:46.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.955+0000 7f653114c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984255a70 0x559984267cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:46.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.955+0000 7f653114c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984255a70 0x559984267cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49042/0 (socket says 172.21.15.107:49042) 2024-05-10T10:56:46.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.955+0000 7f653114c700 1 -- 172.21.15.107:0/2211679570 learned_addr learned my addr 172.21.15.107:0/2211679570 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:46.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.955+0000 7f653dc43b80 1 --2- 172.21.15.107:0/2211679570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559984256430 0x559984268200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:46.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.955+0000 7f653dc43b80 1 --2- 172.21.15.107:0/2211679570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55998425b7c0 0x5599842652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:46.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.955+0000 7f653dc43b80 1 -- 172.21.15.107:0/2211679570 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f652c1acf00 con 0x559984255a70 2024-05-10T10:56:46.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.955+0000 7f653dc43b80 1 -- 172.21.15.107:0/2211679570 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f652c1ac830 con 0x55998425b7c0 2024-05-10T10:56:46.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.955+0000 7f653dc43b80 1 -- 172.21.15.107:0/2211679570 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f652c1a9a30 con 0x559984256430 2024-05-10T10:56:46.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.955+0000 7f653dc43b80 10 client.0 _ll_register_callbacks cb 0x55998413b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:56:46.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.956+0000 7f653194d700 1 --2- 172.21.15.107:0/2211679570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55998425b7c0 0x5599842652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:46.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.956+0000 7f653094b700 1 --2- 172.21.15.107:0/2211679570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559984256430 0x559984268200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:46.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.956+0000 7f653114c700 1 -- 172.21.15.107:0/2211679570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559984256430 msgr2=0x559984268200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:46.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.956+0000 7f653114c700 1 --2- 172.21.15.107:0/2211679570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559984256430 0x559984268200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.956+0000 7f653114c700 1 -- 172.21.15.107:0/2211679570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55998425b7c0 msgr2=0x5599842652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:46.436 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.956+0000 7f653114c700 1 --2- 172.21.15.107:0/2211679570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55998425b7c0 0x5599842652b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.956+0000 7f653114c700 1 -- 172.21.15.107:0/2211679570 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559984265af0 con 0x559984255a70 2024-05-10T10:56:46.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.956+0000 7f653114c700 1 --2- 172.21.15.107:0/2211679570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984255a70 0x559984267cc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6528011720 tx=0x7f6528012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5454a321b0273b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:46.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.956+0000 7f6514ff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:56:46.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.956+0000 7f6514ff9700 1 -- 172.21.15.107:0/2211679570 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6528003920 con 0x559984255a70 2024-05-10T10:56:46.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.956+0000 7f653dc43b80 1 -- 172.21.15.107:0/2211679570 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f651c0055a0 con 0x559984255a70 2024-05-10T10:56:46.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.956+0000 7f6514ff9700 1 -- 172.21.15.107:0/2211679570 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f6528012e00 con 0x559984255a70 2024-05-10T10:56:46.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.956+0000 7f6514ff9700 1 -- 172.21.15.107:0/2211679570 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6528003bd0 con 0x559984255a70 2024-05-10T10:56:46.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.956+0000 7f653dc43b80 10 client.15477 fetch_fsmap learned FSMap version 27 2024-05-10T10:56:46.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.956+0000 7f653dc43b80 1 -- 172.21.15.107:0/2211679570 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5599842e4170 con 0x559984255a70 2024-05-10T10:56:46.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.957+0000 7f6514ff9700 1 -- 172.21.15.107:0/2211679570 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f651c0055a0 con 0x559984255a70 2024-05-10T10:56:46.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.957+0000 7f6514ff9700 1 -- 172.21.15.107:0/2211679570 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f65280336e0 con 0x559984255a70 2024-05-10T10:56:46.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.957+0000 7f653dc43b80 10 client.15477 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:56:46.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.957+0000 7f653dc43b80 10 client.15477 resolve_mds: validated gid 24482 aka daemon mds.b 2024-05-10T10:56:46.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.957+0000 7f653dc43b80 20 client.15477 populate_metadata read hostname 'smithi107' 2024-05-10T10:56:46.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.957+0000 7f653dc43b80 1 --2- 172.21.15.107:0/2211679570 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55998426f670 0x5599842e65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:46.438 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:56:46.438 INFO:teuthology.orchestra.run.smithi107.stdout: "epoch": 27, 2024-05-10T10:56:46.438 INFO:teuthology.orchestra.run.smithi107.stdout: "leader": 24482, 2024-05-10T10:56:46.438 INFO:teuthology.orchestra.run.smithi107.stdout: "set_version": 4, 2024-05-10T10:56:46.438 INFO:teuthology.orchestra.run.smithi107.stdout: "sets": { 2024-05-10T10:56:46.438 INFO:teuthology.orchestra.run.smithi107.stdout: "11076300": { 2024-05-10T10:56:46.438 INFO:teuthology.orchestra.run.smithi107.stdout: "version": 4, 2024-05-10T10:56:46.438 INFO:teuthology.orchestra.run.smithi107.stdout: "age_ref": 0.0, 2024-05-10T10:56:46.439 INFO:teuthology.orchestra.run.smithi107.stdout: "state": { 2024-05-10T10:56:46.439 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RELEASED", 2024-05-10T10:56:46.439 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0 2024-05-10T10:56:46.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T10:56:46.439 INFO:teuthology.orchestra.run.smithi107.stdout: "timeout": 60.0, 2024-05-10T10:56:46.439 INFO:teuthology.orchestra.run.smithi107.stdout: "expiration": 70.0, 2024-05-10T10:56:46.439 INFO:teuthology.orchestra.run.smithi107.stdout: "members": { 2024-05-10T10:56:46.439 INFO:teuthology.orchestra.run.smithi107.stdout: "file:/": { 2024-05-10T10:56:46.439 INFO:teuthology.orchestra.run.smithi107.stdout: "excluded": false, 2024-05-10T10:56:46.439 INFO:teuthology.orchestra.run.smithi107.stdout: "state": { 2024-05-10T10:56:46.439 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RELEASED", 2024-05-10T10:56:46.439 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0 2024-05-10T10:56:46.439 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:56:46.439 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:56:46.439 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:56:46.440 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:56:46.440 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:56:46.440 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:56:46.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.957+0000 7f653dc43b80 4 client.15477 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "11076300", "release": true, "await": true}] 2024-05-10T10:56:46.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.957+0000 7f653dc43b80 1 -- 172.21.15.107:0/2211679570 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "quiesce db", "set_id": "11076300", "release": true, "await": true}) -- 0x5599841af4c0 con 0x55998426f670 2024-05-10T10:56:46.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.957+0000 7f653094b700 1 --2- 172.21.15.107:0/2211679570 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55998426f670 0x5599842e65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:46.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.958+0000 7f6514ff9700 10 client.15477 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:46.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.958+0000 7f653094b700 1 --2- 172.21.15.107:0/2211679570 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55998426f670 0x5599842e65a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68a7247947fc2991 server_cookie=c330a840d22cfcd9 in_seq=0 out_seq=0 2024-05-10T10:56:46.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.960+0000 7f6514ff9700 1 -- 172.21.15.107:0/2211679570 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5599841af4c0 con 0x55998426f670 2024-05-10T10:56:46.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.960+0000 7f6514ff9700 10 client.15477 handle_command_reply: tid=0 2024-05-10T10:56:46.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.960+0000 7f653dc43b80 1 client.15477 shutdown 2024-05-10T10:56:46.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.960+0000 7f653dc43b80 1 -- 172.21.15.107:0/2211679570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984255a70 msgr2=0x559984267cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:46.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.960+0000 7f653dc43b80 1 --2- 172.21.15.107:0/2211679570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984255a70 0x559984267cc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6528011720 tx=0x7f6528012b60 comp rx=0 tx=0).stop 2024-05-10T10:56:46.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.960+0000 7f653dc43b80 1 -- 172.21.15.107:0/2211679570 shutdown_connections 2024-05-10T10:56:46.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.960+0000 7f653dc43b80 1 --2- 172.21.15.107:0/2211679570 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55998426f670 0x5599842e65a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.960+0000 7f653dc43b80 1 --2- 172.21.15.107:0/2211679570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55998425b7c0 0x5599842652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.960+0000 7f653dc43b80 1 --2- 172.21.15.107:0/2211679570 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x559984255a70 0x559984267cc0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.960+0000 7f653dc43b80 1 --2- 172.21.15.107:0/2211679570 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559984256430 0x559984268200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.960+0000 7f653dc43b80 1 -- 172.21.15.107:0/2211679570 >> 172.21.15.107:0/2211679570 conn(0x559984181c70 msgr2=0x5599842552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:46.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.960+0000 7f6514ff9700 0 client.15477 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:46.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.960+0000 7f653dc43b80 1 -- 172.21.15.107:0/2211679570 shutdown_connections 2024-05-10T10:56:46.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.960+0000 7f653dc43b80 1 -- 172.21.15.107:0/2211679570 wait complete. 2024-05-10T10:56:46.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.961+0000 7f653dc43b80 20 client.15477 trim_cache size 0 max 16384 2024-05-10T10:56:46.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.961+0000 7f65333b0700 1 -- 172.21.15.107:0/1827808298 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f65180b2aa0 msgr2=0x7f65180b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:46.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.961+0000 7f65333b0700 1 --2- 172.21.15.107:0/1827808298 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f65180b2aa0 0x7f65180b4f60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6528007b60 tx=0x7f65280073d0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.961+0000 7f65333b0700 1 -- 172.21.15.107:0/1827808298 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f652c108400 msgr2=0x7f652c199b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:46.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.961+0000 7f65333b0700 1 --2- 172.21.15.107:0/1827808298 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f652c108400 0x7f652c199b60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6524007ee0 tx=0x7f652400d3b0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.961+0000 7f65333b0700 1 -- 172.21.15.107:0/1827808298 shutdown_connections 2024-05-10T10:56:46.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.961+0000 7f65333b0700 1 --2- 172.21.15.107:0/1827808298 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f65180b2aa0 0x7f65180b4f60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.961+0000 7f65333b0700 1 --2- 172.21.15.107:0/1827808298 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f652c102390 0x7f652c19fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.961+0000 7f65333b0700 1 --2- 172.21.15.107:0/1827808298 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f652c108400 0x7f652c199b60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.961+0000 7f65333b0700 1 --2- 172.21.15.107:0/1827808298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f652c102d50 0x7f652c19ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:46.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.961+0000 7f65333b0700 1 -- 172.21.15.107:0/1827808298 >> 172.21.15.107:0/1827808298 conn(0x7f652c079310 msgr2=0x7f652c100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:46.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.962+0000 7f65333b0700 1 -- 172.21.15.107:0/1827808298 shutdown_connections 2024-05-10T10:56:46.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:56:45.962+0000 7f65333b0700 1 -- 172.21.15.107:0/1827808298 wait complete. 2024-05-10T10:56:47.253 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '11076300', seconds elapsed: 25.2 2024-05-10T10:56:47.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:47 smithi184 ceph-mon[34585]: pgmap v421: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 13 op/s 2024-05-10T10:56:47.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:47 smithi107 ceph-mon[30373]: pgmap v421: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 13 op/s 2024-05-10T10:56:47.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:47 smithi196 ceph-mon[34872]: pgmap v421: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 853 B/s wr, 13 op/s 2024-05-10T10:56:49.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:49 smithi184 ceph-mon[34585]: pgmap v422: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 853 B/s wr, 10 op/s 2024-05-10T10:56:49.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:49 smithi107 ceph-mon[30373]: pgmap v422: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 853 B/s wr, 10 op/s 2024-05-10T10:56:49.566 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:49 smithi196 ceph-mon[34872]: pgmap v422: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 853 B/s wr, 10 op/s 2024-05-10T10:56:50.228 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.225+0000 7fa3b6b22640 1 -- 172.21.15.107:0/3675289761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3b01034c0 msgr2=0x7fa3b0109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.225+0000 7fa3b6b22640 1 --2- 172.21.15.107:0/3675289761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3b01034c0 0x7fa3b0109d50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009ca0 tx=0x7fa3a802a8c0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.225+0000 7fa3b6b22640 1 -- 172.21.15.107:0/3675289761 shutdown_connections 2024-05-10T10:56:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.225+0000 7fa3b6b22640 1 --2- 172.21.15.107:0/3675289761 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3b01034c0 0x7fa3b0109d50 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.269 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.225+0000 7fa3b6b22640 1 --2- 172.21.15.107:0/3675289761 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3b0102b00 0x7fa3b0102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.225+0000 7fa3b6b22640 1 --2- 172.21.15.107:0/3675289761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3b0101910 0x7fa3b0101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.225+0000 7fa3b6b22640 1 -- 172.21.15.107:0/3675289761 >> 172.21.15.107:0/3675289761 conn(0x7fa3b00fce80 msgr2=0x7fa3b00ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.225+0000 7fa3b6b22640 1 -- 172.21.15.107:0/3675289761 shutdown_connections 2024-05-10T10:56:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.225+0000 7fa3b6b22640 1 -- 172.21.15.107:0/3675289761 wait complete. 2024-05-10T10:56:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.226+0000 7fa3b6b22640 1 Processor -- start 2024-05-10T10:56:50.270 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.226+0000 7fa3b6b22640 1 -- start start 2024-05-10T10:56:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.226+0000 7fa3b6b22640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3b0101910 0x7fa3b006abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.226+0000 7fa3b6b22640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3b0102b00 0x7fa3b019d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.226+0000 7fa3b6b22640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3b01034c0 0x7fa3b019ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.226+0000 7fa3b6b22640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b010d570 con 0x7fa3b01034c0 2024-05-10T10:56:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.226+0000 7fa3b6b22640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b010d3f0 con 0x7fa3b0102b00 2024-05-10T10:56:50.271 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.226+0000 7fa3b6b22640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b010d6f0 con 0x7fa3b0101910 2024-05-10T10:56:50.272 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.226+0000 7fa3b50bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3b01034c0 0x7fa3b019ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:50.272 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.226+0000 7fa3b50bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3b01034c0 0x7fa3b019ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59878/0 (socket says 172.21.15.107:59878) 2024-05-10T10:56:50.272 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.226+0000 7fa3b50bf640 1 -- 172.21.15.107:0/1618549193 learned_addr learned my addr 172.21.15.107:0/1618549193 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:50.272 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.226+0000 7fa3b48be640 1 --2- 172.21.15.107:0/1618549193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3b0101910 0x7fa3b006abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:50.272 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.227+0000 7fa3affff640 1 --2- 172.21.15.107:0/1618549193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3b0102b00 0x7fa3b019d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:50.272 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.227+0000 7fa3b50bf640 1 -- 172.21.15.107:0/1618549193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3b0101910 msgr2=0x7fa3b006abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:50.273 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.227+0000 7fa3b50bf640 1 --2- 172.21.15.107:0/1618549193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3b0101910 0x7fa3b006abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.273 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.227+0000 7fa3b50bf640 1 -- 172.21.15.107:0/1618549193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3b0102b00 msgr2=0x7fa3b019d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:50.273 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.227+0000 7fa3b50bf640 1 --2- 172.21.15.107:0/1618549193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3b0102b00 0x7fa3b019d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.273 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.227+0000 7fa3b50bf640 1 -- 172.21.15.107:0/1618549193 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b01a07f0 con 0x7fa3b01034c0 2024-05-10T10:56:50.273 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.227+0000 7fa3affff640 1 --2- 172.21.15.107:0/1618549193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3b0102b00 0x7fa3b019d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:56:50.273 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.227+0000 7fa3b50bf640 1 --2- 172.21.15.107:0/1618549193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3b01034c0 0x7fa3b019ff30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009dc0 tx=0x7fa3a802f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.227+0000 7fa3adffb640 1 -- 172.21.15.107:0/1618549193 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8003cf0 con 0x7fa3b01034c0 2024-05-10T10:56:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.227+0000 7fa3b6b22640 1 -- 172.21.15.107:0/1618549193 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b01a0a80 con 0x7fa3b01034c0 2024-05-10T10:56:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.227+0000 7fa3adffb640 1 -- 172.21.15.107:0/1618549193 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa3a8004510 con 0x7fa3b01034c0 2024-05-10T10:56:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.227+0000 7fa3adffb640 1 -- 172.21.15.107:0/1618549193 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a802fdb0 con 0x7fa3b01034c0 2024-05-10T10:56:50.274 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.228+0000 7fa3b6b22640 1 -- 172.21.15.107:0/1618549193 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b01a0fd0 con 0x7fa3b01034c0 2024-05-10T10:56:50.300 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.231+0000 7fa3b9835740 1 Processor -- start 2024-05-10T10:56:50.301 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.231+0000 7fa3adffb640 1 -- 172.21.15.107:0/1618549193 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7fa3a80046c0 con 0x7fa3b01034c0 2024-05-10T10:56:50.301 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.231+0000 7fa3b9835740 1 -- start start 2024-05-10T10:56:50.301 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.231+0000 7fa3b9835740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaec5c10 0x55f6eaec6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:50.301 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.231+0000 7fa3b9835740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec6600 0x55f6eaecaae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:50.301 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.231+0000 7fa3b9835740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaecb150 0x55f6eaecd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:50.301 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.231+0000 7fa3b9835740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f6eae215d0 con 0x55f6eaec5c10 2024-05-10T10:56:50.302 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.231+0000 7fa3b9835740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f6eadda890 con 0x55f6eaec6600 2024-05-10T10:56:50.302 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.231+0000 7fa3b9835740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f6eae1d590 con 0x55f6eaecb150 2024-05-10T10:56:50.302 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.231+0000 7fa3affff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaec5c10 0x55f6eaec6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:50.302 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.231+0000 7fa3affff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaec5c10 0x55f6eaec6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59886/0 (socket says 172.21.15.107:59886) 2024-05-10T10:56:50.302 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.231+0000 7fa3affff640 1 -- 172.21.15.107:0/322275969 learned_addr learned my addr 172.21.15.107:0/322275969 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:50.302 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.231+0000 7fa3b48be640 1 --2- 172.21.15.107:0/322275969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec6600 0x55f6eaecaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:50.302 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.231+0000 7fa3affff640 1 --2- 172.21.15.107:0/322275969 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaecb150 0x55f6eaecd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:50.303 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.232+0000 7fa3affff640 1 -- 172.21.15.107:0/322275969 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaecb150 msgr2=0x55f6eaecd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:50.303 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.232+0000 7fa3affff640 1 --2- 172.21.15.107:0/322275969 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaecb150 0x55f6eaecd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.303 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.232+0000 7fa3affff640 1 -- 172.21.15.107:0/322275969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec6600 msgr2=0x55f6eaecaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:50.303 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.232+0000 7fa3affff640 1 --2- 172.21.15.107:0/322275969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec6600 0x55f6eaecaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.303 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.232+0000 7fa3affff640 1 -- 172.21.15.107:0/322275969 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6eab33210 con 0x55f6eaec5c10 2024-05-10T10:56:50.303 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.232+0000 7fa3affff640 1 --2- 172.21.15.107:0/322275969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaec5c10 0x55f6eaec6030 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa39c012560 tx=0x7fa39c00a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412f24f5f78b98ec server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:50.304 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.232+0000 7fa3adffb640 1 --2- 172.21.15.107:0/1618549193 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa3a00b29a0 0x7fa3a00b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:50.304 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.232+0000 7fa39affd640 1 -- 172.21.15.107:0/322275969 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c018070 con 0x55f6eaec5c10 2024-05-10T10:56:50.304 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.232+0000 7fa3b48be640 1 --2- 172.21.15.107:0/1618549193 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa3a00b29a0 0x7fa3a00b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:50.304 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.232+0000 7fa3adffb640 1 -- 172.21.15.107:0/1618549193 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fa3a81038d0 con 0x7fa3b01034c0 2024-05-10T10:56:50.304 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.232+0000 7fa39affd640 1 -- 172.21.15.107:0/322275969 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa39c0056f0 con 0x55f6eaec5c10 2024-05-10T10:56:50.304 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.232+0000 7fa39affd640 1 -- 172.21.15.107:0/322275969 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c010920 con 0x55f6eaec5c10 2024-05-10T10:56:50.304 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.233+0000 7fa3b9835740 1 -- 172.21.15.107:0/322275969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaec5c10 msgr2=0x55f6eaec6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:50.304 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.233+0000 7fa3b48be640 1 --2- 172.21.15.107:0/1618549193 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa3a00b29a0 0x7fa3a00b4e60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55f6eaebc150 tx=0x7fa3a400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:50.305 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.233+0000 7fa3b9835740 1 --2- 172.21.15.107:0/322275969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaec5c10 0x55f6eaec6030 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa39c012560 tx=0x7fa39c00a6f0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.305 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.233+0000 7fa3b9835740 1 -- 172.21.15.107:0/322275969 shutdown_connections 2024-05-10T10:56:50.305 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.233+0000 7fa3b9835740 1 --2- 172.21.15.107:0/322275969 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaecb150 0x55f6eaecd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.305 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.233+0000 7fa3b9835740 1 --2- 172.21.15.107:0/322275969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec6600 0x55f6eaecaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.305 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.233+0000 7fa3b9835740 1 --2- 172.21.15.107:0/322275969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaec5c10 0x55f6eaec6030 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.305 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.233+0000 7fa3b9835740 1 -- 172.21.15.107:0/322275969 >> 172.21.15.107:0/322275969 conn(0x55f6eaeb83a0 msgr2=0x55f6eaeb87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:50.305 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.233+0000 7fa3b9835740 1 -- 172.21.15.107:0/322275969 shutdown_connections 2024-05-10T10:56:50.305 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.233+0000 7fa3b9835740 1 -- 172.21.15.107:0/322275969 wait complete. 2024-05-10T10:56:50.306 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.234+0000 7fa3b9835740 1 -- start start 2024-05-10T10:56:50.306 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.234+0000 7fa3b9835740 1 Processor -- start 2024-05-10T10:56:50.306 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.234+0000 7fa3b9835740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec5c10 0x55f6eaecf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:50.306 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.234+0000 7fa3b9835740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaec6600 0x55f6eaecfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:50.306 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.234+0000 7fa3b9835740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaecb150 0x55f6eaed6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:50.306 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.234+0000 7fa3b9835740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f6eaece0c0 con 0x55f6eaecb150 2024-05-10T10:56:50.306 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.234+0000 7fa3b9835740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f6eadde370 con 0x55f6eaec5c10 2024-05-10T10:56:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.234+0000 7fa3b9835740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55f6eaece240 con 0x55f6eaec6600 2024-05-10T10:56:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.234+0000 7fa3b9835740 10 client.0 _ll_register_callbacks cb 0x55f6eab32a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:56:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.234+0000 7fa3b50bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaecb150 0x55f6eaed6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.234+0000 7fa3b50bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaecb150 0x55f6eaed6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59888/0 (socket says 172.21.15.107:59888) 2024-05-10T10:56:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.234+0000 7fa3b50bf640 1 -- 172.21.15.107:0/1795099450 learned_addr learned my addr 172.21.15.107:0/1795099450 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.234+0000 7fa3affff640 1 --2- 172.21.15.107:0/1795099450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaec6600 0x55f6eaecfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.234+0000 7fa3b48be640 1 --2- 172.21.15.107:0/1795099450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec5c10 0x55f6eaecf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.235+0000 7fa3b50bf640 1 -- 172.21.15.107:0/1795099450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaec6600 msgr2=0x55f6eaecfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.235+0000 7fa3b50bf640 1 --2- 172.21.15.107:0/1795099450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaec6600 0x55f6eaecfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.235+0000 7fa3b50bf640 1 -- 172.21.15.107:0/1795099450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec5c10 msgr2=0x55f6eaecf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.235+0000 7fa3b50bf640 1 --2- 172.21.15.107:0/1795099450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec5c10 0x55f6eaecf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.235+0000 7fa3b50bf640 1 -- 172.21.15.107:0/1795099450 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6eabff620 con 0x55f6eaecb150 2024-05-10T10:56:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.235+0000 7fa3b50bf640 1 --2- 172.21.15.107:0/1795099450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaecb150 0x55f6eaed6d70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80c6f70 tx=0x7fa3a80ca8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3a87e4bc76eccf server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.235+0000 7fa38ffff640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:56:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.235+0000 7fa38ffff640 1 -- 172.21.15.107:0/1795099450 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a80cb5f0 con 0x55f6eaecb150 2024-05-10T10:56:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.235+0000 7fa38ffff640 1 -- 172.21.15.107:0/1795099450 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fa3a80c7180 con 0x55f6eaecb150 2024-05-10T10:56:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.235+0000 7fa3b9835740 1 -- 172.21.15.107:0/1795099450 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f6eae2f1e0 con 0x55f6eaecb150 2024-05-10T10:56:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.235+0000 7fa38ffff640 1 -- 172.21.15.107:0/1795099450 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa3a80caef0 con 0x55f6eaecb150 2024-05-10T10:56:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.235+0000 7fa3b9835740 10 client.15489 fetch_fsmap learned FSMap version 27 2024-05-10T10:56:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.235+0000 7fa3b9835740 1 -- 172.21.15.107:0/1795099450 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f6eaece0c0 con 0x55f6eaecb150 2024-05-10T10:56:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.235+0000 7fa38ffff640 1 -- 172.21.15.107:0/1795099450 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x55f6eae2f1e0 con 0x55f6eaecb150 2024-05-10T10:56:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.236+0000 7fa38ffff640 1 -- 172.21.15.107:0/1795099450 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fa3a80d39b0 con 0x55f6eaecb150 2024-05-10T10:56:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.236+0000 7fa3b9835740 10 client.15489 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:56:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.236+0000 7fa3b9835740 10 client.15489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:56:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.236+0000 7fa3b9835740 20 client.15489 populate_metadata read hostname 'smithi107' 2024-05-10T10:56:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.236+0000 7fa3b9835740 1 --2- 172.21.15.107:0/1795099450 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f6eaedb290 0x55f6eaedd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.236+0000 7fa3b9835740 4 client.15489 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:56:50.309 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.236+0000 7fa3b9835740 1 -- 172.21.15.107:0/1795099450 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6eae29050 con 0x55f6eaedb290 2024-05-10T10:56:50.309 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.237+0000 7fa3b48be640 1 --2- 172.21.15.107:0/1795099450 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f6eaedb290 0x55f6eaedd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:50.309 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.237+0000 7fa38ffff640 10 client.15489 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:50.309 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.237+0000 7fa3b48be640 1 --2- 172.21.15.107:0/1795099450 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f6eaedb290 0x55f6eaedd6d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=205789d1a4d4af88 server_cookie=92786a3ef52f54ff in_seq=0 out_seq=0 2024-05-10T10:56:50.309 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.238+0000 7fa38ffff640 1 -- 172.21.15.107:0/1795099450 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f6eae29050 con 0x55f6eaedb290 2024-05-10T10:56:50.309 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.238+0000 7fa38ffff640 10 client.15489 handle_command_reply: tid=0 2024-05-10T10:56:50.309 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.238+0000 7fa3b9835740 1 client.15489 shutdown 2024-05-10T10:56:50.309 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.238+0000 7fa3b9835740 1 -- 172.21.15.107:0/1795099450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaecb150 msgr2=0x55f6eaed6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:50.309 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.238+0000 7fa3b9835740 1 --2- 172.21.15.107:0/1795099450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaecb150 0x55f6eaed6d70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80c6f70 tx=0x7fa3a80ca8c0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.309 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.238+0000 7fa3b9835740 1 -- 172.21.15.107:0/1795099450 shutdown_connections 2024-05-10T10:56:50.309 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.238+0000 7fa3b9835740 1 --2- 172.21.15.107:0/1795099450 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f6eaedb290 0x55f6eaedd6d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.238+0000 7fa3b9835740 1 --2- 172.21.15.107:0/1795099450 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaecb150 0x55f6eaed6d70 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.238+0000 7fa3b9835740 1 --2- 172.21.15.107:0/1795099450 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaec6600 0x55f6eaecfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.238+0000 7fa3b9835740 1 --2- 172.21.15.107:0/1795099450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec5c10 0x55f6eaecf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.238+0000 7fa38ffff640 0 client.15489 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.238+0000 7fa3b9835740 1 -- 172.21.15.107:0/1795099450 >> 172.21.15.107:0/1795099450 conn(0x55f6eaeb83a0 msgr2=0x55f6eaec52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.238+0000 7fa3b9835740 1 -- 172.21.15.107:0/1795099450 shutdown_connections 2024-05-10T10:56:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.238+0000 7fa3b9835740 1 -- 172.21.15.107:0/1795099450 wait complete. 2024-05-10T10:56:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.238+0000 7fa3b9835740 20 client.15489 trim_cache size 0 max 16384 2024-05-10T10:56:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.253+0000 7fa3b9835740 1 Processor -- start 2024-05-10T10:56:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.253+0000 7fa3b9835740 1 -- start start 2024-05-10T10:56:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.253+0000 7fa3b9835740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaec5c10 0x55f6eaec7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:50.311 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.253+0000 7fa3b9835740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec6600 0x55f6eaec77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:50.311 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.253+0000 7fa3b9835740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaecb150 0x55f6eaeb6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:50.311 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.253+0000 7fa3b9835740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b01a7930 con 0x55f6eaecb150 2024-05-10T10:56:50.311 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.253+0000 7fa3b9835740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b01a9470 con 0x55f6eaec6600 2024-05-10T10:56:50.311 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.253+0000 7fa3b9835740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b01a8000 con 0x55f6eaec5c10 2024-05-10T10:56:50.311 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.254+0000 7fa3b50bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaecb150 0x55f6eaeb6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:50.311 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.254+0000 7fa3affff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec6600 0x55f6eaec77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:50.311 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.254+0000 7fa3affff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec6600 0x55f6eaec77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.107:54080/0 (socket says 172.21.15.107:54080) 2024-05-10T10:56:50.311 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.254+0000 7fa3b50bf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaecb150 0x55f6eaeb6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59896/0 (socket says 172.21.15.107:59896) 2024-05-10T10:56:50.311 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.254+0000 7fa3affff640 1 -- 172.21.15.107:0/3770433696 learned_addr learned my addr 172.21.15.107:0/3770433696 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:50.311 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.254+0000 7fa3b48be640 1 --2- 172.21.15.107:0/3770433696 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaec5c10 0x55f6eaec7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:50.311 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.254+0000 7fa3b50bf640 1 -- 172.21.15.107:0/3770433696 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaec5c10 msgr2=0x55f6eaec7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:50.311 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.254+0000 7fa3b50bf640 1 --2- 172.21.15.107:0/3770433696 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaec5c10 0x55f6eaec7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.254+0000 7fa3b50bf640 1 -- 172.21.15.107:0/3770433696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec6600 msgr2=0x55f6eaec77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.254+0000 7fa3b50bf640 1 --2- 172.21.15.107:0/3770433696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec6600 0x55f6eaec77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.254+0000 7fa3b50bf640 1 -- 172.21.15.107:0/3770433696 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6eaeddd50 con 0x55f6eaecb150 2024-05-10T10:56:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.254+0000 7fa3b48be640 1 --2- 172.21.15.107:0/3770433696 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaec5c10 0x55f6eaec7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:56:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.254+0000 7fa3affff640 1 --2- 172.21.15.107:0/3770433696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec6600 0x55f6eaec77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:56:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.254+0000 7fa3b50bf640 1 --2- 172.21.15.107:0/3770433696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaecb150 0x55f6eaeb6cf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80ca150 tx=0x7fa3a80c6db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f5f2a6d4460f0d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.254+0000 7fa39a7fc640 1 -- 172.21.15.107:0/3770433696 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a80aa070 con 0x55f6eaecb150 2024-05-10T10:56:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.254+0000 7fa39a7fc640 1 -- 172.21.15.107:0/3770433696 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa3a8036040 con 0x55f6eaecb150 2024-05-10T10:56:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.254+0000 7fa39a7fc640 1 -- 172.21.15.107:0/3770433696 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a80ca450 con 0x55f6eaecb150 2024-05-10T10:56:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.255+0000 7fa3b9835740 1 -- 172.21.15.107:0/3770433696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaecb150 msgr2=0x55f6eaeb6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.255+0000 7fa3b9835740 1 --2- 172.21.15.107:0/3770433696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaecb150 0x55f6eaeb6cf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80ca150 tx=0x7fa3a80c6db0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.255+0000 7fa3b9835740 1 -- 172.21.15.107:0/3770433696 shutdown_connections 2024-05-10T10:56:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.255+0000 7fa3b9835740 1 --2- 172.21.15.107:0/3770433696 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaecb150 0x55f6eaeb6cf0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.255+0000 7fa3b9835740 1 --2- 172.21.15.107:0/3770433696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec6600 0x55f6eaec77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.255+0000 7fa3b9835740 1 --2- 172.21.15.107:0/3770433696 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaec5c10 0x55f6eaec7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.255+0000 7fa3b9835740 1 -- 172.21.15.107:0/3770433696 >> 172.21.15.107:0/3770433696 conn(0x55f6eaeb83a0 msgr2=0x55f6eaeb33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.255+0000 7fa3b9835740 1 -- 172.21.15.107:0/3770433696 shutdown_connections 2024-05-10T10:56:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.255+0000 7fa3b9835740 1 -- 172.21.15.107:0/3770433696 wait complete. 2024-05-10T10:56:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.255+0000 7fa3b9835740 1 -- start start 2024-05-10T10:56:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.256+0000 7fa3b9835740 1 Processor -- start 2024-05-10T10:56:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.256+0000 7fa3b9835740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec5c10 0x55f6eaed3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.256+0000 7fa3b9835740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaec6600 0x55f6eaed4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.256+0000 7fa3affff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaec6600 0x55f6eaed4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.256+0000 7fa3affff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaec6600 0x55f6eaed4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:59904/0 (socket says 172.21.15.107:59904) 2024-05-10T10:56:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.256+0000 7fa3affff640 1 -- 172.21.15.107:0/3513814519 learned_addr learned my addr 172.21.15.107:0/3513814519 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:56:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.256+0000 7fa3b9835740 1 --2- 172.21.15.107:0/3513814519 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaecb150 0x55f6eaed5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.256+0000 7fa3b9835740 1 -- 172.21.15.107:0/3513814519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b01a8da0 con 0x55f6eaec6600 2024-05-10T10:56:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.256+0000 7fa3b48be640 1 --2- 172.21.15.107:0/3513814519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec5c10 0x55f6eaed3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.256+0000 7fa3b9835740 1 -- 172.21.15.107:0/3513814519 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b01a86d0 con 0x55f6eaec5c10 2024-05-10T10:56:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.256+0000 7fa3b9835740 1 -- 172.21.15.107:0/3513814519 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b01a5910 con 0x55f6eaecb150 2024-05-10T10:56:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.257+0000 7fa3b9835740 10 client.0 _ll_register_callbacks cb 0x7fa3a802ff70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:56:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.257+0000 7fa3affff640 1 -- 172.21.15.107:0/3513814519 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaecb150 msgr2=0x55f6eaed5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.257+0000 7fa3affff640 1 --2- 172.21.15.107:0/3513814519 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaecb150 0x55f6eaed5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.257+0000 7fa3affff640 1 -- 172.21.15.107:0/3513814519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec5c10 msgr2=0x55f6eaed3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:56:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.257+0000 7fa3affff640 1 --2- 172.21.15.107:0/3513814519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec5c10 0x55f6eaed3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.257+0000 7fa3affff640 1 -- 172.21.15.107:0/3513814519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6eaed5620 con 0x55f6eaec6600 2024-05-10T10:56:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.257+0000 7fa3affff640 1 --2- 172.21.15.107:0/3513814519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaec6600 0x55f6eaed4020 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa39c015040 tx=0x7fa39c00afb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a71ca78ff95e66 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:56:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.257+0000 7fa38ffff640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:56:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.257+0000 7fa38ffff640 1 -- 172.21.15.107:0/3513814519 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c018040 con 0x55f6eaec6600 2024-05-10T10:56:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.257+0000 7fa38ffff640 1 -- 172.21.15.107:0/3513814519 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fa39c004890 con 0x55f6eaec6600 2024-05-10T10:56:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.257+0000 7fa3b9835740 1 -- 172.21.15.107:0/3513814519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3a8036040 con 0x55f6eaec6600 2024-05-10T10:56:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.258+0000 7fa38ffff640 1 -- 172.21.15.107:0/3513814519 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa39c004a90 con 0x55f6eaec6600 2024-05-10T10:56:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.258+0000 7fa3b9835740 10 client.15495 fetch_fsmap learned FSMap version 27 2024-05-10T10:56:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.258+0000 7fa3b9835740 1 -- 172.21.15.107:0/3513814519 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f6eaf45b90 con 0x55f6eaec6600 2024-05-10T10:56:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.258+0000 7fa38ffff640 1 -- 172.21.15.107:0/3513814519 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa39c02c070 con 0x55f6eaec6600 2024-05-10T10:56:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.258+0000 7fa38ffff640 1 -- 172.21.15.107:0/3513814519 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fa39c00f040 con 0x55f6eaec6600 2024-05-10T10:56:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.258+0000 7fa3b9835740 10 client.15495 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:56:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.258+0000 7fa3b9835740 10 client.15495 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:56:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.258+0000 7fa3b9835740 20 client.15495 populate_metadata read hostname 'smithi107' 2024-05-10T10:56:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.258+0000 7fa3b9835740 1 --2- 172.21.15.107:0/3513814519 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f6eaf46250 0x55f6eaf48670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:56:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.258+0000 7fa3b9835740 4 client.15495 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T10:56:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.258+0000 7fa3b9835740 1 -- 172.21.15.107:0/3513814519 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fa3a8036040 con 0x55f6eaf46250 2024-05-10T10:56:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.258+0000 7fa3b48be640 1 --2- 172.21.15.107:0/3513814519 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f6eaf46250 0x55f6eaf48670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:56:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.259+0000 7fa38ffff640 10 client.15495 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.259+0000 7fa3b48be640 1 --2- 172.21.15.107:0/3513814519 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f6eaf46250 0x55f6eaf48670 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97c4cef794cee143 server_cookie=83dedbca28e63933 in_seq=0 out_seq=0 2024-05-10T10:56:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.264+0000 7fa38ffff640 1 -- 172.21.15.107:0/3513814519 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fa3a8036040 con 0x55f6eaf46250 2024-05-10T10:56:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.264+0000 7fa38ffff640 10 client.15495 handle_command_reply: tid=0 2024-05-10T10:56:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.264+0000 7fa3b9835740 1 client.15495 shutdown 2024-05-10T10:56:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.264+0000 7fa3b9835740 1 -- 172.21.15.107:0/3513814519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaec6600 msgr2=0x55f6eaed4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.264+0000 7fa3b9835740 1 --2- 172.21.15.107:0/3513814519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaec6600 0x55f6eaed4020 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa39c015040 tx=0x7fa39c00afb0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.265+0000 7fa3b9835740 1 -- 172.21.15.107:0/3513814519 shutdown_connections 2024-05-10T10:56:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.265+0000 7fa3b9835740 1 --2- 172.21.15.107:0/3513814519 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55f6eaf46250 0x55f6eaf48670 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.265+0000 7fa3b9835740 1 --2- 172.21.15.107:0/3513814519 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55f6eaecb150 0x55f6eaed5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.265+0000 7fa3b9835740 1 --2- 172.21.15.107:0/3513814519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f6eaec6600 0x55f6eaed4020 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.265+0000 7fa3b9835740 1 --2- 172.21.15.107:0/3513814519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f6eaec5c10 0x55f6eaed3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.265+0000 7fa3b9835740 1 -- 172.21.15.107:0/3513814519 >> 172.21.15.107:0/3513814519 conn(0x55f6eaeb83a0 msgr2=0x55f6eaecf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.265+0000 7fa38ffff640 0 client.15495 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:56:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.265+0000 7fa3b9835740 1 -- 172.21.15.107:0/3513814519 shutdown_connections 2024-05-10T10:56:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.265+0000 7fa3b9835740 1 -- 172.21.15.107:0/3513814519 wait complete. 2024-05-10T10:56:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.265+0000 7fa3b9835740 20 client.15495 trim_cache size 0 max 16384 2024-05-10T10:56:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:{ 2024-05-10T10:56:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "message": "", 2024-05-10T10:56:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "return_code": 0 2024-05-10T10:56:50.317 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:} 2024-05-10T10:56:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.265+0000 7fa3b6b22640 1 -- 172.21.15.107:0/1618549193 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa3a00b29a0 msgr2=0x7fa3a00b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.265+0000 7fa3b6b22640 1 --2- 172.21.15.107:0/1618549193 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa3a00b29a0 0x7fa3a00b4e60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55f6eaebc150 tx=0x7fa3a400b390 comp rx=0 tx=0).stop 2024-05-10T10:56:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.265+0000 7fa3b6b22640 1 -- 172.21.15.107:0/1618549193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3b01034c0 msgr2=0x7fa3b019ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:56:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.265+0000 7fa3b6b22640 1 --2- 172.21.15.107:0/1618549193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3b01034c0 0x7fa3b019ff30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009dc0 tx=0x7fa3a802f460 comp rx=0 tx=0).stop 2024-05-10T10:56:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.266+0000 7fa3b6b22640 1 -- 172.21.15.107:0/1618549193 shutdown_connections 2024-05-10T10:56:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.266+0000 7fa3b6b22640 1 --2- 172.21.15.107:0/1618549193 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fa3a00b29a0 0x7fa3a00b4e60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.318 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.266+0000 7fa3b6b22640 1 --2- 172.21.15.107:0/1618549193 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3b01034c0 0x7fa3b019ff30 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.266+0000 7fa3b6b22640 1 --2- 172.21.15.107:0/1618549193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3b0102b00 0x7fa3b019d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.266+0000 7fa3b6b22640 1 --2- 172.21.15.107:0/1618549193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa3b0101910 0x7fa3b006abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:56:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.266+0000 7fa3b6b22640 1 -- 172.21.15.107:0/1618549193 >> 172.21.15.107:0/1618549193 conn(0x7fa3b00fce80 msgr2=0x7fa3b0105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:56:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.266+0000 7fa3b6b22640 1 -- 172.21.15.107:0/1618549193 shutdown_connections 2024-05-10T10:56:50.319 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:56:50.266+0000 7fa3b6b22640 1 -- 172.21.15.107:0/1618549193 wait complete. 2024-05-10T10:56:51.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:51 smithi184 ceph-mon[34585]: pgmap v423: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 11 op/s 2024-05-10T10:56:51.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:51 smithi107 ceph-mon[30373]: pgmap v423: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 11 op/s 2024-05-10T10:56:51.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:51 smithi196 ceph-mon[34872]: pgmap v423: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 11 op/s 2024-05-10T10:56:53.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:53 smithi184 ceph-mon[34585]: pgmap v424: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-10T10:56:53.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:53 smithi107 ceph-mon[30373]: pgmap v424: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-10T10:56:53.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:53 smithi196 ceph-mon[34872]: pgmap v424: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-10T10:56:55.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:55 smithi184 ceph-mon[34585]: pgmap v425: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-10T10:56:55.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:55 smithi107 ceph-mon[30373]: pgmap v425: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-10T10:56:55.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:55 smithi196 ceph-mon[34872]: pgmap v425: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-10T10:56:57.388 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:57 smithi184 ceph-mon[34585]: pgmap v426: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-10T10:56:57.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:57 smithi107 ceph-mon[30373]: pgmap v426: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-10T10:56:57.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:57 smithi196 ceph-mon[34872]: pgmap v426: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-10T10:56:59.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:56:59 smithi184 ceph-mon[34585]: pgmap v427: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:56:59.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:56:59 smithi107 ceph-mon[30373]: pgmap v427: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:56:59.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:56:59 smithi196 ceph-mon[34872]: pgmap v427: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:57:01.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:01 smithi184 ceph-mon[34585]: pgmap v428: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-10T10:57:01.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:01 smithi107 ceph-mon[30373]: pgmap v428: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-10T10:57:01.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:01 smithi196 ceph-mon[34872]: pgmap v428: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-10T10:57:03.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:03 smithi184 ceph-mon[34585]: pgmap v429: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T10:57:03.402 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.401+0000 7f058d786640 1 -- 172.21.15.107:0/576989741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0588101930 msgr2=0x7f0588101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:03.402 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.401+0000 7f058d786640 1 --2- 172.21.15.107:0/576989741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0588101930 0x7f0588101d50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0578009900 tx=0x7f057802a410 comp rx=0 tx=0).stop 2024-05-10T10:57:03.402 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.401+0000 7f058d786640 1 -- 172.21.15.107:0/576989741 shutdown_connections 2024-05-10T10:57:03.402 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.401+0000 7f058d786640 1 --2- 172.21.15.107:0/576989741 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05881034e0 0x7f0588109d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.402 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.401+0000 7f058d786640 1 --2- 172.21.15.107:0/576989741 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0588102b20 0x7f0588102fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.402 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.401+0000 7f058d786640 1 --2- 172.21.15.107:0/576989741 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0588101930 0x7f0588101d50 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.402 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.401+0000 7f058d786640 1 -- 172.21.15.107:0/576989741 >> 172.21.15.107:0/576989741 conn(0x7f05880fcec0 msgr2=0x7f05880ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.401+0000 7f058d786640 1 -- 172.21.15.107:0/576989741 shutdown_connections 2024-05-10T10:57:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.401+0000 7f058d786640 1 -- 172.21.15.107:0/576989741 wait complete. 2024-05-10T10:57:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.402+0000 7f058d786640 1 Processor -- start 2024-05-10T10:57:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.402+0000 7f058d786640 1 -- start start 2024-05-10T10:57:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.403+0000 7f058d786640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0588101930 0x7f0588198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.403+0000 7f058d786640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0588102b20 0x7f0588199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.403+0000 7f058d786640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05881034e0 0x7f05881a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:03.406 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.403+0000 7f058d786640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f058810e6f0 con 0x7f0588102b20 2024-05-10T10:57:03.406 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.403+0000 7f058d786640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f058810e570 con 0x7f0588101930 2024-05-10T10:57:03.406 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.403+0000 7f057e7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0588102b20 0x7f0588199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:03.406 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.403+0000 7f057e7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0588102b20 0x7f0588199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54292/0 (socket says 172.21.15.107:54292) 2024-05-10T10:57:03.406 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.403+0000 7f057e7fc640 1 -- 172.21.15.107:0/705801836 learned_addr learned my addr 172.21.15.107:0/705801836 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:03.406 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.403+0000 7f0586ffd640 1 --2- 172.21.15.107:0/705801836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0588101930 0x7f0588198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:03.406 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.403+0000 7f058d786640 1 -- 172.21.15.107:0/705801836 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f058810e870 con 0x7f05881034e0 2024-05-10T10:57:03.406 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.403+0000 7f05877fe640 1 --2- 172.21.15.107:0/705801836 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05881034e0 0x7f05881a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:03.406 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.404+0000 7f05877fe640 1 -- 172.21.15.107:0/705801836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0588101930 msgr2=0x7f0588198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:03.406 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.404+0000 7f05877fe640 1 --2- 172.21.15.107:0/705801836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0588101930 0x7f0588198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.406 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.404+0000 7f05877fe640 1 -- 172.21.15.107:0/705801836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0588102b20 msgr2=0x7f0588199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:03.406 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.404+0000 7f05877fe640 1 --2- 172.21.15.107:0/705801836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0588102b20 0x7f0588199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.406 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.404+0000 7f05877fe640 1 -- 172.21.15.107:0/705801836 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05881a0900 con 0x7f05881034e0 2024-05-10T10:57:03.407 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.404+0000 7f057e7fc640 1 --2- 172.21.15.107:0/705801836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0588102b20 0x7f0588199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:57:03.407 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.404+0000 7f05877fe640 1 --2- 172.21.15.107:0/705801836 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05881034e0 0x7f05881a0260 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f058000be20 tx=0x7f058000bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:03.407 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.404+0000 7f0584ff9640 1 -- 172.21.15.107:0/705801836 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0580019070 con 0x7f05881034e0 2024-05-10T10:57:03.407 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.404+0000 7f0584ff9640 1 -- 172.21.15.107:0/705801836 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0580014910 con 0x7f05881034e0 2024-05-10T10:57:03.407 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.404+0000 7f058d786640 1 -- 172.21.15.107:0/705801836 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05881a0bf0 con 0x7f05881034e0 2024-05-10T10:57:03.407 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.405+0000 7f058d786640 1 -- 172.21.15.107:0/705801836 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05881a1140 con 0x7f05881034e0 2024-05-10T10:57:03.407 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.405+0000 7f0584ff9640 1 -- 172.21.15.107:0/705801836 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0580012900 con 0x7f05881034e0 2024-05-10T10:57:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.408+0000 7f0590578740 1 Processor -- start 2024-05-10T10:57:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.408+0000 7f0590578740 1 -- start start 2024-05-10T10:57:03.409 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.408+0000 7f0584ff9640 1 -- 172.21.15.107:0/705801836 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f058001c070 con 0x7f05881034e0 2024-05-10T10:57:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.409+0000 7f0590578740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e421c0 0x55bd58e425e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.409+0000 7f0590578740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e42bb0 0x55bd58e476b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.409+0000 7f0586ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e42bb0 0x55bd58e476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.409+0000 7f0586ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e42bb0 0x55bd58e476b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54302/0 (socket says 172.21.15.107:54302) 2024-05-10T10:57:03.415 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.409+0000 7f0590578740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e47d20 0x55bd58e4a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:03.416 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.409+0000 7f0590578740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55bd58da25d0 con 0x55bd58e42bb0 2024-05-10T10:57:03.416 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.409+0000 7f0590578740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55bd58d5b890 con 0x55bd58e47d20 2024-05-10T10:57:03.416 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.409+0000 7f0590578740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55bd58d9e590 con 0x55bd58e421c0 2024-05-10T10:57:03.416 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.409+0000 7f0586ffd640 1 -- 172.21.15.107:0/2969969262 learned_addr learned my addr 172.21.15.107:0/2969969262 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:03.416 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.409+0000 7f057e7fc640 1 --2- 172.21.15.107:0/2969969262 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e421c0 0x55bd58e425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:03.416 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.409+0000 7f057e7fc640 1 --2- 172.21.15.107:0/2969969262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e47d20 0x55bd58e4a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:03.416 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.409+0000 7f0586ffd640 1 -- 172.21.15.107:0/2969969262 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e421c0 msgr2=0x55bd58e425e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:03.416 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.409+0000 7f0586ffd640 1 --2- 172.21.15.107:0/2969969262 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e421c0 0x55bd58e425e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.416 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.409+0000 7f0586ffd640 1 -- 172.21.15.107:0/2969969262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e47d20 msgr2=0x55bd58e4a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:03.416 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.409+0000 7f0586ffd640 1 --2- 172.21.15.107:0/2969969262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e47d20 0x55bd58e4a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.416 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.409+0000 7f0586ffd640 1 -- 172.21.15.107:0/2969969262 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd58ab4210 con 0x55bd58e42bb0 2024-05-10T10:57:03.416 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.409+0000 7f057e7fc640 1 --2- 172.21.15.107:0/2969969262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e47d20 0x55bd58e4a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:03.416 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.410+0000 7f0586ffd640 1 --2- 172.21.15.107:0/2969969262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e42bb0 0x55bd58e476b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0588102980 tx=0x7f0578031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1b060fb1ed13e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.410+0000 7f0584ff9640 1 --2- 172.21.15.107:0/705801836 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f05740b29a0 0x7f05740b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.410+0000 7f057d7fa640 1 -- 172.21.15.107:0/2969969262 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0578040070 con 0x55bd58e42bb0 2024-05-10T10:57:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.410+0000 7f057d7fa640 1 -- 172.21.15.107:0/2969969262 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0578031810 con 0x55bd58e42bb0 2024-05-10T10:57:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.410+0000 7f057d7fa640 1 -- 172.21.15.107:0/2969969262 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0578035040 con 0x55bd58e42bb0 2024-05-10T10:57:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.410+0000 7f057e7fc640 1 --2- 172.21.15.107:0/705801836 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f05740b29a0 0x7f05740b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.411+0000 7f0584ff9640 1 -- 172.21.15.107:0/705801836 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f05800e1a90 con 0x7f05881034e0 2024-05-10T10:57:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.411+0000 7f0590578740 1 -- 172.21.15.107:0/2969969262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e42bb0 msgr2=0x55bd58e476b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.411+0000 7f057e7fc640 1 --2- 172.21.15.107:0/705801836 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f05740b29a0 0x7f05740b4e60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f057000b770 tx=0x7f0570004730 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.411+0000 7f0590578740 1 --2- 172.21.15.107:0/2969969262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e42bb0 0x55bd58e476b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0588102980 tx=0x7f0578031c70 comp rx=0 tx=0).stop 2024-05-10T10:57:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.411+0000 7f0590578740 1 -- 172.21.15.107:0/2969969262 shutdown_connections 2024-05-10T10:57:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.411+0000 7f0590578740 1 --2- 172.21.15.107:0/2969969262 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e47d20 0x55bd58e4a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.411+0000 7f0590578740 1 --2- 172.21.15.107:0/2969969262 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e42bb0 0x55bd58e476b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.411+0000 7f0590578740 1 --2- 172.21.15.107:0/2969969262 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e421c0 0x55bd58e425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.411+0000 7f0590578740 1 -- 172.21.15.107:0/2969969262 >> 172.21.15.107:0/2969969262 conn(0x55bd58e39420 msgr2=0x55bd58e39820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.411+0000 7f0590578740 1 -- 172.21.15.107:0/2969969262 shutdown_connections 2024-05-10T10:57:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.411+0000 7f0590578740 1 -- 172.21.15.107:0/2969969262 wait complete. 2024-05-10T10:57:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.412+0000 7f0590578740 1 -- start start 2024-05-10T10:57:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.412+0000 7f0590578740 1 Processor -- start 2024-05-10T10:57:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.412+0000 7f0590578740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e421c0 0x55bd58e4c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.412+0000 7f0590578740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e42bb0 0x55bd58e4c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.412+0000 7f0590578740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e47d20 0x55bd58e53900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.412+0000 7f0590578740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55bd58e4ac70 con 0x55bd58e42bb0 2024-05-10T10:57:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.413+0000 7f0590578740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55bd58d5f370 con 0x55bd58e47d20 2024-05-10T10:57:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.413+0000 7f057e7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e42bb0 0x55bd58e4c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.413+0000 7f0590578740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55bd58e4adf0 con 0x55bd58e421c0 2024-05-10T10:57:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.413+0000 7f0586ffd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e421c0 0x55bd58e4c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.413+0000 7f0586ffd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e421c0 0x55bd58e4c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.107:53776/0 (socket says 172.21.15.107:53776) 2024-05-10T10:57:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.413+0000 7f0586ffd640 1 -- 172.21.15.107:0/1265347027 learned_addr learned my addr 172.21.15.107:0/1265347027 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.413+0000 7f0590578740 10 client.0 _ll_register_callbacks cb 0x55bd58ab3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:57:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.413+0000 7f05877fe640 1 --2- 172.21.15.107:0/1265347027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e47d20 0x55bd58e53900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.413+0000 7f0586ffd640 1 -- 172.21.15.107:0/1265347027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e47d20 msgr2=0x55bd58e53900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.413+0000 7f0586ffd640 1 --2- 172.21.15.107:0/1265347027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e47d20 0x55bd58e53900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.413+0000 7f0586ffd640 1 -- 172.21.15.107:0/1265347027 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e42bb0 msgr2=0x55bd58e4c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.413+0000 7f0586ffd640 1 --2- 172.21.15.107:0/1265347027 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e42bb0 0x55bd58e4c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.413+0000 7f0586ffd640 1 -- 172.21.15.107:0/1265347027 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd58b80620 con 0x55bd58e421c0 2024-05-10T10:57:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.413+0000 7f0586ffd640 1 --2- 172.21.15.107:0/1265347027 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e421c0 0x55bd58e4c380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0578005ab0 tx=0x7f0578005230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=201e3599be29af1d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.414+0000 7f056e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.196:3300/0 2024-05-10T10:57:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.414+0000 7f056e7fc640 1 -- 172.21.15.107:0/1265347027 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057804b020 con 0x55bd58e421c0 2024-05-10T10:57:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.414+0000 7f056e7fc640 1 -- 172.21.15.107:0/1265347027 <== mon.1 v2:172.21.15.196:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f0578004250 con 0x55bd58e421c0 2024-05-10T10:57:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.414+0000 7f0590578740 1 -- 172.21.15.107:0/1265347027 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0578031810 con 0x55bd58e421c0 2024-05-10T10:57:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.414+0000 7f056e7fc640 1 -- 172.21.15.107:0/1265347027 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0578035070 con 0x55bd58e421c0 2024-05-10T10:57:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.414+0000 7f0590578740 10 client.24991 fetch_fsmap learned FSMap version 27 2024-05-10T10:57:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.414+0000 7f0590578740 1 -- 172.21.15.107:0/1265347027 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bd58e4ac70 con 0x55bd58e421c0 2024-05-10T10:57:03.420 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.414+0000 7f056e7fc640 1 -- 172.21.15.107:0/1265347027 <== mon.1 v2:172.21.15.196:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0578031810 con 0x55bd58e421c0 2024-05-10T10:57:03.420 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.415+0000 7f056e7fc640 1 -- 172.21.15.107:0/1265347027 <== mon.1 v2:172.21.15.196:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0578003680 con 0x55bd58e421c0 2024-05-10T10:57:03.421 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.416+0000 7f0590578740 10 client.24991 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:57:03.421 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.416+0000 7f0590578740 10 client.24991 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:57:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.416+0000 7f0590578740 20 client.24991 populate_metadata read hostname 'smithi107' 2024-05-10T10:57:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.416+0000 7f0590578740 1 --2- 172.21.15.107:0/1265347027 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55bd58e57a20 0x55bd58e59e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.416+0000 7f0590578740 4 client.24991 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:57:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.416+0000 7f0590578740 1 -- 172.21.15.107:0/1265347027 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd58db01e0 con 0x55bd58e57a20 2024-05-10T10:57:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.416+0000 7f057e7fc640 1 --2- 172.21.15.107:0/1265347027 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55bd58e57a20 0x55bd58e59e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.416+0000 7f056e7fc640 10 client.24991 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.416+0000 7f057e7fc640 1 --2- 172.21.15.107:0/1265347027 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55bd58e57a20 0x55bd58e59e10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a3f84581715e7a9 server_cookie=172142bcb4c45b03 in_seq=0 out_seq=0 2024-05-10T10:57:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.417+0000 7f056e7fc640 1 -- 172.21.15.107:0/1265347027 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bd58db01e0 con 0x55bd58e57a20 2024-05-10T10:57:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.417+0000 7f056e7fc640 10 client.24991 handle_command_reply: tid=0 2024-05-10T10:57:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.417+0000 7f0590578740 1 client.24991 shutdown 2024-05-10T10:57:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.417+0000 7f0590578740 1 -- 172.21.15.107:0/1265347027 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e421c0 msgr2=0x55bd58e4c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.417+0000 7f0590578740 1 --2- 172.21.15.107:0/1265347027 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e421c0 0x55bd58e4c380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0578005ab0 tx=0x7f0578005230 comp rx=0 tx=0).stop 2024-05-10T10:57:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.418+0000 7f0590578740 1 -- 172.21.15.107:0/1265347027 shutdown_connections 2024-05-10T10:57:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.418+0000 7f0590578740 1 --2- 172.21.15.107:0/1265347027 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55bd58e57a20 0x55bd58e59e10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.418+0000 7f0590578740 1 --2- 172.21.15.107:0/1265347027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e47d20 0x55bd58e53900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.418+0000 7f056e7fc640 0 client.24991 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.418+0000 7f0590578740 1 --2- 172.21.15.107:0/1265347027 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e42bb0 0x55bd58e4c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.418+0000 7f0590578740 1 --2- 172.21.15.107:0/1265347027 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e421c0 0x55bd58e4c380 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.418+0000 7f0590578740 1 -- 172.21.15.107:0/1265347027 >> 172.21.15.107:0/1265347027 conn(0x55bd58e39420 msgr2=0x55bd58e38580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.418+0000 7f0590578740 1 -- 172.21.15.107:0/1265347027 shutdown_connections 2024-05-10T10:57:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.418+0000 7f0590578740 1 -- 172.21.15.107:0/1265347027 wait complete. 2024-05-10T10:57:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.418+0000 7f0590578740 20 client.24991 trim_cache size 0 max 16384 2024-05-10T10:57:03.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:03 smithi107 ceph-mon[30373]: pgmap v429: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T10:57:03.448 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.447+0000 7f0590578740 1 Processor -- start 2024-05-10T10:57:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.447+0000 7f0590578740 1 -- start start 2024-05-10T10:57:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.447+0000 7f0590578740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e421c0 0x55bd58e4c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.447+0000 7f0590578740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e42bb0 0x55bd58e538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.447+0000 7f0590578740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e47d20 0x55bd58e4c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.447+0000 7f0590578740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f05881a7a40 con 0x55bd58e421c0 2024-05-10T10:57:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.447+0000 7f0590578740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f05881a9580 con 0x55bd58e42bb0 2024-05-10T10:57:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.447+0000 7f0590578740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f05881a8110 con 0x55bd58e47d20 2024-05-10T10:57:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.447+0000 7f0586ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e421c0 0x55bd58e4c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.447+0000 7f0586ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e421c0 0x55bd58e4c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54326/0 (socket says 172.21.15.107:54326) 2024-05-10T10:57:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.447+0000 7f0586ffd640 1 -- 172.21.15.107:0/3679077284 learned_addr learned my addr 172.21.15.107:0/3679077284 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.447+0000 7f05877fe640 1 --2- 172.21.15.107:0/3679077284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e47d20 0x55bd58e4c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.447+0000 7f057e7fc640 1 --2- 172.21.15.107:0/3679077284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e42bb0 0x55bd58e538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.448+0000 7f0586ffd640 1 -- 172.21.15.107:0/3679077284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e47d20 msgr2=0x55bd58e4c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.448+0000 7f0586ffd640 1 --2- 172.21.15.107:0/3679077284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e47d20 0x55bd58e4c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.448+0000 7f0586ffd640 1 -- 172.21.15.107:0/3679077284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e42bb0 msgr2=0x55bd58e538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:03.450 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.448+0000 7f0586ffd640 1 --2- 172.21.15.107:0/3679077284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e42bb0 0x55bd58e538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.450 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.448+0000 7f0586ffd640 1 -- 172.21.15.107:0/3679077284 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd58e4af50 con 0x55bd58e421c0 2024-05-10T10:57:03.450 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.448+0000 7f0586ffd640 1 --2- 172.21.15.107:0/3679077284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e421c0 0x55bd58e4c0b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0578009900 tx=0x7f0578031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe6c5bc0fe562d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:03.450 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.448+0000 7f057cff9640 1 -- 172.21.15.107:0/3679077284 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057804b040 con 0x55bd58e421c0 2024-05-10T10:57:03.450 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.448+0000 7f057cff9640 1 -- 172.21.15.107:0/3679077284 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0578004250 con 0x55bd58e421c0 2024-05-10T10:57:03.450 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.448+0000 7f057cff9640 1 -- 172.21.15.107:0/3679077284 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0578040040 con 0x55bd58e421c0 2024-05-10T10:57:03.454 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.449+0000 7f0590578740 1 -- 172.21.15.107:0/3679077284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e421c0 msgr2=0x55bd58e4c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:03.454 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.449+0000 7f0590578740 1 --2- 172.21.15.107:0/3679077284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e421c0 0x55bd58e4c0b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0578009900 tx=0x7f0578031c70 comp rx=0 tx=0).stop 2024-05-10T10:57:03.454 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.449+0000 7f0590578740 1 -- 172.21.15.107:0/3679077284 shutdown_connections 2024-05-10T10:57:03.455 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.449+0000 7f0590578740 1 --2- 172.21.15.107:0/3679077284 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e47d20 0x55bd58e4c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.455 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.449+0000 7f0590578740 1 --2- 172.21.15.107:0/3679077284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e42bb0 0x55bd58e538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.455 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.449+0000 7f0590578740 1 --2- 172.21.15.107:0/3679077284 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e421c0 0x55bd58e4c0b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.455 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.449+0000 7f0590578740 1 -- 172.21.15.107:0/3679077284 >> 172.21.15.107:0/3679077284 conn(0x55bd58e39420 msgr2=0x55bd58e4b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:03.455 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.449+0000 7f0590578740 1 -- 172.21.15.107:0/3679077284 shutdown_connections 2024-05-10T10:57:03.455 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.449+0000 7f0590578740 1 -- 172.21.15.107:0/3679077284 wait complete. 2024-05-10T10:57:03.455 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.450+0000 7f0590578740 1 -- start start 2024-05-10T10:57:03.455 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.450+0000 7f0590578740 1 Processor -- start 2024-05-10T10:57:03.455 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.450+0000 7f0590578740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e421c0 0x55bd58e53160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:03.455 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.450+0000 7f0590578740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e42bb0 0x55bd58e536a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:03.455 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.450+0000 7f0590578740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e47d20 0x55bd58e517e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:03.455 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.450+0000 7f0590578740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f05881a8eb0 con 0x55bd58e42bb0 2024-05-10T10:57:03.455 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.450+0000 7f0590578740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f05881a87e0 con 0x55bd58e421c0 2024-05-10T10:57:03.455 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.450+0000 7f0590578740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f05881a5a70 con 0x55bd58e47d20 2024-05-10T10:57:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.450+0000 7f057e7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e42bb0 0x55bd58e536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.450+0000 7f0590578740 10 client.0 _ll_register_callbacks cb 0x7f057000bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:57:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.450+0000 7f057e7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e42bb0 0x55bd58e536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54330/0 (socket says 172.21.15.107:54330) 2024-05-10T10:57:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.450+0000 7f057e7fc640 1 -- 172.21.15.107:0/98863971 learned_addr learned my addr 172.21.15.107:0/98863971 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.451+0000 7f05877fe640 1 --2- 172.21.15.107:0/98863971 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e47d20 0x55bd58e517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.451+0000 7f057e7fc640 1 -- 172.21.15.107:0/98863971 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e47d20 msgr2=0x55bd58e517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.451+0000 7f057e7fc640 1 --2- 172.21.15.107:0/98863971 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e47d20 0x55bd58e517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.451+0000 7f057e7fc640 1 -- 172.21.15.107:0/98863971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e421c0 msgr2=0x55bd58e53160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.451+0000 7f0586ffd640 1 --2- 172.21.15.107:0/98863971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e421c0 0x55bd58e53160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.451+0000 7f057e7fc640 1 --2- 172.21.15.107:0/98863971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e421c0 0x55bd58e53160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.451+0000 7f057e7fc640 1 -- 172.21.15.107:0/98863971 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd58e51df0 con 0x55bd58e42bb0 2024-05-10T10:57:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.451+0000 7f0586ffd640 1 --2- 172.21.15.107:0/98863971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e421c0 0x55bd58e53160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.451+0000 7f057e7fc640 1 --2- 172.21.15.107:0/98863971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e42bb0 0x55bd58e536a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x55bd58e43410 tx=0x7f057000bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03b85784683ae3c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.451+0000 7f056e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:57:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.451+0000 7f056e7fc640 1 -- 172.21.15.107:0/98863971 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057002d070 con 0x55bd58e42bb0 2024-05-10T10:57:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.451+0000 7f056e7fc640 1 -- 172.21.15.107:0/98863971 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f05700296e0 con 0x55bd58e42bb0 2024-05-10T10:57:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.451+0000 7f0590578740 1 -- 172.21.15.107:0/98863971 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0578004250 con 0x55bd58e42bb0 2024-05-10T10:57:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.451+0000 7f056e7fc640 1 -- 172.21.15.107:0/98863971 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f05700298e0 con 0x55bd58e42bb0 2024-05-10T10:57:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.451+0000 7f0590578740 10 client.15513 fetch_fsmap learned FSMap version 27 2024-05-10T10:57:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.451+0000 7f0590578740 1 -- 172.21.15.107:0/98863971 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bd58ec2c50 con 0x55bd58e42bb0 2024-05-10T10:57:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.452+0000 7f056e7fc640 1 -- 172.21.15.107:0/98863971 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0578004250 con 0x55bd58e42bb0 2024-05-10T10:57:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.452+0000 7f056e7fc640 1 -- 172.21.15.107:0/98863971 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0570030030 con 0x55bd58e42bb0 2024-05-10T10:57:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.452+0000 7f0590578740 10 client.15513 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:57:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.452+0000 7f0590578740 10 client.15513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:57:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.452+0000 7f0590578740 20 client.15513 populate_metadata read hostname 'smithi107' 2024-05-10T10:57:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.452+0000 7f0590578740 1 --2- 172.21.15.107:0/98863971 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55bd58ec3630 0x55bd58ec5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.452+0000 7f0590578740 4 client.15513 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T10:57:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.452+0000 7f0590578740 1 -- 172.21.15.107:0/98863971 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bd58daa050 con 0x55bd58ec3630 2024-05-10T10:57:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.453+0000 7f0586ffd640 1 --2- 172.21.15.107:0/98863971 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55bd58ec3630 0x55bd58ec5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:03.458 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.453+0000 7f056e7fc640 10 client.15513 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:03.458 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.453+0000 7f0586ffd640 1 --2- 172.21.15.107:0/98863971 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55bd58ec3630 0x55bd58ec5a50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9238362487f6b594 server_cookie=2e3182132fe0052c in_seq=0 out_seq=0 2024-05-10T10:57:03.459 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.457+0000 7f056e7fc640 1 -- 172.21.15.107:0/98863971 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bd58daa050 con 0x55bd58ec3630 2024-05-10T10:57:03.459 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.457+0000 7f056e7fc640 10 client.15513 handle_command_reply: tid=0 2024-05-10T10:57:03.459 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.457+0000 7f0590578740 1 client.15513 shutdown 2024-05-10T10:57:03.459 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.457+0000 7f0590578740 1 -- 172.21.15.107:0/98863971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e42bb0 msgr2=0x55bd58e536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:03.459 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.457+0000 7f0590578740 1 --2- 172.21.15.107:0/98863971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e42bb0 0x55bd58e536a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x55bd58e43410 tx=0x7f057000bd20 comp rx=0 tx=0).stop 2024-05-10T10:57:03.459 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.457+0000 7f0590578740 1 -- 172.21.15.107:0/98863971 shutdown_connections 2024-05-10T10:57:03.459 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.457+0000 7f0590578740 1 --2- 172.21.15.107:0/98863971 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55bd58ec3630 0x55bd58ec5a50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.459 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.457+0000 7f0590578740 1 --2- 172.21.15.107:0/98863971 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55bd58e47d20 0x55bd58e517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.459 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.457+0000 7f0590578740 1 --2- 172.21.15.107:0/98863971 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55bd58e42bb0 0x55bd58e536a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.457+0000 7f0590578740 1 --2- 172.21.15.107:0/98863971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bd58e421c0 0x55bd58e53160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.457+0000 7f0590578740 1 -- 172.21.15.107:0/98863971 >> 172.21.15.107:0/98863971 conn(0x55bd58e39420 msgr2=0x55bd58e3c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.458+0000 7f056e7fc640 0 client.15513 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.458+0000 7f0590578740 1 -- 172.21.15.107:0/98863971 shutdown_connections 2024-05-10T10:57:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.458+0000 7f0590578740 1 -- 172.21.15.107:0/98863971 wait complete. 2024-05-10T10:57:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.458+0000 7f0590578740 20 client.15513 trim_cache size 0 max 16384 2024-05-10T10:57:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:{ 2024-05-10T10:57:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "message": "", 2024-05-10T10:57:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "return_code": 0 2024-05-10T10:57:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:} 2024-05-10T10:57:03.461 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.458+0000 7f058d786640 1 -- 172.21.15.107:0/705801836 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f05740b29a0 msgr2=0x7f05740b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:03.461 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.458+0000 7f058d786640 1 --2- 172.21.15.107:0/705801836 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f05740b29a0 0x7f05740b4e60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f057000b770 tx=0x7f0570004730 comp rx=0 tx=0).stop 2024-05-10T10:57:03.461 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.458+0000 7f058d786640 1 -- 172.21.15.107:0/705801836 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05881034e0 msgr2=0x7f05881a0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:03.461 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.458+0000 7f058d786640 1 --2- 172.21.15.107:0/705801836 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05881034e0 0x7f05881a0260 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f058000be20 tx=0x7f058000bf10 comp rx=0 tx=0).stop 2024-05-10T10:57:03.461 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.458+0000 7f058d786640 1 -- 172.21.15.107:0/705801836 shutdown_connections 2024-05-10T10:57:03.462 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.458+0000 7f058d786640 1 --2- 172.21.15.107:0/705801836 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f05881034e0 0x7f05881a0260 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.462 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.458+0000 7f058d786640 1 --2- 172.21.15.107:0/705801836 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f05740b29a0 0x7f05740b4e60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.462 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.458+0000 7f058d786640 1 --2- 172.21.15.107:0/705801836 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0588102b20 0x7f0588199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.462 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.458+0000 7f058d786640 1 --2- 172.21.15.107:0/705801836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0588101930 0x7f0588198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:03.462 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.458+0000 7f058d786640 1 -- 172.21.15.107:0/705801836 >> 172.21.15.107:0/705801836 conn(0x7f05880fcec0 msgr2=0x7f0588105dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:03.462 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.459+0000 7f058d786640 1 -- 172.21.15.107:0/705801836 shutdown_connections 2024-05-10T10:57:03.462 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:03.459+0000 7f058d786640 1 -- 172.21.15.107:0/705801836 wait complete. 2024-05-10T10:57:03.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:03 smithi196 ceph-mon[34872]: pgmap v429: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T10:57:05.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:05 smithi184 ceph-mon[34585]: pgmap v430: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:57:05.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:05 smithi107 ceph-mon[30373]: pgmap v430: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:57:05.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:05 smithi196 ceph-mon[34872]: pgmap v430: 97 pgs: 97 active+clean; 679 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:57:05.825 INFO:tasks.quiescer.fs.[cephfs]:Total duration (53.3) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-10T10:57:05.825 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.65 2024-05-10T10:57:05.826 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:57:06.194 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:57:07.389 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:07 smithi184 ceph-mon[34585]: pgmap v431: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 12 op/s 2024-05-10T10:57:07.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:07 smithi107 ceph-mon[30373]: pgmap v431: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 12 op/s 2024-05-10T10:57:07.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:07 smithi196 ceph-mon[34872]: pgmap v431: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 12 op/s 2024-05-10T10:57:08.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.124+0000 7f569e2e1700 1 -- 172.21.15.107:0/3731951366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f569810ff50 msgr2=0x7f5698112340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:08.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.124+0000 7f569e2e1700 1 --2- 172.21.15.107:0/3731951366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f569810ff50 0x7f5698112340 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f569000b0a0 tx=0x7f569000b3b0 comp rx=0 tx=0).stop 2024-05-10T10:57:08.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.124+0000 7f569e2e1700 1 -- 172.21.15.107:0/3731951366 shutdown_connections 2024-05-10T10:57:08.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.124+0000 7f569e2e1700 1 --2- 172.21.15.107:0/3731951366 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f569810ff50 0x7f5698112340 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:08.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.124+0000 7f569e2e1700 1 --2- 172.21.15.107:0/3731951366 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f569806b1b0 0x7f569806b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:08.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.124+0000 7f569e2e1700 1 --2- 172.21.15.107:0/3731951366 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f569806bad0 0x7f569810fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:08.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.124+0000 7f569e2e1700 1 -- 172.21.15.107:0/3731951366 >> 172.21.15.107:0/3731951366 conn(0x7f5698079350 msgr2=0x7f5698079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:08.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.125+0000 7f569e2e1700 1 -- 172.21.15.107:0/3731951366 shutdown_connections 2024-05-10T10:57:08.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.125+0000 7f569e2e1700 1 -- 172.21.15.107:0/3731951366 wait complete. 2024-05-10T10:57:08.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.126+0000 7f569e2e1700 1 Processor -- start 2024-05-10T10:57:08.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.126+0000 7f569e2e1700 1 -- start start 2024-05-10T10:57:08.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.126+0000 7f569e2e1700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f569806b1b0 0x7f569819bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:08.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.126+0000 7f569e2e1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f569806bad0 0x7f569819c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:08.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.126+0000 7f569e2e1700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f569810ff50 0x7f56981a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:08.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.127+0000 7f569e2e1700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f56981159f0 con 0x7f569806b1b0 2024-05-10T10:57:08.128 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.127+0000 7f569e2e1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5698115870 con 0x7f569806bad0 2024-05-10T10:57:08.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.127+0000 7f569e2e1700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f5698115b70 con 0x7f569810ff50 2024-05-10T10:57:08.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.127+0000 7f5697fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f569806b1b0 0x7f569819bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:08.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.127+0000 7f5697fff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f569806b1b0 0x7f569819bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54682/0 (socket says 172.21.15.107:54682) 2024-05-10T10:57:08.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.127+0000 7f5697fff700 1 -- 172.21.15.107:0/2695866168 learned_addr learned my addr 172.21.15.107:0/2695866168 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:08.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.127+0000 7f56977fe700 1 --2- 172.21.15.107:0/2695866168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f569806bad0 0x7f569819c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:08.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.127+0000 7f5697fff700 1 -- 172.21.15.107:0/2695866168 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f569810ff50 msgr2=0x7f56981a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:08.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.127+0000 7f5697fff700 1 --2- 172.21.15.107:0/2695866168 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f569810ff50 0x7f56981a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:08.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.127+0000 7f5697fff700 1 -- 172.21.15.107:0/2695866168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f569806bad0 msgr2=0x7f569819c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:08.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.127+0000 7f5697fff700 1 --2- 172.21.15.107:0/2695866168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f569806bad0 0x7f569819c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:08.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.127+0000 7f5697fff700 1 -- 172.21.15.107:0/2695866168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56981a0db0 con 0x7f569806b1b0 2024-05-10T10:57:08.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.128+0000 7f5697fff700 1 --2- 172.21.15.107:0/2695866168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f569806b1b0 0x7f569819bda0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f568800d950 tx=0x7f568800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:08.129 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.128+0000 7f56957fa700 1 -- 172.21.15.107:0/2695866168 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688016070 con 0x7f569806b1b0 2024-05-10T10:57:08.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.128+0000 7f569e2e1700 1 -- 172.21.15.107:0/2695866168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56981a10a0 con 0x7f569806b1b0 2024-05-10T10:57:08.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.128+0000 7f56957fa700 1 -- 172.21.15.107:0/2695866168 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5688009e10 con 0x7f569806b1b0 2024-05-10T10:57:08.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.128+0000 7f56957fa700 1 -- 172.21.15.107:0/2695866168 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568800f620 con 0x7f569806b1b0 2024-05-10T10:57:08.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.128+0000 7f569e2e1700 1 -- 172.21.15.107:0/2695866168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56981a8920 con 0x7f569806b1b0 2024-05-10T10:57:08.130 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.129+0000 7f569e2e1700 1 -- 172.21.15.107:0/2695866168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f569806a190 con 0x7f569806b1b0 2024-05-10T10:57:08.131 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.131+0000 7f56957fa700 1 -- 172.21.15.107:0/2695866168 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f5688019070 con 0x7f569806b1b0 2024-05-10T10:57:08.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.131+0000 7f56957fa700 1 --2- 172.21.15.107:0/2695866168 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f56800b2880 0x7f56800b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:08.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.132+0000 7f56957fa700 1 -- 172.21.15.107:0/2695866168 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f56880e1df0 con 0x7f569806b1b0 2024-05-10T10:57:08.132 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.132+0000 7f56977fe700 1 --2- 172.21.15.107:0/2695866168 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f56800b2880 0x7f56800b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:08.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.132+0000 7f56977fe700 1 --2- 172.21.15.107:0/2695866168 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f56800b2880 0x7f56800b4d40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5698103900 tx=0x7f568c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:08.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.139+0000 7f56957fa700 1 -- 172.21.15.107:0/2695866168 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f56880a9bb0 con 0x7f569806b1b0 2024-05-10T10:57:08.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.408+0000 7f569e2e1700 1 -- 172.21.15.107:0/2695866168 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f569819d130 con 0x7f569806b1b0 2024-05-10T10:57:08.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.409+0000 7f56957fa700 1 -- 172.21.15.107:0/2695866168 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11951 (secure 0 0 0) 0x7f569819d130 con 0x7f569806b1b0 2024-05-10T10:57:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:57:08.410 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T10:52:17.367732+0000","modified":"2024-05-10T10:55:30.125781+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24482,"mds_1":24449,"mds_2":24442,"mds_3":24431,"mds_4":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/2332963094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":2332963094},{"type":"v1","addr":"172.21.15.107:6841","nonce":2332963094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.184:6839/16501252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":16501252},{"type":"v1","addr":"172.21.15.184:6839","nonce":16501252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24430,24431,24482,24449,24442]},"id":1}]} 2024-05-10T10:57:08.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.411+0000 7f569e2e1700 1 -- 172.21.15.107:0/2695866168 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f56800b2880 msgr2=0x7f56800b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:08.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.411+0000 7f569e2e1700 1 --2- 172.21.15.107:0/2695866168 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f56800b2880 0x7f56800b4d40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5698103900 tx=0x7f568c00b410 comp rx=0 tx=0).stop 2024-05-10T10:57:08.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.411+0000 7f569e2e1700 1 -- 172.21.15.107:0/2695866168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f569806b1b0 msgr2=0x7f569819bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:08.412 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.411+0000 7f569e2e1700 1 --2- 172.21.15.107:0/2695866168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f569806b1b0 0x7f569819bda0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f568800d950 tx=0x7f568800dc60 comp rx=0 tx=0).stop 2024-05-10T10:57:08.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.412+0000 7f569e2e1700 1 -- 172.21.15.107:0/2695866168 shutdown_connections 2024-05-10T10:57:08.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.412+0000 7f569e2e1700 1 --2- 172.21.15.107:0/2695866168 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f56800b2880 0x7f56800b4d40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:08.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.412+0000 7f569e2e1700 1 --2- 172.21.15.107:0/2695866168 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f569810ff50 0x7f56981a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:08.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.412+0000 7f569e2e1700 1 --2- 172.21.15.107:0/2695866168 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f569806b1b0 0x7f569819bda0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:08.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.412+0000 7f569e2e1700 1 --2- 172.21.15.107:0/2695866168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f569806bad0 0x7f569819c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:08.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.412+0000 7f569e2e1700 1 -- 172.21.15.107:0/2695866168 >> 172.21.15.107:0/2695866168 conn(0x7f5698079350 msgr2=0x7f5698111380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:08.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.412+0000 7f569e2e1700 1 -- 172.21.15.107:0/2695866168 shutdown_connections 2024-05-10T10:57:08.413 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:08.412+0000 7f569e2e1700 1 -- 172.21.15.107:0/2695866168 wait complete. 2024-05-10T10:57:08.413 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 27 2024-05-10T10:57:09.149 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24482 quiesce db / --timeout 60 --expiration 86.65 --await-for 42.0' 2024-05-10T10:57:09.149 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24482 quiesce db / --timeout 60 --expiration 86.65 --await-for 42.0 2024-05-10T10:57:09.415 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:57:09.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:09 smithi107 ceph-mon[30373]: pgmap v432: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:57:09.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:09 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2695866168' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:57:09.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:09 smithi196 ceph-mon[34872]: pgmap v432: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:57:09.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:09 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/2695866168' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:57:09.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:09 smithi184 ceph-mon[34585]: pgmap v432: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:57:09.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:09 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/2695866168' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:57:11.222 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:11 smithi107 ceph-mon[30373]: pgmap v433: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:57:11.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.356+0000 7f122f4a3700 1 -- 172.21.15.107:0/1555796433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1228102d90 msgr2=0x7f122810f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:11.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.356+0000 7f122f4a3700 1 --2- 172.21.15.107:0/1555796433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1228102d90 0x7f122810f230 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f122000b0a0 tx=0x7f122000b3b0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.357 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.356+0000 7f122f4a3700 1 -- 172.21.15.107:0/1555796433 shutdown_connections 2024-05-10T10:57:11.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.356+0000 7f122f4a3700 1 --2- 172.21.15.107:0/1555796433 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1228102d90 0x7f122810f230 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.356+0000 7f122f4a3700 1 --2- 172.21.15.107:0/1555796433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1228108480 0x7f1228108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.356+0000 7f122f4a3700 1 --2- 172.21.15.107:0/1555796433 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12281023d0 0x7f1228102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.356+0000 7f122f4a3700 1 -- 172.21.15.107:0/1555796433 >> 172.21.15.107:0/1555796433 conn(0x7f12280793e0 msgr2=0x7f12280797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:11.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.356+0000 7f122f4a3700 1 -- 172.21.15.107:0/1555796433 shutdown_connections 2024-05-10T10:57:11.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.356+0000 7f122f4a3700 1 -- 172.21.15.107:0/1555796433 wait complete. 2024-05-10T10:57:11.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.357+0000 7f122f4a3700 1 Processor -- start 2024-05-10T10:57:11.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.357+0000 7f122f4a3700 1 -- start start 2024-05-10T10:57:11.358 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.357+0000 7f122f4a3700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12281023d0 0x7f122819f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:11.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.357+0000 7f122f4a3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1228102d90 0x7f122819fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:11.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.357+0000 7f122f4a3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1228108480 0x7f1228199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:11.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.357+0000 7f122f4a3700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f12281137a0 con 0x7f1228108480 2024-05-10T10:57:11.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.357+0000 7f122f4a3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1228113620 con 0x7f1228102d90 2024-05-10T10:57:11.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.357+0000 7f122f4a3700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1228113920 con 0x7f12281023d0 2024-05-10T10:57:11.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.357+0000 7f122da40700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1228108480 0x7f1228199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:11.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.357+0000 7f122da40700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1228108480 0x7f1228199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54706/0 (socket says 172.21.15.107:54706) 2024-05-10T10:57:11.359 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.357+0000 7f122da40700 1 -- 172.21.15.107:0/3635192882 learned_addr learned my addr 172.21.15.107:0/3635192882 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:11.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.357+0000 7f122d23f700 1 --2- 172.21.15.107:0/3635192882 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12281023d0 0x7f122819f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:11.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.358+0000 7f122ca3e700 1 --2- 172.21.15.107:0/3635192882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1228102d90 0x7f122819fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:11.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.358+0000 7f122da40700 1 -- 172.21.15.107:0/3635192882 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12281023d0 msgr2=0x7f122819f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:11.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.358+0000 7f122da40700 1 --2- 172.21.15.107:0/3635192882 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12281023d0 0x7f122819f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.358+0000 7f122da40700 1 -- 172.21.15.107:0/3635192882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1228102d90 msgr2=0x7f122819fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:11.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.358+0000 7f122da40700 1 --2- 172.21.15.107:0/3635192882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1228102d90 0x7f122819fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.358+0000 7f122da40700 1 -- 172.21.15.107:0/3635192882 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1228199fc0 con 0x7f1228108480 2024-05-10T10:57:11.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.358+0000 7f122da40700 1 --2- 172.21.15.107:0/3635192882 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1228108480 0x7f1228199860 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f122000b070 tx=0x7f1220007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:11.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.358+0000 7f121e7fc700 1 -- 172.21.15.107:0/3635192882 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1220021070 con 0x7f1228108480 2024-05-10T10:57:11.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.358+0000 7f122f4a3700 1 -- 172.21.15.107:0/3635192882 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f122819a250 con 0x7f1228108480 2024-05-10T10:57:11.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.358+0000 7f121e7fc700 1 -- 172.21.15.107:0/3635192882 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1220007e50 con 0x7f1228108480 2024-05-10T10:57:11.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.358+0000 7f121e7fc700 1 -- 172.21.15.107:0/3635192882 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122001ba90 con 0x7f1228108480 2024-05-10T10:57:11.360 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.358+0000 7f122f4a3700 1 -- 172.21.15.107:0/3635192882 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f122810fe80 con 0x7f1228108480 2024-05-10T10:57:11.363 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.362+0000 7f1239d36b80 1 Processor -- start 2024-05-10T10:57:11.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.363+0000 7f121e7fc700 1 -- 172.21.15.107:0/3635192882 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f1220024070 con 0x7f1228108480 2024-05-10T10:57:11.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.363+0000 7f1239d36b80 1 -- start start 2024-05-10T10:57:11.364 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.364+0000 7f1239d36b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f94654f0 0x5633f94658d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:11.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.364+0000 7f1239d36b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f9465e10 0x5633f9469ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:11.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.364+0000 7f1239d36b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f946a0e0 0x5633f946a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:11.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.364+0000 7f122ca3e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f94654f0 0x5633f94658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:11.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.364+0000 7f122ca3e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f94654f0 0x5633f94658d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54714/0 (socket says 172.21.15.107:54714) 2024-05-10T10:57:11.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.364+0000 7f122ca3e700 1 -- 172.21.15.107:0/1461866804 learned_addr learned my addr 172.21.15.107:0/1461866804 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:11.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.364+0000 7f1239d36b80 1 -- 172.21.15.107:0/1461866804 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5633f93aead0 con 0x5633f94654f0 2024-05-10T10:57:11.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.364+0000 7f1239d36b80 1 -- 172.21.15.107:0/1461866804 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5633f9313f30 con 0x5633f9465e10 2024-05-10T10:57:11.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.364+0000 7f1239d36b80 1 -- 172.21.15.107:0/1461866804 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5633f93aaa90 con 0x5633f946a0e0 2024-05-10T10:57:11.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.364+0000 7f122d23f700 1 --2- 172.21.15.107:0/1461866804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f9465e10 0x5633f9469ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:11.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.364+0000 7f122ca3e700 1 -- 172.21.15.107:0/1461866804 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f946a0e0 msgr2=0x5633f946a520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T10:57:11.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.364+0000 7f122ca3e700 1 --2- 172.21.15.107:0/1461866804 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f946a0e0 0x5633f946a520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.364+0000 7f122ca3e700 1 -- 172.21.15.107:0/1461866804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f9465e10 msgr2=0x5633f9469ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:11.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.364+0000 7f122ca3e700 1 --2- 172.21.15.107:0/1461866804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f9465e10 0x5633f9469ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.364+0000 7f122ca3e700 1 -- 172.21.15.107:0/1461866804 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633f92fba60 con 0x5633f94654f0 2024-05-10T10:57:11.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.364+0000 7f122ca3e700 1 --2- 172.21.15.107:0/1461866804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f94654f0 0x5633f94658d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1218007cf0 tx=0x7f12180103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6f38934e1ca190 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:11.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.365+0000 7f12137fe700 1 -- 172.21.15.107:0/1461866804 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218010c50 con 0x5633f94654f0 2024-05-10T10:57:11.366 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.365+0000 7f12137fe700 1 -- 172.21.15.107:0/1461866804 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1218010df0 con 0x5633f94654f0 2024-05-10T10:57:11.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.365+0000 7f12137fe700 1 -- 172.21.15.107:0/1461866804 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f121801a470 con 0x5633f94654f0 2024-05-10T10:57:11.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.365+0000 7f121e7fc700 1 --2- 172.21.15.107:0/3635192882 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f12140b29b0 0x7f12140b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:11.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.365+0000 7f122d23f700 1 --2- 172.21.15.107:0/3635192882 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f12140b29b0 0x7f12140b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:11.367 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.365+0000 7f121e7fc700 1 -- 172.21.15.107:0/3635192882 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f122000f020 con 0x7f1228108480 2024-05-10T10:57:11.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.366+0000 7f1239d36b80 1 -- 172.21.15.107:0/1461866804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f94654f0 msgr2=0x5633f94658d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:11.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.366+0000 7f1239d36b80 1 --2- 172.21.15.107:0/1461866804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f94654f0 0x5633f94658d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1218007cf0 tx=0x7f12180103d0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.366+0000 7f122d23f700 1 --2- 172.21.15.107:0/3635192882 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f12140b29b0 0x7f12140b4e70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x5633f9459510 tx=0x7f122400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:11.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.366+0000 7f1239d36b80 1 -- 172.21.15.107:0/1461866804 shutdown_connections 2024-05-10T10:57:11.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.366+0000 7f1239d36b80 1 --2- 172.21.15.107:0/1461866804 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f946a0e0 0x5633f946a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.366+0000 7f1239d36b80 1 --2- 172.21.15.107:0/1461866804 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f94654f0 0x5633f94658d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.370 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.366+0000 7f1239d36b80 1 --2- 172.21.15.107:0/1461866804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f9465e10 0x5633f9469ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.366+0000 7f1239d36b80 1 -- 172.21.15.107:0/1461866804 >> 172.21.15.107:0/1461866804 conn(0x5633f9388d00 msgr2=0x5633f9457880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:11.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.366+0000 7f1239d36b80 1 -- 172.21.15.107:0/1461866804 shutdown_connections 2024-05-10T10:57:11.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.366+0000 7f1239d36b80 1 -- 172.21.15.107:0/1461866804 wait complete. 2024-05-10T10:57:11.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.366+0000 7f1239d36b80 1 -- start start 2024-05-10T10:57:11.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.367+0000 7f1239d36b80 1 Processor -- start 2024-05-10T10:57:11.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.367+0000 7f1239d36b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f94654f0 0x5633f9471600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:11.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.367+0000 7f1239d36b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f9465e10 0x5633f946e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:11.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.367+0000 7f1239d36b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f946a0e0 0x5633f946eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:11.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.367+0000 7f122ca3e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f9465e10 0x5633f946e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:11.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.367+0000 7f122ca3e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f9465e10 0x5633f946e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54718/0 (socket says 172.21.15.107:54718) 2024-05-10T10:57:11.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.367+0000 7f122ca3e700 1 -- 172.21.15.107:0/2428771676 learned_addr learned my addr 172.21.15.107:0/2428771676 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:11.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.367+0000 7f1239d36b80 1 -- 172.21.15.107:0/2428771676 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5633f9472280 con 0x5633f9465e10 2024-05-10T10:57:11.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.367+0000 7f1239d36b80 1 -- 172.21.15.107:0/2428771676 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5633f9368060 con 0x5633f94654f0 2024-05-10T10:57:11.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.367+0000 7f1239d36b80 1 -- 172.21.15.107:0/2428771676 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5633f9472400 con 0x5633f946a0e0 2024-05-10T10:57:11.371 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.368+0000 7f1239d36b80 10 client.0 _ll_register_callbacks cb 0x5633f9342740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:57:11.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.368+0000 7f122da40700 1 --2- 172.21.15.107:0/2428771676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f946a0e0 0x5633f946eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:11.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.368+0000 7f122ca3e700 1 -- 172.21.15.107:0/2428771676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f946a0e0 msgr2=0x5633f946eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:11.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.368+0000 7f122ca3e700 1 --2- 172.21.15.107:0/2428771676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f946a0e0 0x5633f946eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.368+0000 7f122ca3e700 1 -- 172.21.15.107:0/2428771676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f94654f0 msgr2=0x5633f9471600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:11.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.368+0000 7f122ca3e700 1 --2- 172.21.15.107:0/2428771676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f94654f0 0x5633f9471600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.368+0000 7f122ca3e700 1 -- 172.21.15.107:0/2428771676 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633f93658f0 con 0x5633f9465e10 2024-05-10T10:57:11.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.368+0000 7f122ca3e700 1 --2- 172.21.15.107:0/2428771676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f9465e10 0x5633f946e9a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1218003f40 tx=0x7f1218010b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab748997b21b095a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:11.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.368+0000 7f1210ff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:57:11.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.368+0000 7f1210ff9700 1 -- 172.21.15.107:0/2428771676 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218028060 con 0x5633f9465e10 2024-05-10T10:57:11.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.368+0000 7f1210ff9700 1 -- 172.21.15.107:0/2428771676 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f12180052c0 con 0x5633f9465e10 2024-05-10T10:57:11.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.368+0000 7f1239d36b80 1 -- 172.21.15.107:0/2428771676 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1218010df0 con 0x5633f9465e10 2024-05-10T10:57:11.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.369+0000 7f1210ff9700 1 -- 172.21.15.107:0/2428771676 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1218003950 con 0x5633f9465e10 2024-05-10T10:57:11.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.369+0000 7f1239d36b80 10 client.15531 fetch_fsmap learned FSMap version 27 2024-05-10T10:57:11.372 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.369+0000 7f1239d36b80 1 -- 172.21.15.107:0/2428771676 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5633f947c930 con 0x5633f9465e10 2024-05-10T10:57:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.369+0000 7f1210ff9700 1 -- 172.21.15.107:0/2428771676 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1218005500 con 0x5633f9465e10 2024-05-10T10:57:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.369+0000 7f1210ff9700 1 -- 172.21.15.107:0/2428771676 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f121802d070 con 0x5633f9465e10 2024-05-10T10:57:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.369+0000 7f1239d36b80 10 client.15531 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:57:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.369+0000 7f1239d36b80 10 client.15531 resolve_mds: validated gid 24482 aka daemon mds.b 2024-05-10T10:57:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.369+0000 7f1239d36b80 20 client.15531 populate_metadata read hostname 'smithi107' 2024-05-10T10:57:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.369+0000 7f1239d36b80 1 --2- 172.21.15.107:0/2428771676 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5633f947ef10 0x5633f9481300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.369+0000 7f1239d36b80 4 client.15531 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:57:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.369+0000 7f1239d36b80 1 -- 172.21.15.107:0/2428771676 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1218010df0 con 0x5633f947ef10 2024-05-10T10:57:11.373 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.370+0000 7f122d23f700 1 --2- 172.21.15.107:0/2428771676 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5633f947ef10 0x5633f9481300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:11.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.370+0000 7f122d23f700 1 --2- 172.21.15.107:0/2428771676 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5633f947ef10 0x5633f9481300 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa6c6ba6de716648 server_cookie=347d2c7339eead07 in_seq=0 out_seq=0 2024-05-10T10:57:11.374 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.370+0000 7f1210ff9700 10 client.15531 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:11.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.371+0000 7f1210ff9700 1 -- 172.21.15.107:0/2428771676 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f1218010df0 con 0x5633f947ef10 2024-05-10T10:57:11.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.371+0000 7f1210ff9700 10 client.15531 handle_command_reply: tid=0 2024-05-10T10:57:11.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.371+0000 7f1239d36b80 1 client.15531 shutdown 2024-05-10T10:57:11.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.371+0000 7f1239d36b80 1 -- 172.21.15.107:0/2428771676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f9465e10 msgr2=0x5633f946e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:11.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.371+0000 7f1239d36b80 1 --2- 172.21.15.107:0/2428771676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f9465e10 0x5633f946e9a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1218003f40 tx=0x7f1218010b00 comp rx=0 tx=0).stop 2024-05-10T10:57:11.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.371+0000 7f1239d36b80 1 -- 172.21.15.107:0/2428771676 shutdown_connections 2024-05-10T10:57:11.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.371+0000 7f1239d36b80 1 --2- 172.21.15.107:0/2428771676 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f946a0e0 0x5633f946eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.371+0000 7f1239d36b80 1 --2- 172.21.15.107:0/2428771676 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5633f947ef10 0x5633f9481300 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.371+0000 7f1239d36b80 1 --2- 172.21.15.107:0/2428771676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f94654f0 0x5633f9471600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.372+0000 7f1239d36b80 1 --2- 172.21.15.107:0/2428771676 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f9465e10 0x5633f946e9a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.372+0000 7f1210ff9700 0 client.15531 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:11.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.372+0000 7f1239d36b80 1 -- 172.21.15.107:0/2428771676 >> 172.21.15.107:0/2428771676 conn(0x5633f9388d00 msgr2=0x5633f946b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:11.375 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.372+0000 7f1239d36b80 1 -- 172.21.15.107:0/2428771676 shutdown_connections 2024-05-10T10:57:11.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.372+0000 7f1239d36b80 1 -- 172.21.15.107:0/2428771676 wait complete. 2024-05-10T10:57:11.376 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.372+0000 7f1239d36b80 20 client.15531 trim_cache size 0 max 16384 2024-05-10T10:57:11.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.407+0000 7f1239d36b80 1 Processor -- start 2024-05-10T10:57:11.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.407+0000 7f1239d36b80 1 -- start start 2024-05-10T10:57:11.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.408+0000 7f1239d36b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f94654f0 0x5633f946db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:11.417 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.408+0000 7f1239d36b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f9465e10 0x5633f945c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:11.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.408+0000 7f1239d36b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f946a0e0 0x5633f9484320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:11.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.408+0000 7f122ca3e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f9465e10 0x5633f945c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:11.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.408+0000 7f1239d36b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f12281ab720 con 0x5633f9465e10 2024-05-10T10:57:11.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.408+0000 7f1239d36b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f12281ad260 con 0x5633f94654f0 2024-05-10T10:57:11.418 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.408+0000 7f1239d36b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f12281abdf0 con 0x5633f946a0e0 2024-05-10T10:57:11.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.408+0000 7f122ca3e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f9465e10 0x5633f945c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54728/0 (socket says 172.21.15.107:54728) 2024-05-10T10:57:11.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.408+0000 7f122ca3e700 1 -- 172.21.15.107:0/3254156889 learned_addr learned my addr 172.21.15.107:0/3254156889 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:11.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.408+0000 7f122da40700 1 --2- 172.21.15.107:0/3254156889 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f946a0e0 0x5633f9484320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:11.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.408+0000 7f122d23f700 1 --2- 172.21.15.107:0/3254156889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f94654f0 0x5633f946db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:11.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.409+0000 7f122d23f700 1 -- 172.21.15.107:0/3254156889 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f946a0e0 msgr2=0x5633f9484320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:11.419 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.409+0000 7f122d23f700 1 --2- 172.21.15.107:0/3254156889 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f946a0e0 0x5633f9484320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.409+0000 7f122d23f700 1 -- 172.21.15.107:0/3254156889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f9465e10 msgr2=0x5633f945c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:11.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.409+0000 7f122d23f700 1 --2- 172.21.15.107:0/3254156889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f9465e10 0x5633f945c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.409+0000 7f122d23f700 1 -- 172.21.15.107:0/3254156889 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633f946cf30 con 0x5633f94654f0 2024-05-10T10:57:11.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.409+0000 7f122ca3e700 1 --2- 172.21.15.107:0/3254156889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f9465e10 0x5633f945c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:57:11.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.409+0000 7f122d23f700 1 --2- 172.21.15.107:0/3254156889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f94654f0 0x5633f946db40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x5633f9472490 tx=0x7f1224016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5ab577fb150928a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:11.420 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.409+0000 7f1212ffd700 1 -- 172.21.15.107:0/3254156889 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122401eb60 con 0x5633f94654f0 2024-05-10T10:57:11.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.409+0000 7f1212ffd700 1 -- 172.21.15.107:0/3254156889 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f12240044f0 con 0x5633f94654f0 2024-05-10T10:57:11.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.409+0000 7f1212ffd700 1 -- 172.21.15.107:0/3254156889 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224028a00 con 0x5633f94654f0 2024-05-10T10:57:11.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.410+0000 7f1239d36b80 1 -- 172.21.15.107:0/3254156889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f94654f0 msgr2=0x5633f946db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:11.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.410+0000 7f1239d36b80 1 --2- 172.21.15.107:0/3254156889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f94654f0 0x5633f946db40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x5633f9472490 tx=0x7f1224016000 comp rx=0 tx=0).stop 2024-05-10T10:57:11.421 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.410+0000 7f1239d36b80 1 -- 172.21.15.107:0/3254156889 shutdown_connections 2024-05-10T10:57:11.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.410+0000 7f1239d36b80 1 --2- 172.21.15.107:0/3254156889 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f946a0e0 0x5633f9484320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.410+0000 7f1239d36b80 1 --2- 172.21.15.107:0/3254156889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f94654f0 0x5633f946db40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.410+0000 7f1239d36b80 1 --2- 172.21.15.107:0/3254156889 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f9465e10 0x5633f945c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.410+0000 7f1239d36b80 1 -- 172.21.15.107:0/3254156889 >> 172.21.15.107:0/3254156889 conn(0x5633f9388d00 msgr2=0x5633f945baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:11.422 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.411+0000 7f1239d36b80 1 -- 172.21.15.107:0/3254156889 shutdown_connections 2024-05-10T10:57:11.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.411+0000 7f1239d36b80 1 -- 172.21.15.107:0/3254156889 wait complete. 2024-05-10T10:57:11.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.411+0000 7f1239d36b80 1 -- start start 2024-05-10T10:57:11.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.411+0000 7f1239d36b80 1 Processor -- start 2024-05-10T10:57:11.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.412+0000 7f1239d36b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f94654f0 0x5633f9482fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:11.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.412+0000 7f1239d36b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f9465e10 0x5633f9483520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:11.423 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.412+0000 7f1239d36b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f946a0e0 0x5633f9483a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:11.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.412+0000 7f1239d36b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f12281acb90 con 0x5633f946a0e0 2024-05-10T10:57:11.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.412+0000 7f1239d36b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f12281ac4c0 con 0x5633f9465e10 2024-05-10T10:57:11.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.412+0000 7f1239d36b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f12281a96e0 con 0x5633f94654f0 2024-05-10T10:57:11.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.412+0000 7f1239d36b80 10 client.0 _ll_register_callbacks cb 0x5633f9342740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:57:11.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.412+0000 7f122da40700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f946a0e0 0x5633f9483a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:11.424 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.412+0000 7f122da40700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f946a0e0 0x5633f9483a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54740/0 (socket says 172.21.15.107:54740) 2024-05-10T10:57:11.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.412+0000 7f122da40700 1 -- 172.21.15.107:0/637361818 learned_addr learned my addr 172.21.15.107:0/637361818 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:11.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.412+0000 7f122ca3e700 1 --2- 172.21.15.107:0/637361818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f9465e10 0x5633f9483520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:11.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.412+0000 7f122d23f700 1 --2- 172.21.15.107:0/637361818 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f94654f0 0x5633f9482fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:11.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.412+0000 7f122da40700 1 -- 172.21.15.107:0/637361818 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f94654f0 msgr2=0x5633f9482fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:11.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.412+0000 7f122da40700 1 --2- 172.21.15.107:0/637361818 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f94654f0 0x5633f9482fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.425 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.412+0000 7f122da40700 1 -- 172.21.15.107:0/637361818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f9465e10 msgr2=0x5633f9483520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:11.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.412+0000 7f122da40700 1 --2- 172.21.15.107:0/637361818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f9465e10 0x5633f9483520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.412+0000 7f122da40700 1 -- 172.21.15.107:0/637361818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633f94e9540 con 0x5633f946a0e0 2024-05-10T10:57:11.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.412+0000 7f122ca3e700 1 --2- 172.21.15.107:0/637361818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f9465e10 0x5633f9483520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:57:11.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.413+0000 7f122da40700 1 --2- 172.21.15.107:0/637361818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f946a0e0 0x5633f9483a60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f12200aad50 tx=0x7f12200aa530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846b6807bd4a3c0a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:11.426 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.413+0000 7f1210ff9700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:57:11.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.413+0000 7f1210ff9700 1 -- 172.21.15.107:0/637361818 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12200ab4c0 con 0x5633f946a0e0 2024-05-10T10:57:11.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.413+0000 7f1210ff9700 1 -- 172.21.15.107:0/637361818 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f12200c53c0 con 0x5633f946a0e0 2024-05-10T10:57:11.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.413+0000 7f1239d36b80 1 -- 172.21.15.107:0/637361818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12240044f0 con 0x5633f946a0e0 2024-05-10T10:57:11.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.414+0000 7f1210ff9700 1 -- 172.21.15.107:0/637361818 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f12200aadc0 con 0x5633f946a0e0 2024-05-10T10:57:11.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.414+0000 7f1239d36b80 10 client.15537 fetch_fsmap learned FSMap version 27 2024-05-10T10:57:11.427 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.414+0000 7f1239d36b80 1 -- 172.21.15.107:0/637361818 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5633f94ea860 con 0x5633f946a0e0 2024-05-10T10:57:11.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.414+0000 7f1210ff9700 1 -- 172.21.15.107:0/637361818 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f12240044f0 con 0x5633f946a0e0 2024-05-10T10:57:11.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.414+0000 7f1210ff9700 1 -- 172.21.15.107:0/637361818 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1220011070 con 0x5633f946a0e0 2024-05-10T10:57:11.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.414+0000 7f1239d36b80 10 client.15537 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:57:11.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.414+0000 7f1239d36b80 10 client.15537 resolve_mds: validated gid 24482 aka daemon mds.b 2024-05-10T10:57:11.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.414+0000 7f1239d36b80 20 client.15537 populate_metadata read hostname 'smithi107' 2024-05-10T10:57:11.428 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.414+0000 7f1239d36b80 1 --2- 172.21.15.107:0/637361818 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5633f947ef10 0x5633f94ecff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:11.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.414+0000 7f1239d36b80 4 client.15537 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.65, "await_for": 42.0}] 2024-05-10T10:57:11.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.414+0000 7f1239d36b80 1 -- 172.21.15.107:0/637361818 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.65, "await_for": 42.0}) -- 0x5633f93bc4b0 con 0x5633f947ef10 2024-05-10T10:57:11.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.414+0000 7f122d23f700 1 --2- 172.21.15.107:0/637361818 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5633f947ef10 0x5633f94ecff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:11.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.415+0000 7f1210ff9700 10 client.15537 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:11.429 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.415+0000 7f122d23f700 1 --2- 172.21.15.107:0/637361818 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5633f947ef10 0x5633f94ecff0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb41fcc96572029c server_cookie=b29b3d6d11514ce7 in_seq=0 out_seq=0 2024-05-10T10:57:11.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.425+0000 7f1210ff9700 1 -- 172.21.15.107:0/637361818 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5633f93bc4b0 con 0x5633f947ef10 2024-05-10T10:57:11.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.425+0000 7f1210ff9700 10 client.15537 handle_command_reply: tid=0 2024-05-10T10:57:11.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.425+0000 7f1239d36b80 1 client.15537 shutdown 2024-05-10T10:57:11.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.425+0000 7f1239d36b80 1 -- 172.21.15.107:0/637361818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f946a0e0 msgr2=0x5633f9483a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:11.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.425+0000 7f1239d36b80 1 --2- 172.21.15.107:0/637361818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f946a0e0 0x5633f9483a60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f12200aad50 tx=0x7f12200aa530 comp rx=0 tx=0).stop 2024-05-10T10:57:11.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.425+0000 7f1239d36b80 1 -- 172.21.15.107:0/637361818 shutdown_connections 2024-05-10T10:57:11.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.425+0000 7f1239d36b80 1 --2- 172.21.15.107:0/637361818 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5633f94654f0 0x5633f9482fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.432 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.425+0000 7f1239d36b80 1 --2- 172.21.15.107:0/637361818 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5633f947ef10 0x5633f94ecff0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.425+0000 7f1239d36b80 1 --2- 172.21.15.107:0/637361818 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5633f946a0e0 0x5633f9483a60 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.425+0000 7f1239d36b80 1 --2- 172.21.15.107:0/637361818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633f9465e10 0x5633f9483520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.425+0000 7f1239d36b80 1 -- 172.21.15.107:0/637361818 >> 172.21.15.107:0/637361818 conn(0x5633f9388d00 msgr2=0x5633f946ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:11.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.425+0000 7f1210ff9700 0 client.15537 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:11.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.426+0000 7f1239d36b80 1 -- 172.21.15.107:0/637361818 shutdown_connections 2024-05-10T10:57:11.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.426+0000 7f1239d36b80 1 -- 172.21.15.107:0/637361818 wait complete. 2024-05-10T10:57:11.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.426+0000 7f1239d36b80 20 client.15537 trim_cache size 0 max 16384 2024-05-10T10:57:11.434 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:57:11.434 INFO:teuthology.orchestra.run.smithi107.stdout: "epoch": 27, 2024-05-10T10:57:11.435 INFO:teuthology.orchestra.run.smithi107.stdout: "leader": 24482, 2024-05-10T10:57:11.435 INFO:teuthology.orchestra.run.smithi107.stdout: "set_version": 6, 2024-05-10T10:57:11.435 INFO:teuthology.orchestra.run.smithi107.stdout: "sets": { 2024-05-10T10:57:11.435 INFO:teuthology.orchestra.run.smithi107.stdout: "13975d87": { 2024-05-10T10:57:11.435 INFO:teuthology.orchestra.run.smithi107.stdout: "version": 6, 2024-05-10T10:57:11.435 INFO:teuthology.orchestra.run.smithi107.stdout: "age_ref": 0.0, 2024-05-10T10:57:11.436 INFO:teuthology.orchestra.run.smithi107.stdout: "state": { 2024-05-10T10:57:11.436 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "QUIESCED", 2024-05-10T10:57:11.436 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0 2024-05-10T10:57:11.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T10:57:11.436 INFO:teuthology.orchestra.run.smithi107.stdout: "timeout": 60.0, 2024-05-10T10:57:11.437 INFO:teuthology.orchestra.run.smithi107.stdout: "expiration": 86.7, 2024-05-10T10:57:11.437 INFO:teuthology.orchestra.run.smithi107.stdout: "members": { 2024-05-10T10:57:11.437 INFO:teuthology.orchestra.run.smithi107.stdout: "file:/": { 2024-05-10T10:57:11.437 INFO:teuthology.orchestra.run.smithi107.stdout: "excluded": false, 2024-05-10T10:57:11.437 INFO:teuthology.orchestra.run.smithi107.stdout: "state": { 2024-05-10T10:57:11.437 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "QUIESCED", 2024-05-10T10:57:11.438 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0 2024-05-10T10:57:11.438 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:57:11.438 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:57:11.438 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:57:11.438 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:57:11.438 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:57:11.439 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:57:11.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.427+0000 7f122f4a3700 1 -- 172.21.15.107:0/3635192882 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f12140b29b0 msgr2=0x7f12140b4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:11.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.427+0000 7f122f4a3700 1 --2- 172.21.15.107:0/3635192882 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f12140b29b0 0x7f12140b4e70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x5633f9459510 tx=0x7f122400b410 comp rx=0 tx=0).stop 2024-05-10T10:57:11.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.427+0000 7f122f4a3700 1 -- 172.21.15.107:0/3635192882 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1228108480 msgr2=0x7f1228199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:11.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.427+0000 7f122f4a3700 1 --2- 172.21.15.107:0/3635192882 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1228108480 0x7f1228199860 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f122000b070 tx=0x7f1220007a20 comp rx=0 tx=0).stop 2024-05-10T10:57:11.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.427+0000 7f122f4a3700 1 -- 172.21.15.107:0/3635192882 shutdown_connections 2024-05-10T10:57:11.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.427+0000 7f122f4a3700 1 --2- 172.21.15.107:0/3635192882 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f12140b29b0 0x7f12140b4e70 secure :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0x5633f9459510 tx=0x7f122400b410 comp rx=0 tx=0).stop 2024-05-10T10:57:11.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.427+0000 7f122f4a3700 1 --2- 172.21.15.107:0/3635192882 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f12281023d0 0x7f122819f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.427+0000 7f122f4a3700 1 --2- 172.21.15.107:0/3635192882 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1228108480 0x7f1228199860 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.427+0000 7f122f4a3700 1 --2- 172.21.15.107:0/3635192882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1228102d90 0x7f122819fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:11.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.427+0000 7f122f4a3700 1 -- 172.21.15.107:0/3635192882 >> 172.21.15.107:0/3635192882 conn(0x7f12280793e0 msgr2=0x7f1228100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:11.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.427+0000 7f122f4a3700 1 -- 172.21.15.107:0/3635192882 shutdown_connections 2024-05-10T10:57:11.441 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:11.427+0000 7f122f4a3700 1 -- 172.21.15.107:0/3635192882 wait complete. 2024-05-10T10:57:11.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:11 smithi196 ceph-mon[34872]: pgmap v433: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:57:11.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:11 smithi184 ceph-mon[34585]: pgmap v433: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:57:12.305 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '13975d87', quiesce took 6.5 seconds. Will release after: 26.65 2024-05-10T10:57:13.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:13 smithi107 ceph-mon[30373]: pgmap v434: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T10:57:13.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:13 smithi196 ceph-mon[34872]: pgmap v434: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T10:57:13.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:13 smithi184 ceph-mon[34585]: pgmap v434: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 11 op/s 2024-05-10T10:57:15.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:15 smithi107 ceph-mon[30373]: pgmap v435: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:57:15.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:15 smithi196 ceph-mon[34872]: pgmap v435: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:57:15.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:15 smithi184 ceph-mon[34585]: pgmap v435: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:57:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.551+0000 7f0a73e09640 1 -- 172.21.15.107:0/43704958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a6c105e00 msgr2=0x7f0a6c1081f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.551+0000 7f0a73e09640 1 --2- 172.21.15.107:0/43704958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a6c105e00 0x7f0a6c1081f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009900 tx=0x7f0a5c02a410 comp rx=0 tx=0).stop 2024-05-10T10:57:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.551+0000 7f0a73e09640 1 -- 172.21.15.107:0/43704958 shutdown_connections 2024-05-10T10:57:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.551+0000 7f0a73e09640 1 --2- 172.21.15.107:0/43704958 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a6c108730 0x7f0a6c10ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.551+0000 7f0a73e09640 1 --2- 172.21.15.107:0/43704958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a6c105e00 0x7f0a6c1081f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.551+0000 7f0a73e09640 1 --2- 172.21.15.107:0/43704958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a6c1034d0 0x7f0a6c1058c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.551+0000 7f0a73e09640 1 -- 172.21.15.107:0/43704958 >> 172.21.15.107:0/43704958 conn(0x7f0a6c0fce80 msgr2=0x7f0a6c0ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.551+0000 7f0a73e09640 1 -- 172.21.15.107:0/43704958 shutdown_connections 2024-05-10T10:57:16.554 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.551+0000 7f0a73e09640 1 -- 172.21.15.107:0/43704958 wait complete. 2024-05-10T10:57:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.551+0000 7f0a73e09640 1 Processor -- start 2024-05-10T10:57:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a73e09640 1 -- start start 2024-05-10T10:57:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a73e09640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a6c1034d0 0x7f0a6c198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a73e09640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a6c105e00 0x7f0a6c1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a73e09640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a6c108730 0x7f0a6c1a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a73e09640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c10e670 con 0x7f0a6c108730 2024-05-10T10:57:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a73e09640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c10e4f0 con 0x7f0a6c105e00 2024-05-10T10:57:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a73e09640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c10e7f0 con 0x7f0a6c1034d0 2024-05-10T10:57:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a723a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a6c108730 0x7f0a6c1a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a723a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a6c108730 0x7f0a6c1a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54750/0 (socket says 172.21.15.107:54750) 2024-05-10T10:57:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a723a6640 1 -- 172.21.15.107:0/434022872 learned_addr learned my addr 172.21.15.107:0/434022872 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a713a4640 1 --2- 172.21.15.107:0/434022872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a6c105e00 0x7f0a6c1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a71ba5640 1 --2- 172.21.15.107:0/434022872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a6c1034d0 0x7f0a6c198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a723a6640 1 -- 172.21.15.107:0/434022872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a6c1034d0 msgr2=0x7f0a6c198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a723a6640 1 --2- 172.21.15.107:0/434022872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a6c1034d0 0x7f0a6c198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a723a6640 1 -- 172.21.15.107:0/434022872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a6c105e00 msgr2=0x7f0a6c1991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a723a6640 1 --2- 172.21.15.107:0/434022872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a6c105e00 0x7f0a6c1991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a723a6640 1 -- 172.21.15.107:0/434022872 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a6c1a0870 con 0x7f0a6c108730 2024-05-10T10:57:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a71ba5640 1 --2- 172.21.15.107:0/434022872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a6c1034d0 0x7f0a6c198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:57:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a723a6640 1 --2- 172.21.15.107:0/434022872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a6c108730 0x7f0a6c1a01d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400cad0 tx=0x7f0a6400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.552+0000 7f0a62ffd640 1 -- 172.21.15.107:0/434022872 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6400ae20 con 0x7f0a6c108730 2024-05-10T10:57:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.553+0000 7f0a62ffd640 1 -- 172.21.15.107:0/434022872 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0a64005020 con 0x7f0a6c108730 2024-05-10T10:57:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.553+0000 7f0a73e09640 1 -- 172.21.15.107:0/434022872 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a6c1a0b60 con 0x7f0a6c108730 2024-05-10T10:57:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.553+0000 7f0a62ffd640 1 -- 172.21.15.107:0/434022872 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6400f6b0 con 0x7f0a6c108730 2024-05-10T10:57:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.553+0000 7f0a73e09640 1 -- 172.21.15.107:0/434022872 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a6c1a10b0 con 0x7f0a6c108730 2024-05-10T10:57:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.555+0000 7f0a76bfe740 1 Processor -- start 2024-05-10T10:57:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.556+0000 7f0a62ffd640 1 -- 172.21.15.107:0/434022872 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f0a640051d0 con 0x7f0a6c108730 2024-05-10T10:57:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.556+0000 7f0a76bfe740 1 -- start start 2024-05-10T10:57:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a76bfe740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 0x560ebdc5e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a76bfe740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 0x560ebdc632a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a76bfe740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc63910 0x560ebdc65da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a76bfe740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560ebdbc25d0 con 0x560ebdc5ddb0 2024-05-10T10:57:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a76bfe740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560ebdb7b890 con 0x560ebdc5e7a0 2024-05-10T10:57:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a76bfe740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560ebdbbe590 con 0x560ebdc63910 2024-05-10T10:57:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a713a4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 0x560ebdc5e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a713a4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 0x560ebdc5e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54752/0 (socket says 172.21.15.107:54752) 2024-05-10T10:57:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a713a4640 1 -- 172.21.15.107:0/3753337939 learned_addr learned my addr 172.21.15.107:0/3753337939 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a713a4640 1 --2- 172.21.15.107:0/3753337939 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc63910 0x560ebdc65da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a71ba5640 1 --2- 172.21.15.107:0/3753337939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 0x560ebdc632a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a713a4640 1 -- 172.21.15.107:0/3753337939 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc63910 msgr2=0x560ebdc65da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a713a4640 1 --2- 172.21.15.107:0/3753337939 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc63910 0x560ebdc65da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a713a4640 1 -- 172.21.15.107:0/3753337939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 msgr2=0x560ebdc632a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a713a4640 1 --2- 172.21.15.107:0/3753337939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 0x560ebdc632a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a713a4640 1 -- 172.21.15.107:0/3753337939 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ebd8d4210 con 0x560ebdc5ddb0 2024-05-10T10:57:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a71ba5640 1 --2- 172.21.15.107:0/3753337939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 0x560ebdc632a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:57:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a62ffd640 1 --2- 172.21.15.107:0/434022872 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0a580b28a0 0x7f0a580b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a713a4640 1 --2- 172.21.15.107:0/3753337939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 0x560ebdc5e1d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c06ab80 tx=0x7f0a5c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ce3fd2f04a2f91 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a71ba5640 1 --2- 172.21.15.107:0/434022872 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0a580b28a0 0x7f0a580b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a62ffd640 1 -- 172.21.15.107:0/434022872 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f0a640e21b0 con 0x7f0a6c108730 2024-05-10T10:57:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.557+0000 7f0a57fff640 1 -- 172.21.15.107:0/3753337939 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c035040 con 0x560ebdc5ddb0 2024-05-10T10:57:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.558+0000 7f0a57fff640 1 -- 172.21.15.107:0/3753337939 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0a5c005020 con 0x560ebdc5ddb0 2024-05-10T10:57:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.558+0000 7f0a57fff640 1 -- 172.21.15.107:0/3753337939 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c004a00 con 0x560ebdc5ddb0 2024-05-10T10:57:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.558+0000 7f0a76bfe740 1 -- 172.21.15.107:0/3753337939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 msgr2=0x560ebdc5e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.558+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/3753337939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 0x560ebdc5e1d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c06ab80 tx=0x7f0a5c000bc0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.558+0000 7f0a71ba5640 1 --2- 172.21.15.107:0/434022872 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0a580b28a0 0x7f0a580b4d60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0a68005fd0 tx=0x7f0a68005f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.558+0000 7f0a76bfe740 1 -- 172.21.15.107:0/3753337939 shutdown_connections 2024-05-10T10:57:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.558+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/3753337939 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc63910 0x560ebdc65da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.558+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/3753337939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 0x560ebdc632a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.558+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/3753337939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 0x560ebdc5e1d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.558+0000 7f0a76bfe740 1 -- 172.21.15.107:0/3753337939 >> 172.21.15.107:0/3753337939 conn(0x560ebdc59420 msgr2=0x560ebdc59820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.558+0000 7f0a76bfe740 1 -- 172.21.15.107:0/3753337939 shutdown_connections 2024-05-10T10:57:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.558+0000 7f0a76bfe740 1 -- 172.21.15.107:0/3753337939 wait complete. 2024-05-10T10:57:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.559+0000 7f0a76bfe740 1 -- start start 2024-05-10T10:57:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.559+0000 7f0a76bfe740 1 Processor -- start 2024-05-10T10:57:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.559+0000 7f0a76bfe740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 0x560ebdc67fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.559+0000 7f0a76bfe740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 0x560ebdc68500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.559+0000 7f0a76bfe740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc63910 0x560ebdc6f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.559+0000 7f0a76bfe740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x560ebdc66800 con 0x560ebdc5ddb0 2024-05-10T10:57:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.559+0000 7f0a76bfe740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560ebdb7f370 con 0x560ebdc5e7a0 2024-05-10T10:57:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.559+0000 7f0a76bfe740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x560ebdc66980 con 0x560ebdc63910 2024-05-10T10:57:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.559+0000 7f0a76bfe740 10 client.0 _ll_register_callbacks cb 0x560ebd8d3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:57:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.559+0000 7f0a71ba5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 0x560ebdc67fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.559+0000 7f0a71ba5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 0x560ebdc67fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54760/0 (socket says 172.21.15.107:54760) 2024-05-10T10:57:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.559+0000 7f0a71ba5640 1 -- 172.21.15.107:0/416024128 learned_addr learned my addr 172.21.15.107:0/416024128 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.560+0000 7f0a723a6640 1 --2- 172.21.15.107:0/416024128 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc63910 0x560ebdc6f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.560+0000 7f0a713a4640 1 --2- 172.21.15.107:0/416024128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 0x560ebdc68500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.560+0000 7f0a71ba5640 1 -- 172.21.15.107:0/416024128 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc63910 msgr2=0x560ebdc6f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.560+0000 7f0a71ba5640 1 --2- 172.21.15.107:0/416024128 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc63910 0x560ebdc6f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.560+0000 7f0a71ba5640 1 -- 172.21.15.107:0/416024128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 msgr2=0x560ebdc68500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.560+0000 7f0a71ba5640 1 --2- 172.21.15.107:0/416024128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 0x560ebdc68500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.560+0000 7f0a71ba5640 1 -- 172.21.15.107:0/416024128 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ebd9a0620 con 0x560ebdc5ddb0 2024-05-10T10:57:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.560+0000 7f0a713a4640 1 --2- 172.21.15.107:0/416024128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 0x560ebdc68500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.560+0000 7f0a71ba5640 1 --2- 172.21.15.107:0/416024128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 0x560ebdc67fc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0a68011e30 tx=0x7f0a680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7cc8f76ce8e271f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.560+0000 7f0a557fa640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:57:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.560+0000 7f0a557fa640 1 -- 172.21.15.107:0/416024128 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6801e420 con 0x560ebdc5ddb0 2024-05-10T10:57:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.560+0000 7f0a557fa640 1 -- 172.21.15.107:0/416024128 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f0a6801e5c0 con 0x560ebdc5ddb0 2024-05-10T10:57:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.560+0000 7f0a76bfe740 1 -- 172.21.15.107:0/416024128 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a5c005020 con 0x560ebdc5ddb0 2024-05-10T10:57:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.560+0000 7f0a557fa640 1 -- 172.21.15.107:0/416024128 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0a6801e7c0 con 0x560ebdc5ddb0 2024-05-10T10:57:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.560+0000 7f0a76bfe740 10 client.15549 fetch_fsmap learned FSMap version 27 2024-05-10T10:57:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.560+0000 7f0a76bfe740 1 -- 172.21.15.107:0/416024128 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560ebdc725d0 con 0x560ebdc5ddb0 2024-05-10T10:57:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.560+0000 7f0a557fa640 1 -- 172.21.15.107:0/416024128 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0a5c005020 con 0x560ebdc5ddb0 2024-05-10T10:57:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.560+0000 7f0a557fa640 1 -- 172.21.15.107:0/416024128 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0a6801c930 con 0x560ebdc5ddb0 2024-05-10T10:57:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.561+0000 7f0a76bfe740 10 client.15549 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:57:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.561+0000 7f0a76bfe740 10 client.15549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:57:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.561+0000 7f0a76bfe740 20 client.15549 populate_metadata read hostname 'smithi107' 2024-05-10T10:57:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.561+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/416024128 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x560ebdc73cc0 0x560ebdc76150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.561+0000 7f0a76bfe740 4 client.15549 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:57:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.561+0000 7f0a76bfe740 1 -- 172.21.15.107:0/416024128 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ebdbd01e0 con 0x560ebdc73cc0 2024-05-10T10:57:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.561+0000 7f0a713a4640 1 --2- 172.21.15.107:0/416024128 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x560ebdc73cc0 0x560ebdc76150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.561+0000 7f0a557fa640 10 client.15549 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.561+0000 7f0a713a4640 1 --2- 172.21.15.107:0/416024128 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x560ebdc73cc0 0x560ebdc76150 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13c3661a33bb6916 server_cookie=459ab9fdcbe7c9c5 in_seq=0 out_seq=0 2024-05-10T10:57:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.562+0000 7f0a557fa640 1 -- 172.21.15.107:0/416024128 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560ebdbd01e0 con 0x560ebdc73cc0 2024-05-10T10:57:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.562+0000 7f0a557fa640 10 client.15549 handle_command_reply: tid=0 2024-05-10T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.562+0000 7f0a76bfe740 1 client.15549 shutdown 2024-05-10T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.562+0000 7f0a76bfe740 1 -- 172.21.15.107:0/416024128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 msgr2=0x560ebdc67fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.562+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/416024128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 0x560ebdc67fc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0a68011e30 tx=0x7f0a680046c0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.562+0000 7f0a76bfe740 1 -- 172.21.15.107:0/416024128 shutdown_connections 2024-05-10T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.562+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/416024128 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x560ebdc73cc0 0x560ebdc76150 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.562+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/416024128 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc63910 0x560ebdc6f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.562+0000 7f0a557fa640 0 client.15549 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.562+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/416024128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 0x560ebdc68500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.562+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/416024128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 0x560ebdc67fc0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.562+0000 7f0a76bfe740 1 -- 172.21.15.107:0/416024128 >> 172.21.15.107:0/416024128 conn(0x560ebdc59420 msgr2=0x560ebdc58580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.562+0000 7f0a76bfe740 1 -- 172.21.15.107:0/416024128 shutdown_connections 2024-05-10T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.562+0000 7f0a76bfe740 1 -- 172.21.15.107:0/416024128 wait complete. 2024-05-10T10:57:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.562+0000 7f0a76bfe740 20 client.15549 trim_cache size 0 max 16384 2024-05-10T10:57:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.578+0000 7f0a76bfe740 1 Processor -- start 2024-05-10T10:57:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.578+0000 7f0a76bfe740 1 -- start start 2024-05-10T10:57:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.578+0000 7f0a76bfe740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc5ddb0 0x560ebdc67bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.578+0000 7f0a76bfe740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 0x560ebdc68110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.578+0000 7f0a76bfe740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc63910 0x560ebdc57cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.578+0000 7f0a76bfe740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c1a9bb0 con 0x560ebdc63910 2024-05-10T10:57:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.578+0000 7f0a76bfe740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c1ab6f0 con 0x560ebdc5e7a0 2024-05-10T10:57:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.578+0000 7f0a76bfe740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c1aa280 con 0x560ebdc5ddb0 2024-05-10T10:57:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.578+0000 7f0a723a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc63910 0x560ebdc57cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.578+0000 7f0a723a6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc63910 0x560ebdc57cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54776/0 (socket says 172.21.15.107:54776) 2024-05-10T10:57:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.578+0000 7f0a723a6640 1 -- 172.21.15.107:0/3650449986 learned_addr learned my addr 172.21.15.107:0/3650449986 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.578+0000 7f0a71ba5640 1 --2- 172.21.15.107:0/3650449986 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc5ddb0 0x560ebdc67bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.578+0000 7f0a713a4640 1 --2- 172.21.15.107:0/3650449986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 0x560ebdc68110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.578+0000 7f0a723a6640 1 -- 172.21.15.107:0/3650449986 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc5ddb0 msgr2=0x560ebdc67bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.578+0000 7f0a723a6640 1 --2- 172.21.15.107:0/3650449986 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc5ddb0 0x560ebdc67bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.578+0000 7f0a723a6640 1 -- 172.21.15.107:0/3650449986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 msgr2=0x560ebdc68110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.578+0000 7f0a723a6640 1 --2- 172.21.15.107:0/3650449986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 0x560ebdc68110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.578+0000 7f0a723a6640 1 -- 172.21.15.107:0/3650449986 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ebdc59250 con 0x560ebdc63910 2024-05-10T10:57:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.578+0000 7f0a723a6640 1 --2- 172.21.15.107:0/3650449986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc63910 0x560ebdc57cf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0a640a5860 tx=0x7f0a640a9f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e597e2db19d96a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.579+0000 7f0a577fe640 1 -- 172.21.15.107:0/3650449986 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a640e1070 con 0x560ebdc63910 2024-05-10T10:57:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.579+0000 7f0a577fe640 1 -- 172.21.15.107:0/3650449986 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0a640adc20 con 0x560ebdc63910 2024-05-10T10:57:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.579+0000 7f0a577fe640 1 -- 172.21.15.107:0/3650449986 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6401d040 con 0x560ebdc63910 2024-05-10T10:57:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.579+0000 7f0a76bfe740 1 -- 172.21.15.107:0/3650449986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc63910 msgr2=0x560ebdc57cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.579+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/3650449986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc63910 0x560ebdc57cf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0a640a5860 tx=0x7f0a640a9f70 comp rx=0 tx=0).stop 2024-05-10T10:57:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.579+0000 7f0a76bfe740 1 -- 172.21.15.107:0/3650449986 shutdown_connections 2024-05-10T10:57:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.579+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/3650449986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc63910 0x560ebdc57cf0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.579+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/3650449986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 0x560ebdc68110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.579+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/3650449986 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc5ddb0 0x560ebdc67bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.579+0000 7f0a76bfe740 1 -- 172.21.15.107:0/3650449986 >> 172.21.15.107:0/3650449986 conn(0x560ebdc59420 msgr2=0x560ebdc59800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.579+0000 7f0a76bfe740 1 -- 172.21.15.107:0/3650449986 shutdown_connections 2024-05-10T10:57:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.579+0000 7f0a76bfe740 1 -- 172.21.15.107:0/3650449986 wait complete. 2024-05-10T10:57:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a76bfe740 1 -- start start 2024-05-10T10:57:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a76bfe740 1 Processor -- start 2024-05-10T10:57:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a76bfe740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 0x560ebdc6c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a76bfe740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 0x560ebdc6c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a76bfe740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc63910 0x560ebdc6d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a76bfe740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c1ab020 con 0x560ebdc5ddb0 2024-05-10T10:57:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a76bfe740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c1aa950 con 0x560ebdc5e7a0 2024-05-10T10:57:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a76bfe740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c1a7b90 con 0x560ebdc63910 2024-05-10T10:57:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a76bfe740 10 client.0 _ll_register_callbacks cb 0x7f0a68011ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:57:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a71ba5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 0x560ebdc6c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a71ba5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 0x560ebdc6c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54792/0 (socket says 172.21.15.107:54792) 2024-05-10T10:57:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a71ba5640 1 -- 172.21.15.107:0/4266330920 learned_addr learned my addr 172.21.15.107:0/4266330920 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a723a6640 1 --2- 172.21.15.107:0/4266330920 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc63910 0x560ebdc6d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a71ba5640 1 -- 172.21.15.107:0/4266330920 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc63910 msgr2=0x560ebdc6d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a71ba5640 1 --2- 172.21.15.107:0/4266330920 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc63910 0x560ebdc6d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a713a4640 1 --2- 172.21.15.107:0/4266330920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 0x560ebdc6c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a71ba5640 1 -- 172.21.15.107:0/4266330920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 msgr2=0x560ebdc6c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a71ba5640 1 --2- 172.21.15.107:0/4266330920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 0x560ebdc6c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a71ba5640 1 -- 172.21.15.107:0/4266330920 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ebdc6ddc0 con 0x560ebdc5ddb0 2024-05-10T10:57:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a723a6640 1 --2- 172.21.15.107:0/4266330920 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc63910 0x560ebdc6d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.580+0000 7f0a713a4640 1 --2- 172.21.15.107:0/4266330920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 0x560ebdc6c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.581+0000 7f0a71ba5640 1 --2- 172.21.15.107:0/4266330920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 0x560ebdc6c340 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0a68011e30 tx=0x7f0a68000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5f2956c5aa8b70 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.581+0000 7f0a557fa640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:57:16.588 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.581+0000 7f0a557fa640 1 -- 172.21.15.107:0/4266330920 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6801ed70 con 0x560ebdc5ddb0 2024-05-10T10:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.581+0000 7f0a557fa640 1 -- 172.21.15.107:0/4266330920 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f0a68004020 con 0x560ebdc5ddb0 2024-05-10T10:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.581+0000 7f0a76bfe740 1 -- 172.21.15.107:0/4266330920 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a640adc20 con 0x560ebdc5ddb0 2024-05-10T10:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.581+0000 7f0a557fa640 1 -- 172.21.15.107:0/4266330920 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0a68004220 con 0x560ebdc5ddb0 2024-05-10T10:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.581+0000 7f0a76bfe740 10 client.15555 fetch_fsmap learned FSMap version 27 2024-05-10T10:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.581+0000 7f0a76bfe740 1 -- 172.21.15.107:0/4266330920 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560ebdcde680 con 0x560ebdc5ddb0 2024-05-10T10:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.581+0000 7f0a557fa640 1 -- 172.21.15.107:0/4266330920 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0a640adc20 con 0x560ebdc5ddb0 2024-05-10T10:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.581+0000 7f0a557fa640 1 -- 172.21.15.107:0/4266330920 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f0a680035f0 con 0x560ebdc5ddb0 2024-05-10T10:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.581+0000 7f0a76bfe740 10 client.15555 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.581+0000 7f0a76bfe740 10 client.15555 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.581+0000 7f0a76bfe740 20 client.15555 populate_metadata read hostname 'smithi107' 2024-05-10T10:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.581+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/4266330920 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x560ebdcdf0a0 0x560ebdce14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.581+0000 7f0a76bfe740 4 client.15555 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T10:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.581+0000 7f0a76bfe740 1 -- 172.21.15.107:0/4266330920 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560ebdbca050 con 0x560ebdcdf0a0 2024-05-10T10:57:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.582+0000 7f0a713a4640 1 --2- 172.21.15.107:0/4266330920 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x560ebdcdf0a0 0x560ebdce14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.582+0000 7f0a557fa640 10 client.15555 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.582+0000 7f0a713a4640 1 --2- 172.21.15.107:0/4266330920 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x560ebdcdf0a0 0x560ebdce14c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f007e77c6dc167d6 server_cookie=6f5bc04423ea1a20 in_seq=0 out_seq=0 2024-05-10T10:57:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.586+0000 7f0a557fa640 1 -- 172.21.15.107:0/4266330920 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560ebdbca050 con 0x560ebdcdf0a0 2024-05-10T10:57:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.586+0000 7f0a557fa640 10 client.15555 handle_command_reply: tid=0 2024-05-10T10:57:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.586+0000 7f0a76bfe740 1 client.15555 shutdown 2024-05-10T10:57:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.586+0000 7f0a76bfe740 1 -- 172.21.15.107:0/4266330920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 msgr2=0x560ebdc6c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.586+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/4266330920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 0x560ebdc6c340 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0a68011e30 tx=0x7f0a68000bc0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.586+0000 7f0a76bfe740 1 -- 172.21.15.107:0/4266330920 shutdown_connections 2024-05-10T10:57:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.586+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/4266330920 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x560ebdcdf0a0 0x560ebdce14c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.586+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/4266330920 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x560ebdc63910 0x560ebdc6d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.586+0000 7f0a557fa640 0 client.15555 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.586+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/4266330920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560ebdc5e7a0 0x560ebdc6c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.586+0000 7f0a76bfe740 1 --2- 172.21.15.107:0/4266330920 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x560ebdc5ddb0 0x560ebdc6c340 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.586+0000 7f0a76bfe740 1 -- 172.21.15.107:0/4266330920 >> 172.21.15.107:0/4266330920 conn(0x560ebdc59420 msgr2=0x560ebdc67b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.586+0000 7f0a76bfe740 1 -- 172.21.15.107:0/4266330920 shutdown_connections 2024-05-10T10:57:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.586+0000 7f0a76bfe740 1 -- 172.21.15.107:0/4266330920 wait complete. 2024-05-10T10:57:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.586+0000 7f0a76bfe740 20 client.15555 trim_cache size 0 max 16384 2024-05-10T10:57:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:{ 2024-05-10T10:57:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "message": "", 2024-05-10T10:57:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "return_code": 0 2024-05-10T10:57:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:} 2024-05-10T10:57:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.586+0000 7f0a73e09640 1 -- 172.21.15.107:0/434022872 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0a580b28a0 msgr2=0x7f0a580b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.586+0000 7f0a73e09640 1 --2- 172.21.15.107:0/434022872 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0a580b28a0 0x7f0a580b4d60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0a68005fd0 tx=0x7f0a68005f40 comp rx=0 tx=0).stop 2024-05-10T10:57:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.586+0000 7f0a73e09640 1 -- 172.21.15.107:0/434022872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a6c108730 msgr2=0x7f0a6c1a01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.586+0000 7f0a73e09640 1 --2- 172.21.15.107:0/434022872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a6c108730 0x7f0a6c1a01d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400cad0 tx=0x7f0a6400cf90 comp rx=0 tx=0).stop 2024-05-10T10:57:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.587+0000 7f0a73e09640 1 -- 172.21.15.107:0/434022872 shutdown_connections 2024-05-10T10:57:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.587+0000 7f0a73e09640 1 --2- 172.21.15.107:0/434022872 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0a580b28a0 0x7f0a580b4d60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.587+0000 7f0a73e09640 1 --2- 172.21.15.107:0/434022872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0a6c108730 0x7f0a6c1a01d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.594 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.587+0000 7f0a73e09640 1 --2- 172.21.15.107:0/434022872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a6c105e00 0x7f0a6c1991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.587+0000 7f0a73e09640 1 --2- 172.21.15.107:0/434022872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0a6c1034d0 0x7f0a6c198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.587+0000 7f0a73e09640 1 -- 172.21.15.107:0/434022872 >> 172.21.15.107:0/434022872 conn(0x7f0a6c0fce80 msgr2=0x7f0a6c103d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.587+0000 7f0a73e09640 1 -- 172.21.15.107:0/434022872 shutdown_connections 2024-05-10T10:57:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:16.587+0000 7f0a73e09640 1 -- 172.21.15.107:0/434022872 wait complete. 2024-05-10T10:57:16.607 INFO:tasks.workunit.client.0.smithi107.stderr:Updating files: 99% (12223/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-10T10:57:17.339 INFO:tasks.workunit.client.0.smithi107.stderr:Note: switching to 'd39fa08867836ac070c47cb66c782fa559fd480b'. 2024-05-10T10:57:17.340 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-05-10T10:57:17.340 INFO:tasks.workunit.client.0.smithi107.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-10T10:57:17.340 INFO:tasks.workunit.client.0.smithi107.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-10T10:57:17.340 INFO:tasks.workunit.client.0.smithi107.stderr:state without impacting any branches by switching back to a branch. 2024-05-10T10:57:17.340 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-05-10T10:57:17.340 INFO:tasks.workunit.client.0.smithi107.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-10T10:57:17.340 INFO:tasks.workunit.client.0.smithi107.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-10T10:57:17.340 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-05-10T10:57:17.340 INFO:tasks.workunit.client.0.smithi107.stderr: git switch -c 2024-05-10T10:57:17.340 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-05-10T10:57:17.340 INFO:tasks.workunit.client.0.smithi107.stderr:Or undo this operation with: 2024-05-10T10:57:17.340 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-05-10T10:57:17.340 INFO:tasks.workunit.client.0.smithi107.stderr: git switch - 2024-05-10T10:57:17.340 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-05-10T10:57:17.341 INFO:tasks.workunit.client.0.smithi107.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-10T10:57:17.341 INFO:tasks.workunit.client.0.smithi107.stderr: 2024-05-10T10:57:17.341 INFO:tasks.workunit.client.0.smithi107.stderr:HEAD is now at d39fa088678 client: fix file cache cap leak which can stall async read call 2024-05-10T10:57:17.346 DEBUG:teuthology.orchestra.run.smithi107:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-10T10:57:17.367 INFO:tasks.workunit.client.0.smithi107.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-10T10:57:17.369 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-10T10:57:17.369 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-10T10:57:17.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:17 smithi107 ceph-mon[30373]: pgmap v436: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-10T10:57:17.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:17 smithi196 ceph-mon[34872]: pgmap v436: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-10T10:57:17.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:17 smithi184 ceph-mon[34585]: pgmap v436: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-10T10:57:18.042 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-10T10:57:18.098 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-10T10:57:18.139 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-10T10:57:18.140 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-10T10:57:18.140 INFO:tasks.workunit.client.0.smithi107.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-10T10:57:18.180 INFO:tasks.workunit.client.0.smithi107.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-10T10:57:18.183 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T10:57:18.183 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-10T10:57:18.240 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-05-10T10:57:18.241 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-05-10T10:57:18.241 DEBUG:teuthology.orchestra.run.smithi107:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d39fa08867836ac070c47cb66c782fa559fd480b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-05-10T10:57:19.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:19 smithi107 ceph-mon[30373]: pgmap v437: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-10T10:57:19.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:19 smithi196 ceph-mon[34872]: pgmap v437: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-10T10:57:19.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:19 smithi184 ceph-mon[34585]: pgmap v437: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-10T10:57:21.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:21 smithi107 ceph-mon[30373]: pgmap v438: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-10T10:57:21.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:21 smithi196 ceph-mon[34872]: pgmap v438: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-10T10:57:21.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:21 smithi184 ceph-mon[34585]: pgmap v438: 97 pgs: 97 active+clean; 680 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-10T10:57:23.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:23 smithi107 ceph-mon[30373]: pgmap v439: 97 pgs: 97 active+clean; 681 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 11 op/s 2024-05-10T10:57:23.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:23 smithi196 ceph-mon[34872]: pgmap v439: 97 pgs: 97 active+clean; 681 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 11 op/s 2024-05-10T10:57:23.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:23 smithi184 ceph-mon[34585]: pgmap v439: 97 pgs: 97 active+clean; 681 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 11 op/s 2024-05-10T10:57:25.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:25 smithi107 ceph-mon[30373]: pgmap v440: 97 pgs: 97 active+clean; 681 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-10T10:57:25.440 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:25 smithi184 ceph-mon[34585]: pgmap v440: 97 pgs: 97 active+clean; 681 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-10T10:57:25.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:25 smithi196 ceph-mon[34872]: pgmap v440: 97 pgs: 97 active+clean; 681 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-10T10:57:27.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:27 smithi107 ceph-mon[30373]: pgmap v441: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-10T10:57:27.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:27 smithi196 ceph-mon[34872]: pgmap v441: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-10T10:57:27.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:27 smithi184 ceph-mon[34585]: pgmap v441: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-10T10:57:29.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:29 smithi107 ceph-mon[30373]: pgmap v442: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-05-10T10:57:29.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:29 smithi196 ceph-mon[34872]: pgmap v442: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-05-10T10:57:29.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:29 smithi184 ceph-mon[34585]: pgmap v442: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-05-10T10:57:29.686 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.683+0000 7fbcbe346640 1 -- 172.21.15.107:0/3593179668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb8105db0 msgr2=0x7fbcb81081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.683+0000 7fbcbe346640 1 --2- 172.21.15.107:0/3593179668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb8105db0 0x7fbcb81081a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbcac009900 tx=0x7fbcac02a410 comp rx=0 tx=0).stop 2024-05-10T10:57:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.683+0000 7fbcbe346640 1 -- 172.21.15.107:0/3593179668 shutdown_connections 2024-05-10T10:57:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.683+0000 7fbcbe346640 1 --2- 172.21.15.107:0/3593179668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcb81086e0 0x7fbcb810ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.683+0000 7fbcbe346640 1 --2- 172.21.15.107:0/3593179668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb8105db0 0x7fbcb81081a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.683+0000 7fbcbe346640 1 --2- 172.21.15.107:0/3593179668 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcb8103480 0x7fbcb8105870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.683+0000 7fbcbe346640 1 -- 172.21.15.107:0/3593179668 >> 172.21.15.107:0/3593179668 conn(0x7fbcb80fce70 msgr2=0x7fbcb80ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.683+0000 7fbcbe346640 1 -- 172.21.15.107:0/3593179668 shutdown_connections 2024-05-10T10:57:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.683+0000 7fbcbe346640 1 -- 172.21.15.107:0/3593179668 wait complete. 2024-05-10T10:57:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.683+0000 7fbcbe346640 1 Processor -- start 2024-05-10T10:57:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.683+0000 7fbcbe346640 1 -- start start 2024-05-10T10:57:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.684+0000 7fbcbe346640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb8103480 0x7fbcb8198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.684+0000 7fbcbe346640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcb8105db0 0x7fbcb81991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.684+0000 7fbcbe346640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcb81086e0 0x7fbcb81a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.684+0000 7fbcbe346640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb810e660 con 0x7fbcb8103480 2024-05-10T10:57:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.684+0000 7fbcbe346640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb810e4e0 con 0x7fbcb81086e0 2024-05-10T10:57:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.684+0000 7fbcbe346640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb810e7e0 con 0x7fbcb8105db0 2024-05-10T10:57:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.684+0000 7fbcb7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb8103480 0x7fbcb8198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.684+0000 7fbcb7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb8103480 0x7fbcb8198c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56210/0 (socket says 172.21.15.107:56210) 2024-05-10T10:57:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.684+0000 7fbcb7fff640 1 -- 172.21.15.107:0/3171761530 learned_addr learned my addr 172.21.15.107:0/3171761530 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.684+0000 7fbcbc8e3640 1 --2- 172.21.15.107:0/3171761530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcb81086e0 0x7fbcb81a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.684+0000 7fbcb77fe640 1 --2- 172.21.15.107:0/3171761530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcb8105db0 0x7fbcb81991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.684+0000 7fbcb7fff640 1 -- 172.21.15.107:0/3171761530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcb8105db0 msgr2=0x7fbcb81991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.684+0000 7fbcb7fff640 1 --2- 172.21.15.107:0/3171761530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcb8105db0 0x7fbcb81991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.684+0000 7fbcb7fff640 1 -- 172.21.15.107:0/3171761530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcb81086e0 msgr2=0x7fbcb81a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.684+0000 7fbcb7fff640 1 --2- 172.21.15.107:0/3171761530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcb81086e0 0x7fbcb81a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.684+0000 7fbcb7fff640 1 -- 172.21.15.107:0/3171761530 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb81a08c0 con 0x7fbcb8103480 2024-05-10T10:57:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.684+0000 7fbcbc8e3640 1 --2- 172.21.15.107:0/3171761530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcb81086e0 0x7fbcb81a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.684+0000 7fbcb77fe640 1 --2- 172.21.15.107:0/3171761530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcb8105db0 0x7fbcb81991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:29.689 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.684+0000 7fbcb7fff640 1 --2- 172.21.15.107:0/3171761530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb8103480 0x7fbcb8198c80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbca800d770 tx=0x7fbca800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:29.689 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.685+0000 7fbcb57fa640 1 -- 172.21.15.107:0/3171761530 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8017070 con 0x7fbcb8103480 2024-05-10T10:57:29.689 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.685+0000 7fbcb57fa640 1 -- 172.21.15.107:0/3171761530 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbca80054f0 con 0x7fbcb8103480 2024-05-10T10:57:29.689 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.685+0000 7fbcb57fa640 1 -- 172.21.15.107:0/3171761530 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8004de0 con 0x7fbcb8103480 2024-05-10T10:57:29.689 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.685+0000 7fbcbe346640 1 -- 172.21.15.107:0/3171761530 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb81a0bb0 con 0x7fbcb8103480 2024-05-10T10:57:29.689 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.685+0000 7fbcbe346640 1 -- 172.21.15.107:0/3171761530 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb81a10b0 con 0x7fbcb8103480 2024-05-10T10:57:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.687+0000 7fbcb57fa640 1 -- 172.21.15.107:0/3171761530 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7fbca8004f80 con 0x7fbcb8103480 2024-05-10T10:57:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcc1068740 1 Processor -- start 2024-05-10T10:57:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcc1068740 1 -- start start 2024-05-10T10:57:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcc1068740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55989f35b1c0 0x55989f35b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcc1068740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 0x55989f3606b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcc1068740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f360d20 0x55989f3631b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcc1068740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55989f2bb5d0 con 0x55989f35bbb0 2024-05-10T10:57:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcc1068740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55989f274890 con 0x55989f360d20 2024-05-10T10:57:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcc1068740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55989f2b7590 con 0x55989f35b1c0 2024-05-10T10:57:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcb7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 0x55989f3606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcb7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 0x55989f3606b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56222/0 (socket says 172.21.15.107:56222) 2024-05-10T10:57:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcb7fff640 1 -- 172.21.15.107:0/2532600260 learned_addr learned my addr 172.21.15.107:0/2532600260 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcbc8e3640 1 --2- 172.21.15.107:0/2532600260 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55989f35b1c0 0x55989f35b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcb77fe640 1 --2- 172.21.15.107:0/2532600260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f360d20 0x55989f3631b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:29.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcb7fff640 1 -- 172.21.15.107:0/2532600260 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55989f35b1c0 msgr2=0x55989f35b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:29.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcb7fff640 1 --2- 172.21.15.107:0/2532600260 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55989f35b1c0 0x55989f35b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcb7fff640 1 -- 172.21.15.107:0/2532600260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f360d20 msgr2=0x55989f3631b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:29.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcb7fff640 1 --2- 172.21.15.107:0/2532600260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f360d20 0x55989f3631b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcb7fff640 1 -- 172.21.15.107:0/2532600260 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989efcd210 con 0x55989f35bbb0 2024-05-10T10:57:29.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcb77fe640 1 --2- 172.21.15.107:0/2532600260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f360d20 0x55989f3631b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:57:29.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.688+0000 7fbcb57fa640 1 --2- 172.21.15.107:0/3171761530 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbca00b28a0 0x7fbca00b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:29.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.689+0000 7fbcbc8e3640 1 --2- 172.21.15.107:0/3171761530 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbca00b28a0 0x7fbca00b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:29.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.689+0000 7fbcb7fff640 1 --2- 172.21.15.107:0/2532600260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 0x55989f3606b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbca80e5fa0 tx=0x7fbca80e88d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0dd11fca01f2147 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:29.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.689+0000 7fbcb57fa640 1 -- 172.21.15.107:0/3171761530 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fbca80e1d60 con 0x7fbcb8103480 2024-05-10T10:57:29.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.689+0000 7fbc9e7fc640 1 -- 172.21.15.107:0/2532600260 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca80a52e0 con 0x55989f35bbb0 2024-05-10T10:57:29.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.689+0000 7fbc9e7fc640 1 -- 172.21.15.107:0/2532600260 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbca80a8f30 con 0x55989f35bbb0 2024-05-10T10:57:29.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.689+0000 7fbc9e7fc640 1 -- 172.21.15.107:0/2532600260 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca80a8b90 con 0x55989f35bbb0 2024-05-10T10:57:29.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.689+0000 7fbcc1068740 1 -- 172.21.15.107:0/2532600260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 msgr2=0x55989f3606b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:29.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.689+0000 7fbcc1068740 1 --2- 172.21.15.107:0/2532600260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 0x55989f3606b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbca80e5fa0 tx=0x7fbca80e88d0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.689+0000 7fbcbc8e3640 1 --2- 172.21.15.107:0/3171761530 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbca00b28a0 0x7fbca00b4d60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55989f35c410 tx=0x7fbcb0009790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:29.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.690+0000 7fbcc1068740 1 -- 172.21.15.107:0/2532600260 shutdown_connections 2024-05-10T10:57:29.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.690+0000 7fbcc1068740 1 --2- 172.21.15.107:0/2532600260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f360d20 0x55989f3631b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.690+0000 7fbcc1068740 1 --2- 172.21.15.107:0/2532600260 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 0x55989f3606b0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.690+0000 7fbcc1068740 1 --2- 172.21.15.107:0/2532600260 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55989f35b1c0 0x55989f35b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.690+0000 7fbcc1068740 1 -- 172.21.15.107:0/2532600260 >> 172.21.15.107:0/2532600260 conn(0x55989f352420 msgr2=0x55989f352820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:29.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.690+0000 7fbcc1068740 1 -- 172.21.15.107:0/2532600260 shutdown_connections 2024-05-10T10:57:29.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.690+0000 7fbcc1068740 1 -- 172.21.15.107:0/2532600260 wait complete. 2024-05-10T10:57:29.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.690+0000 7fbcc1068740 1 -- start start 2024-05-10T10:57:29.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.690+0000 7fbcc1068740 1 Processor -- start 2024-05-10T10:57:29.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.690+0000 7fbcc1068740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f35b1c0 0x55989f365430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.690+0000 7fbcc1068740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 0x55989f365970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.690+0000 7fbcc1068740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55989f360d20 0x55989f36c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.690+0000 7fbcc1068740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55989f363cd0 con 0x55989f35bbb0 2024-05-10T10:57:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.690+0000 7fbcc1068740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55989f278370 con 0x55989f35b1c0 2024-05-10T10:57:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.690+0000 7fbcc1068740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55989f363e50 con 0x55989f360d20 2024-05-10T10:57:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbcc1068740 10 client.0 _ll_register_callbacks cb 0x55989efcca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:57:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbcb77fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 0x55989f365970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbcb77fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 0x55989f365970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56232/0 (socket says 172.21.15.107:56232) 2024-05-10T10:57:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbcb77fe640 1 -- 172.21.15.107:0/2537700671 learned_addr learned my addr 172.21.15.107:0/2537700671 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbcbc8e3640 1 --2- 172.21.15.107:0/2537700671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55989f360d20 0x55989f36c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbcb7fff640 1 --2- 172.21.15.107:0/2537700671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f35b1c0 0x55989f365430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbcb77fe640 1 -- 172.21.15.107:0/2537700671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55989f360d20 msgr2=0x55989f36c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbcb77fe640 1 --2- 172.21.15.107:0/2537700671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55989f360d20 0x55989f36c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbcb77fe640 1 -- 172.21.15.107:0/2537700671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f35b1c0 msgr2=0x55989f365430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbcb77fe640 1 --2- 172.21.15.107:0/2537700671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f35b1c0 0x55989f365430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbcb77fe640 1 -- 172.21.15.107:0/2537700671 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55989f099620 con 0x55989f35bbb0 2024-05-10T10:57:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbcb7fff640 1 --2- 172.21.15.107:0/2537700671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f35b1c0 0x55989f365430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbcb77fe640 1 --2- 172.21.15.107:0/2537700671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 0x55989f365970 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbcb806bd40 tx=0x7fbcac0318c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d027750ddc51660d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbc977fe640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:57:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbc977fe640 1 -- 172.21.15.107:0/2537700671 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac03f070 con 0x55989f35bbb0 2024-05-10T10:57:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbc977fe640 1 -- 172.21.15.107:0/2537700671 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fbcac004450 con 0x55989f35bbb0 2024-05-10T10:57:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbcc1068740 1 -- 172.21.15.107:0/2537700671 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbca80a8f30 con 0x55989f35bbb0 2024-05-10T10:57:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbc977fe640 1 -- 172.21.15.107:0/2537700671 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbcac035070 con 0x55989f35bbb0 2024-05-10T10:57:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbcc1068740 10 client.15567 fetch_fsmap learned FSMap version 27 2024-05-10T10:57:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.691+0000 7fbcc1068740 1 -- 172.21.15.107:0/2537700671 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55989f36f9e0 con 0x55989f35bbb0 2024-05-10T10:57:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.692+0000 7fbc977fe640 1 -- 172.21.15.107:0/2537700671 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbca80a8f30 con 0x55989f35bbb0 2024-05-10T10:57:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.692+0000 7fbc977fe640 1 -- 172.21.15.107:0/2537700671 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fbcac004c90 con 0x55989f35bbb0 2024-05-10T10:57:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.692+0000 7fbcc1068740 10 client.15567 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:57:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.692+0000 7fbcc1068740 10 client.15567 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:57:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.692+0000 7fbcc1068740 20 client.15567 populate_metadata read hostname 'smithi107' 2024-05-10T10:57:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.692+0000 7fbcc1068740 1 --2- 172.21.15.107:0/2537700671 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55989f3710b0 0x55989f373520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.692+0000 7fbcc1068740 4 client.15567 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:57:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.692+0000 7fbcc1068740 1 -- 172.21.15.107:0/2537700671 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55989f2c91e0 con 0x55989f3710b0 2024-05-10T10:57:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.692+0000 7fbcb7fff640 1 --2- 172.21.15.107:0/2537700671 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55989f3710b0 0x55989f373520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.692+0000 7fbcb7fff640 1 --2- 172.21.15.107:0/2537700671 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55989f3710b0 0x55989f373520 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cd414e77c02394b server_cookie=407f7582ddfb07fa in_seq=0 out_seq=0 2024-05-10T10:57:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.692+0000 7fbc977fe640 10 client.15567 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.693+0000 7fbc977fe640 1 -- 172.21.15.107:0/2537700671 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55989f2c91e0 con 0x55989f3710b0 2024-05-10T10:57:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.693+0000 7fbc977fe640 10 client.15567 handle_command_reply: tid=0 2024-05-10T10:57:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.693+0000 7fbcc1068740 1 client.15567 shutdown 2024-05-10T10:57:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.693+0000 7fbcc1068740 1 -- 172.21.15.107:0/2537700671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 msgr2=0x55989f365970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.693+0000 7fbcc1068740 1 --2- 172.21.15.107:0/2537700671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 0x55989f365970 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbcb806bd40 tx=0x7fbcac0318c0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.693+0000 7fbcc1068740 1 -- 172.21.15.107:0/2537700671 shutdown_connections 2024-05-10T10:57:29.702 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.693+0000 7fbcc1068740 1 --2- 172.21.15.107:0/2537700671 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55989f3710b0 0x55989f373520 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.702 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.693+0000 7fbcc1068740 1 --2- 172.21.15.107:0/2537700671 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55989f360d20 0x55989f36c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.702 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.693+0000 7fbcc1068740 1 --2- 172.21.15.107:0/2537700671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 0x55989f365970 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.702 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.693+0000 7fbcc1068740 1 --2- 172.21.15.107:0/2537700671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f35b1c0 0x55989f365430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.702 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.693+0000 7fbc977fe640 0 client.15567 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:29.702 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.693+0000 7fbcc1068740 1 -- 172.21.15.107:0/2537700671 >> 172.21.15.107:0/2537700671 conn(0x55989f352420 msgr2=0x55989f351580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:29.702 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.693+0000 7fbcc1068740 1 -- 172.21.15.107:0/2537700671 shutdown_connections 2024-05-10T10:57:29.702 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.694+0000 7fbcc1068740 1 -- 172.21.15.107:0/2537700671 wait complete. 2024-05-10T10:57:29.702 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.694+0000 7fbcc1068740 20 client.15567 trim_cache size 0 max 16384 2024-05-10T10:57:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.708+0000 7fbcc1068740 1 Processor -- start 2024-05-10T10:57:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbcc1068740 1 -- start start 2024-05-10T10:57:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbcc1068740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55989f35b1c0 0x55989f35cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbcc1068740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 0x55989f35d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbcc1068740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f360d20 0x55989f350cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbcc1068740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb81a7ae0 con 0x55989f35bbb0 2024-05-10T10:57:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbcc1068740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb81a9620 con 0x55989f360d20 2024-05-10T10:57:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbcc1068740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb81a81b0 con 0x55989f35b1c0 2024-05-10T10:57:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbcb77fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 0x55989f35d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbcb77fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 0x55989f35d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56236/0 (socket says 172.21.15.107:56236) 2024-05-10T10:57:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbcb77fe640 1 -- 172.21.15.107:0/1217693042 learned_addr learned my addr 172.21.15.107:0/1217693042 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbcbc8e3640 1 --2- 172.21.15.107:0/1217693042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f360d20 0x55989f350cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbcb7fff640 1 --2- 172.21.15.107:0/1217693042 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55989f35b1c0 0x55989f35cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbcb77fe640 1 -- 172.21.15.107:0/1217693042 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55989f35b1c0 msgr2=0x55989f35cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbcb77fe640 1 --2- 172.21.15.107:0/1217693042 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55989f35b1c0 0x55989f35cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbcb77fe640 1 -- 172.21.15.107:0/1217693042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f360d20 msgr2=0x55989f350cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbcb77fe640 1 --2- 172.21.15.107:0/1217693042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f360d20 0x55989f350cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbcb77fe640 1 -- 172.21.15.107:0/1217693042 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989f35c880 con 0x55989f35bbb0 2024-05-10T10:57:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbcb77fe640 1 --2- 172.21.15.107:0/1217693042 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 0x55989f35d2d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbcac031ac0 tx=0x7fbcac001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388b6c14b09cba5f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbc9dffb640 1 -- 172.21.15.107:0/1217693042 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac03f070 con 0x55989f35bbb0 2024-05-10T10:57:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbc9dffb640 1 -- 172.21.15.107:0/1217693042 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbcac0054d0 con 0x55989f35bbb0 2024-05-10T10:57:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.709+0000 7fbc9dffb640 1 -- 172.21.15.107:0/1217693042 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac053040 con 0x55989f35bbb0 2024-05-10T10:57:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.710+0000 7fbcc1068740 1 -- 172.21.15.107:0/1217693042 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 msgr2=0x55989f35d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.710+0000 7fbcc1068740 1 --2- 172.21.15.107:0/1217693042 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 0x55989f35d2d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbcac031ac0 tx=0x7fbcac001e70 comp rx=0 tx=0).stop 2024-05-10T10:57:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.710+0000 7fbcc1068740 1 -- 172.21.15.107:0/1217693042 shutdown_connections 2024-05-10T10:57:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.710+0000 7fbcc1068740 1 --2- 172.21.15.107:0/1217693042 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f360d20 0x55989f350cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.710+0000 7fbcc1068740 1 --2- 172.21.15.107:0/1217693042 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35bbb0 0x55989f35d2d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.710+0000 7fbcc1068740 1 --2- 172.21.15.107:0/1217693042 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55989f35b1c0 0x55989f35cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.710+0000 7fbcc1068740 1 -- 172.21.15.107:0/1217693042 >> 172.21.15.107:0/1217693042 conn(0x55989f352420 msgr2=0x55989f352800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.710+0000 7fbcc1068740 1 -- 172.21.15.107:0/1217693042 shutdown_connections 2024-05-10T10:57:29.717 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.710+0000 7fbcc1068740 1 -- 172.21.15.107:0/1217693042 wait complete. 2024-05-10T10:57:29.717 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.710+0000 7fbcc1068740 1 -- start start 2024-05-10T10:57:29.717 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbcc1068740 1 Processor -- start 2024-05-10T10:57:29.717 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbcc1068740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35b1c0 0x55989f3698c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:29.717 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbcc1068740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f35bbb0 0x55989f369e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:29.717 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbcc1068740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55989f360d20 0x55989f36ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:29.717 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbcc1068740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb81a8f50 con 0x55989f35b1c0 2024-05-10T10:57:29.717 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbcc1068740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb81a8880 con 0x55989f35bbb0 2024-05-10T10:57:29.717 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbcc1068740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb81a5ac0 con 0x55989f360d20 2024-05-10T10:57:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbcc1068740 10 client.0 _ll_register_callbacks cb 0x7fbcac009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:57:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbcb7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35b1c0 0x55989f3698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbcb7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35b1c0 0x55989f3698c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:56242/0 (socket says 172.21.15.107:56242) 2024-05-10T10:57:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbcb7fff640 1 -- 172.21.15.107:0/2105173 learned_addr learned my addr 172.21.15.107:0/2105173 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbcb7fff640 1 -- 172.21.15.107:0/2105173 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55989f360d20 msgr2=0x55989f36ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbcb77fe640 1 --2- 172.21.15.107:0/2105173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f35bbb0 0x55989f369e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbcb7fff640 1 --2- 172.21.15.107:0/2105173 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55989f360d20 0x55989f36ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbcb7fff640 1 -- 172.21.15.107:0/2105173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f35bbb0 msgr2=0x55989f369e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbcb7fff640 1 --2- 172.21.15.107:0/2105173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f35bbb0 0x55989f369e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbcb7fff640 1 -- 172.21.15.107:0/2105173 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55989f352250 con 0x55989f35b1c0 2024-05-10T10:57:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbcb7fff640 1 --2- 172.21.15.107:0/2105173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35b1c0 0x55989f3698c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbca80df950 tx=0x7fbca80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfd3570d38eaf1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbc977fe640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.711+0000 7fbc977fe640 1 -- 172.21.15.107:0/2105173 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8020030 con 0x55989f35b1c0 2024-05-10T10:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.712+0000 7fbc977fe640 1 -- 172.21.15.107:0/2105173 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fbca8009d50 con 0x55989f35b1c0 2024-05-10T10:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.712+0000 7fbcc1068740 1 -- 172.21.15.107:0/2105173 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcac0054d0 con 0x55989f35b1c0 2024-05-10T10:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.712+0000 7fbc977fe640 1 -- 172.21.15.107:0/2105173 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbca80a8d70 con 0x55989f35b1c0 2024-05-10T10:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.712+0000 7fbcc1068740 10 client.15573 fetch_fsmap learned FSMap version 27 2024-05-10T10:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.712+0000 7fbcc1068740 1 -- 172.21.15.107:0/2105173 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55989f3dba50 con 0x55989f35b1c0 2024-05-10T10:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.712+0000 7fbc977fe640 1 -- 172.21.15.107:0/2105173 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbcac0054d0 con 0x55989f35b1c0 2024-05-10T10:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.712+0000 7fbc977fe640 1 -- 172.21.15.107:0/2105173 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fbca80a56b0 con 0x55989f35b1c0 2024-05-10T10:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.712+0000 7fbcc1068740 10 client.15573 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.712+0000 7fbcc1068740 10 client.15573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.712+0000 7fbcc1068740 20 client.15573 populate_metadata read hostname 'smithi107' 2024-05-10T10:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.712+0000 7fbcc1068740 1 --2- 172.21.15.107:0/2105173 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55989f3dc020 0x55989f3de430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.712+0000 7fbcc1068740 4 client.15573 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T10:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.712+0000 7fbcc1068740 1 -- 172.21.15.107:0/2105173 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55989f2c3050 con 0x55989f3dc020 2024-05-10T10:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.712+0000 7fbcb77fe640 1 --2- 172.21.15.107:0/2105173 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55989f3dc020 0x55989f3de430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.713+0000 7fbc977fe640 10 client.15573 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.713+0000 7fbcb77fe640 1 --2- 172.21.15.107:0/2105173 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55989f3dc020 0x55989f3de430 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49411b63fdd768a5 server_cookie=b17348c14990cfa5 in_seq=0 out_seq=0 2024-05-10T10:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.719+0000 7fbc977fe640 1 -- 172.21.15.107:0/2105173 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55989f2c3050 con 0x55989f3dc020 2024-05-10T10:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.719+0000 7fbc977fe640 10 client.15573 handle_command_reply: tid=0 2024-05-10T10:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.719+0000 7fbcc1068740 1 client.15573 shutdown 2024-05-10T10:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.719+0000 7fbcc1068740 1 -- 172.21.15.107:0/2105173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35b1c0 msgr2=0x55989f3698c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.719+0000 7fbcc1068740 1 --2- 172.21.15.107:0/2105173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35b1c0 0x55989f3698c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbca80df950 tx=0x7fbca80057f0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.719+0000 7fbcc1068740 1 -- 172.21.15.107:0/2105173 shutdown_connections 2024-05-10T10:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.719+0000 7fbcc1068740 1 --2- 172.21.15.107:0/2105173 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55989f3dc020 0x55989f3de430 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.719+0000 7fbcc1068740 1 --2- 172.21.15.107:0/2105173 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55989f360d20 0x55989f36ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.719+0000 7fbcc1068740 1 --2- 172.21.15.107:0/2105173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55989f35bbb0 0x55989f369e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.719+0000 7fbc977fe640 0 client.15573 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.719+0000 7fbcc1068740 1 --2- 172.21.15.107:0/2105173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55989f35b1c0 0x55989f3698c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.719+0000 7fbcc1068740 1 -- 172.21.15.107:0/2105173 >> 172.21.15.107:0/2105173 conn(0x55989f352420 msgr2=0x55989f365410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.719+0000 7fbcc1068740 1 -- 172.21.15.107:0/2105173 shutdown_connections 2024-05-10T10:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.719+0000 7fbcc1068740 1 -- 172.21.15.107:0/2105173 wait complete. 2024-05-10T10:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.719+0000 7fbcc1068740 20 client.15573 trim_cache size 0 max 16384 2024-05-10T10:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:{ 2024-05-10T10:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "message": "", 2024-05-10T10:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "return_code": 0 2024-05-10T10:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:} 2024-05-10T10:57:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.720+0000 7fbcbe346640 1 -- 172.21.15.107:0/3171761530 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbca00b28a0 msgr2=0x7fbca00b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.720+0000 7fbcbe346640 1 --2- 172.21.15.107:0/3171761530 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbca00b28a0 0x7fbca00b4d60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55989f35c410 tx=0x7fbcb0009790 comp rx=0 tx=0).stop 2024-05-10T10:57:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.720+0000 7fbcbe346640 1 -- 172.21.15.107:0/3171761530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb8103480 msgr2=0x7fbcb8198c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.720+0000 7fbcbe346640 1 --2- 172.21.15.107:0/3171761530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb8103480 0x7fbcb8198c80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbca800d770 tx=0x7fbca800dc30 comp rx=0 tx=0).stop 2024-05-10T10:57:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.720+0000 7fbcbe346640 1 -- 172.21.15.107:0/3171761530 shutdown_connections 2024-05-10T10:57:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.720+0000 7fbcbe346640 1 --2- 172.21.15.107:0/3171761530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcb81086e0 0x7fbcb81a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.720+0000 7fbcbe346640 1 --2- 172.21.15.107:0/3171761530 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbcb8105db0 0x7fbcb81991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.720+0000 7fbcbe346640 1 --2- 172.21.15.107:0/3171761530 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fbca00b28a0 0x7fbca00b4d60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.720+0000 7fbcbe346640 1 --2- 172.21.15.107:0/3171761530 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbcb8103480 0x7fbcb8198c80 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.720+0000 7fbcbe346640 1 -- 172.21.15.107:0/3171761530 >> 172.21.15.107:0/3171761530 conn(0x7fbcb80fce70 msgr2=0x7fbcb8103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.720+0000 7fbcbe346640 1 -- 172.21.15.107:0/3171761530 shutdown_connections 2024-05-10T10:57:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:29.720+0000 7fbcbe346640 1 -- 172.21.15.107:0/3171761530 wait complete. 2024-05-10T10:57:31.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:31 smithi107 ceph-mon[30373]: pgmap v443: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-05-10T10:57:31.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:31 smithi196 ceph-mon[34872]: pgmap v443: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-05-10T10:57:31.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:31 smithi184 ceph-mon[34585]: pgmap v443: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-05-10T10:57:32.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:32 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:57:32.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:32 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:57:32.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:32 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:57:33.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:33 smithi196 ceph-mon[34872]: pgmap v444: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-10T10:57:33.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:57:33.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:57:33.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:57:33.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:33 smithi184 ceph-mon[34585]: pgmap v444: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-10T10:57:33.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:57:33.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:57:33.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:57:33.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:33 smithi107 ceph-mon[30373]: pgmap v444: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-10T10:57:33.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:57:33.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:57:33.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:57:35.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:35 smithi196 ceph-mon[34872]: pgmap v445: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 9 op/s 2024-05-10T10:57:35.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:35 smithi184 ceph-mon[34585]: pgmap v445: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 9 op/s 2024-05-10T10:57:35.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:35 smithi107 ceph-mon[30373]: pgmap v445: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 767 B/s wr, 9 op/s 2024-05-10T10:57:37.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:37 smithi196 ceph-mon[34872]: pgmap v446: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-10T10:57:37.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:37 smithi184 ceph-mon[34585]: pgmap v446: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-10T10:57:37.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:37 smithi107 ceph-mon[30373]: pgmap v446: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-10T10:57:38.957 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:57:39.213 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:57:39.335 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:39 smithi107 ceph-mon[30373]: pgmap v447: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-10T10:57:39.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:39 smithi196 ceph-mon[34872]: pgmap v447: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-10T10:57:39.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:39 smithi184 ceph-mon[34585]: pgmap v447: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-10T10:57:40.954 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.952+0000 7f44ff46c700 1 -- 172.21.15.107:0/863785075 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44f8104100 msgr2=0x7f44f8108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:40.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.952+0000 7f44ff46c700 1 --2- 172.21.15.107:0/863785075 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44f8104100 0x7f44f8108120 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0099c0 tx=0x7f44ec009cd0 comp rx=0 tx=0).stop 2024-05-10T10:57:40.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.952+0000 7f44ff46c700 1 -- 172.21.15.107:0/863785075 shutdown_connections 2024-05-10T10:57:40.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.952+0000 7f44ff46c700 1 --2- 172.21.15.107:0/863785075 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44f8103750 0x7f44f8103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:40.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.952+0000 7f44ff46c700 1 --2- 172.21.15.107:0/863785075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44f8108850 0x7f44f81103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:40.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.952+0000 7f44ff46c700 1 --2- 172.21.15.107:0/863785075 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44f8104100 0x7f44f8108120 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:40.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.952+0000 7f44ff46c700 1 -- 172.21.15.107:0/863785075 >> 172.21.15.107:0/863785075 conn(0x7f44f807a600 msgr2=0x7f44f807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:40.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.952+0000 7f44ff46c700 1 -- 172.21.15.107:0/863785075 shutdown_connections 2024-05-10T10:57:40.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.952+0000 7f44ff46c700 1 -- 172.21.15.107:0/863785075 wait complete. 2024-05-10T10:57:40.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.953+0000 7f44ff46c700 1 Processor -- start 2024-05-10T10:57:40.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.953+0000 7f44ff46c700 1 -- start start 2024-05-10T10:57:40.955 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.953+0000 7f44ff46c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44f8103750 0x7f44f80757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:40.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.953+0000 7f44ff46c700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44f8104100 0x7f44f8075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:40.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.953+0000 7f44ff46c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44f8108850 0x7f44f8076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:40.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.953+0000 7f44ff46c700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f44f8113850 con 0x7f44f8108850 2024-05-10T10:57:40.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.953+0000 7f44ff46c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f44f81136d0 con 0x7f44f8103750 2024-05-10T10:57:40.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.953+0000 7f44ff46c700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f44f81139d0 con 0x7f44f8104100 2024-05-10T10:57:40.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.953+0000 7f44fda09700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44f8108850 0x7f44f8076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:40.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.953+0000 7f44fda09700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44f8108850 0x7f44f8076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49328/0 (socket says 172.21.15.107:49328) 2024-05-10T10:57:40.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.953+0000 7f44fda09700 1 -- 172.21.15.107:0/792430087 learned_addr learned my addr 172.21.15.107:0/792430087 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:40.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.954+0000 7f44fd208700 1 --2- 172.21.15.107:0/792430087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44f8103750 0x7f44f80757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:40.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.954+0000 7f44fca07700 1 --2- 172.21.15.107:0/792430087 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44f8104100 0x7f44f8075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:40.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.954+0000 7f44fda09700 1 -- 172.21.15.107:0/792430087 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44f8104100 msgr2=0x7f44f8075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:40.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.954+0000 7f44fda09700 1 --2- 172.21.15.107:0/792430087 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44f8104100 0x7f44f8075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:40.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.954+0000 7f44fda09700 1 -- 172.21.15.107:0/792430087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44f8103750 msgr2=0x7f44f80757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:40.956 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.954+0000 7f44fda09700 1 --2- 172.21.15.107:0/792430087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44f8103750 0x7f44f80757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:40.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.954+0000 7f44fda09700 1 -- 172.21.15.107:0/792430087 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f81a8180 con 0x7f44f8108850 2024-05-10T10:57:40.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.954+0000 7f44fd208700 1 --2- 172.21.15.107:0/792430087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44f8103750 0x7f44f80757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:40.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.954+0000 7f44fca07700 1 --2- 172.21.15.107:0/792430087 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44f8104100 0x7f44f8075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:40.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.954+0000 7f44fda09700 1 --2- 172.21.15.107:0/792430087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44f8108850 0x7f44f8076220 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f44f000b970 tx=0x7f44f000bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:40.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.954+0000 7f44ea7fc700 1 -- 172.21.15.107:0/792430087 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f0019070 con 0x7f44f8108850 2024-05-10T10:57:40.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.954+0000 7f44ff46c700 1 -- 172.21.15.107:0/792430087 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f81a8470 con 0x7f44f8108850 2024-05-10T10:57:40.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.954+0000 7f44ea7fc700 1 -- 172.21.15.107:0/792430087 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f44f0014440 con 0x7f44f8108850 2024-05-10T10:57:40.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.954+0000 7f44ea7fc700 1 -- 172.21.15.107:0/792430087 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f00075d0 con 0x7f44f8108850 2024-05-10T10:57:40.957 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.954+0000 7f44ff46c700 1 -- 172.21.15.107:0/792430087 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f81a8960 con 0x7f44f8108850 2024-05-10T10:57:40.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.955+0000 7f44ff46c700 1 -- 172.21.15.107:0/792430087 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f806a190 con 0x7f44f8108850 2024-05-10T10:57:40.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.956+0000 7f44ea7fc700 1 -- 172.21.15.107:0/792430087 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f44f001c070 con 0x7f44f8108850 2024-05-10T10:57:40.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.957+0000 7f44ea7fc700 1 --2- 172.21.15.107:0/792430087 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f44e40b2880 0x7f44e40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:40.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.957+0000 7f44fd208700 1 --2- 172.21.15.107:0/792430087 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f44e40b2880 0x7f44e40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:40.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.957+0000 7f44ea7fc700 1 -- 172.21.15.107:0/792430087 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f44f00e1a40 con 0x7f44f8108850 2024-05-10T10:57:40.958 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.957+0000 7f44fd208700 1 --2- 172.21.15.107:0/792430087 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f44e40b2880 0x7f44e40b4d40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f44f4007900 tx=0x7f44f4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:40.961 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:40.960+0000 7f44ea7fc700 1 -- 172.21.15.107:0/792430087 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f44f00a9800 con 0x7f44f8108850 2024-05-10T10:57:41.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:41.216+0000 7f44ff46c700 1 -- 172.21.15.107:0/792430087 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44f810ba90 con 0x7f44f8108850 2024-05-10T10:57:41.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:41.217+0000 7f44ea7fc700 1 -- 172.21.15.107:0/792430087 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11951 (secure 0 0 0) 0x7f44f00a9100 con 0x7f44f8108850 2024-05-10T10:57:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:57:41.218 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T10:52:17.367732+0000","modified":"2024-05-10T10:55:30.125781+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24482,"mds_1":24449,"mds_2":24442,"mds_3":24431,"mds_4":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/2332963094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":2332963094},{"type":"v1","addr":"172.21.15.107:6841","nonce":2332963094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.184:6839/16501252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":16501252},{"type":"v1","addr":"172.21.15.184:6839","nonce":16501252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24430,24431,24482,24449,24442]},"id":1}]} 2024-05-10T10:57:41.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:41.219+0000 7f44ff46c700 1 -- 172.21.15.107:0/792430087 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f44e40b2880 msgr2=0x7f44e40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:41.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:41.219+0000 7f44ff46c700 1 --2- 172.21.15.107:0/792430087 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f44e40b2880 0x7f44e40b4d40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f44f4007900 tx=0x7f44f4008040 comp rx=0 tx=0).stop 2024-05-10T10:57:41.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:41.219+0000 7f44ff46c700 1 -- 172.21.15.107:0/792430087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44f8108850 msgr2=0x7f44f8076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:41.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:41.219+0000 7f44ff46c700 1 --2- 172.21.15.107:0/792430087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44f8108850 0x7f44f8076220 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f44f000b970 tx=0x7f44f000bd30 comp rx=0 tx=0).stop 2024-05-10T10:57:41.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:41.219+0000 7f44ff46c700 1 -- 172.21.15.107:0/792430087 shutdown_connections 2024-05-10T10:57:41.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:41.219+0000 7f44ff46c700 1 --2- 172.21.15.107:0/792430087 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f44e40b2880 0x7f44e40b4d40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:41.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:41.219+0000 7f44ff46c700 1 --2- 172.21.15.107:0/792430087 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f44f8108850 0x7f44f8076220 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:41.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:41.219+0000 7f44ff46c700 1 --2- 172.21.15.107:0/792430087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44f8103750 0x7f44f80757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:41.220 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:41.219+0000 7f44ff46c700 1 --2- 172.21.15.107:0/792430087 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44f8104100 0x7f44f8075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:41.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:41.219+0000 7f44ff46c700 1 -- 172.21.15.107:0/792430087 >> 172.21.15.107:0/792430087 conn(0x7f44f807a600 msgr2=0x7f44f8102c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:41.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:41.219+0000 7f44ff46c700 1 -- 172.21.15.107:0/792430087 shutdown_connections 2024-05-10T10:57:41.221 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:41.219+0000 7f44ff46c700 1 -- 172.21.15.107:0/792430087 wait complete. 2024-05-10T10:57:41.221 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 27 2024-05-10T10:57:41.546 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:41 smithi107 ceph-mon[30373]: pgmap v448: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-10T10:57:41.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:41 smithi196 ceph-mon[34872]: pgmap v448: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-10T10:57:41.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:41 smithi184 ceph-mon[34585]: pgmap v448: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-10T10:57:42.015 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24482 quiesce db --set-id 13975d87 --release --await' 2024-05-10T10:57:42.015 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24482 quiesce db --set-id 13975d87 --release --await 2024-05-10T10:57:42.262 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:57:42.385 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:42 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/792430087' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:57:42.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:42 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/792430087' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:57:42.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:42 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/792430087' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:57:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.810+0000 7f0545069640 1 -- 172.21.15.107:0/1277838963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05401034c0 msgr2=0x7f0540109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.810+0000 7f0545069640 1 --2- 172.21.15.107:0/1277838963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05401034c0 0x7f0540109d50 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0530009900 tx=0x7f053002a410 comp rx=0 tx=0).stop 2024-05-10T10:57:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.810+0000 7f0545069640 1 -- 172.21.15.107:0/1277838963 shutdown_connections 2024-05-10T10:57:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.810+0000 7f0545069640 1 --2- 172.21.15.107:0/1277838963 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f05401034c0 0x7f0540109d50 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.810+0000 7f0545069640 1 --2- 172.21.15.107:0/1277838963 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0540102b00 0x7f0540102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.810+0000 7f0545069640 1 --2- 172.21.15.107:0/1277838963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0540101910 0x7f0540101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.810+0000 7f0545069640 1 -- 172.21.15.107:0/1277838963 >> 172.21.15.107:0/1277838963 conn(0x7f05400fce80 msgr2=0x7f05400ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.810+0000 7f0545069640 1 -- 172.21.15.107:0/1277838963 shutdown_connections 2024-05-10T10:57:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.810+0000 7f0545069640 1 -- 172.21.15.107:0/1277838963 wait complete. 2024-05-10T10:57:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.811+0000 7f0545069640 1 Processor -- start 2024-05-10T10:57:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.811+0000 7f0545069640 1 -- start start 2024-05-10T10:57:42.813 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.811+0000 7f0545069640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0540101910 0x7f0540198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:42.814 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.811+0000 7f0545069640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0540102b00 0x7f05401991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:42.814 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.811+0000 7f0545069640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05401034c0 0x7f05401a01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:42.814 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.811+0000 7f0545069640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f054010d570 con 0x7f0540101910 2024-05-10T10:57:42.814 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.811+0000 7f0545069640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f054010d3f0 con 0x7f05401034c0 2024-05-10T10:57:42.814 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.811+0000 7f0545069640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f054010d6f0 con 0x7f0540102b00 2024-05-10T10:57:42.814 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.811+0000 7f053ed9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0540101910 0x7f0540198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:42.814 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.811+0000 7f053ed9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0540101910 0x7f0540198ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49344/0 (socket says 172.21.15.107:49344) 2024-05-10T10:57:42.814 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.811+0000 7f053ed9d640 1 -- 172.21.15.107:0/3806431169 learned_addr learned my addr 172.21.15.107:0/3806431169 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:42.814 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.811+0000 7f053f59e640 1 --2- 172.21.15.107:0/3806431169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05401034c0 0x7f05401a01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:42.814 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.811+0000 7f053e59c640 1 --2- 172.21.15.107:0/3806431169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0540102b00 0x7f05401991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:42.814 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.811+0000 7f053ed9d640 1 -- 172.21.15.107:0/3806431169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0540102b00 msgr2=0x7f05401991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:42.814 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.811+0000 7f053ed9d640 1 --2- 172.21.15.107:0/3806431169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0540102b00 0x7f05401991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.814 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.811+0000 7f053ed9d640 1 -- 172.21.15.107:0/3806431169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05401034c0 msgr2=0x7f05401a01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:42.814 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.811+0000 7f053ed9d640 1 --2- 172.21.15.107:0/3806431169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05401034c0 0x7f05401a01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.815 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.811+0000 7f053ed9d640 1 -- 172.21.15.107:0/3806431169 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05401a0860 con 0x7f0540101910 2024-05-10T10:57:42.815 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.812+0000 7f053ed9d640 1 --2- 172.21.15.107:0/3806431169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0540101910 0x7f0540198ca0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f053800d770 tx=0x7f053800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:42.815 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.812+0000 7f0527fff640 1 -- 172.21.15.107:0/3806431169 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0538017070 con 0x7f0540101910 2024-05-10T10:57:42.815 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.812+0000 7f0545069640 1 -- 172.21.15.107:0/3806431169 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05401a0b50 con 0x7f0540101910 2024-05-10T10:57:42.815 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.812+0000 7f0545069640 1 -- 172.21.15.107:0/3806431169 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05401a10f0 con 0x7f0540101910 2024-05-10T10:57:42.815 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.812+0000 7f0527fff640 1 -- 172.21.15.107:0/3806431169 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0538009c30 con 0x7f0540101910 2024-05-10T10:57:42.815 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.812+0000 7f0527fff640 1 -- 172.21.15.107:0/3806431169 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0538020060 con 0x7f0540101910 2024-05-10T10:57:42.822 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.814+0000 7f0527fff640 1 -- 172.21.15.107:0/3806431169 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f0538004020 con 0x7f0540101910 2024-05-10T10:57:42.822 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.814+0000 7f0547d78740 1 Processor -- start 2024-05-10T10:57:42.822 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.814+0000 7f0547d78740 1 -- start start 2024-05-10T10:57:42.822 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f0547d78740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642cdb0 0x55557642d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:42.822 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f0547d78740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55557642d7a0 0x5555764322a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:42.822 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f0547d78740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 0x555576434da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:42.823 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f0547d78740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5555763915d0 con 0x555576432910 2024-05-10T10:57:42.823 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f0547d78740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55557634a890 con 0x55557642d7a0 2024-05-10T10:57:42.823 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f0547d78740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55557638d590 con 0x55557642cdb0 2024-05-10T10:57:42.823 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f053e59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 0x555576434da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:42.823 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f0527fff640 1 --2- 172.21.15.107:0/3806431169 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f05280b28a0 0x7f05280b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:42.823 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f053e59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 0x555576434da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49356/0 (socket says 172.21.15.107:49356) 2024-05-10T10:57:42.823 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f053e59c640 1 -- 172.21.15.107:0/4079309553 learned_addr learned my addr 172.21.15.107:0/4079309553 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:42.823 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f053ed9d640 1 --2- 172.21.15.107:0/4079309553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55557642d7a0 0x5555764322a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:42.823 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f053f59e640 1 --2- 172.21.15.107:0/4079309553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642cdb0 0x55557642d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:42.823 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f053f59e640 1 --2- 172.21.15.107:0/3806431169 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f05280b28a0 0x7f05280b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:42.823 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f053e59c640 1 -- 172.21.15.107:0/4079309553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642cdb0 msgr2=0x55557642d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:42.823 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f053e59c640 1 --2- 172.21.15.107:0/4079309553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642cdb0 0x55557642d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.823 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f053e59c640 1 -- 172.21.15.107:0/4079309553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55557642d7a0 msgr2=0x5555764322a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:42.823 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f053e59c640 1 --2- 172.21.15.107:0/4079309553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55557642d7a0 0x5555764322a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f053e59c640 1 -- 172.21.15.107:0/4079309553 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555760a3210 con 0x555576432910 2024-05-10T10:57:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f0527fff640 1 -- 172.21.15.107:0/3806431169 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f05380e1c90 con 0x7f0540101910 2024-05-10T10:57:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f053e59c640 1 --2- 172.21.15.107:0/4079309553 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 0x555576434da0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0534008d90 tx=0x7f053400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7265829b033017b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.815+0000 7f053f59e640 1 --2- 172.21.15.107:0/3806431169 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f05280b28a0 0x7f05280b4d60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0530005940 tx=0x7f0530009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.816+0000 7f05257fa640 1 -- 172.21.15.107:0/4079309553 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0534004d20 con 0x555576432910 2024-05-10T10:57:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.816+0000 7f05257fa640 1 -- 172.21.15.107:0/4079309553 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f053400de20 con 0x555576432910 2024-05-10T10:57:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.816+0000 7f05257fa640 1 -- 172.21.15.107:0/4079309553 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05340055d0 con 0x555576432910 2024-05-10T10:57:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.816+0000 7f0547d78740 1 -- 172.21.15.107:0/4079309553 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 msgr2=0x555576434da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.816+0000 7f0547d78740 1 --2- 172.21.15.107:0/4079309553 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 0x555576434da0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0534008d90 tx=0x7f053400d710 comp rx=0 tx=0).stop 2024-05-10T10:57:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.816+0000 7f0547d78740 1 -- 172.21.15.107:0/4079309553 shutdown_connections 2024-05-10T10:57:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.816+0000 7f0547d78740 1 --2- 172.21.15.107:0/4079309553 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 0x555576434da0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.816+0000 7f0547d78740 1 --2- 172.21.15.107:0/4079309553 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55557642d7a0 0x5555764322a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.816+0000 7f0547d78740 1 --2- 172.21.15.107:0/4079309553 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642cdb0 0x55557642d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.816+0000 7f0547d78740 1 -- 172.21.15.107:0/4079309553 >> 172.21.15.107:0/4079309553 conn(0x555576428420 msgr2=0x555576428820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:42.824 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.816+0000 7f0547d78740 1 -- 172.21.15.107:0/4079309553 shutdown_connections 2024-05-10T10:57:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.816+0000 7f0547d78740 1 -- 172.21.15.107:0/4079309553 wait complete. 2024-05-10T10:57:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f0547d78740 1 -- start start 2024-05-10T10:57:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f0547d78740 1 Processor -- start 2024-05-10T10:57:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f0547d78740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642cdb0 0x555576436f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f0547d78740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55557642d7a0 0x5555764374d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f0547d78740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 0x55557643e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f0547d78740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5555764358c0 con 0x555576432910 2024-05-10T10:57:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f0547d78740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55557634e370 con 0x55557642d7a0 2024-05-10T10:57:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f0547d78740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555576435a40 con 0x55557642cdb0 2024-05-10T10:57:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f0547d78740 10 client.0 _ll_register_callbacks cb 0x5555760a2a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:57:42.825 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f053f59e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 0x55557643e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f053f59e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 0x55557643e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49362/0 (socket says 172.21.15.107:49362) 2024-05-10T10:57:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f053f59e640 1 -- 172.21.15.107:0/4230138958 learned_addr learned my addr 172.21.15.107:0/4230138958 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f053e59c640 1 --2- 172.21.15.107:0/4230138958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55557642d7a0 0x5555764374d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f053ed9d640 1 --2- 172.21.15.107:0/4230138958 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642cdb0 0x555576436f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f053f59e640 1 -- 172.21.15.107:0/4230138958 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642cdb0 msgr2=0x555576436f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f053f59e640 1 --2- 172.21.15.107:0/4230138958 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642cdb0 0x555576436f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f053f59e640 1 -- 172.21.15.107:0/4230138958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55557642d7a0 msgr2=0x5555764374d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f053f59e640 1 --2- 172.21.15.107:0/4230138958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55557642d7a0 0x5555764374d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f053f59e640 1 -- 172.21.15.107:0/4230138958 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55557616f620 con 0x555576432910 2024-05-10T10:57:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f053ed9d640 1 --2- 172.21.15.107:0/4230138958 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642cdb0 0x555576436f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f053e59c640 1 --2- 172.21.15.107:0/4230138958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55557642d7a0 0x5555764374d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:57:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f053f59e640 1 --2- 172.21.15.107:0/4230138958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 0x55557643e510 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0530033000 tx=0x7f053002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c845918f804be7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:42.826 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.817+0000 7f0522ff5640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:57:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.818+0000 7f0522ff5640 1 -- 172.21.15.107:0/4230138958 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053004f020 con 0x555576432910 2024-05-10T10:57:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.818+0000 7f0522ff5640 1 -- 172.21.15.107:0/4230138958 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f0530003d70 con 0x555576432910 2024-05-10T10:57:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.818+0000 7f0547d78740 1 -- 172.21.15.107:0/4230138958 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f053400de20 con 0x555576432910 2024-05-10T10:57:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.818+0000 7f0522ff5640 1 -- 172.21.15.107:0/4230138958 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0530035040 con 0x555576432910 2024-05-10T10:57:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.818+0000 7f0547d78740 10 client.15591 fetch_fsmap learned FSMap version 27 2024-05-10T10:57:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.818+0000 7f0547d78740 1 -- 172.21.15.107:0/4230138958 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555576441560 con 0x555576432910 2024-05-10T10:57:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.818+0000 7f0522ff5640 1 -- 172.21.15.107:0/4230138958 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f053400de20 con 0x555576432910 2024-05-10T10:57:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.818+0000 7f0522ff5640 1 -- 172.21.15.107:0/4230138958 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f053003a040 con 0x555576432910 2024-05-10T10:57:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.818+0000 7f0547d78740 10 client.15591 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:57:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.818+0000 7f0547d78740 10 client.15591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:57:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.818+0000 7f0547d78740 20 client.15591 populate_metadata read hostname 'smithi107' 2024-05-10T10:57:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.818+0000 7f0547d78740 1 --2- 172.21.15.107:0/4230138958 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x555576442c70 0x5555764450d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:42.827 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.818+0000 7f0547d78740 4 client.15591 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:57:42.828 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.818+0000 7f0547d78740 1 -- 172.21.15.107:0/4230138958 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55557639f1e0 con 0x555576442c70 2024-05-10T10:57:42.828 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.819+0000 7f053ed9d640 1 --2- 172.21.15.107:0/4230138958 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x555576442c70 0x5555764450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:42.828 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.819+0000 7f053ed9d640 1 --2- 172.21.15.107:0/4230138958 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x555576442c70 0x5555764450d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7c8a489ec358b4f server_cookie=fae0fa68a52ff0d4 in_seq=0 out_seq=0 2024-05-10T10:57:42.828 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.819+0000 7f0522ff5640 10 client.15591 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:42.828 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.820+0000 7f0522ff5640 1 -- 172.21.15.107:0/4230138958 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55557639f1e0 con 0x555576442c70 2024-05-10T10:57:42.828 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.820+0000 7f0522ff5640 10 client.15591 handle_command_reply: tid=0 2024-05-10T10:57:42.828 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.820+0000 7f0547d78740 1 client.15591 shutdown 2024-05-10T10:57:42.828 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.820+0000 7f0547d78740 1 -- 172.21.15.107:0/4230138958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 msgr2=0x55557643e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:42.828 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.820+0000 7f0547d78740 1 --2- 172.21.15.107:0/4230138958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 0x55557643e510 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0530033000 tx=0x7f053002a410 comp rx=0 tx=0).stop 2024-05-10T10:57:42.828 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.820+0000 7f0547d78740 1 -- 172.21.15.107:0/4230138958 shutdown_connections 2024-05-10T10:57:42.828 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.820+0000 7f0547d78740 1 --2- 172.21.15.107:0/4230138958 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x555576442c70 0x5555764450d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.828 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.820+0000 7f0547d78740 1 --2- 172.21.15.107:0/4230138958 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 0x55557643e510 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.828 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.820+0000 7f0547d78740 1 --2- 172.21.15.107:0/4230138958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55557642d7a0 0x5555764374d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.829 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.820+0000 7f0522ff5640 0 client.15591 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:42.829 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.820+0000 7f0547d78740 1 --2- 172.21.15.107:0/4230138958 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642cdb0 0x555576436f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.829 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.820+0000 7f0547d78740 1 -- 172.21.15.107:0/4230138958 >> 172.21.15.107:0/4230138958 conn(0x555576428420 msgr2=0x555576427580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:42.829 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.820+0000 7f0547d78740 1 -- 172.21.15.107:0/4230138958 shutdown_connections 2024-05-10T10:57:42.829 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.820+0000 7f0547d78740 1 -- 172.21.15.107:0/4230138958 wait complete. 2024-05-10T10:57:42.829 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.820+0000 7f0547d78740 20 client.15591 trim_cache size 0 max 16384 2024-05-10T10:57:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f0547d78740 1 Processor -- start 2024-05-10T10:57:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f0547d78740 1 -- start start 2024-05-10T10:57:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f0547d78740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55557642cdb0 0x55557642b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f0547d78740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642d7a0 0x55557643e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f0547d78740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 0x55557642b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f0547d78740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f05401a9ce0 con 0x555576432910 2024-05-10T10:57:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f0547d78740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f05401ab820 con 0x55557642cdb0 2024-05-10T10:57:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f0547d78740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f05401aa3b0 con 0x55557642d7a0 2024-05-10T10:57:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f053f59e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 0x55557642b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f053f59e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 0x55557642b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49374/0 (socket says 172.21.15.107:49374) 2024-05-10T10:57:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f053f59e640 1 -- 172.21.15.107:0/246697 learned_addr learned my addr 172.21.15.107:0/246697 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f053e59c640 1 --2- 172.21.15.107:0/246697 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642d7a0 0x55557643e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f053ed9d640 1 --2- 172.21.15.107:0/246697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55557642cdb0 0x55557642b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f053f59e640 1 -- 172.21.15.107:0/246697 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642d7a0 msgr2=0x55557643e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f053f59e640 1 --2- 172.21.15.107:0/246697 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642d7a0 0x55557643e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f053f59e640 1 -- 172.21.15.107:0/246697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55557642cdb0 msgr2=0x55557642b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f053f59e640 1 --2- 172.21.15.107:0/246697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55557642cdb0 0x55557642b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f053f59e640 1 -- 172.21.15.107:0/246697 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555576428250 con 0x555576432910 2024-05-10T10:57:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f053ed9d640 1 --2- 172.21.15.107:0/246697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55557642cdb0 0x55557642b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f053e59c640 1 --2- 172.21.15.107:0/246697 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642d7a0 0x55557643e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:57:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.835+0000 7f053f59e640 1 --2- 172.21.15.107:0/246697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 0x55557642b870 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0530032fd0 tx=0x7f0530009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1065929a376180fc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.836+0000 7f0524ff9640 1 -- 172.21.15.107:0/246697 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053004f070 con 0x555576432910 2024-05-10T10:57:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.836+0000 7f0524ff9640 1 -- 172.21.15.107:0/246697 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0530031610 con 0x555576432910 2024-05-10T10:57:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.836+0000 7f0524ff9640 1 -- 172.21.15.107:0/246697 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530004c60 con 0x555576432910 2024-05-10T10:57:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.836+0000 7f0547d78740 1 -- 172.21.15.107:0/246697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 msgr2=0x55557642b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.836+0000 7f0547d78740 1 --2- 172.21.15.107:0/246697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 0x55557642b870 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0530032fd0 tx=0x7f0530009580 comp rx=0 tx=0).stop 2024-05-10T10:57:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.836+0000 7f0547d78740 1 -- 172.21.15.107:0/246697 shutdown_connections 2024-05-10T10:57:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.836+0000 7f0547d78740 1 --2- 172.21.15.107:0/246697 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555576432910 0x55557642b870 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.836+0000 7f0547d78740 1 --2- 172.21.15.107:0/246697 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642d7a0 0x55557643e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.836+0000 7f0547d78740 1 --2- 172.21.15.107:0/246697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55557642cdb0 0x55557642b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.836+0000 7f0547d78740 1 -- 172.21.15.107:0/246697 >> 172.21.15.107:0/246697 conn(0x555576428420 msgr2=0x55557642e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.836+0000 7f0547d78740 1 -- 172.21.15.107:0/246697 shutdown_connections 2024-05-10T10:57:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.836+0000 7f0547d78740 1 -- 172.21.15.107:0/246697 wait complete. 2024-05-10T10:57:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f0547d78740 1 -- start start 2024-05-10T10:57:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f0547d78740 1 Processor -- start 2024-05-10T10:57:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f0547d78740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55557642cdb0 0x55557643b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f0547d78740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642d7a0 0x55557643bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f0547d78740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555576432910 0x55557643cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f0547d78740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f05401ab150 con 0x55557642cdb0 2024-05-10T10:57:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f0547d78740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f05401aaa80 con 0x555576432910 2024-05-10T10:57:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f0547d78740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f05401a7cc0 con 0x55557642d7a0 2024-05-10T10:57:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f0547d78740 10 client.0 _ll_register_callbacks cb 0x7f05300319c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:57:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f053ed9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55557642cdb0 0x55557643b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f053ed9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55557642cdb0 0x55557643b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49386/0 (socket says 172.21.15.107:49386) 2024-05-10T10:57:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f053ed9d640 1 -- 172.21.15.107:0/3791858372 learned_addr learned my addr 172.21.15.107:0/3791858372 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f053e59c640 1 --2- 172.21.15.107:0/3791858372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642d7a0 0x55557643bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f053f59e640 1 --2- 172.21.15.107:0/3791858372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555576432910 0x55557643cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f053ed9d640 1 -- 172.21.15.107:0/3791858372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642d7a0 msgr2=0x55557643bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f053ed9d640 1 --2- 172.21.15.107:0/3791858372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642d7a0 0x55557643bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f053ed9d640 1 -- 172.21.15.107:0/3791858372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555576432910 msgr2=0x55557643cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f053ed9d640 1 --2- 172.21.15.107:0/3791858372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555576432910 0x55557643cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f053ed9d640 1 -- 172.21.15.107:0/3791858372 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55557643d4f0 con 0x55557642cdb0 2024-05-10T10:57:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f053f59e640 1 --2- 172.21.15.107:0/3791858372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555576432910 0x55557643cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f053ed9d640 1 --2- 172.21.15.107:0/3791858372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55557642cdb0 0x55557643b9b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f05380df7d0 tx=0x7f0538003840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfaec987d9acbef server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f0522ff5640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:57:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.837+0000 7f0522ff5640 1 -- 172.21.15.107:0/3791858372 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05380ad6a0 con 0x55557642cdb0 2024-05-10T10:57:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.838+0000 7f0522ff5640 1 -- 172.21.15.107:0/3791858372 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f0538003d50 con 0x55557642cdb0 2024-05-10T10:57:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.838+0000 7f0547d78740 1 -- 172.21.15.107:0/3791858372 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0530031610 con 0x55557642cdb0 2024-05-10T10:57:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.838+0000 7f0522ff5640 1 -- 172.21.15.107:0/3791858372 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f05380b2150 con 0x55557642cdb0 2024-05-10T10:57:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.838+0000 7f0547d78740 10 client.15597 fetch_fsmap learned FSMap version 27 2024-05-10T10:57:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.838+0000 7f0547d78740 1 -- 172.21.15.107:0/3791858372 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55557643e840 con 0x55557642cdb0 2024-05-10T10:57:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.838+0000 7f0522ff5640 1 -- 172.21.15.107:0/3791858372 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0530031610 con 0x55557642cdb0 2024-05-10T10:57:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.838+0000 7f0522ff5640 1 -- 172.21.15.107:0/3791858372 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f05380a72d0 con 0x55557642cdb0 2024-05-10T10:57:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.838+0000 7f0547d78740 10 client.15597 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:57:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.838+0000 7f0547d78740 10 client.15597 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:57:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.838+0000 7f0547d78740 20 client.15597 populate_metadata read hostname 'smithi107' 2024-05-10T10:57:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.838+0000 7f0547d78740 1 --2- 172.21.15.107:0/3791858372 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5555764add40 0x5555764b0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.838+0000 7f0547d78740 4 client.15597 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T10:57:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.838+0000 7f0547d78740 1 -- 172.21.15.107:0/3791858372 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555576399050 con 0x5555764add40 2024-05-10T10:57:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.838+0000 7f053e59c640 1 --2- 172.21.15.107:0/3791858372 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5555764add40 0x5555764b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.839+0000 7f053e59c640 1 --2- 172.21.15.107:0/3791858372 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5555764add40 0x5555764b0160 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f91820fb59e3b12 server_cookie=384c1ebf39c177b in_seq=0 out_seq=0 2024-05-10T10:57:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.839+0000 7f0522ff5640 10 client.15597 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.842+0000 7f0522ff5640 1 -- 172.21.15.107:0/3791858372 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555576399050 con 0x5555764add40 2024-05-10T10:57:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.842+0000 7f0522ff5640 10 client.15597 handle_command_reply: tid=0 2024-05-10T10:57:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.842+0000 7f0547d78740 1 client.15597 shutdown 2024-05-10T10:57:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.842+0000 7f0547d78740 1 -- 172.21.15.107:0/3791858372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55557642cdb0 msgr2=0x55557643b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.842+0000 7f0547d78740 1 --2- 172.21.15.107:0/3791858372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55557642cdb0 0x55557643b9b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f05380df7d0 tx=0x7f0538003840 comp rx=0 tx=0).stop 2024-05-10T10:57:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0547d78740 1 -- 172.21.15.107:0/3791858372 shutdown_connections 2024-05-10T10:57:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0547d78740 1 --2- 172.21.15.107:0/3791858372 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5555764add40 0x5555764b0160 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0547d78740 1 --2- 172.21.15.107:0/3791858372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555576432910 0x55557643cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0547d78740 1 --2- 172.21.15.107:0/3791858372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55557642d7a0 0x55557643bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0522ff5640 0 client.15597 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0547d78740 1 --2- 172.21.15.107:0/3791858372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55557642cdb0 0x55557643b9b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0547d78740 1 -- 172.21.15.107:0/3791858372 >> 172.21.15.107:0/3791858372 conn(0x555576428420 msgr2=0x55557642b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0547d78740 1 -- 172.21.15.107:0/3791858372 shutdown_connections 2024-05-10T10:57:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0547d78740 1 -- 172.21.15.107:0/3791858372 wait complete. 2024-05-10T10:57:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0547d78740 20 client.15597 trim_cache size 0 max 16384 2024-05-10T10:57:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:{ 2024-05-10T10:57:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "message": "", 2024-05-10T10:57:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "return_code": 0 2024-05-10T10:57:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:} 2024-05-10T10:57:42.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0545069640 1 -- 172.21.15.107:0/3806431169 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f05280b28a0 msgr2=0x7f05280b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:42.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0545069640 1 --2- 172.21.15.107:0/3806431169 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f05280b28a0 0x7f05280b4d60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0530005940 tx=0x7f0530009260 comp rx=0 tx=0).stop 2024-05-10T10:57:42.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0545069640 1 -- 172.21.15.107:0/3806431169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0540101910 msgr2=0x7f0540198ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:42.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0545069640 1 --2- 172.21.15.107:0/3806431169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0540101910 0x7f0540198ca0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f053800d770 tx=0x7f053800dc30 comp rx=0 tx=0).stop 2024-05-10T10:57:42.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0545069640 1 -- 172.21.15.107:0/3806431169 shutdown_connections 2024-05-10T10:57:42.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0545069640 1 --2- 172.21.15.107:0/3806431169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05401034c0 0x7f05401a01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0545069640 1 --2- 172.21.15.107:0/3806431169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0540102b00 0x7f05401991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0545069640 1 --2- 172.21.15.107:0/3806431169 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f05280b28a0 0x7f05280b4d60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0545069640 1 --2- 172.21.15.107:0/3806431169 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0540101910 0x7f0540198ca0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:42.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0545069640 1 -- 172.21.15.107:0/3806431169 >> 172.21.15.107:0/3806431169 conn(0x7f05400fce80 msgr2=0x7f05400fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:42.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0545069640 1 -- 172.21.15.107:0/3806431169 shutdown_connections 2024-05-10T10:57:42.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:42.843+0000 7f0545069640 1 -- 172.21.15.107:0/3806431169 wait complete. 2024-05-10T10:57:43.523 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:43 smithi107 ceph-mon[30373]: pgmap v449: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 11 op/s 2024-05-10T10:57:43.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:43 smithi196 ceph-mon[34872]: pgmap v449: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 11 op/s 2024-05-10T10:57:43.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:43 smithi184 ceph-mon[34585]: pgmap v449: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 11 op/s 2024-05-10T10:57:44.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.433+0000 7ff62557f700 1 -- 172.21.15.107:0/4166126583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff620108410 msgr2=0x7ff6201087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:44.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.433+0000 7ff62557f700 1 --2- 172.21.15.107:0/4166126583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff620108410 0x7ff6201087f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff610009990 tx=0x7ff610009ca0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.433+0000 7ff62557f700 1 -- 172.21.15.107:0/4166126583 shutdown_connections 2024-05-10T10:57:44.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.433+0000 7ff62557f700 1 --2- 172.21.15.107:0/4166126583 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff620102d60 0x7ff62010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.433+0000 7ff62557f700 1 --2- 172.21.15.107:0/4166126583 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff620108410 0x7ff6201087f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.433+0000 7ff62557f700 1 --2- 172.21.15.107:0/4166126583 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6201023a0 0x7ff620102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.433+0000 7ff62557f700 1 -- 172.21.15.107:0/4166126583 >> 172.21.15.107:0/4166126583 conn(0x7ff620079350 msgr2=0x7ff620079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:44.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.433+0000 7ff62557f700 1 -- 172.21.15.107:0/4166126583 shutdown_connections 2024-05-10T10:57:44.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.433+0000 7ff62557f700 1 -- 172.21.15.107:0/4166126583 wait complete. 2024-05-10T10:57:44.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.434+0000 7ff62557f700 1 Processor -- start 2024-05-10T10:57:44.435 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.434+0000 7ff62557f700 1 -- start start 2024-05-10T10:57:44.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.434+0000 7ff62557f700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6201023a0 0x7ff6201a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:44.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.434+0000 7ff62557f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff620102d60 0x7ff6201a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:44.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.434+0000 7ff62557f700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff620108410 0x7ff6201a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:44.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.434+0000 7ff62557f700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201126f0 con 0x7ff6201023a0 2024-05-10T10:57:44.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.434+0000 7ff62557f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff620112570 con 0x7ff620102d60 2024-05-10T10:57:44.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.434+0000 7ff62557f700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff620112870 con 0x7ff620108410 2024-05-10T10:57:44.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.434+0000 7ff61effd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6201023a0 0x7ff6201a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:44.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.434+0000 7ff61effd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6201023a0 0x7ff6201a05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49406/0 (socket says 172.21.15.107:49406) 2024-05-10T10:57:44.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.434+0000 7ff61effd700 1 -- 172.21.15.107:0/1592035488 learned_addr learned my addr 172.21.15.107:0/1592035488 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:44.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.434+0000 7ff6167fc700 1 --2- 172.21.15.107:0/1592035488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff620102d60 0x7ff6201a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:44.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.435+0000 7ff61f7fe700 1 --2- 172.21.15.107:0/1592035488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff620108410 0x7ff6201a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:44.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.435+0000 7ff61effd700 1 -- 172.21.15.107:0/1592035488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff620108410 msgr2=0x7ff6201a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:44.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.435+0000 7ff61effd700 1 --2- 172.21.15.107:0/1592035488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff620108410 0x7ff6201a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.435+0000 7ff61effd700 1 -- 172.21.15.107:0/1592035488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff620102d60 msgr2=0x7ff6201a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:44.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.435+0000 7ff61effd700 1 --2- 172.21.15.107:0/1592035488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff620102d60 0x7ff6201a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.435+0000 7ff61effd700 1 -- 172.21.15.107:0/1592035488 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6201021d0 con 0x7ff6201023a0 2024-05-10T10:57:44.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.435+0000 7ff61f7fe700 1 --2- 172.21.15.107:0/1592035488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff620108410 0x7ff6201a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:57:44.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.435+0000 7ff61effd700 1 --2- 172.21.15.107:0/1592035488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6201023a0 0x7ff6201a05a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff610009fb0 tx=0x7ff610005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:44.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.435+0000 7ff61cff9700 1 -- 172.21.15.107:0/1592035488 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff610027070 con 0x7ff6201023a0 2024-05-10T10:57:44.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.435+0000 7ff62557f700 1 -- 172.21.15.107:0/1592035488 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6201a54e0 con 0x7ff6201023a0 2024-05-10T10:57:44.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.435+0000 7ff61cff9700 1 -- 172.21.15.107:0/1592035488 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff610004030 con 0x7ff6201023a0 2024-05-10T10:57:44.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.435+0000 7ff61cff9700 1 -- 172.21.15.107:0/1592035488 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff610022d60 con 0x7ff6201023a0 2024-05-10T10:57:44.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.435+0000 7ff62557f700 1 -- 172.21.15.107:0/1592035488 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6201a5a10 con 0x7ff6201023a0 2024-05-10T10:57:44.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.438+0000 7ff61cff9700 1 -- 172.21.15.107:0/1592035488 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7ff61002a070 con 0x7ff6201023a0 2024-05-10T10:57:44.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.438+0000 7ff61cff9700 1 --2- 172.21.15.107:0/1592035488 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff60c0b2880 0x7ff60c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:44.439 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.439+0000 7ff6167fc700 1 --2- 172.21.15.107:0/1592035488 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff60c0b2880 0x7ff60c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:44.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.439+0000 7ff61cff9700 1 -- 172.21.15.107:0/1592035488 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7ff6100e2dd0 con 0x7ff6201023a0 2024-05-10T10:57:44.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.439+0000 7ff62fe12b80 1 Processor -- start 2024-05-10T10:57:44.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.439+0000 7ff62fe12b80 1 -- start start 2024-05-10T10:57:44.440 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.439+0000 7ff6167fc700 1 --2- 172.21.15.107:0/1592035488 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff60c0b2880 0x7ff60c0b4d40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff6201070b0 tx=0x7ff608009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:44.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.439+0000 7ff62fe12b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24b37c0 0x555be24b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:44.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.439+0000 7ff62fe12b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ada70 0x555be24adef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:44.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.439+0000 7ff62fe12b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24ae430 0x555be24ba580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:44.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.439+0000 7ff62fe12b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555be23ffa40 con 0x555be24b37c0 2024-05-10T10:57:44.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.439+0000 7ff62fe12b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555be2364ea0 con 0x555be24ae430 2024-05-10T10:57:44.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.439+0000 7ff62fe12b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555be23fba00 con 0x555be24ada70 2024-05-10T10:57:44.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.440+0000 7ff61effd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24b37c0 0x555be24b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:44.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.440+0000 7ff61effd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24b37c0 0x555be24b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49408/0 (socket says 172.21.15.107:49408) 2024-05-10T10:57:44.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.440+0000 7ff61effd700 1 -- 172.21.15.107:0/178672713 learned_addr learned my addr 172.21.15.107:0/178672713 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:44.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.440+0000 7ff6167fc700 1 --2- 172.21.15.107:0/178672713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ada70 0x555be24adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:44.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.440+0000 7ff61f7fe700 1 --2- 172.21.15.107:0/178672713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24ae430 0x555be24ba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:44.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.440+0000 7ff61effd700 1 -- 172.21.15.107:0/178672713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ada70 msgr2=0x555be24adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:44.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.440+0000 7ff61effd700 1 --2- 172.21.15.107:0/178672713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ada70 0x555be24adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.440+0000 7ff61effd700 1 -- 172.21.15.107:0/178672713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24ae430 msgr2=0x555be24ba580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:44.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.440+0000 7ff61effd700 1 --2- 172.21.15.107:0/178672713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24ae430 0x555be24ba580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.440+0000 7ff61effd700 1 -- 172.21.15.107:0/178672713 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555be234c9d0 con 0x555be24b37c0 2024-05-10T10:57:44.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.440+0000 7ff6167fc700 1 --2- 172.21.15.107:0/178672713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ada70 0x555be24adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:44.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.440+0000 7ff61effd700 1 --2- 172.21.15.107:0/178672713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24b37c0 0x555be24b3ba0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff6100a65a0 tx=0x7ff61000b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3de6d54d07ce10 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:44.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.440+0000 7ff6157fa700 1 -- 172.21.15.107:0/178672713 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6100aa520 con 0x555be24b37c0 2024-05-10T10:57:44.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.440+0000 7ff6157fa700 1 -- 172.21.15.107:0/178672713 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff6100ae8d0 con 0x555be24b37c0 2024-05-10T10:57:44.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.440+0000 7ff6157fa700 1 -- 172.21.15.107:0/178672713 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6100aa870 con 0x555be24b37c0 2024-05-10T10:57:44.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.441+0000 7ff62fe12b80 1 -- 172.21.15.107:0/178672713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24b37c0 msgr2=0x555be24b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:44.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.441+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/178672713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24b37c0 0x555be24b3ba0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff6100a65a0 tx=0x7ff61000b540 comp rx=0 tx=0).stop 2024-05-10T10:57:44.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.441+0000 7ff62fe12b80 1 -- 172.21.15.107:0/178672713 shutdown_connections 2024-05-10T10:57:44.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.441+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/178672713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24ae430 0x555be24ba580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.441+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/178672713 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24b37c0 0x555be24b3ba0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.441+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/178672713 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ada70 0x555be24adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.441+0000 7ff62fe12b80 1 -- 172.21.15.107:0/178672713 >> 172.21.15.107:0/178672713 conn(0x555be23d9c70 msgr2=0x555be24a87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:44.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.441+0000 7ff62fe12b80 1 -- 172.21.15.107:0/178672713 shutdown_connections 2024-05-10T10:57:44.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.441+0000 7ff62fe12b80 1 -- 172.21.15.107:0/178672713 wait complete. 2024-05-10T10:57:44.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.441+0000 7ff62fe12b80 1 -- start start 2024-05-10T10:57:44.446 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff62fe12b80 1 Processor -- start 2024-05-10T10:57:44.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff62fe12b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ada70 0x555be24ba060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:44.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff62fe12b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24ae430 0x555be24b7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:44.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff62fe12b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24b37c0 0x555be24b7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:44.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff62fe12b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x555be24b41e0 con 0x555be24ae430 2024-05-10T10:57:44.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff62fe12b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555be23b8fd0 con 0x555be24b37c0 2024-05-10T10:57:44.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff62fe12b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x555be24baac0 con 0x555be24ada70 2024-05-10T10:57:44.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff62fe12b80 10 client.0 _ll_register_callbacks cb 0x555be23936b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:57:44.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff6167fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24ae430 0x555be24b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:44.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff6167fc700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24ae430 0x555be24b7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49416/0 (socket says 172.21.15.107:49416) 2024-05-10T10:57:44.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff6167fc700 1 -- 172.21.15.107:0/2401359989 learned_addr learned my addr 172.21.15.107:0/2401359989 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:44.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff61effd700 1 --2- 172.21.15.107:0/2401359989 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ada70 0x555be24ba060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:44.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff61f7fe700 1 --2- 172.21.15.107:0/2401359989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24b37c0 0x555be24b7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:44.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff6167fc700 1 -- 172.21.15.107:0/2401359989 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ada70 msgr2=0x555be24ba060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:44.447 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff6167fc700 1 --2- 172.21.15.107:0/2401359989 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ada70 0x555be24ba060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff6167fc700 1 -- 172.21.15.107:0/2401359989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24b37c0 msgr2=0x555be24b7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:44.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff6167fc700 1 --2- 172.21.15.107:0/2401359989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24b37c0 0x555be24b7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff6167fc700 1 -- 172.21.15.107:0/2401359989 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555be23b6860 con 0x555be24ae430 2024-05-10T10:57:44.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff61f7fe700 1 --2- 172.21.15.107:0/2401359989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24b37c0 0x555be24b7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:57:44.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff6167fc700 1 --2- 172.21.15.107:0/2401359989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24ae430 0x555be24b7400 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff60800ee80 tx=0x7ff608004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d7dd6350b2b201 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:44.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.442+0000 7ff6067fc700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:57:44.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.443+0000 7ff6067fc700 1 -- 172.21.15.107:0/2401359989 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff608024020 con 0x555be24ae430 2024-05-10T10:57:44.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.443+0000 7ff6067fc700 1 -- 172.21.15.107:0/2401359989 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7ff60800f040 con 0x555be24ae430 2024-05-10T10:57:44.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.443+0000 7ff62fe12b80 1 -- 172.21.15.107:0/2401359989 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6100ae8d0 con 0x555be24ae430 2024-05-10T10:57:44.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.443+0000 7ff6067fc700 1 -- 172.21.15.107:0/2401359989 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff608015b20 con 0x555be24ae430 2024-05-10T10:57:44.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.443+0000 7ff62fe12b80 10 client.15609 fetch_fsmap learned FSMap version 27 2024-05-10T10:57:44.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.443+0000 7ff62fe12b80 1 -- 172.21.15.107:0/2401359989 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555be24c4ea0 con 0x555be24ae430 2024-05-10T10:57:44.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.443+0000 7ff6067fc700 1 -- 172.21.15.107:0/2401359989 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff6100ae8d0 con 0x555be24ae430 2024-05-10T10:57:44.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.443+0000 7ff6067fc700 1 -- 172.21.15.107:0/2401359989 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff6080064f0 con 0x555be24ae430 2024-05-10T10:57:44.448 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.443+0000 7ff62fe12b80 10 client.15609 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:57:44.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.443+0000 7ff62fe12b80 10 client.15609 resolve_mds: validated gid 24482 aka daemon mds.b 2024-05-10T10:57:44.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.443+0000 7ff62fe12b80 20 client.15609 populate_metadata read hostname 'smithi107' 2024-05-10T10:57:44.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.443+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/2401359989 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x555be24c7580 0x555be24c9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:44.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.443+0000 7ff62fe12b80 4 client.15609 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:57:44.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.443+0000 7ff62fe12b80 1 -- 172.21.15.107:0/2401359989 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555be240d420 con 0x555be24c7580 2024-05-10T10:57:44.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.444+0000 7ff61effd700 1 --2- 172.21.15.107:0/2401359989 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x555be24c7580 0x555be24c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:44.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.444+0000 7ff61effd700 1 --2- 172.21.15.107:0/2401359989 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x555be24c7580 0x555be24c9970 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32fee7c12e477865 server_cookie=8b65777d377b9b in_seq=0 out_seq=0 2024-05-10T10:57:44.449 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.444+0000 7ff6067fc700 10 client.15609 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:44.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.445+0000 7ff6067fc700 1 -- 172.21.15.107:0/2401359989 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555be240d420 con 0x555be24c7580 2024-05-10T10:57:44.450 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.445+0000 7ff6067fc700 10 client.15609 handle_command_reply: tid=0 2024-05-10T10:57:44.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.445+0000 7ff62fe12b80 1 client.15609 shutdown 2024-05-10T10:57:44.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.445+0000 7ff62fe12b80 1 -- 172.21.15.107:0/2401359989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24ae430 msgr2=0x555be24b7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:44.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.445+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/2401359989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24ae430 0x555be24b7400 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff60800ee80 tx=0x7ff608004860 comp rx=0 tx=0).stop 2024-05-10T10:57:44.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.445+0000 7ff62fe12b80 1 -- 172.21.15.107:0/2401359989 shutdown_connections 2024-05-10T10:57:44.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.445+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/2401359989 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ada70 0x555be24ba060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.445+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/2401359989 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x555be24c7580 0x555be24c9970 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.445+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/2401359989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24b37c0 0x555be24b7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.445+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/2401359989 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24ae430 0x555be24b7400 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.445+0000 7ff6067fc700 0 client.15609 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:44.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.445+0000 7ff62fe12b80 1 -- 172.21.15.107:0/2401359989 >> 172.21.15.107:0/2401359989 conn(0x555be23d9c70 msgr2=0x555be24a2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:44.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.445+0000 7ff62fe12b80 1 -- 172.21.15.107:0/2401359989 shutdown_connections 2024-05-10T10:57:44.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.445+0000 7ff62fe12b80 1 -- 172.21.15.107:0/2401359989 wait complete. 2024-05-10T10:57:44.451 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.445+0000 7ff62fe12b80 20 client.15609 trim_cache size 0 max 16384 2024-05-10T10:57:44.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.465+0000 7ff62fe12b80 1 Processor -- start 2024-05-10T10:57:44.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.465+0000 7ff62fe12b80 1 -- start start 2024-05-10T10:57:44.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.465+0000 7ff62fe12b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24ada70 0x555be24a2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:44.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.465+0000 7ff62fe12b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ae430 0x555be24b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:44.466 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.465+0000 7ff62fe12b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24b37c0 0x555be24b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.465+0000 7ff62fe12b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201b40f0 con 0x555be24b37c0 2024-05-10T10:57:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.465+0000 7ff62fe12b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201b5c30 con 0x555be24ada70 2024-05-10T10:57:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.465+0000 7ff62fe12b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201b47c0 con 0x555be24ae430 2024-05-10T10:57:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.465+0000 7ff61f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24b37c0 0x555be24b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.465+0000 7ff61f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24b37c0 0x555be24b2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49426/0 (socket says 172.21.15.107:49426) 2024-05-10T10:57:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.465+0000 7ff61f7fe700 1 -- 172.21.15.107:0/3518766270 learned_addr learned my addr 172.21.15.107:0/3518766270 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.466+0000 7ff61effd700 1 --2- 172.21.15.107:0/3518766270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24ada70 0x555be24a2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.466+0000 7ff61f7fe700 1 -- 172.21.15.107:0/3518766270 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ae430 msgr2=0x555be24b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.466+0000 7ff61f7fe700 1 --2- 172.21.15.107:0/3518766270 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ae430 0x555be24b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.466+0000 7ff61f7fe700 1 -- 172.21.15.107:0/3518766270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24ada70 msgr2=0x555be24a2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.466+0000 7ff61f7fe700 1 --2- 172.21.15.107:0/3518766270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24ada70 0x555be24a2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.466+0000 7ff61f7fe700 1 -- 172.21.15.107:0/3518766270 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555be24a33e0 con 0x555be24b37c0 2024-05-10T10:57:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.466+0000 7ff61effd700 1 --2- 172.21.15.107:0/3518766270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24ada70 0x555be24a2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:44.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.466+0000 7ff61f7fe700 1 --2- 172.21.15.107:0/3518766270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24b37c0 0x555be24b2a70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff6180087c0 tx=0x7ff618008ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57fa8713a18ba8a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:44.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.466+0000 7ff614ff9700 1 -- 172.21.15.107:0/3518766270 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61801a020 con 0x555be24b37c0 2024-05-10T10:57:44.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.466+0000 7ff614ff9700 1 -- 172.21.15.107:0/3518766270 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff618016ad0 con 0x555be24b37c0 2024-05-10T10:57:44.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.466+0000 7ff614ff9700 1 -- 172.21.15.107:0/3518766270 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff618014ba0 con 0x555be24b37c0 2024-05-10T10:57:44.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.467+0000 7ff62fe12b80 1 -- 172.21.15.107:0/3518766270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24b37c0 msgr2=0x555be24b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:44.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.467+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/3518766270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24b37c0 0x555be24b2a70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff6180087c0 tx=0x7ff618008ad0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.467+0000 7ff62fe12b80 1 -- 172.21.15.107:0/3518766270 shutdown_connections 2024-05-10T10:57:44.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.467+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/3518766270 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24b37c0 0x555be24b2a70 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.467+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/3518766270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24ada70 0x555be24a2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.467+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/3518766270 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ae430 0x555be24b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.467+0000 7ff62fe12b80 1 -- 172.21.15.107:0/3518766270 >> 172.21.15.107:0/3518766270 conn(0x555be23d9c70 msgr2=0x555be24ad2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:44.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.467+0000 7ff62fe12b80 1 -- 172.21.15.107:0/3518766270 shutdown_connections 2024-05-10T10:57:44.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.467+0000 7ff62fe12b80 1 -- 172.21.15.107:0/3518766270 wait complete. 2024-05-10T10:57:44.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.467+0000 7ff62fe12b80 1 -- start start 2024-05-10T10:57:44.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.467+0000 7ff62fe12b80 1 Processor -- start 2024-05-10T10:57:44.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.467+0000 7ff62fe12b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24ada70 0x555be24b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:44.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.467+0000 7ff62fe12b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ae430 0x555be24bfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:44.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.467+0000 7ff62fe12b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24b37c0 0x555be24c0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:44.471 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.467+0000 7ff62fe12b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201b5560 con 0x555be24ada70 2024-05-10T10:57:44.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.467+0000 7ff62fe12b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201b4e90 con 0x555be24b37c0 2024-05-10T10:57:44.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.467+0000 7ff62fe12b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201b20b0 con 0x555be24ae430 2024-05-10T10:57:44.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff62fe12b80 10 client.0 _ll_register_callbacks cb 0x555be23936b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:57:44.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff61effd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24ada70 0x555be24b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:44.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff61effd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24ada70 0x555be24b0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49440/0 (socket says 172.21.15.107:49440) 2024-05-10T10:57:44.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff61effd700 1 -- 172.21.15.107:0/177554225 learned_addr learned my addr 172.21.15.107:0/177554225 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:44.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff6167fc700 1 --2- 172.21.15.107:0/177554225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ae430 0x555be24bfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:44.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff61f7fe700 1 --2- 172.21.15.107:0/177554225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24b37c0 0x555be24c0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:44.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff61effd700 1 -- 172.21.15.107:0/177554225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ae430 msgr2=0x555be24bfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:44.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff61effd700 1 --2- 172.21.15.107:0/177554225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ae430 0x555be24bfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff61effd700 1 -- 172.21.15.107:0/177554225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24b37c0 msgr2=0x555be24c0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:44.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff61effd700 1 --2- 172.21.15.107:0/177554225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24b37c0 0x555be24c0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff61effd700 1 -- 172.21.15.107:0/177554225 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555be24af1f0 con 0x555be24ada70 2024-05-10T10:57:44.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff61f7fe700 1 --2- 172.21.15.107:0/177554225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24b37c0 0x555be24c0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:44.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff61effd700 1 --2- 172.21.15.107:0/177554225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24ada70 0x555be24b0ac0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff61000c010 tx=0x7ff610009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a36c15a18c79d64 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:44.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff6067fc700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:57:44.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff6067fc700 1 -- 172.21.15.107:0/177554225 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6100ae8d0 con 0x555be24ada70 2024-05-10T10:57:44.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff6067fc700 1 -- 172.21.15.107:0/177554225 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7ff6100920c0 con 0x555be24ada70 2024-05-10T10:57:44.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff62fe12b80 1 -- 172.21.15.107:0/177554225 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff618016ad0 con 0x555be24ada70 2024-05-10T10:57:44.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff6067fc700 1 -- 172.21.15.107:0/177554225 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff610022470 con 0x555be24ada70 2024-05-10T10:57:44.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff62fe12b80 10 client.15615 fetch_fsmap learned FSMap version 27 2024-05-10T10:57:44.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff62fe12b80 1 -- 172.21.15.107:0/177554225 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555be2533110 con 0x555be24ada70 2024-05-10T10:57:44.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.468+0000 7ff6067fc700 1 -- 172.21.15.107:0/177554225 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff618016ad0 con 0x555be24ada70 2024-05-10T10:57:44.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.469+0000 7ff6067fc700 1 -- 172.21.15.107:0/177554225 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff6100b2f40 con 0x555be24ada70 2024-05-10T10:57:44.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.469+0000 7ff62fe12b80 10 client.15615 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:57:44.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.469+0000 7ff62fe12b80 10 client.15615 resolve_mds: validated gid 24482 aka daemon mds.b 2024-05-10T10:57:44.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.469+0000 7ff62fe12b80 20 client.15615 populate_metadata read hostname 'smithi107' 2024-05-10T10:57:44.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.469+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/177554225 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x555be2533630 0x555be2535a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:44.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.469+0000 7ff62fe12b80 4 client.15615 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "13975d87", "release": true, "await": true}] 2024-05-10T10:57:44.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.469+0000 7ff62fe12b80 1 -- 172.21.15.107:0/177554225 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "quiesce db", "set_id": "13975d87", "release": true, "await": true}) -- 0x555be24074c0 con 0x555be2533630 2024-05-10T10:57:44.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.469+0000 7ff6167fc700 1 --2- 172.21.15.107:0/177554225 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x555be2533630 0x555be2535a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:44.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.469+0000 7ff6167fc700 1 --2- 172.21.15.107:0/177554225 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x555be2533630 0x555be2535a20 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4e0fc49ca2646a7 server_cookie=b72b2067040edbd9 in_seq=0 out_seq=0 2024-05-10T10:57:44.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.469+0000 7ff6067fc700 10 client.15615 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:44.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.474+0000 7ff6067fc700 1 -- 172.21.15.107:0/177554225 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x555be24074c0 con 0x555be2533630 2024-05-10T10:57:44.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.474+0000 7ff6067fc700 10 client.15615 handle_command_reply: tid=0 2024-05-10T10:57:44.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.474+0000 7ff62fe12b80 1 client.15615 shutdown 2024-05-10T10:57:44.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62fe12b80 1 -- 172.21.15.107:0/177554225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24ada70 msgr2=0x555be24b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:44.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/177554225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24ada70 0x555be24b0ac0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff61000c010 tx=0x7ff610009ca0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62fe12b80 1 -- 172.21.15.107:0/177554225 shutdown_connections 2024-05-10T10:57:44.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/177554225 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x555be2533630 0x555be2535a20 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/177554225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555be24b37c0 0x555be24c0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/177554225 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x555be24ada70 0x555be24b0ac0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62fe12b80 1 --2- 172.21.15.107:0/177554225 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x555be24ae430 0x555be24bfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62fe12b80 1 -- 172.21.15.107:0/177554225 >> 172.21.15.107:0/177554225 conn(0x555be23d9c70 msgr2=0x555be24b6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:44.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff6067fc700 0 client.15615 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:44.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62fe12b80 1 -- 172.21.15.107:0/177554225 shutdown_connections 2024-05-10T10:57:44.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62fe12b80 1 -- 172.21.15.107:0/177554225 wait complete. 2024-05-10T10:57:44.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62fe12b80 20 client.15615 trim_cache size 0 max 16384 2024-05-10T10:57:44.477 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:57:44.477 INFO:teuthology.orchestra.run.smithi107.stdout: "epoch": 27, 2024-05-10T10:57:44.477 INFO:teuthology.orchestra.run.smithi107.stdout: "leader": 24482, 2024-05-10T10:57:44.477 INFO:teuthology.orchestra.run.smithi107.stdout: "set_version": 8, 2024-05-10T10:57:44.477 INFO:teuthology.orchestra.run.smithi107.stdout: "sets": { 2024-05-10T10:57:44.477 INFO:teuthology.orchestra.run.smithi107.stdout: "13975d87": { 2024-05-10T10:57:44.477 INFO:teuthology.orchestra.run.smithi107.stdout: "version": 8, 2024-05-10T10:57:44.477 INFO:teuthology.orchestra.run.smithi107.stdout: "age_ref": 0.0, 2024-05-10T10:57:44.477 INFO:teuthology.orchestra.run.smithi107.stdout: "state": { 2024-05-10T10:57:44.477 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RELEASED", 2024-05-10T10:57:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0 2024-05-10T10:57:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T10:57:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: "timeout": 60.0, 2024-05-10T10:57:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: "expiration": 86.7, 2024-05-10T10:57:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: "members": { 2024-05-10T10:57:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: "file:/": { 2024-05-10T10:57:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: "excluded": false, 2024-05-10T10:57:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: "state": { 2024-05-10T10:57:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RELEASED", 2024-05-10T10:57:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0 2024-05-10T10:57:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:57:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:57:44.478 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:57:44.479 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:57:44.479 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:57:44.479 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:57:44.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62557f700 1 -- 172.21.15.107:0/1592035488 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff60c0b2880 msgr2=0x7ff60c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:44.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62557f700 1 --2- 172.21.15.107:0/1592035488 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff60c0b2880 0x7ff60c0b4d40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff6201070b0 tx=0x7ff608009190 comp rx=0 tx=0).stop 2024-05-10T10:57:44.479 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62557f700 1 -- 172.21.15.107:0/1592035488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6201023a0 msgr2=0x7ff6201a05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:44.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62557f700 1 --2- 172.21.15.107:0/1592035488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6201023a0 0x7ff6201a05a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff610009fb0 tx=0x7ff610005590 comp rx=0 tx=0).stop 2024-05-10T10:57:44.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62557f700 1 -- 172.21.15.107:0/1592035488 shutdown_connections 2024-05-10T10:57:44.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62557f700 1 --2- 172.21.15.107:0/1592035488 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff60c0b2880 0x7ff60c0b4d40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62557f700 1 --2- 172.21.15.107:0/1592035488 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff620108410 0x7ff6201a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62557f700 1 --2- 172.21.15.107:0/1592035488 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff6201023a0 0x7ff6201a05a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62557f700 1 --2- 172.21.15.107:0/1592035488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff620102d60 0x7ff6201a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:44.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.475+0000 7ff62557f700 1 -- 172.21.15.107:0/1592035488 >> 172.21.15.107:0/1592035488 conn(0x7ff620079350 msgr2=0x7ff620101510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:44.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.476+0000 7ff62557f700 1 -- 172.21.15.107:0/1592035488 shutdown_connections 2024-05-10T10:57:44.480 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:44.476+0000 7ff62557f700 1 -- 172.21.15.107:0/1592035488 wait complete. 2024-05-10T10:57:44.480 INFO:tasks.workunit.client.0.smithi107.stderr:+ KERNEL=linux-4.0.5 2024-05-10T10:57:44.480 INFO:tasks.workunit.client.0.smithi107.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-05-10T10:57:45.281 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '13975d87', seconds elapsed: 39.5 2024-05-10T10:57:45.281 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.65 2024-05-10T10:57:45.281 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:57:45.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:45 smithi196 ceph-mon[34872]: pgmap v450: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-10T10:57:45.570 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:57:45.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:45 smithi184 ceph-mon[34585]: pgmap v450: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-10T10:57:45.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:45 smithi107 ceph-mon[30373]: pgmap v450: 97 pgs: 97 active+clean; 686 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-10T10:57:47.256 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:47 smithi107 ceph-mon[30373]: pgmap v451: 97 pgs: 97 active+clean; 687 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-10T10:57:47.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.261+0000 7f0025442700 1 -- 172.21.15.107:0/1127622125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0020109510 msgr2=0x7f00201098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:47.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.261+0000 7f0025442700 1 --2- 172.21.15.107:0/1127622125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0020109510 0x7f00201098f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0010009990 tx=0x7f0010009ca0 comp rx=0 tx=0).stop 2024-05-10T10:57:47.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.261+0000 7f0025442700 1 -- 172.21.15.107:0/1127622125 shutdown_connections 2024-05-10T10:57:47.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.261+0000 7f0025442700 1 --2- 172.21.15.107:0/1127622125 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f002006bb40 0x7f0020110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:47.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.261+0000 7f0025442700 1 --2- 172.21.15.107:0/1127622125 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0020109510 0x7f00201098f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:47.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.261+0000 7f0025442700 1 --2- 172.21.15.107:0/1127622125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f002006b180 0x7f002006b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:47.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.261+0000 7f0025442700 1 -- 172.21.15.107:0/1127622125 >> 172.21.15.107:0/1127622125 conn(0x7f0020079350 msgr2=0x7f0020079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:47.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.261+0000 7f0025442700 1 -- 172.21.15.107:0/1127622125 shutdown_connections 2024-05-10T10:57:47.262 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.261+0000 7f0025442700 1 -- 172.21.15.107:0/1127622125 wait complete. 2024-05-10T10:57:47.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.262+0000 7f0025442700 1 Processor -- start 2024-05-10T10:57:47.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.262+0000 7f0025442700 1 -- start start 2024-05-10T10:57:47.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.262+0000 7f0025442700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f002006b180 0x7f002019f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:47.264 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.262+0000 7f0025442700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f002006bb40 0x7f002019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:47.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.262+0000 7f0025442700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0020109510 0x7f0020199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:47.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.262+0000 7f0025442700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f00201137e0 con 0x7f0020109510 2024-05-10T10:57:47.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.263+0000 7f0025442700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0020113660 con 0x7f002006b180 2024-05-10T10:57:47.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.263+0000 7f0025442700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0020113960 con 0x7f002006bb40 2024-05-10T10:57:47.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.263+0000 7f001f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0020109510 0x7f0020199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:47.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.263+0000 7f001f7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0020109510 0x7f0020199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39646/0 (socket says 172.21.15.107:39646) 2024-05-10T10:57:47.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.263+0000 7f001f7fe700 1 -- 172.21.15.107:0/1590841283 learned_addr learned my addr 172.21.15.107:0/1590841283 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:47.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.263+0000 7f001e7fc700 1 --2- 172.21.15.107:0/1590841283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f002006bb40 0x7f002019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:47.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.263+0000 7f001effd700 1 --2- 172.21.15.107:0/1590841283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f002006b180 0x7f002019f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:47.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.263+0000 7f001f7fe700 1 -- 172.21.15.107:0/1590841283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f002006bb40 msgr2=0x7f002019fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:47.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.263+0000 7f001f7fe700 1 --2- 172.21.15.107:0/1590841283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f002006bb40 0x7f002019fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:47.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.263+0000 7f001f7fe700 1 -- 172.21.15.107:0/1590841283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f002006b180 msgr2=0x7f002019f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:47.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.263+0000 7f001f7fe700 1 --2- 172.21.15.107:0/1590841283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f002006b180 0x7f002019f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:47.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.263+0000 7f001f7fe700 1 -- 172.21.15.107:0/1590841283 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002019a160 con 0x7f0020109510 2024-05-10T10:57:47.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.263+0000 7f001f7fe700 1 --2- 172.21.15.107:0/1590841283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0020109510 0x7f0020199a00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f001800b970 tx=0x7f001800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:47.265 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.263+0000 7f0007fff700 1 -- 172.21.15.107:0/1590841283 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001800d860 con 0x7f0020109510 2024-05-10T10:57:47.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.263+0000 7f0025442700 1 -- 172.21.15.107:0/1590841283 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f002019a450 con 0x7f0020109510 2024-05-10T10:57:47.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.263+0000 7f0007fff700 1 -- 172.21.15.107:0/1590841283 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f001800e430 con 0x7f0020109510 2024-05-10T10:57:47.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.263+0000 7f0007fff700 1 -- 172.21.15.107:0/1590841283 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0018017660 con 0x7f0020109510 2024-05-10T10:57:47.266 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.263+0000 7f0025442700 1 -- 172.21.15.107:0/1590841283 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00201023a0 con 0x7f0020109510 2024-05-10T10:57:47.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.264+0000 7f0025442700 1 -- 172.21.15.107:0/1590841283 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f002010b9f0 con 0x7f0020109510 2024-05-10T10:57:47.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.266+0000 7f0007fff700 1 -- 172.21.15.107:0/1590841283 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f001800e5e0 con 0x7f0020109510 2024-05-10T10:57:47.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.266+0000 7f0007fff700 1 --2- 172.21.15.107:0/1590841283 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f00080b2880 0x7f00080b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:47.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.266+0000 7f001effd700 1 --2- 172.21.15.107:0/1590841283 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f00080b2880 0x7f00080b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:47.267 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.267+0000 7f0007fff700 1 -- 172.21.15.107:0/1590841283 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f00180e2180 con 0x7f0020109510 2024-05-10T10:57:47.268 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.267+0000 7f001effd700 1 --2- 172.21.15.107:0/1590841283 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f00080b2880 0x7f00080b4d40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f001000b5c0 tx=0x7f0010005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:47.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.270+0000 7f0007fff700 1 -- 172.21.15.107:0/1590841283 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0018013030 con 0x7f0020109510 2024-05-10T10:57:47.537 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.537+0000 7f0025442700 1 -- 172.21.15.107:0/1590841283 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f002019af30 con 0x7f0020109510 2024-05-10T10:57:47.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.537+0000 7f0007fff700 1 -- 172.21.15.107:0/1590841283 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11951 (secure 0 0 0) 0x7f00180a9f40 con 0x7f0020109510 2024-05-10T10:57:47.538 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:57:47.538 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T10:52:17.367732+0000","modified":"2024-05-10T10:55:30.125781+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24482,"mds_1":24449,"mds_2":24442,"mds_3":24431,"mds_4":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/2332963094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":2332963094},{"type":"v1","addr":"172.21.15.107:6841","nonce":2332963094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.184:6839/16501252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":16501252},{"type":"v1","addr":"172.21.15.184:6839","nonce":16501252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24430,24431,24482,24449,24442]},"id":1}]} 2024-05-10T10:57:47.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.540+0000 7f0025442700 1 -- 172.21.15.107:0/1590841283 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f00080b2880 msgr2=0x7f00080b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:47.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.540+0000 7f0025442700 1 --2- 172.21.15.107:0/1590841283 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f00080b2880 0x7f00080b4d40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f001000b5c0 tx=0x7f0010005960 comp rx=0 tx=0).stop 2024-05-10T10:57:47.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.540+0000 7f0025442700 1 -- 172.21.15.107:0/1590841283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0020109510 msgr2=0x7f0020199a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:47.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.540+0000 7f0025442700 1 --2- 172.21.15.107:0/1590841283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0020109510 0x7f0020199a00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f001800b970 tx=0x7f001800bc80 comp rx=0 tx=0).stop 2024-05-10T10:57:47.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.540+0000 7f0025442700 1 -- 172.21.15.107:0/1590841283 shutdown_connections 2024-05-10T10:57:47.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.540+0000 7f0025442700 1 --2- 172.21.15.107:0/1590841283 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f00080b2880 0x7f00080b4d40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:47.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.540+0000 7f0025442700 1 --2- 172.21.15.107:0/1590841283 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0020109510 0x7f0020199a00 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:47.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.540+0000 7f0025442700 1 --2- 172.21.15.107:0/1590841283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f002006b180 0x7f002019f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:47.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.540+0000 7f0025442700 1 --2- 172.21.15.107:0/1590841283 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f002006bb40 0x7f002019fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:47.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.540+0000 7f0025442700 1 -- 172.21.15.107:0/1590841283 >> 172.21.15.107:0/1590841283 conn(0x7f0020079350 msgr2=0x7f0020100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:47.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.541+0000 7f0025442700 1 -- 172.21.15.107:0/1590841283 shutdown_connections 2024-05-10T10:57:47.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:47.541+0000 7f0025442700 1 -- 172.21.15.107:0/1590841283 wait complete. 2024-05-10T10:57:47.542 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 27 2024-05-10T10:57:47.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:47 smithi196 ceph-mon[34872]: pgmap v451: 97 pgs: 97 active+clean; 687 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-10T10:57:47.594 INFO:tasks.workunit.client.0.smithi107.stderr:+ mkdir untar_tar 2024-05-10T10:57:47.596 INFO:tasks.workunit.client.0.smithi107.stderr:+ cd untar_tar 2024-05-10T10:57:47.596 INFO:tasks.workunit.client.0.smithi107.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-05-10T10:57:47.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:47 smithi184 ceph-mon[34585]: pgmap v451: 97 pgs: 97 active+clean; 687 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2024-05-10T10:57:47.690 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ 2024-05-10T10:57:47.695 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/00-INDEX 2024-05-10T10:57:47.695 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/ 2024-05-10T10:57:47.695 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/README 2024-05-10T10:57:47.695 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-05-10T10:57:47.695 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-05-10T10:57:47.696 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-05-10T10:57:47.697 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-05-10T10:57:47.699 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-05-10T10:57:47.701 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-05-10T10:57:47.702 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-05-10T10:57:47.703 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-05-10T10:57:47.704 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-05-10T10:57:47.704 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-05-10T10:57:47.706 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-05-10T10:57:47.707 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-05-10T10:57:47.708 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-05-10T10:57:47.709 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-05-10T10:57:47.710 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-05-10T10:57:47.710 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-05-10T10:57:47.711 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-05-10T10:57:47.713 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-05-10T10:57:47.714 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-05-10T10:57:47.715 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-05-10T10:57:47.716 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-05-10T10:57:47.717 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-05-10T10:57:47.718 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-05-10T10:57:47.719 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-05-10T10:57:47.720 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-05-10T10:57:47.721 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-05-10T10:57:47.722 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-05-10T10:57:47.723 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-05-10T10:57:47.724 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-05-10T10:57:47.725 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-05-10T10:57:47.726 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-05-10T10:57:47.727 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-05-10T10:57:47.728 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-05-10T10:57:47.729 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-05-10T10:57:47.730 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-05-10T10:57:47.731 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-05-10T10:57:47.732 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-05-10T10:57:47.733 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-05-10T10:57:47.734 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-05-10T10:57:47.735 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-05-10T10:57:47.735 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-05-10T10:57:47.736 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-05-10T10:57:47.737 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-05-10T10:57:47.738 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-05-10T10:57:47.739 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-05-10T10:57:47.740 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-05-10T10:57:47.741 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-05-10T10:57:47.742 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-05-10T10:57:47.743 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-05-10T10:57:47.744 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-05-10T10:57:47.745 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-05-10T10:57:47.746 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-05-10T10:57:47.747 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-05-10T10:57:47.747 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-05-10T10:57:47.748 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-05-10T10:57:47.749 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-05-10T10:57:47.750 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-05-10T10:57:47.751 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-05-10T10:57:47.752 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-05-10T10:57:47.753 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-05-10T10:57:47.754 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-05-10T10:57:47.755 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-05-10T10:57:47.756 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-05-10T10:57:47.757 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-05-10T10:57:47.758 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-05-10T10:57:47.759 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-05-10T10:57:47.760 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-05-10T10:57:47.761 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-05-10T10:57:47.762 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-05-10T10:57:47.762 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-05-10T10:57:47.764 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-05-10T10:57:47.765 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-05-10T10:57:47.766 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-05-10T10:57:47.766 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-05-10T10:57:47.767 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-05-10T10:57:47.768 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-05-10T10:57:47.770 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-05-10T10:57:47.771 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-05-10T10:57:47.772 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-05-10T10:57:47.773 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-05-10T10:57:47.774 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-05-10T10:57:47.775 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-05-10T10:57:47.775 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-05-10T10:57:47.776 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-05-10T10:57:47.777 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-05-10T10:57:47.778 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-05-10T10:57:47.779 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-05-10T10:57:47.780 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-05-10T10:57:47.781 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-05-10T10:57:47.782 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-05-10T10:57:47.783 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-05-10T10:57:47.784 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-05-10T10:57:47.785 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-05-10T10:57:47.786 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-05-10T10:57:47.787 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-05-10T10:57:47.788 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-05-10T10:57:47.789 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-05-10T10:57:47.790 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-05-10T10:57:47.791 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-05-10T10:57:47.792 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-05-10T10:57:47.793 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-05-10T10:57:47.794 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-05-10T10:57:47.795 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-05-10T10:57:47.796 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-05-10T10:57:47.797 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-05-10T10:57:47.798 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-05-10T10:57:47.799 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-05-10T10:57:47.799 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-05-10T10:57:47.800 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-05-10T10:57:47.801 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-05-10T10:57:47.803 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-05-10T10:57:47.804 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-05-10T10:57:47.805 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-05-10T10:57:47.806 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-05-10T10:57:47.806 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-05-10T10:57:47.808 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-05-10T10:57:47.809 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-05-10T10:57:47.810 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-05-10T10:57:47.810 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-05-10T10:57:47.811 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-05-10T10:57:47.812 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-05-10T10:57:47.813 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-05-10T10:57:47.814 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-05-10T10:57:47.815 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-05-10T10:57:47.816 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-05-10T10:57:47.817 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-05-10T10:57:47.818 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-05-10T10:57:47.818 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-05-10T10:57:47.819 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-05-10T10:57:47.820 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-05-10T10:57:47.821 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-05-10T10:57:47.823 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-05-10T10:57:47.824 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-05-10T10:57:47.824 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-05-10T10:57:47.825 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-05-10T10:57:47.826 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-05-10T10:57:47.827 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-05-10T10:57:47.828 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-05-10T10:57:47.829 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-05-10T10:57:47.830 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-05-10T10:57:47.831 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-05-10T10:57:47.832 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-05-10T10:57:47.832 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-05-10T10:57:47.833 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-05-10T10:57:47.835 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-05-10T10:57:47.835 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-05-10T10:57:47.837 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-05-10T10:57:47.838 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-05-10T10:57:47.839 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-05-10T10:57:47.840 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-05-10T10:57:47.841 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-05-10T10:57:47.842 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-05-10T10:57:47.843 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-05-10T10:57:47.844 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-05-10T10:57:47.845 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-05-10T10:57:47.846 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-05-10T10:57:47.847 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-05-10T10:57:47.847 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-05-10T10:57:47.849 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-05-10T10:57:47.850 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-05-10T10:57:47.851 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-05-10T10:57:47.852 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-05-10T10:57:47.853 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-05-10T10:57:47.854 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-05-10T10:57:47.855 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-05-10T10:57:47.856 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-05-10T10:57:47.857 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-05-10T10:57:47.857 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-05-10T10:57:47.858 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-05-10T10:57:47.859 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-05-10T10:57:47.860 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-05-10T10:57:47.861 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-05-10T10:57:47.862 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-05-10T10:57:47.863 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-05-10T10:57:47.864 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-05-10T10:57:47.864 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-05-10T10:57:47.866 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-05-10T10:57:47.867 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-05-10T10:57:47.868 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-05-10T10:57:47.868 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-05-10T10:57:47.869 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-05-10T10:57:47.871 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-05-10T10:57:47.872 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-05-10T10:57:47.873 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-05-10T10:57:47.874 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-05-10T10:57:47.875 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-05-10T10:57:47.876 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-05-10T10:57:47.877 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-05-10T10:57:47.878 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-05-10T10:57:47.879 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-05-10T10:57:47.880 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-05-10T10:57:47.881 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-05-10T10:57:47.882 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-05-10T10:57:47.882 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-05-10T10:57:47.883 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-05-10T10:57:48.370 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24482 quiesce db / --timeout 60 --expiration 86.65 --await-for 42.0' 2024-05-10T10:57:48.370 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24482 quiesce db / --timeout 60 --expiration 86.65 --await-for 42.0 2024-05-10T10:57:48.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:48 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1590841283' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:57:48.622 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:57:48.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:48 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1590841283' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:57:48.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:48 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1590841283' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:57:49.560 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:49 smithi107 ceph-mon[30373]: pgmap v452: 97 pgs: 97 active+clean; 687 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:57:49.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:49 smithi196 ceph-mon[34872]: pgmap v452: 97 pgs: 97 active+clean; 687 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:57:49.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:49 smithi184 ceph-mon[34585]: pgmap v452: 97 pgs: 97 active+clean; 687 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-10T10:57:50.240 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-05-10T10:57:50.242 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-05-10T10:57:50.243 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-05-10T10:57:50.244 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-05-10T10:57:50.244 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-05-10T10:57:50.245 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-05-10T10:57:50.246 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-05-10T10:57:50.247 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-05-10T10:57:50.248 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-05-10T10:57:50.249 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-05-10T10:57:50.250 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-05-10T10:57:50.251 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-05-10T10:57:50.252 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-05-10T10:57:50.253 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-05-10T10:57:50.254 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-05-10T10:57:50.255 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-05-10T10:57:50.256 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-05-10T10:57:50.257 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-05-10T10:57:50.258 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-05-10T10:57:50.259 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-05-10T10:57:50.260 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-05-10T10:57:50.261 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-05-10T10:57:50.261 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-05-10T10:57:50.262 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-05-10T10:57:50.263 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-05-10T10:57:50.264 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-05-10T10:57:50.265 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-05-10T10:57:50.266 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-05-10T10:57:50.267 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-05-10T10:57:50.268 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-05-10T10:57:50.269 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-05-10T10:57:50.270 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-05-10T10:57:50.272 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-05-10T10:57:50.272 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-05-10T10:57:50.273 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-05-10T10:57:50.274 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-05-10T10:57:50.275 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-05-10T10:57:50.276 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-05-10T10:57:50.277 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-05-10T10:57:50.278 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-05-10T10:57:50.279 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-05-10T10:57:50.280 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-05-10T10:57:50.281 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-05-10T10:57:50.282 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-05-10T10:57:50.283 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-05-10T10:57:50.284 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-05-10T10:57:50.285 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-05-10T10:57:50.286 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-05-10T10:57:50.287 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-05-10T10:57:50.288 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-05-10T10:57:50.289 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-05-10T10:57:50.290 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-05-10T10:57:50.291 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-05-10T10:57:50.292 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-05-10T10:57:50.293 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-05-10T10:57:50.294 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-05-10T10:57:50.295 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-05-10T10:57:50.296 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-05-10T10:57:50.297 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-05-10T10:57:50.298 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-05-10T10:57:50.299 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-05-10T10:57:50.300 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-05-10T10:57:50.301 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-05-10T10:57:50.301 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/Changes 2024-05-10T10:57:50.303 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-05-10T10:57:50.303 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/CodingStyle 2024-05-10T10:57:50.305 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-05-10T10:57:50.306 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-05-10T10:57:50.307 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-05-10T10:57:50.308 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-05-10T10:57:50.309 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/ 2024-05-10T10:57:50.310 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-05-10T10:57:50.311 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-05-10T10:57:50.311 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-05-10T10:57:50.312 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-05-10T10:57:50.313 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-05-10T10:57:50.314 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-05-10T10:57:50.315 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-05-10T10:57:50.316 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-05-10T10:57:50.317 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-05-10T10:57:50.319 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-05-10T10:57:50.320 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-05-10T10:57:50.320 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-05-10T10:57:50.321 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-05-10T10:57:50.322 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-05-10T10:57:50.323 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-05-10T10:57:50.325 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-05-10T10:57:50.326 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-05-10T10:57:50.327 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-05-10T10:57:50.327 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-05-10T10:57:50.328 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-05-10T10:57:50.329 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-05-10T10:57:50.330 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-05-10T10:57:50.331 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-05-10T10:57:50.332 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-05-10T10:57:50.333 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-05-10T10:57:50.333 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-05-10T10:57:50.334 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-05-10T10:57:50.335 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-05-10T10:57:50.336 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-05-10T10:57:50.337 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-05-10T10:57:50.338 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-05-10T10:57:50.339 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-05-10T10:57:50.340 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-05-10T10:57:50.341 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-05-10T10:57:50.342 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-05-10T10:57:50.343 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-05-10T10:57:50.344 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-05-10T10:57:50.345 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-05-10T10:57:50.346 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-05-10T10:57:50.347 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-05-10T10:57:50.349 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-05-10T10:57:50.351 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-05-10T10:57:50.351 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-05-10T10:57:50.352 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-05-10T10:57:50.353 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-05-10T10:57:50.354 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-05-10T10:57:50.355 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-05-10T10:57:50.356 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-05-10T10:57:50.357 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-05-10T10:57:50.358 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-05-10T10:57:50.358 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-05-10T10:57:50.360 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-05-10T10:57:50.363 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-05-10T10:57:50.364 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-05-10T10:57:50.364 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-05-10T10:57:50.365 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-05-10T10:57:50.366 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-05-10T10:57:50.367 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-05-10T10:57:50.368 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-05-10T10:57:50.369 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-05-10T10:57:50.370 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-05-10T10:57:50.371 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-05-10T10:57:50.372 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-05-10T10:57:50.372 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-05-10T10:57:50.373 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-05-10T10:57:50.374 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-05-10T10:57:50.375 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-05-10T10:57:50.376 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-05-10T10:57:50.377 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-05-10T10:57:50.378 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-05-10T10:57:50.379 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-05-10T10:57:50.380 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-05-10T10:57:50.381 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-05-10T10:57:50.382 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-05-10T10:57:50.382 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-05-10T10:57:50.383 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-05-10T10:57:50.384 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-05-10T10:57:50.385 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-05-10T10:57:50.386 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-05-10T10:57:50.387 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-05-10T10:57:50.388 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-05-10T10:57:50.389 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-05-10T10:57:50.390 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-05-10T10:57:50.390 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-05-10T10:57:50.391 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-05-10T10:57:50.392 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-05-10T10:57:50.393 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-05-10T10:57:50.394 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-05-10T10:57:50.395 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-05-10T10:57:50.396 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-05-10T10:57:50.397 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-05-10T10:57:50.398 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-05-10T10:57:50.399 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-05-10T10:57:50.400 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-05-10T10:57:50.401 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-05-10T10:57:50.401 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-05-10T10:57:50.402 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-05-10T10:57:50.403 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-05-10T10:57:50.404 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-05-10T10:57:50.405 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-05-10T10:57:50.406 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-05-10T10:57:50.407 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-05-10T10:57:50.408 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-05-10T10:57:50.409 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-05-10T10:57:50.409 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-05-10T10:57:50.410 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-05-10T10:57:50.411 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-05-10T10:57:50.412 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-05-10T10:57:50.413 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-05-10T10:57:50.414 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-05-10T10:57:50.415 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-05-10T10:57:50.416 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-05-10T10:57:50.417 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-05-10T10:57:50.418 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-05-10T10:57:50.419 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-05-10T10:57:50.420 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-05-10T10:57:50.422 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-05-10T10:57:50.423 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-05-10T10:57:50.424 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-05-10T10:57:50.425 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-05-10T10:57:50.425 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-05-10T10:57:50.426 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-05-10T10:57:50.427 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-05-10T10:57:50.428 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-05-10T10:57:50.429 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-05-10T10:57:50.430 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-05-10T10:57:50.431 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-05-10T10:57:50.431 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-05-10T10:57:50.432 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-05-10T10:57:50.433 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-05-10T10:57:50.434 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-05-10T10:57:50.435 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-05-10T10:57:50.436 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-05-10T10:57:50.437 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-05-10T10:57:50.438 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-05-10T10:57:50.440 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-05-10T10:57:50.441 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-05-10T10:57:50.442 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-05-10T10:57:50.443 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-05-10T10:57:50.444 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-05-10T10:57:50.445 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-05-10T10:57:50.446 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-05-10T10:57:50.446 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-05-10T10:57:50.447 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-05-10T10:57:50.448 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-05-10T10:57:50.449 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-05-10T10:57:50.450 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-05-10T10:57:50.451 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-05-10T10:57:50.452 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-05-10T10:57:50.453 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-05-10T10:57:50.454 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-05-10T10:57:50.455 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-05-10T10:57:50.456 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-05-10T10:57:50.457 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-05-10T10:57:50.458 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-05-10T10:57:50.459 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-05-10T10:57:50.459 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-05-10T10:57:50.460 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-05-10T10:57:50.461 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-05-10T10:57:50.463 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-05-10T10:57:50.463 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-05-10T10:57:50.464 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-05-10T10:57:50.465 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-05-10T10:57:50.466 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-05-10T10:57:50.468 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-05-10T10:57:50.469 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-05-10T10:57:50.470 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-05-10T10:57:50.470 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-05-10T10:57:50.471 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-05-10T10:57:50.472 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-05-10T10:57:50.473 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-05-10T10:57:50.474 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-05-10T10:57:50.475 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-05-10T10:57:50.476 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-05-10T10:57:50.477 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-05-10T10:57:50.478 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-05-10T10:57:50.479 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-05-10T10:57:50.480 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-05-10T10:57:50.481 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-05-10T10:57:50.481 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-05-10T10:57:50.482 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-05-10T10:57:50.483 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-05-10T10:57:50.484 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-05-10T10:57:50.485 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-05-10T10:57:50.486 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-05-10T10:57:50.487 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-05-10T10:57:50.488 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-05-10T10:57:50.488 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-05-10T10:57:50.489 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-05-10T10:57:50.490 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-05-10T10:57:50.491 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-05-10T10:57:50.492 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-05-10T10:57:50.493 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-05-10T10:57:50.493 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-05-10T10:57:50.494 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-05-10T10:57:50.495 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-05-10T10:57:50.496 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-05-10T10:57:50.497 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-05-10T10:57:51.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:51 smithi107 ceph-mon[30373]: pgmap v453: 97 pgs: 97 active+clean; 687 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-05-10T10:57:51.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:51 smithi196 ceph-mon[34872]: pgmap v453: 97 pgs: 97 active+clean; 687 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-05-10T10:57:51.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:51 smithi184 ceph-mon[34585]: pgmap v453: 97 pgs: 97 active+clean; 687 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-05-10T10:57:51.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.979+0000 7f1d56dc0700 1 -- 172.21.15.107:0/2061099785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d501087a0 msgr2=0x7f1d501103b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:51.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.979+0000 7f1d56dc0700 1 --2- 172.21.15.107:0/2061099785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d501087a0 0x7f1d501103b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800b0d0 tx=0x7f1d4800b3e0 comp rx=0 tx=0).stop 2024-05-10T10:57:51.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.979+0000 7f1d56dc0700 1 -- 172.21.15.107:0/2061099785 shutdown_connections 2024-05-10T10:57:51.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.979+0000 7f1d56dc0700 1 --2- 172.21.15.107:0/2061099785 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d501037b0 0x7f1d50103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:51.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.979+0000 7f1d56dc0700 1 --2- 172.21.15.107:0/2061099785 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d501087a0 0x7f1d501103b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:51.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.979+0000 7f1d56dc0700 1 --2- 172.21.15.107:0/2061099785 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d50104160 0x7f1d501080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:51.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.979+0000 7f1d56dc0700 1 -- 172.21.15.107:0/2061099785 >> 172.21.15.107:0/2061099785 conn(0x7f1d5007a570 msgr2=0x7f1d5007a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:51.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.979+0000 7f1d56dc0700 1 -- 172.21.15.107:0/2061099785 shutdown_connections 2024-05-10T10:57:51.980 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.979+0000 7f1d56dc0700 1 -- 172.21.15.107:0/2061099785 wait complete. 2024-05-10T10:57:51.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.980+0000 7f1d56dc0700 1 Processor -- start 2024-05-10T10:57:51.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.980+0000 7f1d56dc0700 1 -- start start 2024-05-10T10:57:51.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.980+0000 7f1d56dc0700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d501037b0 0x7f1d500757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:51.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.980+0000 7f1d56dc0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d50104160 0x7f1d50075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:51.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.980+0000 7f1d56dc0700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d501087a0 0x7f1d50076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:51.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.980+0000 7f1d56dc0700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1d50113830 con 0x7f1d501087a0 2024-05-10T10:57:51.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.980+0000 7f1d56dc0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501136b0 con 0x7f1d50104160 2024-05-10T10:57:51.986 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.980+0000 7f1d56dc0700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501139b0 con 0x7f1d501037b0 2024-05-10T10:57:51.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.980+0000 7f1d5535d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d501087a0 0x7f1d50076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:51.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.980+0000 7f1d5535d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d501087a0 0x7f1d50076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39658/0 (socket says 172.21.15.107:39658) 2024-05-10T10:57:51.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.980+0000 7f1d5535d700 1 -- 172.21.15.107:0/1309595817 learned_addr learned my addr 172.21.15.107:0/1309595817 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:51.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.981+0000 7f1d54b5c700 1 --2- 172.21.15.107:0/1309595817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d501037b0 0x7f1d500757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:51.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.981+0000 7f1d4ffff700 1 --2- 172.21.15.107:0/1309595817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d50104160 0x7f1d50075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:51.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.981+0000 7f1d5535d700 1 -- 172.21.15.107:0/1309595817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d501037b0 msgr2=0x7f1d500757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:51.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.981+0000 7f1d5535d700 1 --2- 172.21.15.107:0/1309595817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d501037b0 0x7f1d500757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:51.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.981+0000 7f1d5535d700 1 -- 172.21.15.107:0/1309595817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d50104160 msgr2=0x7f1d50075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:51.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.981+0000 7f1d5535d700 1 --2- 172.21.15.107:0/1309595817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d50104160 0x7f1d50075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:51.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.981+0000 7f1d5535d700 1 -- 172.21.15.107:0/1309595817 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d501a8120 con 0x7f1d501087a0 2024-05-10T10:57:51.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.981+0000 7f1d4ffff700 1 --2- 172.21.15.107:0/1309595817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d50104160 0x7f1d50075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:51.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.981+0000 7f1d5535d700 1 --2- 172.21.15.107:0/1309595817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d501087a0 0x7f1d50076220 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1d48007a20 tx=0x7f1d48007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:51.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.981+0000 7f1d4dffb700 1 -- 172.21.15.107:0/1309595817 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4801f070 con 0x7f1d501087a0 2024-05-10T10:57:51.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.981+0000 7f1d4dffb700 1 -- 172.21.15.107:0/1309595817 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1d48004c50 con 0x7f1d501087a0 2024-05-10T10:57:51.987 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.981+0000 7f1d56dc0700 1 -- 172.21.15.107:0/1309595817 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d501a83b0 con 0x7f1d501087a0 2024-05-10T10:57:51.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.981+0000 7f1d4dffb700 1 -- 172.21.15.107:0/1309595817 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4801b6a0 con 0x7f1d501087a0 2024-05-10T10:57:51.988 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.981+0000 7f1d56dc0700 1 -- 172.21.15.107:0/1309595817 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d501a88b0 con 0x7f1d501087a0 2024-05-10T10:57:51.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.984+0000 7f1d4dffb700 1 -- 172.21.15.107:0/1309595817 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f1d48022070 con 0x7f1d501087a0 2024-05-10T10:57:51.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.984+0000 7f1d4dffb700 1 --2- 172.21.15.107:0/1309595817 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1d400b29b0 0x7f1d400b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:51.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.984+0000 7f1d54b5c700 1 --2- 172.21.15.107:0/1309595817 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1d400b29b0 0x7f1d400b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:51.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.984+0000 7f1d4dffb700 1 -- 172.21.15.107:0/1309595817 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f1d4800f020 con 0x7f1d501087a0 2024-05-10T10:57:51.993 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.985+0000 7f1d54b5c700 1 --2- 172.21.15.107:0/1309595817 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1d400b29b0 0x7f1d400b4e70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1d44006fd0 tx=0x7f1d44008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:51.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.985+0000 7f1d61653b80 1 Processor -- start 2024-05-10T10:57:51.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.985+0000 7f1d61653b80 1 -- start start 2024-05-10T10:57:51.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.985+0000 7f1d61653b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ffe850 0x561ce9ffec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:51.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.985+0000 7f1d61653b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ff8b00 0x561ce9ff8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:51.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.985+0000 7f1d61653b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 0x561cea005610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:51.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.985+0000 7f1d61653b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561ce9f4aad0 con 0x561ce9ff94c0 2024-05-10T10:57:51.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.985+0000 7f1d61653b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561ce9eaff30 con 0x561ce9ff8b00 2024-05-10T10:57:51.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.985+0000 7f1d61653b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x561ce9f46a90 con 0x561ce9ffe850 2024-05-10T10:57:51.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.985+0000 7f1d5535d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 0x561cea005610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:51.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.985+0000 7f1d5535d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 0x561cea005610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39662/0 (socket says 172.21.15.107:39662) 2024-05-10T10:57:51.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.985+0000 7f1d5535d700 1 -- 172.21.15.107:0/1686435814 learned_addr learned my addr 172.21.15.107:0/1686435814 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:51.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.985+0000 7f1d4ffff700 1 --2- 172.21.15.107:0/1686435814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ff8b00 0x561ce9ff8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:51.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.986+0000 7f1d54b5c700 1 --2- 172.21.15.107:0/1686435814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ffe850 0x561ce9ffec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:51.994 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.986+0000 7f1d5535d700 1 -- 172.21.15.107:0/1686435814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ffe850 msgr2=0x561ce9ffec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:51.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.986+0000 7f1d5535d700 1 --2- 172.21.15.107:0/1686435814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ffe850 0x561ce9ffec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:51.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.986+0000 7f1d5535d700 1 -- 172.21.15.107:0/1686435814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ff8b00 msgr2=0x561ce9ff8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:51.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.986+0000 7f1d5535d700 1 --2- 172.21.15.107:0/1686435814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ff8b00 0x561ce9ff8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:51.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.986+0000 7f1d5535d700 1 -- 172.21.15.107:0/1686435814 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ce9e97a60 con 0x561ce9ff94c0 2024-05-10T10:57:51.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.986+0000 7f1d54b5c700 1 --2- 172.21.15.107:0/1686435814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ffe850 0x561ce9ffec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:51.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.986+0000 7f1d5535d700 1 --2- 172.21.15.107:0/1686435814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 0x561cea005610 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1d480a6bb0 tx=0x7f1d4800b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc5e9a801c734d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:51.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.986+0000 7f1d3affd700 1 -- 172.21.15.107:0/1686435814 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d480abe60 con 0x561ce9ff94c0 2024-05-10T10:57:51.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.986+0000 7f1d3affd700 1 -- 172.21.15.107:0/1686435814 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1d480b3250 con 0x561ce9ff94c0 2024-05-10T10:57:51.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.986+0000 7f1d3affd700 1 -- 172.21.15.107:0/1686435814 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d480055b0 con 0x561ce9ff94c0 2024-05-10T10:57:51.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.987+0000 7f1d61653b80 1 -- 172.21.15.107:0/1686435814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 msgr2=0x561cea005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:51.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.987+0000 7f1d61653b80 1 --2- 172.21.15.107:0/1686435814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 0x561cea005610 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1d480a6bb0 tx=0x7f1d4800b3e0 comp rx=0 tx=0).stop 2024-05-10T10:57:51.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.987+0000 7f1d61653b80 1 -- 172.21.15.107:0/1686435814 shutdown_connections 2024-05-10T10:57:51.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.987+0000 7f1d61653b80 1 --2- 172.21.15.107:0/1686435814 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ffe850 0x561ce9ffec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:51.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.987+0000 7f1d61653b80 1 --2- 172.21.15.107:0/1686435814 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 0x561cea005610 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:51.995 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.987+0000 7f1d61653b80 1 --2- 172.21.15.107:0/1686435814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ff8b00 0x561ce9ff8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:51.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.987+0000 7f1d61653b80 1 -- 172.21.15.107:0/1686435814 >> 172.21.15.107:0/1686435814 conn(0x561ce9f24d00 msgr2=0x561ce9ff3880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:51.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.987+0000 7f1d61653b80 1 -- 172.21.15.107:0/1686435814 shutdown_connections 2024-05-10T10:57:51.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.987+0000 7f1d61653b80 1 -- 172.21.15.107:0/1686435814 wait complete. 2024-05-10T10:57:51.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.987+0000 7f1d61653b80 1 -- start start 2024-05-10T10:57:51.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.987+0000 7f1d61653b80 1 Processor -- start 2024-05-10T10:57:51.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d61653b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ff8b00 0x561cea0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:51.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d61653b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 0x561cea0025b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:51.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d61653b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ffe850 0x561cea002af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:51.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d61653b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x561ce9fff270 con 0x561ce9ff94c0 2024-05-10T10:57:51.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d61653b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561ce9f04060 con 0x561ce9ffe850 2024-05-10T10:57:51.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d61653b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x561cea005b50 con 0x561ce9ff8b00 2024-05-10T10:57:51.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d61653b80 10 client.0 _ll_register_callbacks cb 0x561ce9ede740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:57:51.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d4ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 0x561cea0025b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:51.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d4ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 0x561cea0025b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39672/0 (socket says 172.21.15.107:39672) 2024-05-10T10:57:51.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d4ffff700 1 -- 172.21.15.107:0/91611463 learned_addr learned my addr 172.21.15.107:0/91611463 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:51.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d54b5c700 1 --2- 172.21.15.107:0/91611463 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ff8b00 0x561cea0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:51.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d5535d700 1 --2- 172.21.15.107:0/91611463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ffe850 0x561cea002af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:51.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d4ffff700 1 -- 172.21.15.107:0/91611463 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ff8b00 msgr2=0x561cea0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:51.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d4ffff700 1 --2- 172.21.15.107:0/91611463 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ff8b00 0x561cea0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:51.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d4ffff700 1 -- 172.21.15.107:0/91611463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ffe850 msgr2=0x561cea002af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:51.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d4ffff700 1 --2- 172.21.15.107:0/91611463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ffe850 0x561cea002af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:51.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d4ffff700 1 -- 172.21.15.107:0/91611463 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ce9f018f0 con 0x561ce9ff94c0 2024-05-10T10:57:51.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d4ffff700 1 --2- 172.21.15.107:0/91611463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 0x561cea0025b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0106a0 tx=0x7f1d3c0109b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a801ac1d6c36fa server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:51.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d2ffff700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:57:51.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d2ffff700 1 -- 172.21.15.107:0/91611463 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c016070 con 0x561ce9ff94c0 2024-05-10T10:57:51.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d2ffff700 1 -- 172.21.15.107:0/91611463 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f1d3c004220 con 0x561ce9ff94c0 2024-05-10T10:57:51.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.988+0000 7f1d61653b80 1 -- 172.21.15.107:0/91611463 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d480b3250 con 0x561ce9ff94c0 2024-05-10T10:57:51.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.989+0000 7f1d2ffff700 1 -- 172.21.15.107:0/91611463 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1d3c004420 con 0x561ce9ff94c0 2024-05-10T10:57:51.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.989+0000 7f1d61653b80 10 client.15633 fetch_fsmap learned FSMap version 27 2024-05-10T10:57:51.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.989+0000 7f1d61653b80 1 -- 172.21.15.107:0/91611463 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561cea00fff0 con 0x561ce9ff94c0 2024-05-10T10:57:51.998 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.989+0000 7f1d2ffff700 1 -- 172.21.15.107:0/91611463 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1d480b3250 con 0x561ce9ff94c0 2024-05-10T10:57:51.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.989+0000 7f1d2ffff700 1 -- 172.21.15.107:0/91611463 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1d3c00f040 con 0x561ce9ff94c0 2024-05-10T10:57:51.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.989+0000 7f1d61653b80 10 client.15633 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:57:51.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.989+0000 7f1d61653b80 10 client.15633 resolve_mds: validated gid 24482 aka daemon mds.b 2024-05-10T10:57:51.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.989+0000 7f1d61653b80 20 client.15633 populate_metadata read hostname 'smithi107' 2024-05-10T10:57:51.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.989+0000 7f1d61653b80 1 --2- 172.21.15.107:0/91611463 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561cea012680 0x561cea014aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:51.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.989+0000 7f1d61653b80 4 client.15633 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:57:51.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.989+0000 7f1d61653b80 1 -- 172.21.15.107:0/91611463 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ce9f584b0 con 0x561cea012680 2024-05-10T10:57:51.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.989+0000 7f1d54b5c700 1 --2- 172.21.15.107:0/91611463 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561cea012680 0x561cea014aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:51.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.990+0000 7f1d2ffff700 10 client.15633 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:51.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.990+0000 7f1d54b5c700 1 --2- 172.21.15.107:0/91611463 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561cea012680 0x561cea014aa0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54982bfed2819215 server_cookie=543a8e024f99b138 in_seq=0 out_seq=0 2024-05-10T10:57:51.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.990+0000 7f1d2ffff700 1 -- 172.21.15.107:0/91611463 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561ce9f584b0 con 0x561cea012680 2024-05-10T10:57:51.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.990+0000 7f1d2ffff700 10 client.15633 handle_command_reply: tid=0 2024-05-10T10:57:51.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.991+0000 7f1d61653b80 1 client.15633 shutdown 2024-05-10T10:57:51.999 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.991+0000 7f1d61653b80 1 -- 172.21.15.107:0/91611463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 msgr2=0x561cea0025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:52.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.991+0000 7f1d61653b80 1 --2- 172.21.15.107:0/91611463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 0x561cea0025b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0106a0 tx=0x7f1d3c0109b0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.991+0000 7f1d61653b80 1 -- 172.21.15.107:0/91611463 shutdown_connections 2024-05-10T10:57:52.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.991+0000 7f1d61653b80 1 --2- 172.21.15.107:0/91611463 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ff8b00 0x561cea0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.991+0000 7f1d61653b80 1 --2- 172.21.15.107:0/91611463 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561cea012680 0x561cea014aa0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.991+0000 7f1d61653b80 1 --2- 172.21.15.107:0/91611463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ffe850 0x561cea002af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.991+0000 7f1d61653b80 1 --2- 172.21.15.107:0/91611463 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 0x561cea0025b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.991+0000 7f1d2ffff700 0 client.15633 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:52.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.991+0000 7f1d61653b80 1 -- 172.21.15.107:0/91611463 >> 172.21.15.107:0/91611463 conn(0x561ce9f24d00 msgr2=0x561ce9ffdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:52.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.991+0000 7f1d61653b80 1 -- 172.21.15.107:0/91611463 shutdown_connections 2024-05-10T10:57:52.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.991+0000 7f1d61653b80 1 -- 172.21.15.107:0/91611463 wait complete. 2024-05-10T10:57:52.000 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:51.991+0000 7f1d61653b80 20 client.15633 trim_cache size 0 max 16384 2024-05-10T10:57:52.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.010+0000 7f1d61653b80 1 Processor -- start 2024-05-10T10:57:52.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.010+0000 7f1d61653b80 1 -- start start 2024-05-10T10:57:52.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.011+0000 7f1d61653b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ff8b00 0x561cea00e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:52.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.011+0000 7f1d61653b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 0x561cea001570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:52.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.011+0000 7f1d61653b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ffe850 0x561ce9ff8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:52.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.011+0000 7f1d61653b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501afbf0 con 0x561ce9ff94c0 2024-05-10T10:57:52.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.011+0000 7f1d61653b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501b1730 con 0x561ce9ff8b00 2024-05-10T10:57:52.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.011+0000 7f1d61653b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501b02c0 con 0x561ce9ffe850 2024-05-10T10:57:52.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.011+0000 7f1d4ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 0x561cea001570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:52.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.011+0000 7f1d4ffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 0x561cea001570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39688/0 (socket says 172.21.15.107:39688) 2024-05-10T10:57:52.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.011+0000 7f1d4ffff700 1 -- 172.21.15.107:0/941454373 learned_addr learned my addr 172.21.15.107:0/941454373 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:52.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.011+0000 7f1d54b5c700 1 --2- 172.21.15.107:0/941454373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ff8b00 0x561cea00e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:52.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.011+0000 7f1d4ffff700 1 -- 172.21.15.107:0/941454373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ffe850 msgr2=0x561ce9ff8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:52.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.011+0000 7f1d4ffff700 1 --2- 172.21.15.107:0/941454373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ffe850 0x561ce9ff8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.011+0000 7f1d4ffff700 1 -- 172.21.15.107:0/941454373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ff8b00 msgr2=0x561cea00e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:52.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.011+0000 7f1d4ffff700 1 --2- 172.21.15.107:0/941454373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ff8b00 0x561cea00e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.011+0000 7f1d4ffff700 1 -- 172.21.15.107:0/941454373 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ce9fee420 con 0x561ce9ff94c0 2024-05-10T10:57:52.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.011+0000 7f1d54b5c700 1 --2- 172.21.15.107:0/941454373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ff8b00 0x561cea00e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:52.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.011+0000 7f1d4ffff700 1 --2- 172.21.15.107:0/941454373 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 0x561cea001570 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c012cd0 tx=0x7f1d3c004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae5444cb83992e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:52.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.012+0000 7f1d3a7fc700 1 -- 172.21.15.107:0/941454373 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c016050 con 0x561ce9ff94c0 2024-05-10T10:57:52.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.012+0000 7f1d3a7fc700 1 -- 172.21.15.107:0/941454373 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1d3c012860 con 0x561ce9ff94c0 2024-05-10T10:57:52.014 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.012+0000 7f1d3a7fc700 1 -- 172.21.15.107:0/941454373 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c025750 con 0x561ce9ff94c0 2024-05-10T10:57:52.016 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.012+0000 7f1d61653b80 1 -- 172.21.15.107:0/941454373 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 msgr2=0x561cea001570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.012+0000 7f1d61653b80 1 --2- 172.21.15.107:0/941454373 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 0x561cea001570 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c012cd0 tx=0x7f1d3c004660 comp rx=0 tx=0).stop 2024-05-10T10:57:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.012+0000 7f1d61653b80 1 -- 172.21.15.107:0/941454373 shutdown_connections 2024-05-10T10:57:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.012+0000 7f1d61653b80 1 --2- 172.21.15.107:0/941454373 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ffe850 0x561ce9ff8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.012+0000 7f1d61653b80 1 --2- 172.21.15.107:0/941454373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ff8b00 0x561cea00e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.012+0000 7f1d61653b80 1 --2- 172.21.15.107:0/941454373 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ff94c0 0x561cea001570 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.012+0000 7f1d61653b80 1 -- 172.21.15.107:0/941454373 >> 172.21.15.107:0/941454373 conn(0x561ce9f24d00 msgr2=0x561cea0043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.012+0000 7f1d61653b80 1 -- 172.21.15.107:0/941454373 shutdown_connections 2024-05-10T10:57:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.012+0000 7f1d61653b80 1 -- 172.21.15.107:0/941454373 wait complete. 2024-05-10T10:57:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.013+0000 7f1d61653b80 1 -- start start 2024-05-10T10:57:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.013+0000 7f1d61653b80 1 Processor -- start 2024-05-10T10:57:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.013+0000 7f1d61653b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ff8b00 0x561cea00ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:52.017 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.013+0000 7f1d61653b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ff94c0 0x561cea00b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:52.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.013+0000 7f1d61653b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ffe850 0x561cea007c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:52.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.013+0000 7f1d61653b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501b1060 con 0x561ce9ffe850 2024-05-10T10:57:52.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.013+0000 7f1d61653b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501b0990 con 0x561ce9ff94c0 2024-05-10T10:57:52.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.013+0000 7f1d61653b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501adbd0 con 0x561ce9ff8b00 2024-05-10T10:57:52.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.013+0000 7f1d61653b80 10 client.0 _ll_register_callbacks cb 0x561ce9ede740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:57:52.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.013+0000 7f1d5535d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ffe850 0x561cea007c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:52.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.013+0000 7f1d5535d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ffe850 0x561cea007c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39704/0 (socket says 172.21.15.107:39704) 2024-05-10T10:57:52.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.013+0000 7f1d5535d700 1 -- 172.21.15.107:0/711627447 learned_addr learned my addr 172.21.15.107:0/711627447 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:52.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.014+0000 7f1d54b5c700 1 --2- 172.21.15.107:0/711627447 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ff8b00 0x561cea00ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:52.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.014+0000 7f1d4ffff700 1 --2- 172.21.15.107:0/711627447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ff94c0 0x561cea00b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:52.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.014+0000 7f1d5535d700 1 -- 172.21.15.107:0/711627447 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ff8b00 msgr2=0x561cea00ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:52.018 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.014+0000 7f1d5535d700 1 --2- 172.21.15.107:0/711627447 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ff8b00 0x561cea00ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.014+0000 7f1d5535d700 1 -- 172.21.15.107:0/711627447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ff94c0 msgr2=0x561cea00b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.014+0000 7f1d5535d700 1 --2- 172.21.15.107:0/711627447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ff94c0 0x561cea00b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.014+0000 7f1d5535d700 1 -- 172.21.15.107:0/711627447 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cea0084c0 con 0x561ce9ffe850 2024-05-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.014+0000 7f1d4ffff700 1 --2- 172.21.15.107:0/711627447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ff94c0 0x561cea00b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.014+0000 7f1d5535d700 1 --2- 172.21.15.107:0/711627447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ffe850 0x561cea007c80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x561ce9ff9aa0 tx=0x7f1d4800b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1351dd887a0acf9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.014+0000 7f1d2ffff700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.014+0000 7f1d2ffff700 1 -- 172.21.15.107:0/711627447 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d480cb070 con 0x561ce9ffe850 2024-05-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.014+0000 7f1d2ffff700 1 -- 172.21.15.107:0/711627447 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f1d480a7120 con 0x561ce9ffe850 2024-05-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.014+0000 7f1d61653b80 1 -- 172.21.15.107:0/711627447 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d3c012860 con 0x561ce9ffe850 2024-05-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.014+0000 7f1d2ffff700 1 -- 172.21.15.107:0/711627447 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1d480abe60 con 0x561ce9ffe850 2024-05-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.014+0000 7f1d61653b80 10 client.15639 fetch_fsmap learned FSMap version 27 2024-05-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.014+0000 7f1d61653b80 1 -- 172.21.15.107:0/711627447 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561cea07d950 con 0x561ce9ffe850 2024-05-10T10:57:52.019 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.014+0000 7f1d2ffff700 1 -- 172.21.15.107:0/711627447 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1d3c012860 con 0x561ce9ffe850 2024-05-10T10:57:52.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.015+0000 7f1d2ffff700 1 -- 172.21.15.107:0/711627447 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1d48088070 con 0x561ce9ffe850 2024-05-10T10:57:52.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.015+0000 7f1d61653b80 10 client.15639 fetch_fsmap finished waiting for FSMap version 27 2024-05-10T10:57:52.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.015+0000 7f1d61653b80 10 client.15639 resolve_mds: validated gid 24482 aka daemon mds.b 2024-05-10T10:57:52.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.015+0000 7f1d61653b80 20 client.15639 populate_metadata read hostname 'smithi107' 2024-05-10T10:57:52.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.015+0000 7f1d61653b80 1 --2- 172.21.15.107:0/711627447 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561cea07df30 0x561cea080350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:52.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.015+0000 7f1d61653b80 4 client.15639 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.65, "await_for": 42.0}] 2024-05-10T10:57:52.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.015+0000 7f1d61653b80 1 -- 172.21.15.107:0/711627447 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.65, "await_for": 42.0}) -- 0x561ce9f52550 con 0x561cea07df30 2024-05-10T10:57:52.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.015+0000 7f1d54b5c700 1 --2- 172.21.15.107:0/711627447 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561cea07df30 0x561cea080350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:52.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.015+0000 7f1d2ffff700 10 client.15639 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:52.020 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.015+0000 7f1d54b5c700 1 --2- 172.21.15.107:0/711627447 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561cea07df30 0x561cea080350 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2e70c1cd1feca06 server_cookie=b1e9afc382809cb2 in_seq=0 out_seq=0 2024-05-10T10:57:52.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.816+0000 7f1d2ffff700 1 -- 172.21.15.107:0/711627447 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x561ce9f52550 con 0x561cea07df30 2024-05-10T10:57:52.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.816+0000 7f1d2ffff700 10 client.15639 handle_command_reply: tid=0 2024-05-10T10:57:52.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.816+0000 7f1d61653b80 1 client.15639 shutdown 2024-05-10T10:57:52.817 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.816+0000 7f1d61653b80 1 -- 172.21.15.107:0/711627447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ffe850 msgr2=0x561cea007c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:52.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.816+0000 7f1d61653b80 1 --2- 172.21.15.107:0/711627447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ffe850 0x561cea007c80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x561ce9ff9aa0 tx=0x7f1d4800b850 comp rx=0 tx=0).stop 2024-05-10T10:57:52.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.816+0000 7f1d61653b80 1 -- 172.21.15.107:0/711627447 shutdown_connections 2024-05-10T10:57:52.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.816+0000 7f1d61653b80 1 --2- 172.21.15.107:0/711627447 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x561ce9ff8b00 0x561cea00ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.816+0000 7f1d61653b80 1 --2- 172.21.15.107:0/711627447 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x561cea07df30 0x561cea080350 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.816+0000 7f1d2ffff700 0 client.15639 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:52.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.816+0000 7f1d61653b80 1 --2- 172.21.15.107:0/711627447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x561ce9ffe850 0x561cea007c80 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.816+0000 7f1d61653b80 1 --2- 172.21.15.107:0/711627447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce9ff94c0 0x561cea00b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.816+0000 7f1d61653b80 1 -- 172.21.15.107:0/711627447 >> 172.21.15.107:0/711627447 conn(0x561ce9f24d00 msgr2=0x561cea003ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:52.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.817+0000 7f1d61653b80 1 -- 172.21.15.107:0/711627447 shutdown_connections 2024-05-10T10:57:52.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.817+0000 7f1d61653b80 1 -- 172.21.15.107:0/711627447 wait complete. 2024-05-10T10:57:52.818 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.817+0000 7f1d61653b80 20 client.15639 trim_cache size 0 max 16384 2024-05-10T10:57:52.819 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:57:52.819 INFO:teuthology.orchestra.run.smithi107.stdout: "epoch": 28, 2024-05-10T10:57:52.819 INFO:teuthology.orchestra.run.smithi107.stdout: "leader": 24482, 2024-05-10T10:57:52.819 INFO:teuthology.orchestra.run.smithi107.stdout: "set_version": 10, 2024-05-10T10:57:52.819 INFO:teuthology.orchestra.run.smithi107.stdout: "sets": { 2024-05-10T10:57:52.819 INFO:teuthology.orchestra.run.smithi107.stdout: "25edc73": { 2024-05-10T10:57:52.819 INFO:teuthology.orchestra.run.smithi107.stdout: "version": 10, 2024-05-10T10:57:52.819 INFO:teuthology.orchestra.run.smithi107.stdout: "age_ref": 0.0, 2024-05-10T10:57:52.819 INFO:teuthology.orchestra.run.smithi107.stdout: "state": { 2024-05-10T10:57:52.819 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "QUIESCED", 2024-05-10T10:57:52.819 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0 2024-05-10T10:57:52.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T10:57:52.820 INFO:teuthology.orchestra.run.smithi107.stdout: "timeout": 60.0, 2024-05-10T10:57:52.820 INFO:teuthology.orchestra.run.smithi107.stdout: "expiration": 86.7, 2024-05-10T10:57:52.820 INFO:teuthology.orchestra.run.smithi107.stdout: "members": { 2024-05-10T10:57:52.820 INFO:teuthology.orchestra.run.smithi107.stdout: "file:/": { 2024-05-10T10:57:52.820 INFO:teuthology.orchestra.run.smithi107.stdout: "excluded": false, 2024-05-10T10:57:52.820 INFO:teuthology.orchestra.run.smithi107.stdout: "state": { 2024-05-10T10:57:52.820 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "QUIESCED", 2024-05-10T10:57:52.820 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0 2024-05-10T10:57:52.820 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:57:52.820 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:57:52.820 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:57:52.820 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:57:52.820 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:57:52.820 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:57:52.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.817+0000 7f1d56dc0700 1 -- 172.21.15.107:0/1309595817 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1d400b29b0 msgr2=0x7f1d400b4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:52.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.817+0000 7f1d56dc0700 1 --2- 172.21.15.107:0/1309595817 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1d400b29b0 0x7f1d400b4e70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1d44006fd0 tx=0x7f1d44008040 comp rx=0 tx=0).stop 2024-05-10T10:57:52.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.817+0000 7f1d56dc0700 1 -- 172.21.15.107:0/1309595817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d501087a0 msgr2=0x7f1d50076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:52.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.817+0000 7f1d56dc0700 1 --2- 172.21.15.107:0/1309595817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d501087a0 0x7f1d50076220 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1d48007a20 tx=0x7f1d48007b00 comp rx=0 tx=0).stop 2024-05-10T10:57:52.821 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.817+0000 7f1d56dc0700 1 -- 172.21.15.107:0/1309595817 shutdown_connections 2024-05-10T10:57:52.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.817+0000 7f1d56dc0700 1 --2- 172.21.15.107:0/1309595817 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f1d400b29b0 0x7f1d400b4e70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.817+0000 7f1d56dc0700 1 --2- 172.21.15.107:0/1309595817 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d501037b0 0x7f1d500757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.817+0000 7f1d56dc0700 1 --2- 172.21.15.107:0/1309595817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1d501087a0 0x7f1d50076220 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.817+0000 7f1d56dc0700 1 --2- 172.21.15.107:0/1309595817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d50104160 0x7f1d50075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:52.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.817+0000 7f1d56dc0700 1 -- 172.21.15.107:0/1309595817 >> 172.21.15.107:0/1309595817 conn(0x7f1d5007a570 msgr2=0x7f1d501015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:52.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.817+0000 7f1d56dc0700 1 -- 172.21.15.107:0/1309595817 shutdown_connections 2024-05-10T10:57:52.822 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:57:52.817+0000 7f1d56dc0700 1 -- 172.21.15.107:0/1309595817 wait complete. 2024-05-10T10:57:53.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:53 smithi107 ceph-mon[30373]: pgmap v454: 97 pgs: 97 active+clean; 13 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 1.0 MiB/s wr, 16 op/s 2024-05-10T10:57:53.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:53 smithi107 ceph-mon[30373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:57:53.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:53 smithi196 ceph-mon[34872]: pgmap v454: 97 pgs: 97 active+clean; 13 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 1.0 MiB/s wr, 16 op/s 2024-05-10T10:57:53.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:53 smithi196 ceph-mon[34872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:57:53.610 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '25edc73', quiesce took 8.3 seconds. Will release after: 26.65 2024-05-10T10:57:53.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:53 smithi184 ceph-mon[34585]: pgmap v454: 97 pgs: 97 active+clean; 13 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 1.0 MiB/s wr, 16 op/s 2024-05-10T10:57:53.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:53 smithi184 ceph-mon[34585]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:57:55.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:55 smithi196 ceph-mon[34872]: pgmap v455: 97 pgs: 97 active+clean; 33 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.7 MiB/s wr, 19 op/s 2024-05-10T10:57:55.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:55 smithi184 ceph-mon[34585]: pgmap v455: 97 pgs: 97 active+clean; 33 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.7 MiB/s wr, 19 op/s 2024-05-10T10:57:55.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:55 smithi107 ceph-mon[30373]: pgmap v455: 97 pgs: 97 active+clean; 33 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.7 MiB/s wr, 19 op/s 2024-05-10T10:57:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.941+0000 7f7a7b96a640 1 -- 172.21.15.107:0/3022602526 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a741045f0 msgr2=0x7f7a7410ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.941+0000 7f7a7b96a640 1 --2- 172.21.15.107:0/3022602526 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a741045f0 0x7f7a7410ae80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009ca0 tx=0x7f7a6c02a8c0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.941+0000 7f7a7b96a640 1 -- 172.21.15.107:0/3022602526 shutdown_connections 2024-05-10T10:57:55.955 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.941+0000 7f7a7b96a640 1 --2- 172.21.15.107:0/3022602526 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a741045f0 0x7f7a7410ae80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.941+0000 7f7a7b96a640 1 --2- 172.21.15.107:0/3022602526 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a74103c30 0x7f7a741040b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.941+0000 7f7a7b96a640 1 --2- 172.21.15.107:0/3022602526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a74102a40 0x7f7a74102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.941+0000 7f7a7b96a640 1 -- 172.21.15.107:0/3022602526 >> 172.21.15.107:0/3022602526 conn(0x7f7a740fdfd0 msgr2=0x7f7a741003f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.941+0000 7f7a7b96a640 1 -- 172.21.15.107:0/3022602526 shutdown_connections 2024-05-10T10:57:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.941+0000 7f7a7b96a640 1 -- 172.21.15.107:0/3022602526 wait complete. 2024-05-10T10:57:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.941+0000 7f7a7b96a640 1 Processor -- start 2024-05-10T10:57:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.941+0000 7f7a7b96a640 1 -- start start 2024-05-10T10:57:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a7b96a640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a74102a40 0x7f7a74076710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a7b96a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a74103c30 0x7f7a74074da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a7b96a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a741045f0 0x7f7a740752e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a7b96a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7410e6a0 con 0x7f7a74103c30 2024-05-10T10:57:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a7b96a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7410e520 con 0x7f7a741045f0 2024-05-10T10:57:55.956 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a7b96a640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7410e820 con 0x7f7a74102a40 2024-05-10T10:57:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a78f05640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a74103c30 0x7f7a74074da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a78f05640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a74103c30 0x7f7a74074da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39726/0 (socket says 172.21.15.107:39726) 2024-05-10T10:57:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a78f05640 1 -- 172.21.15.107:0/3083928560 learned_addr learned my addr 172.21.15.107:0/3083928560 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a79706640 1 --2- 172.21.15.107:0/3083928560 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a74102a40 0x7f7a74076710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a79f07640 1 --2- 172.21.15.107:0/3083928560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a741045f0 0x7f7a740752e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a78f05640 1 -- 172.21.15.107:0/3083928560 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a74102a40 msgr2=0x7f7a74076710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a78f05640 1 --2- 172.21.15.107:0/3083928560 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a74102a40 0x7f7a74076710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a78f05640 1 -- 172.21.15.107:0/3083928560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a741045f0 msgr2=0x7f7a740752e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a78f05640 1 --2- 172.21.15.107:0/3083928560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a741045f0 0x7f7a740752e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a78f05640 1 -- 172.21.15.107:0/3083928560 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a74075ba0 con 0x7f7a74103c30 2024-05-10T10:57:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a78f05640 1 --2- 172.21.15.107:0/3083928560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a74103c30 0x7f7a74074da0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800d950 tx=0x7f7a6800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a667fc640 1 -- 172.21.15.107:0/3083928560 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68017030 con 0x7f7a74103c30 2024-05-10T10:57:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a7b96a640 1 -- 172.21.15.107:0/3083928560 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a741a2d20 con 0x7f7a74103c30 2024-05-10T10:57:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a667fc640 1 -- 172.21.15.107:0/3083928560 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7a68004020 con 0x7f7a74103c30 2024-05-10T10:57:55.957 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a667fc640 1 -- 172.21.15.107:0/3083928560 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a680047a0 con 0x7f7a74103c30 2024-05-10T10:57:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.942+0000 7f7a7b96a640 1 -- 172.21.15.107:0/3083928560 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a741a31e0 con 0x7f7a74103c30 2024-05-10T10:57:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.945+0000 7f7a7e683740 1 Processor -- start 2024-05-10T10:57:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.945+0000 7f7a667fc640 1 -- 172.21.15.107:0/3083928560 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f7a680041d0 con 0x7f7a74103c30 2024-05-10T10:57:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.945+0000 7f7a7e683740 1 -- start start 2024-05-10T10:57:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.945+0000 7f7a7e683740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b376db0 0x55715b3771d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.945+0000 7f7a7e683740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b3777a0 0x55715b37c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.945+0000 7f7a7e683740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b37c910 0x55715b37eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.945+0000 7f7a7e683740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55715b2db5d0 con 0x55715b3777a0 2024-05-10T10:57:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.945+0000 7f7a7e683740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55715b294890 con 0x55715b37c910 2024-05-10T10:57:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.945+0000 7f7a7e683740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55715b2d7590 con 0x55715b376db0 2024-05-10T10:57:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.946+0000 7f7a79706640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b3777a0 0x55715b37c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.946+0000 7f7a79706640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b3777a0 0x55715b37c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39730/0 (socket says 172.21.15.107:39730) 2024-05-10T10:57:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.946+0000 7f7a79706640 1 -- 172.21.15.107:0/1830168692 learned_addr learned my addr 172.21.15.107:0/1830168692 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:55.958 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.946+0000 7f7a79f07640 1 --2- 172.21.15.107:0/1830168692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b376db0 0x55715b3771d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.946+0000 7f7a78f05640 1 --2- 172.21.15.107:0/1830168692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b37c910 0x55715b37eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.946+0000 7f7a79706640 1 -- 172.21.15.107:0/1830168692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b376db0 msgr2=0x55715b3771d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.946+0000 7f7a79706640 1 --2- 172.21.15.107:0/1830168692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b376db0 0x55715b3771d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.946+0000 7f7a79706640 1 -- 172.21.15.107:0/1830168692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b37c910 msgr2=0x55715b37eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.946+0000 7f7a79706640 1 --2- 172.21.15.107:0/1830168692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b37c910 0x55715b37eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.946+0000 7f7a79706640 1 -- 172.21.15.107:0/1830168692 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55715afed210 con 0x55715b3777a0 2024-05-10T10:57:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.946+0000 7f7a667fc640 1 --2- 172.21.15.107:0/3083928560 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7a600b28a0 0x7f7a600b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.946+0000 7f7a79706640 1 --2- 172.21.15.107:0/1830168692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b3777a0 0x55715b37c2a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000bcb0 tx=0x7f7a700107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad07f41d163a260f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.946+0000 7f7a79f07640 1 --2- 172.21.15.107:0/3083928560 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7a600b28a0 0x7f7a600b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.946+0000 7f7a5f7fe640 1 -- 172.21.15.107:0/1830168692 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70004020 con 0x55715b3777a0 2024-05-10T10:57:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.946+0000 7f7a667fc640 1 -- 172.21.15.107:0/3083928560 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f7a680e1ae0 con 0x7f7a74103c30 2024-05-10T10:57:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.946+0000 7f7a5f7fe640 1 -- 172.21.15.107:0/1830168692 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7a700054f0 con 0x55715b3777a0 2024-05-10T10:57:55.959 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.946+0000 7f7a5f7fe640 1 -- 172.21.15.107:0/1830168692 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a700035f0 con 0x55715b3777a0 2024-05-10T10:57:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.947+0000 7f7a7e683740 1 -- 172.21.15.107:0/1830168692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b3777a0 msgr2=0x55715b37c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.947+0000 7f7a79f07640 1 --2- 172.21.15.107:0/3083928560 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7a600b28a0 0x7f7a600b4d60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c031ba0 tx=0x7f7a6c009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.947+0000 7f7a7e683740 1 --2- 172.21.15.107:0/1830168692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b3777a0 0x55715b37c2a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000bcb0 tx=0x7f7a700107a0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.947+0000 7f7a7e683740 1 -- 172.21.15.107:0/1830168692 shutdown_connections 2024-05-10T10:57:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.947+0000 7f7a7e683740 1 --2- 172.21.15.107:0/1830168692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b37c910 0x55715b37eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.947+0000 7f7a7e683740 1 --2- 172.21.15.107:0/1830168692 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b3777a0 0x55715b37c2a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.947+0000 7f7a7e683740 1 --2- 172.21.15.107:0/1830168692 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b376db0 0x55715b3771d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.947+0000 7f7a7e683740 1 -- 172.21.15.107:0/1830168692 >> 172.21.15.107:0/1830168692 conn(0x55715b372420 msgr2=0x55715b372820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.947+0000 7f7a7e683740 1 -- 172.21.15.107:0/1830168692 shutdown_connections 2024-05-10T10:57:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.947+0000 7f7a7e683740 1 -- 172.21.15.107:0/1830168692 wait complete. 2024-05-10T10:57:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.947+0000 7f7a7e683740 1 -- start start 2024-05-10T10:57:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.948+0000 7f7a7e683740 1 Processor -- start 2024-05-10T10:57:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.948+0000 7f7a7e683740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 0x55715b380f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.948+0000 7f7a7e683740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b3777a0 0x55715b3814d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:55.960 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.948+0000 7f7a7e683740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b37c910 0x55715b388510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.948+0000 7f7a7e683740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55715b37f8c0 con 0x55715b376db0 2024-05-10T10:57:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.948+0000 7f7a7e683740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55715b298370 con 0x55715b3777a0 2024-05-10T10:57:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.948+0000 7f7a7e683740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55715b37fa40 con 0x55715b37c910 2024-05-10T10:57:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.948+0000 7f7a7e683740 10 client.0 _ll_register_callbacks cb 0x55715afeca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:57:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.948+0000 7f7a79706640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 0x55715b380f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.948+0000 7f7a79706640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 0x55715b380f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39746/0 (socket says 172.21.15.107:39746) 2024-05-10T10:57:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.948+0000 7f7a79706640 1 -- 172.21.15.107:0/3460558285 learned_addr learned my addr 172.21.15.107:0/3460558285 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.948+0000 7f7a78f05640 1 --2- 172.21.15.107:0/3460558285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b3777a0 0x55715b3814d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.948+0000 7f7a79706640 1 -- 172.21.15.107:0/3460558285 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b37c910 msgr2=0x55715b388510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.948+0000 7f7a79706640 1 --2- 172.21.15.107:0/3460558285 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b37c910 0x55715b388510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.948+0000 7f7a79706640 1 -- 172.21.15.107:0/3460558285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b3777a0 msgr2=0x55715b3814d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.948+0000 7f7a79706640 1 --2- 172.21.15.107:0/3460558285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b3777a0 0x55715b3814d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.948+0000 7f7a79706640 1 -- 172.21.15.107:0/3460558285 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55715b0b9620 con 0x55715b376db0 2024-05-10T10:57:55.961 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.949+0000 7f7a79706640 1 --2- 172.21.15.107:0/3460558285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 0x55715b380f90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7a70004590 tx=0x7f7a70005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec3d547bac30437 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.949+0000 7f7a5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:57:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.949+0000 7f7a5cff9640 1 -- 172.21.15.107:0/3460558285 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7002b060 con 0x55715b376db0 2024-05-10T10:57:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.949+0000 7f7a5cff9640 1 -- 172.21.15.107:0/3460558285 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f7a70004b80 con 0x55715b376db0 2024-05-10T10:57:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.949+0000 7f7a7e683740 1 -- 172.21.15.107:0/3460558285 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a700054f0 con 0x55715b376db0 2024-05-10T10:57:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.949+0000 7f7a5cff9640 1 -- 172.21.15.107:0/3460558285 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7a70004d80 con 0x55715b376db0 2024-05-10T10:57:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.949+0000 7f7a7e683740 10 client.15651 fetch_fsmap learned FSMap version 28 2024-05-10T10:57:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.949+0000 7f7a7e683740 1 -- 172.21.15.107:0/3460558285 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55715b38b4f0 con 0x55715b376db0 2024-05-10T10:57:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.949+0000 7f7a5cff9640 1 -- 172.21.15.107:0/3460558285 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7a700054f0 con 0x55715b376db0 2024-05-10T10:57:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.949+0000 7f7a5cff9640 1 -- 172.21.15.107:0/3460558285 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f7a70030070 con 0x55715b376db0 2024-05-10T10:57:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.949+0000 7f7a7e683740 10 client.15651 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T10:57:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.949+0000 7f7a7e683740 10 client.15651 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:57:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.949+0000 7f7a7e683740 20 client.15651 populate_metadata read hostname 'smithi107' 2024-05-10T10:57:55.962 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.949+0000 7f7a7e683740 1 --2- 172.21.15.107:0/3460558285 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55715b38c950 0x55715b38ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.949+0000 7f7a7e683740 4 client.15651 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:57:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.949+0000 7f7a7e683740 1 -- 172.21.15.107:0/3460558285 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55715b2e91e0 con 0x55715b38c950 2024-05-10T10:57:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.950+0000 7f7a78f05640 1 --2- 172.21.15.107:0/3460558285 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55715b38c950 0x55715b38ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.950+0000 7f7a78f05640 1 --2- 172.21.15.107:0/3460558285 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55715b38c950 0x55715b38ed40 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=354467c2e6df814e server_cookie=cf3b1a44a58a0a5b in_seq=0 out_seq=0 2024-05-10T10:57:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.950+0000 7f7a5cff9640 10 client.15651 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.951+0000 7f7a5cff9640 1 -- 172.21.15.107:0/3460558285 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55715b2e91e0 con 0x55715b38c950 2024-05-10T10:57:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.951+0000 7f7a5cff9640 10 client.15651 handle_command_reply: tid=0 2024-05-10T10:57:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.951+0000 7f7a7e683740 1 client.15651 shutdown 2024-05-10T10:57:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.951+0000 7f7a7e683740 1 -- 172.21.15.107:0/3460558285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 msgr2=0x55715b380f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.951+0000 7f7a7e683740 1 --2- 172.21.15.107:0/3460558285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 0x55715b380f90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7a70004590 tx=0x7f7a70005710 comp rx=0 tx=0).stop 2024-05-10T10:57:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.951+0000 7f7a7e683740 1 -- 172.21.15.107:0/3460558285 shutdown_connections 2024-05-10T10:57:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.951+0000 7f7a7e683740 1 --2- 172.21.15.107:0/3460558285 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55715b38c950 0x55715b38ed40 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.951+0000 7f7a7e683740 1 --2- 172.21.15.107:0/3460558285 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b37c910 0x55715b388510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.963 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.951+0000 7f7a7e683740 1 --2- 172.21.15.107:0/3460558285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b3777a0 0x55715b3814d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.951+0000 7f7a5cff9640 0 client.15651 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.951+0000 7f7a7e683740 1 --2- 172.21.15.107:0/3460558285 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 0x55715b380f90 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.951+0000 7f7a7e683740 1 -- 172.21.15.107:0/3460558285 >> 172.21.15.107:0/3460558285 conn(0x55715b372420 msgr2=0x55715b371580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.951+0000 7f7a7e683740 1 -- 172.21.15.107:0/3460558285 shutdown_connections 2024-05-10T10:57:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.951+0000 7f7a7e683740 1 -- 172.21.15.107:0/3460558285 wait complete. 2024-05-10T10:57:55.964 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.951+0000 7f7a7e683740 20 client.15651 trim_cache size 0 max 16384 2024-05-10T10:57:55.971 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.966+0000 7f7a7e683740 1 Processor -- start 2024-05-10T10:57:55.971 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a7e683740 1 -- start start 2024-05-10T10:57:55.971 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a7e683740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 0x55715b36d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a7e683740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b3777a0 0x55715b375300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a7e683740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b37c910 0x55715b375840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a7e683740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7a741abf40 con 0x55715b376db0 2024-05-10T10:57:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a7e683740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7a741adab0 con 0x55715b37c910 2024-05-10T10:57:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a7e683740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7a741ac610 con 0x55715b3777a0 2024-05-10T10:57:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a79706640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 0x55715b36d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a79706640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 0x55715b36d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39756/0 (socket says 172.21.15.107:39756) 2024-05-10T10:57:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a79706640 1 -- 172.21.15.107:0/884195458 learned_addr learned my addr 172.21.15.107:0/884195458 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a79f07640 1 --2- 172.21.15.107:0/884195458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b37c910 0x55715b375840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a79706640 1 -- 172.21.15.107:0/884195458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b3777a0 msgr2=0x55715b375300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a78f05640 1 --2- 172.21.15.107:0/884195458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b3777a0 0x55715b375300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a79706640 1 --2- 172.21.15.107:0/884195458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b3777a0 0x55715b375300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a79706640 1 -- 172.21.15.107:0/884195458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b37c910 msgr2=0x55715b375840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a79706640 1 --2- 172.21.15.107:0/884195458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b37c910 0x55715b375840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.972 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a79706640 1 -- 172.21.15.107:0/884195458 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55715b3730f0 con 0x55715b376db0 2024-05-10T10:57:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a79f07640 1 --2- 172.21.15.107:0/884195458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b37c910 0x55715b375840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a78f05640 1 --2- 172.21.15.107:0/884195458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b3777a0 0x55715b375300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:57:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a79706640 1 --2- 172.21.15.107:0/884195458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 0x55715b36d3e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7a70006010 tx=0x7f7a700045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb7d6187fb31dc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a5effd640 1 -- 172.21.15.107:0/884195458 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70036030 con 0x55715b376db0 2024-05-10T10:57:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a5effd640 1 -- 172.21.15.107:0/884195458 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7a7001f070 con 0x55715b376db0 2024-05-10T10:57:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.967+0000 7f7a5effd640 1 -- 172.21.15.107:0/884195458 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70004b80 con 0x55715b376db0 2024-05-10T10:57:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.968+0000 7f7a7e683740 1 -- 172.21.15.107:0/884195458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 msgr2=0x55715b36d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:57:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.968+0000 7f7a7e683740 1 --2- 172.21.15.107:0/884195458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 0x55715b36d3e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7a70006010 tx=0x7f7a700045c0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.968+0000 7f7a7e683740 1 -- 172.21.15.107:0/884195458 shutdown_connections 2024-05-10T10:57:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.968+0000 7f7a7e683740 1 --2- 172.21.15.107:0/884195458 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b37c910 0x55715b375840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.968+0000 7f7a7e683740 1 --2- 172.21.15.107:0/884195458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b3777a0 0x55715b375300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.968+0000 7f7a7e683740 1 --2- 172.21.15.107:0/884195458 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 0x55715b36d3e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.968+0000 7f7a7e683740 1 -- 172.21.15.107:0/884195458 >> 172.21.15.107:0/884195458 conn(0x55715b372420 msgr2=0x55715b37bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:57:55.973 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.968+0000 7f7a7e683740 1 -- 172.21.15.107:0/884195458 shutdown_connections 2024-05-10T10:57:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.968+0000 7f7a7e683740 1 -- 172.21.15.107:0/884195458 wait complete. 2024-05-10T10:57:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.968+0000 7f7a7e683740 1 -- start start 2024-05-10T10:57:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.968+0000 7f7a7e683740 1 Processor -- start 2024-05-10T10:57:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.969+0000 7f7a7e683740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 0x55715b384e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.969+0000 7f7a7e683740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b3777a0 0x55715b385390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.969+0000 7f7a7e683740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b37c910 0x55715b3863a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.969+0000 7f7a7e683740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7a741ad3b0 con 0x55715b376db0 2024-05-10T10:57:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.969+0000 7f7a7e683740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7a741acce0 con 0x55715b37c910 2024-05-10T10:57:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.969+0000 7f7a7e683740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7a741a9f40 con 0x55715b3777a0 2024-05-10T10:57:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.969+0000 7f7a7e683740 10 client.0 _ll_register_callbacks cb 0x7f7a7000bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:57:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.969+0000 7f7a79706640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 0x55715b384e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.969+0000 7f7a79706640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 0x55715b384e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:39762/0 (socket says 172.21.15.107:39762) 2024-05-10T10:57:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.969+0000 7f7a79706640 1 -- 172.21.15.107:0/2512275940 learned_addr learned my addr 172.21.15.107:0/2512275940 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:57:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.969+0000 7f7a79f07640 1 --2- 172.21.15.107:0/2512275940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b37c910 0x55715b3863a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.969+0000 7f7a78f05640 1 --2- 172.21.15.107:0/2512275940 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b3777a0 0x55715b385390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.969+0000 7f7a79706640 1 -- 172.21.15.107:0/2512275940 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b3777a0 msgr2=0x55715b385390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.969+0000 7f7a79706640 1 --2- 172.21.15.107:0/2512275940 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b3777a0 0x55715b385390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.969+0000 7f7a79706640 1 -- 172.21.15.107:0/2512275940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b37c910 msgr2=0x55715b3863a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:57:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.969+0000 7f7a79706640 1 --2- 172.21.15.107:0/2512275940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b37c910 0x55715b3863a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:57:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.969+0000 7f7a79706640 1 -- 172.21.15.107:0/2512275940 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55715b386990 con 0x55715b376db0 2024-05-10T10:57:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.969+0000 7f7a79706640 1 --2- 172.21.15.107:0/2512275940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 0x55715b384e50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000bcb0 tx=0x7f7a70011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4601bc9d230906 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:57:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.969+0000 7f7a5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:57:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.970+0000 7f7a5cff9640 1 -- 172.21.15.107:0/2512275940 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7003f020 con 0x55715b376db0 2024-05-10T10:57:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.970+0000 7f7a7e683740 1 -- 172.21.15.107:0/2512275940 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a7001f070 con 0x55715b376db0 2024-05-10T10:57:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.970+0000 7f7a5cff9640 1 -- 172.21.15.107:0/2512275940 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f7a70004f20 con 0x55715b376db0 2024-05-10T10:57:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.970+0000 7f7a5cff9640 1 -- 172.21.15.107:0/2512275940 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7a7002b070 con 0x55715b376db0 2024-05-10T10:57:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.970+0000 7f7a7e683740 10 client.15657 fetch_fsmap learned FSMap version 28 2024-05-10T10:57:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.970+0000 7f7a7e683740 1 -- 172.21.15.107:0/2512275940 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55715b387c10 con 0x55715b376db0 2024-05-10T10:57:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.970+0000 7f7a5cff9640 1 -- 172.21.15.107:0/2512275940 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7a7001f070 con 0x55715b376db0 2024-05-10T10:57:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.970+0000 7f7a5cff9640 1 -- 172.21.15.107:0/2512275940 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f7a70030070 con 0x55715b376db0 2024-05-10T10:57:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.970+0000 7f7a7e683740 10 client.15657 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T10:57:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.970+0000 7f7a7e683740 10 client.15657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:57:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.970+0000 7f7a7e683740 20 client.15657 populate_metadata read hostname 'smithi107' 2024-05-10T10:57:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.970+0000 7f7a7e683740 1 --2- 172.21.15.107:0/2512275940 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55715b3f7550 0x55715b3f9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:57:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.970+0000 7f7a7e683740 4 client.15657 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T10:57:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.970+0000 7f7a7e683740 1 -- 172.21.15.107:0/2512275940 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55715b2e3050 con 0x55715b3f7550 2024-05-10T10:57:55.980 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.970+0000 7f7a78f05640 1 --2- 172.21.15.107:0/2512275940 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55715b3f7550 0x55715b3f9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:57:55.980 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.971+0000 7f7a78f05640 1 --2- 172.21.15.107:0/2512275940 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55715b3f7550 0x55715b3f9970 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f20f62aa57f38f37 server_cookie=d5e2dc556a56dd19 in_seq=0 out_seq=0 2024-05-10T10:57:55.980 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:57:55.971+0000 7f7a5cff9640 10 client.15657 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:57:57.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:57 smithi196 ceph-mon[34872]: pgmap v456: 97 pgs: 97 active+clean; 82 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 6.8 MiB/s wr, 56 op/s 2024-05-10T10:57:57.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:57 smithi184 ceph-mon[34585]: pgmap v456: 97 pgs: 97 active+clean; 82 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 6.8 MiB/s wr, 56 op/s 2024-05-10T10:57:57.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:57 smithi107 ceph-mon[30373]: pgmap v456: 97 pgs: 97 active+clean; 82 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 6.8 MiB/s wr, 56 op/s 2024-05-10T10:57:59.491 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:57:59 smithi107 ceph-mon[30373]: pgmap v457: 97 pgs: 97 active+clean; 82 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 6.8 MiB/s wr, 71 op/s 2024-05-10T10:57:59.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:57:59 smithi196 ceph-mon[34872]: pgmap v457: 97 pgs: 97 active+clean; 82 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 6.8 MiB/s wr, 71 op/s 2024-05-10T10:57:59.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:57:59 smithi184 ceph-mon[34585]: pgmap v457: 97 pgs: 97 active+clean; 82 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 6.8 MiB/s wr, 71 op/s 2024-05-10T10:58:01.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:01 smithi196 ceph-mon[34872]: pgmap v458: 97 pgs: 97 active+clean; 82 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 6.8 MiB/s wr, 100 op/s 2024-05-10T10:58:01.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:01 smithi184 ceph-mon[34585]: pgmap v458: 97 pgs: 97 active+clean; 82 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 6.8 MiB/s wr, 100 op/s 2024-05-10T10:58:01.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:01 smithi107 ceph-mon[30373]: pgmap v458: 97 pgs: 97 active+clean; 82 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 6.8 MiB/s wr, 100 op/s 2024-05-10T10:58:03.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:03 smithi196 ceph-mon[34872]: pgmap v459: 97 pgs: 97 active+clean; 82 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 6.8 MiB/s wr, 115 op/s 2024-05-10T10:58:03.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:03 smithi184 ceph-mon[34585]: pgmap v459: 97 pgs: 97 active+clean; 82 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 6.8 MiB/s wr, 115 op/s 2024-05-10T10:58:03.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:03 smithi107 ceph-mon[30373]: pgmap v459: 97 pgs: 97 active+clean; 82 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 6.8 MiB/s wr, 115 op/s 2024-05-10T10:58:05.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:05 smithi196 ceph-mon[34872]: pgmap v460: 97 pgs: 97 active+clean; 82 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 5.8 MiB/s wr, 108 op/s 2024-05-10T10:58:05.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:05 smithi184 ceph-mon[34585]: pgmap v460: 97 pgs: 97 active+clean; 82 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 5.8 MiB/s wr, 108 op/s 2024-05-10T10:58:05.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:05 smithi107 ceph-mon[30373]: pgmap v460: 97 pgs: 97 active+clean; 82 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 5.8 MiB/s wr, 108 op/s 2024-05-10T10:58:07.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:07 smithi196 ceph-mon[34872]: pgmap v461: 97 pgs: 97 active+clean; 82 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 4.1 MiB/s wr, 108 op/s 2024-05-10T10:58:07.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:07 smithi184 ceph-mon[34585]: pgmap v461: 97 pgs: 97 active+clean; 82 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 4.1 MiB/s wr, 108 op/s 2024-05-10T10:58:07.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:07 smithi107 ceph-mon[30373]: pgmap v461: 97 pgs: 97 active+clean; 82 MiB data, 623 MiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 4.1 MiB/s wr, 108 op/s 2024-05-10T10:58:09.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:09 smithi196 ceph-mon[34872]: pgmap v462: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 58 KiB/s wr, 70 op/s 2024-05-10T10:58:09.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:09 smithi184 ceph-mon[34585]: pgmap v462: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 58 KiB/s wr, 70 op/s 2024-05-10T10:58:09.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:09 smithi107 ceph-mon[30373]: pgmap v462: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 58 KiB/s wr, 70 op/s 2024-05-10T10:58:11.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:11 smithi196 ceph-mon[34872]: pgmap v463: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 KiB/s wr, 53 op/s 2024-05-10T10:58:11.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:11 smithi184 ceph-mon[34585]: pgmap v463: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 KiB/s wr, 53 op/s 2024-05-10T10:58:11.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:11 smithi107 ceph-mon[30373]: pgmap v463: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 KiB/s wr, 53 op/s 2024-05-10T10:58:13.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:13 smithi196 ceph-mon[34872]: pgmap v464: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 52 KiB/s wr, 26 op/s 2024-05-10T10:58:13.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:13 smithi184 ceph-mon[34585]: pgmap v464: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 52 KiB/s wr, 26 op/s 2024-05-10T10:58:13.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:13 smithi107 ceph-mon[30373]: pgmap v464: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 52 KiB/s wr, 26 op/s 2024-05-10T10:58:15.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:15 smithi196 ceph-mon[34872]: pgmap v465: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 45 KiB/s wr, 10 op/s 2024-05-10T10:58:15.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:15 smithi184 ceph-mon[34585]: pgmap v465: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 45 KiB/s wr, 10 op/s 2024-05-10T10:58:15.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:15 smithi107 ceph-mon[30373]: pgmap v465: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 45 KiB/s wr, 10 op/s 2024-05-10T10:58:17.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:17 smithi196 ceph-mon[34872]: pgmap v466: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 46 KiB/s wr, 13 op/s 2024-05-10T10:58:17.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:17 smithi184 ceph-mon[34585]: pgmap v466: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 46 KiB/s wr, 13 op/s 2024-05-10T10:58:17.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:17 smithi107 ceph-mon[30373]: pgmap v466: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 46 KiB/s wr, 13 op/s 2024-05-10T10:58:19.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:19 smithi196 ceph-mon[34872]: pgmap v467: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-05-10T10:58:19.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:19 smithi184 ceph-mon[34585]: pgmap v467: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-05-10T10:58:19.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:19 smithi107 ceph-mon[30373]: pgmap v467: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-05-10T10:58:20.262 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T10:58:20.520 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:58:21.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:21 smithi196 ceph-mon[34872]: pgmap v468: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-05-10T10:58:21.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:21 smithi184 ceph-mon[34585]: pgmap v468: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-05-10T10:58:21.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:21 smithi107 ceph-mon[30373]: pgmap v468: 97 pgs: 97 active+clean; 82 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-05-10T10:58:22.379 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.376+0000 7fc07d2ff700 1 -- 172.21.15.107:0/3611401950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc07806bc10 msgr2=0x7fc07806c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:58:22.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.376+0000 7fc07d2ff700 1 --2- 172.21.15.107:0/3611401950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc07806bc10 0x7fc07806c090 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc06c009990 tx=0x7fc06c009ca0 comp rx=0 tx=0).stop 2024-05-10T10:58:22.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.376+0000 7fc07d2ff700 1 -- 172.21.15.107:0/3611401950 shutdown_connections 2024-05-10T10:58:22.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.376+0000 7fc07d2ff700 1 --2- 172.21.15.107:0/3611401950 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc07806c5d0 0x7fc078110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:22.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.376+0000 7fc07d2ff700 1 --2- 172.21.15.107:0/3611401950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc078109540 0x7fc078109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:22.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.376+0000 7fc07d2ff700 1 --2- 172.21.15.107:0/3611401950 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc07806bc10 0x7fc07806c090 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:22.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.376+0000 7fc07d2ff700 1 -- 172.21.15.107:0/3611401950 >> 172.21.15.107:0/3611401950 conn(0x7fc078078410 msgr2=0x7fc078078820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:58:22.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.376+0000 7fc07d2ff700 1 -- 172.21.15.107:0/3611401950 shutdown_connections 2024-05-10T10:58:22.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.376+0000 7fc07d2ff700 1 -- 172.21.15.107:0/3611401950 wait complete. 2024-05-10T10:58:22.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.376+0000 7fc07d2ff700 1 Processor -- start 2024-05-10T10:58:22.380 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.377+0000 7fc07d2ff700 1 -- start start 2024-05-10T10:58:22.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.377+0000 7fc07d2ff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc07806bc10 0x7fc078199d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:58:22.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.377+0000 7fc07d2ff700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc07806c5d0 0x7fc07819a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:58:22.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.377+0000 7fc07d2ff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc078109540 0x7fc07819e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:58:22.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.377+0000 7fc07d2ff700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc078113860 con 0x7fc078109540 2024-05-10T10:58:22.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.377+0000 7fc07d2ff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc0781136e0 con 0x7fc07806bc10 2024-05-10T10:58:22.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.377+0000 7fc07d2ff700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc0781139e0 con 0x7fc07806c5d0 2024-05-10T10:58:22.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.377+0000 7fc0777fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc078109540 0x7fc07819e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:58:22.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.377+0000 7fc076ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc07806bc10 0x7fc078199d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:58:22.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.377+0000 7fc0777fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc078109540 0x7fc07819e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37648/0 (socket says 172.21.15.107:37648) 2024-05-10T10:58:22.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.377+0000 7fc0777fe700 1 -- 172.21.15.107:0/1538208234 learned_addr learned my addr 172.21.15.107:0/1538208234 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:58:22.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.377+0000 7fc0767fc700 1 --2- 172.21.15.107:0/1538208234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc07806c5d0 0x7fc07819a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:58:22.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.377+0000 7fc0777fe700 1 -- 172.21.15.107:0/1538208234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc07806c5d0 msgr2=0x7fc07819a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:58:22.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.377+0000 7fc0777fe700 1 --2- 172.21.15.107:0/1538208234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc07806c5d0 0x7fc07819a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:22.381 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.377+0000 7fc0777fe700 1 -- 172.21.15.107:0/1538208234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc07806bc10 msgr2=0x7fc078199d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:58:22.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.377+0000 7fc0777fe700 1 --2- 172.21.15.107:0/1538208234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc07806bc10 0x7fc078199d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:22.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.377+0000 7fc0777fe700 1 -- 172.21.15.107:0/1538208234 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc07819eda0 con 0x7fc078109540 2024-05-10T10:58:22.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.377+0000 7fc0777fe700 1 --2- 172.21.15.107:0/1538208234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc078109540 0x7fc07819e660 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc07000b550 tx=0x7fc07000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:58:22.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.378+0000 7fc05ffff700 1 -- 172.21.15.107:0/1538208234 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc070015020 con 0x7fc078109540 2024-05-10T10:58:22.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.378+0000 7fc05ffff700 1 -- 172.21.15.107:0/1538208234 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc070011d00 con 0x7fc078109540 2024-05-10T10:58:22.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.378+0000 7fc07d2ff700 1 -- 172.21.15.107:0/1538208234 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc07819f090 con 0x7fc078109540 2024-05-10T10:58:22.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.378+0000 7fc05ffff700 1 -- 172.21.15.107:0/1538208234 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc070010d40 con 0x7fc078109540 2024-05-10T10:58:22.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.378+0000 7fc07d2ff700 1 -- 172.21.15.107:0/1538208234 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0781a6910 con 0x7fc078109540 2024-05-10T10:58:22.382 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.379+0000 7fc07d2ff700 1 -- 172.21.15.107:0/1538208234 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc07810ba40 con 0x7fc078109540 2024-05-10T10:58:22.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.380+0000 7fc05ffff700 1 -- 172.21.15.107:0/1538208234 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7fc070018020 con 0x7fc078109540 2024-05-10T10:58:22.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.381+0000 7fc05ffff700 1 --2- 172.21.15.107:0/1538208234 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc0600b2880 0x7fc0600b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:58:22.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.381+0000 7fc076ffd700 1 --2- 172.21.15.107:0/1538208234 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc0600b2880 0x7fc0600b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:58:22.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.381+0000 7fc05ffff700 1 -- 172.21.15.107:0/1538208234 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fc0700e1ea0 con 0x7fc078109540 2024-05-10T10:58:22.383 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.382+0000 7fc076ffd700 1 --2- 172.21.15.107:0/1538208234 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc0600b2880 0x7fc0600b4d40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc06800a400 tx=0x7fc06800d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:58:22.385 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.385+0000 7fc05ffff700 1 -- 172.21.15.107:0/1538208234 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc07001f020 con 0x7fc078109540 2024-05-10T10:58:22.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.641+0000 7fc07d2ff700 1 -- 172.21.15.107:0/1538208234 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc078104c00 con 0x7fc078109540 2024-05-10T10:58:22.642 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.642+0000 7fc05ffff700 1 -- 172.21.15.107:0/1538208234 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11952 (secure 0 0 0) 0x7fc078104c00 con 0x7fc078109540 2024-05-10T10:58:22.643 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T10:58:22.643 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T10:52:17.367732+0000","modified":"2024-05-10T10:57:52.135503+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24482,"mds_1":24449,"mds_2":24442,"mds_3":24431,"mds_4":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/2332963094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":2332963094},{"type":"v1","addr":"172.21.15.107:6841","nonce":2332963094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.184:6839/16501252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":16501252},{"type":"v1","addr":"172.21.15.184:6839","nonce":16501252}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24442,24449,24482,24430,24431]},"id":1}]} 2024-05-10T10:58:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.644+0000 7fc07d2ff700 1 -- 172.21.15.107:0/1538208234 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc0600b2880 msgr2=0x7fc0600b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:58:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.644+0000 7fc07d2ff700 1 --2- 172.21.15.107:0/1538208234 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc0600b2880 0x7fc0600b4d40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc06800a400 tx=0x7fc06800d040 comp rx=0 tx=0).stop 2024-05-10T10:58:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.644+0000 7fc07d2ff700 1 -- 172.21.15.107:0/1538208234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc078109540 msgr2=0x7fc07819e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:58:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.644+0000 7fc07d2ff700 1 --2- 172.21.15.107:0/1538208234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc078109540 0x7fc07819e660 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc07000b550 tx=0x7fc07000b860 comp rx=0 tx=0).stop 2024-05-10T10:58:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.644+0000 7fc07d2ff700 1 -- 172.21.15.107:0/1538208234 shutdown_connections 2024-05-10T10:58:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.644+0000 7fc07d2ff700 1 --2- 172.21.15.107:0/1538208234 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc0600b2880 0x7fc0600b4d40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:22.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.644+0000 7fc07d2ff700 1 --2- 172.21.15.107:0/1538208234 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc078109540 0x7fc07819e660 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:22.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.644+0000 7fc07d2ff700 1 --2- 172.21.15.107:0/1538208234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc07806bc10 0x7fc078199d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:22.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.644+0000 7fc07d2ff700 1 --2- 172.21.15.107:0/1538208234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc07806c5d0 0x7fc07819a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:22.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.644+0000 7fc07d2ff700 1 -- 172.21.15.107:0/1538208234 >> 172.21.15.107:0/1538208234 conn(0x7fc078078410 msgr2=0x7fc078101280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:58:22.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.645+0000 7fc07d2ff700 1 -- 172.21.15.107:0/1538208234 shutdown_connections 2024-05-10T10:58:22.646 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:22.645+0000 7fc07d2ff700 1 -- 172.21.15.107:0/1538208234 wait complete. 2024-05-10T10:58:22.647 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 28 2024-05-10T10:58:23.496 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24482 quiesce db --set-id 25edc73 --release --await' 2024-05-10T10:58:23.496 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24482 quiesce db --set-id 25edc73 --release --await 2024-05-10T10:58:23.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:23 smithi196 ceph-mon[34872]: pgmap v469: 97 pgs: 97 active+clean; 82 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-05-10T10:58:23.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:23 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1538208234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:58:23.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:23 smithi184 ceph-mon[34585]: pgmap v469: 97 pgs: 97 active+clean; 82 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-05-10T10:58:23.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:23 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1538208234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:58:23.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:23 smithi107 ceph-mon[30373]: pgmap v469: 97 pgs: 97 active+clean; 82 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 16 KiB/s wr, 12 op/s 2024-05-10T10:58:23.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:23 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1538208234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T10:58:23.749 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T10:58:25.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.506+0000 7f7bc8d8e700 1 -- 172.21.15.107:0/555368951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bc4102600 msgr2=0x7f7bc4108160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:58:25.506 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.506+0000 7f7bc8d8e700 1 --2- 172.21.15.107:0/555368951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bc4102600 0x7f7bc4108160 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80099c0 tx=0x7f7bb8009cd0 comp rx=0 tx=0).stop 2024-05-10T10:58:25.506 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:25 smithi107 ceph-mon[30373]: pgmap v470: 97 pgs: 97 active+clean; 83 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 71 KiB/s wr, 15 op/s 2024-05-10T10:58:25.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.506+0000 7f7bc8d8e700 1 -- 172.21.15.107:0/555368951 shutdown_connections 2024-05-10T10:58:25.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.506+0000 7f7bc8d8e700 1 --2- 172.21.15.107:0/555368951 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bc4101c50 0x7f7bc4102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:25.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.506+0000 7f7bc8d8e700 1 --2- 172.21.15.107:0/555368951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bc4108890 0x7f7bc4110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:25.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.506+0000 7f7bc8d8e700 1 --2- 172.21.15.107:0/555368951 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bc4102600 0x7f7bc4108160 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:25.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.506+0000 7f7bc8d8e700 1 -- 172.21.15.107:0/555368951 >> 172.21.15.107:0/555368951 conn(0x7f7bc40789a0 msgr2=0x7f7bc40ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:58:25.509 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.506+0000 7f7bc8d8e700 1 -- 172.21.15.107:0/555368951 shutdown_connections 2024-05-10T10:58:25.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.506+0000 7f7bc8d8e700 1 -- 172.21.15.107:0/555368951 wait complete. 2024-05-10T10:58:25.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.507+0000 7f7bc8d8e700 1 Processor -- start 2024-05-10T10:58:25.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.507+0000 7f7bc8d8e700 1 -- start start 2024-05-10T10:58:25.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.507+0000 7f7bc8d8e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bc4101c50 0x7f7bc419f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:58:25.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.507+0000 7f7bc8d8e700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bc4102600 0x7f7bc419fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:58:25.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.507+0000 7f7bc8d8e700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bc4108890 0x7f7bc4199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:58:25.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.507+0000 7f7bc8d8e700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc4113810 con 0x7f7bc4102600 2024-05-10T10:58:25.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.507+0000 7f7bc8d8e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc4113690 con 0x7f7bc4101c50 2024-05-10T10:58:25.510 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.507+0000 7f7bc8d8e700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc4113990 con 0x7f7bc4108890 2024-05-10T10:58:25.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.507+0000 7f7bc1d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bc4102600 0x7f7bc419fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:58:25.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.507+0000 7f7bc1d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bc4102600 0x7f7bc419fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37674/0 (socket says 172.21.15.107:37674) 2024-05-10T10:58:25.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.507+0000 7f7bc1d9b700 1 -- 172.21.15.107:0/3010487102 learned_addr learned my addr 172.21.15.107:0/3010487102 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:58:25.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.508+0000 7f7bc259c700 1 --2- 172.21.15.107:0/3010487102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bc4101c50 0x7f7bc419f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:58:25.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.508+0000 7f7bc2d9d700 1 --2- 172.21.15.107:0/3010487102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bc4108890 0x7f7bc4199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:58:25.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.508+0000 7f7bc1d9b700 1 -- 172.21.15.107:0/3010487102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bc4108890 msgr2=0x7f7bc4199a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:58:25.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.508+0000 7f7bc1d9b700 1 --2- 172.21.15.107:0/3010487102 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bc4108890 0x7f7bc4199a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:25.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.508+0000 7f7bc1d9b700 1 -- 172.21.15.107:0/3010487102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bc4101c50 msgr2=0x7f7bc419f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:58:25.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.508+0000 7f7bc1d9b700 1 --2- 172.21.15.107:0/3010487102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bc4101c50 0x7f7bc419f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:25.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.508+0000 7f7bc1d9b700 1 -- 172.21.15.107:0/3010487102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc419a1d0 con 0x7f7bc4102600 2024-05-10T10:58:25.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.508+0000 7f7bc259c700 1 --2- 172.21.15.107:0/3010487102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bc4101c50 0x7f7bc419f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:58:25.511 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.508+0000 7f7bc1d9b700 1 --2- 172.21.15.107:0/3010487102 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7bc4102600 0x7f7bc419fdf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800b580 tx=0x7f7bb8004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:58:25.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.508+0000 7f7bb37fe700 1 -- 172.21.15.107:0/3010487102 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8027070 con 0x7f7bc4102600 2024-05-10T10:58:25.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.508+0000 7f7bc8d8e700 1 -- 172.21.15.107:0/3010487102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bc419a460 con 0x7f7bc4102600 2024-05-10T10:58:25.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.508+0000 7f7bb37fe700 1 -- 172.21.15.107:0/3010487102 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7bb8004030 con 0x7f7bc4102600 2024-05-10T10:58:25.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.508+0000 7f7bb37fe700 1 -- 172.21.15.107:0/3010487102 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb800f460 con 0x7f7bc4102600 2024-05-10T10:58:25.512 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.508+0000 7f7bc8d8e700 1 -- 172.21.15.107:0/3010487102 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bc41a6780 con 0x7f7bc4102600 2024-05-10T10:58:25.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.511+0000 7f7bb37fe700 1 -- 172.21.15.107:0/3010487102 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f7bb80226b0 con 0x7f7bc4102600 2024-05-10T10:58:25.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.511+0000 7f7bb37fe700 1 --2- 172.21.15.107:0/3010487102 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7bac0b2880 0x7f7bac0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:58:25.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.511+0000 7f7bc259c700 1 --2- 172.21.15.107:0/3010487102 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7bac0b2880 0x7f7bac0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:58:25.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.511+0000 7f7bb37fe700 1 -- 172.21.15.107:0/3010487102 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f7bb80e2e10 con 0x7f7bc4102600 2024-05-10T10:58:25.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.512+0000 7f7bc259c700 1 --2- 172.21.15.107:0/3010487102 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7bac0b2880 0x7f7bac0b4d40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7bc419abb0 tx=0x7f7bb4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:58:25.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.512+0000 7f7bd3621b80 1 Processor -- start 2024-05-10T10:58:25.517 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.512+0000 7f7bd3621b80 1 -- start start 2024-05-10T10:58:25.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.512+0000 7f7bd3621b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e096c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:58:25.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.512+0000 7f7bd3621b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e096c8c0 0x5615e09677a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:58:25.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.512+0000 7f7bd3621b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e0967dc0 0x5615e0968220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:58:25.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.512+0000 7f7bd3621b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5615e08b9960 con 0x5615e096bfa0 2024-05-10T10:58:25.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.512+0000 7f7bd3621b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5615e08588c0 con 0x5615e0967dc0 2024-05-10T10:58:25.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.512+0000 7f7bd3621b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5615e08b5920 con 0x5615e096c8c0 2024-05-10T10:58:25.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.512+0000 7f7bc259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e096c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:58:25.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.512+0000 7f7bc259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e096c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37688/0 (socket says 172.21.15.107:37688) 2024-05-10T10:58:25.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.512+0000 7f7bc259c700 1 -- 172.21.15.107:0/1580285700 learned_addr learned my addr 172.21.15.107:0/1580285700 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:58:25.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.513+0000 7f7bc1d9b700 1 --2- 172.21.15.107:0/1580285700 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e096c8c0 0x5615e09677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:58:25.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.513+0000 7f7bc2d9d700 1 --2- 172.21.15.107:0/1580285700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e0967dc0 0x5615e0968220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:58:25.518 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.513+0000 7f7bc259c700 1 -- 172.21.15.107:0/1580285700 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e096c8c0 msgr2=0x5615e09677a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:58:25.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.513+0000 7f7bc259c700 1 --2- 172.21.15.107:0/1580285700 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e096c8c0 0x5615e09677a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:25.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.513+0000 7f7bc259c700 1 -- 172.21.15.107:0/1580285700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e0967dc0 msgr2=0x5615e0968220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:58:25.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.513+0000 7f7bc259c700 1 --2- 172.21.15.107:0/1580285700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e0967dc0 0x5615e0968220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:25.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.513+0000 7f7bc259c700 1 -- 172.21.15.107:0/1580285700 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615e08069d0 con 0x5615e096bfa0 2024-05-10T10:58:25.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.513+0000 7f7bc259c700 1 --2- 172.21.15.107:0/1580285700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e096c380 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400d7a0 tx=0x7f7bb4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7a8ebb7e79f0c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:58:25.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.513+0000 7f7bb0ff9700 1 -- 172.21.15.107:0/1580285700 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4024070 con 0x5615e096bfa0 2024-05-10T10:58:25.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.513+0000 7f7bb0ff9700 1 -- 172.21.15.107:0/1580285700 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7bb4014b10 con 0x5615e096bfa0 2024-05-10T10:58:25.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.513+0000 7f7bb0ff9700 1 -- 172.21.15.107:0/1580285700 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb401fb70 con 0x5615e096bfa0 2024-05-10T10:58:25.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.514+0000 7f7bd3621b80 1 -- 172.21.15.107:0/1580285700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 msgr2=0x5615e096c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:58:25.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.514+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/1580285700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e096c380 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400d7a0 tx=0x7f7bb4010000 comp rx=0 tx=0).stop 2024-05-10T10:58:25.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.514+0000 7f7bd3621b80 1 -- 172.21.15.107:0/1580285700 shutdown_connections 2024-05-10T10:58:25.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.514+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/1580285700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e0967dc0 0x5615e0968220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:25.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.514+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/1580285700 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e096c380 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:25.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.514+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/1580285700 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e096c8c0 0x5615e09677a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:25.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.514+0000 7f7bd3621b80 1 -- 172.21.15.107:0/1580285700 >> 172.21.15.107:0/1580285700 conn(0x5615e0893200 msgr2=0x5615e0961fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:58:25.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.514+0000 7f7bd3621b80 1 -- 172.21.15.107:0/1580285700 shutdown_connections 2024-05-10T10:58:25.520 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.514+0000 7f7bd3621b80 1 -- 172.21.15.107:0/1580285700 wait complete. 2024-05-10T10:58:25.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.514+0000 7f7bd3621b80 1 -- start start 2024-05-10T10:58:25.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.514+0000 7f7bd3621b80 1 Processor -- start 2024-05-10T10:58:25.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7bd3621b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e0967dc0 0x5615e0973630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:58:25.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7bd3621b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e0970a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:58:25.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7bd3621b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e096c8c0 0x5615e0970f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:58:25.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7bd3621b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5615e0974490 con 0x5615e096bfa0 2024-05-10T10:58:25.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7bd3621b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5615e081fd30 con 0x5615e096c8c0 2024-05-10T10:58:25.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7bd3621b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5615e0974610 con 0x5615e0967dc0 2024-05-10T10:58:25.521 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7bc1d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e0970a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:58:25.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7bd3621b80 10 client.0 _ll_register_callbacks cb 0x5615e0851a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:58:25.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7bc1d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e0970a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:37702/0 (socket says 172.21.15.107:37702) 2024-05-10T10:58:25.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7bc1d9b700 1 -- 172.21.15.107:0/4241434153 learned_addr learned my addr 172.21.15.107:0/4241434153 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:58:25.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7bc2d9d700 1 --2- 172.21.15.107:0/4241434153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e096c8c0 0x5615e0970f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:58:25.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7bc259c700 1 --2- 172.21.15.107:0/4241434153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e0967dc0 0x5615e0973630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:58:25.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7bc1d9b700 1 -- 172.21.15.107:0/4241434153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e0967dc0 msgr2=0x5615e0973630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:58:25.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7bc1d9b700 1 --2- 172.21.15.107:0/4241434153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e0967dc0 0x5615e0973630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:25.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7bc1d9b700 1 -- 172.21.15.107:0/4241434153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e096c8c0 msgr2=0x5615e0970f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:58:25.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7bc1d9b700 1 --2- 172.21.15.107:0/4241434153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e096c8c0 0x5615e0970f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:58:25.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7bc1d9b700 1 -- 172.21.15.107:0/4241434153 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615e0855790 con 0x5615e096bfa0 2024-05-10T10:58:25.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7bc1d9b700 1 --2- 172.21.15.107:0/4241434153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e0970a40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80e09b0 tx=0x7f7bb80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319a4b49cb215792 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:58:25.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7ba9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:58:25.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7ba9ffb700 1 -- 172.21.15.107:0/4241434153 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb80ae910 con 0x5615e096bfa0 2024-05-10T10:58:25.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7ba9ffb700 1 -- 172.21.15.107:0/4241434153 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f7bb80b2ea0 con 0x5615e096bfa0 2024-05-10T10:58:25.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.515+0000 7f7bd3621b80 1 -- 172.21.15.107:0/4241434153 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bb4014b10 con 0x5615e096bfa0 2024-05-10T10:58:25.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.516+0000 7f7ba9ffb700 1 -- 172.21.15.107:0/4241434153 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7bb80b3330 con 0x5615e096bfa0 2024-05-10T10:58:25.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.516+0000 7f7bd3621b80 10 client.15675 fetch_fsmap learned FSMap version 28 2024-05-10T10:58:25.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.516+0000 7f7bd3621b80 1 -- 172.21.15.107:0/4241434153 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5615e097ec90 con 0x5615e096bfa0 2024-05-10T10:58:25.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.516+0000 7f7ba9ffb700 1 -- 172.21.15.107:0/4241434153 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7bb4014b10 con 0x5615e096bfa0 2024-05-10T10:58:25.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.516+0000 7f7ba9ffb700 1 -- 172.21.15.107:0/4241434153 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f7bb8003c80 con 0x5615e096bfa0 2024-05-10T10:58:25.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.516+0000 7f7bd3621b80 10 client.15675 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T10:58:25.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.516+0000 7f7bd3621b80 10 client.15675 resolve_mds: validated gid 24482 aka daemon mds.b 2024-05-10T10:58:25.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.516+0000 7f7bd3621b80 20 client.15675 populate_metadata read hostname 'smithi107' 2024-05-10T10:58:25.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.516+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/4241434153 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5615e0981230 0x5615e0983650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:58:25.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.516+0000 7f7bd3621b80 4 client.15675 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:58:25.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.516+0000 7f7bd3621b80 1 -- 172.21.15.107:0/4241434153 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615e0933750 con 0x5615e0981230 2024-05-10T10:58:25.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.516+0000 7f7bc259c700 1 --2- 172.21.15.107:0/4241434153 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5615e0981230 0x5615e0983650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:58:25.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.517+0000 7f7bc259c700 1 --2- 172.21.15.107:0/4241434153 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5615e0981230 0x5615e0983650 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b580b6cc54c243fb server_cookie=dcbc6574b663a5bb in_seq=0 out_seq=0 2024-05-10T10:58:25.525 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:58:25.517+0000 7f7ba9ffb700 10 client.15675 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:58:25.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:25 smithi196 ceph-mon[34872]: pgmap v470: 97 pgs: 97 active+clean; 83 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 71 KiB/s wr, 15 op/s 2024-05-10T10:58:25.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:25 smithi184 ceph-mon[34585]: pgmap v470: 97 pgs: 97 active+clean; 83 MiB data, 627 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 71 KiB/s wr, 15 op/s 2024-05-10T10:58:27.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:27 smithi196 ceph-mon[34872]: pgmap v471: 97 pgs: 97 active+clean; 85 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 279 KiB/s wr, 31 op/s 2024-05-10T10:58:27.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:27 smithi184 ceph-mon[34585]: pgmap v471: 97 pgs: 97 active+clean; 85 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 279 KiB/s wr, 31 op/s 2024-05-10T10:58:27.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:27 smithi107 ceph-mon[30373]: pgmap v471: 97 pgs: 97 active+clean; 85 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 279 KiB/s wr, 31 op/s 2024-05-10T10:58:29.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:29 smithi196 ceph-mon[34872]: pgmap v472: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 309 KiB/s wr, 32 op/s 2024-05-10T10:58:29.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:29 smithi184 ceph-mon[34585]: pgmap v472: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 309 KiB/s wr, 32 op/s 2024-05-10T10:58:29.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:29 smithi107 ceph-mon[30373]: pgmap v472: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 309 KiB/s wr, 32 op/s 2024-05-10T10:58:31.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:31 smithi196 ceph-mon[34872]: pgmap v473: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 309 KiB/s wr, 32 op/s 2024-05-10T10:58:31.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:31 smithi184 ceph-mon[34585]: pgmap v473: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 309 KiB/s wr, 32 op/s 2024-05-10T10:58:31.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:31 smithi107 ceph-mon[30373]: pgmap v473: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 309 KiB/s wr, 32 op/s 2024-05-10T10:58:33.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:33 smithi196 ceph-mon[34872]: pgmap v474: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 312 KiB/s wr, 34 op/s 2024-05-10T10:58:33.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:58:33.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:58:33.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:58:33.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:33 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:58:33.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:33 smithi184 ceph-mon[34585]: pgmap v474: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 312 KiB/s wr, 34 op/s 2024-05-10T10:58:33.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:58:33.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:58:33.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:58:33.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:33 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:58:33.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:33 smithi107 ceph-mon[30373]: pgmap v474: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 312 KiB/s wr, 34 op/s 2024-05-10T10:58:33.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:58:33.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:58:33.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:58:33.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:33 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:58:35.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:35 smithi196 ceph-mon[34872]: pgmap v475: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 298 KiB/s wr, 31 op/s 2024-05-10T10:58:35.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:35 smithi184 ceph-mon[34585]: pgmap v475: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 298 KiB/s wr, 31 op/s 2024-05-10T10:58:35.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:35 smithi107 ceph-mon[30373]: pgmap v475: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 298 KiB/s wr, 31 op/s 2024-05-10T10:58:37.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:37 smithi196 ceph-mon[34872]: pgmap v476: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 242 KiB/s wr, 29 op/s 2024-05-10T10:58:37.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:37 smithi184 ceph-mon[34585]: pgmap v476: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 242 KiB/s wr, 29 op/s 2024-05-10T10:58:37.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:37 smithi107 ceph-mon[30373]: pgmap v476: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 242 KiB/s wr, 29 op/s 2024-05-10T10:58:39.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:39 smithi196 ceph-mon[34872]: pgmap v477: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-05-10T10:58:39.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:39 smithi184 ceph-mon[34585]: pgmap v477: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-05-10T10:58:39.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:39 smithi107 ceph-mon[30373]: pgmap v477: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-05-10T10:58:41.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:41 smithi196 ceph-mon[34872]: pgmap v478: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-05-10T10:58:41.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:41 smithi184 ceph-mon[34585]: pgmap v478: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-05-10T10:58:41.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:41 smithi107 ceph-mon[30373]: pgmap v478: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-05-10T10:58:43.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:43 smithi196 ceph-mon[34872]: pgmap v479: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-05-10T10:58:43.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:43 smithi184 ceph-mon[34585]: pgmap v479: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-05-10T10:58:43.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:43 smithi107 ceph-mon[30373]: pgmap v479: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-05-10T10:58:45.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:45 smithi196 ceph-mon[34872]: pgmap v480: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 9 op/s 2024-05-10T10:58:45.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:45 smithi184 ceph-mon[34585]: pgmap v480: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 9 op/s 2024-05-10T10:58:45.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:45 smithi107 ceph-mon[30373]: pgmap v480: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 9 op/s 2024-05-10T10:58:47.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:47 smithi196 ceph-mon[34872]: pgmap v481: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 12 op/s 2024-05-10T10:58:47.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:47 smithi184 ceph-mon[34585]: pgmap v481: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 12 op/s 2024-05-10T10:58:47.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:47 smithi107 ceph-mon[30373]: pgmap v481: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 12 op/s 2024-05-10T10:58:49.642 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:49 smithi184 ceph-mon[34585]: pgmap v482: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-05-10T10:58:49.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:49 smithi107 ceph-mon[30373]: pgmap v482: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-05-10T10:58:49.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:49 smithi196 ceph-mon[34872]: pgmap v482: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-05-10T10:58:51.615 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:51 smithi196 ceph-mon[34872]: pgmap v483: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 9 op/s 2024-05-10T10:58:51.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:51 smithi184 ceph-mon[34585]: pgmap v483: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 9 op/s 2024-05-10T10:58:51.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:51 smithi107 ceph-mon[30373]: pgmap v483: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 9 op/s 2024-05-10T10:58:53.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:53 smithi184 ceph-mon[34585]: pgmap v484: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-10T10:58:53.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:53 smithi107 ceph-mon[30373]: pgmap v484: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-10T10:58:53.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:53 smithi196 ceph-mon[34872]: pgmap v484: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-10T10:58:55.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:55 smithi184 ceph-mon[34585]: pgmap v485: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-10T10:58:55.675 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:55 smithi107 ceph-mon[30373]: pgmap v485: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-10T10:58:55.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:55 smithi196 ceph-mon[34872]: pgmap v485: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-10T10:58:57.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:57 smithi184 ceph-mon[34585]: pgmap v486: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:58:57.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:57 smithi107 ceph-mon[30373]: pgmap v486: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:58:57.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:57 smithi196 ceph-mon[34872]: pgmap v486: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:58:59.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:58:59 smithi184 ceph-mon[34585]: pgmap v487: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:58:59.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:58:59 smithi107 ceph-mon[30373]: pgmap v487: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:58:59.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:58:59 smithi196 ceph-mon[34872]: pgmap v487: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:59:01.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:01 smithi184 ceph-mon[34585]: pgmap v488: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:59:01.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:01 smithi107 ceph-mon[30373]: pgmap v488: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:59:01.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:01 smithi196 ceph-mon[34872]: pgmap v488: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:59:03.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:03 smithi184 ceph-mon[34585]: pgmap v489: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:59:03.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:03 smithi107 ceph-mon[30373]: pgmap v489: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:59:03.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:03 smithi196 ceph-mon[34872]: pgmap v489: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:59:05.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:05 smithi184 ceph-mon[34585]: pgmap v490: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-10T10:59:05.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:05 smithi107 ceph-mon[30373]: pgmap v490: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-10T10:59:05.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:05 smithi196 ceph-mon[34872]: pgmap v490: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-10T10:59:07.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:07 smithi184 ceph-mon[34585]: pgmap v491: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:59:07.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:07 smithi107 ceph-mon[30373]: pgmap v491: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:59:07.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:07 smithi196 ceph-mon[34872]: pgmap v491: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:59:09.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:09 smithi184 ceph-mon[34585]: pgmap v492: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:59:09.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:09 smithi107 ceph-mon[30373]: pgmap v492: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:59:09.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:09 smithi196 ceph-mon[34872]: pgmap v492: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:59:11.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:11 smithi184 ceph-mon[34585]: pgmap v493: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:59:11.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:11 smithi107 ceph-mon[30373]: pgmap v493: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:59:11.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:11 smithi196 ceph-mon[34872]: pgmap v493: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:59:13.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:13 smithi184 ceph-mon[34585]: pgmap v494: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:59:13.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:13 smithi107 ceph-mon[30373]: pgmap v494: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:59:13.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:13 smithi196 ceph-mon[34872]: pgmap v494: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-10T10:59:15.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:15 smithi184 ceph-mon[34585]: pgmap v495: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-10T10:59:15.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:15 smithi107 ceph-mon[30373]: pgmap v495: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-10T10:59:15.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:15 smithi196 ceph-mon[34872]: pgmap v495: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-10T10:59:17.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:17 smithi184 ceph-mon[34585]: pgmap v496: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:59:17.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:17 smithi107 ceph-mon[30373]: pgmap v496: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:59:17.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:17 smithi196 ceph-mon[34872]: pgmap v496: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T10:59:19.517 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-05-10T10:59:19.548 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-05-10T10:59:19.552 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-05-10T10:59:19.553 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-05-10T10:59:19.554 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.553+0000 7f7a5cff9640 1 -- 172.21.15.107:0/2512275940 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55715b2e3050 con 0x55715b3f7550 2024-05-10T10:59:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.553+0000 7f7a5cff9640 10 client.15657 handle_command_reply: tid=0 2024-05-10T10:59:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.553+0000 7f7a7e683740 1 client.15657 shutdown 2024-05-10T10:59:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.553+0000 7f7a7e683740 1 -- 172.21.15.107:0/2512275940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 msgr2=0x55715b384e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.553+0000 7f7a7e683740 1 --2- 172.21.15.107:0/2512275940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 0x55715b384e50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000bcb0 tx=0x7f7a70011a10 comp rx=0 tx=0).stop 2024-05-10T10:59:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7a7e683740 1 -- 172.21.15.107:0/2512275940 shutdown_connections 2024-05-10T10:59:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7a7e683740 1 --2- 172.21.15.107:0/2512275940 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55715b3f7550 0x55715b3f9970 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7a7e683740 1 --2- 172.21.15.107:0/2512275940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55715b37c910 0x55715b3863a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7a7e683740 1 --2- 172.21.15.107:0/2512275940 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55715b3777a0 0x55715b385390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7a7e683740 1 --2- 172.21.15.107:0/2512275940 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55715b376db0 0x55715b384e50 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7a5cff9640 0 client.15657 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:59:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7a7e683740 1 -- 172.21.15.107:0/2512275940 >> 172.21.15.107:0/2512275940 conn(0x55715b372420 msgr2=0x55715b378980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7a7e683740 1 -- 172.21.15.107:0/2512275940 shutdown_connections 2024-05-10T10:59:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7a7e683740 1 -- 172.21.15.107:0/2512275940 wait complete. 2024-05-10T10:59:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7a7e683740 20 client.15657 trim_cache size 0 max 16384 2024-05-10T10:59:19.556 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:{ 2024-05-10T10:59:19.556 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "message": "", 2024-05-10T10:59:19.556 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "return_code": 0 2024-05-10T10:59:19.556 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:} 2024-05-10T10:59:19.556 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-05-10T10:59:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.555+0000 7f7a7b96a640 1 -- 172.21.15.107:0/3083928560 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7a600b28a0 msgr2=0x7f7a600b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.555+0000 7f7a7b96a640 1 --2- 172.21.15.107:0/3083928560 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7a600b28a0 0x7f7a600b4d60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c031ba0 tx=0x7f7a6c009360 comp rx=0 tx=0).stop 2024-05-10T10:59:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.555+0000 7f7a7b96a640 1 -- 172.21.15.107:0/3083928560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a74103c30 msgr2=0x7f7a74074da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.555+0000 7f7a7b96a640 1 --2- 172.21.15.107:0/3083928560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a74103c30 0x7f7a74074da0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800d950 tx=0x7f7a6800de10 comp rx=0 tx=0).stop 2024-05-10T10:59:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.555+0000 7f7a7b96a640 1 -- 172.21.15.107:0/3083928560 shutdown_connections 2024-05-10T10:59:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.555+0000 7f7a7b96a640 1 --2- 172.21.15.107:0/3083928560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a741045f0 0x7f7a740752e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.555+0000 7f7a7b96a640 1 --2- 172.21.15.107:0/3083928560 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f7a600b28a0 0x7f7a600b4d60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.555+0000 7f7a7b96a640 1 --2- 172.21.15.107:0/3083928560 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7a74103c30 0x7f7a74074da0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.555+0000 7f7a7b96a640 1 --2- 172.21.15.107:0/3083928560 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7a74102a40 0x7f7a74076710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.555+0000 7f7a7b96a640 1 -- 172.21.15.107:0/3083928560 >> 172.21.15.107:0/3083928560 conn(0x7f7a740fdfd0 msgr2=0x7f7a74106ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.555+0000 7f7a7b96a640 1 -- 172.21.15.107:0/3083928560 shutdown_connections 2024-05-10T10:59:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:19.555+0000 7f7a7b96a640 1 -- 172.21.15.107:0/3083928560 wait complete. 2024-05-10T10:59:19.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7ba9ffb700 1 -- 172.21.15.107:0/4241434153 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5615e0933750 con 0x5615e0981230 2024-05-10T10:59:19.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7ba9ffb700 10 client.15675 handle_command_reply: tid=0 2024-05-10T10:59:19.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7bd3621b80 1 client.15675 shutdown 2024-05-10T10:59:19.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7bd3621b80 1 -- 172.21.15.107:0/4241434153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 msgr2=0x5615e0970a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:19.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/4241434153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e0970a40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80e09b0 tx=0x7f7bb80044c0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7bd3621b80 1 -- 172.21.15.107:0/4241434153 shutdown_connections 2024-05-10T10:59:19.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/4241434153 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e0967dc0 0x5615e0973630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/4241434153 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5615e0981230 0x5615e0983650 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/4241434153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e096c8c0 0x5615e0970f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7ba9ffb700 0 client.15675 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:59:19.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/4241434153 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e0970a40 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7bd3621b80 1 -- 172.21.15.107:0/4241434153 >> 172.21.15.107:0/4241434153 conn(0x5615e0893200 msgr2=0x5615e0960da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:19.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7bd3621b80 1 -- 172.21.15.107:0/4241434153 shutdown_connections 2024-05-10T10:59:19.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.554+0000 7f7bd3621b80 1 -- 172.21.15.107:0/4241434153 wait complete. 2024-05-10T10:59:19.559 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.555+0000 7f7bd3621b80 20 client.15675 trim_cache size 0 max 16384 2024-05-10T10:59:19.560 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-05-10T10:59:19.560 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-05-10T10:59:19.560 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-05-10T10:59:19.560 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-05-10T10:59:19.560 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-05-10T10:59:19.561 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-05-10T10:59:19.561 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-05-10T10:59:19.562 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-05-10T10:59:19.564 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-05-10T10:59:19.565 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-05-10T10:59:19.566 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-05-10T10:59:19.567 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-05-10T10:59:19.568 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-05-10T10:59:19.569 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-05-10T10:59:19.570 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-05-10T10:59:19.571 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-05-10T10:59:19.572 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-05-10T10:59:19.572 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-05-10T10:59:19.573 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-05-10T10:59:19.574 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-05-10T10:59:19.576 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-05-10T10:59:19.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.576+0000 7f7bd3621b80 1 Processor -- start 2024-05-10T10:59:19.577 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.576+0000 7f7bd3621b80 1 -- start start 2024-05-10T10:59:19.577 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-05-10T10:59:19.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.577+0000 7f7bd3621b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e0967dc0 0x5615e097d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:19.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.577+0000 7f7bd3621b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e0966790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:19.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.577+0000 7f7bd3621b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e096c8c0 0x5615e0972800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:19.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.577+0000 7f7bd3621b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc41ada40 con 0x5615e096bfa0 2024-05-10T10:59:19.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.577+0000 7f7bd3621b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc41af5b0 con 0x5615e096c8c0 2024-05-10T10:59:19.578 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.577+0000 7f7bd3621b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc41ae110 con 0x5615e0967dc0 2024-05-10T10:59:19.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.577+0000 7f7bc1d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e0966790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:19.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.577+0000 7f7bc1d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e0966790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:42336/0 (socket says 172.21.15.107:42336) 2024-05-10T10:59:19.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.577+0000 7f7bc1d9b700 1 -- 172.21.15.107:0/3702608788 learned_addr learned my addr 172.21.15.107:0/3702608788 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:59:19.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.577+0000 7f7bc2d9d700 1 --2- 172.21.15.107:0/3702608788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e096c8c0 0x5615e0972800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:19.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.577+0000 7f7bc259c700 1 --2- 172.21.15.107:0/3702608788 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e0967dc0 0x5615e097d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:19.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.577+0000 7f7bc1d9b700 1 -- 172.21.15.107:0/3702608788 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e0967dc0 msgr2=0x5615e097d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:19.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.577+0000 7f7bc1d9b700 1 --2- 172.21.15.107:0/3702608788 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e0967dc0 0x5615e097d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.577+0000 7f7bc1d9b700 1 -- 172.21.15.107:0/3702608788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e096c8c0 msgr2=0x5615e0972800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:19.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.577+0000 7f7bc1d9b700 1 --2- 172.21.15.107:0/3702608788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e096c8c0 0x5615e0972800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.579 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.577+0000 7f7bc1d9b700 1 -- 172.21.15.107:0/3702608788 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615e096bbf0 con 0x5615e096bfa0 2024-05-10T10:59:19.579 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-05-10T10:59:19.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.577+0000 7f7bc1d9b700 1 --2- 172.21.15.107:0/3702608788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e0966790 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80a65e0 tx=0x7f7bb8086000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e747190d3c62a420 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:19.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.578+0000 7f7babfff700 1 -- 172.21.15.107:0/3702608788 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8090070 con 0x5615e096bfa0 2024-05-10T10:59:19.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.578+0000 7f7babfff700 1 -- 172.21.15.107:0/3702608788 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7bb80a6b50 con 0x5615e096bfa0 2024-05-10T10:59:19.580 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.578+0000 7f7babfff700 1 -- 172.21.15.107:0/3702608788 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8088070 con 0x5615e096bfa0 2024-05-10T10:59:19.580 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-05-10T10:59:19.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.578+0000 7f7bd3621b80 1 -- 172.21.15.107:0/3702608788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 msgr2=0x5615e0966790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:19.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.578+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/3702608788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e0966790 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80a65e0 tx=0x7f7bb8086000 comp rx=0 tx=0).stop 2024-05-10T10:59:19.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.578+0000 7f7bd3621b80 1 -- 172.21.15.107:0/3702608788 shutdown_connections 2024-05-10T10:59:19.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.578+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/3702608788 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e0967dc0 0x5615e097d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.578+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/3702608788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e096c8c0 0x5615e0972800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.578+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/3702608788 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e0966790 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.578+0000 7f7bd3621b80 1 -- 172.21.15.107:0/3702608788 >> 172.21.15.107:0/3702608788 conn(0x5615e0893200 msgr2=0x5615e09720f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:19.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.579+0000 7f7bd3621b80 1 -- 172.21.15.107:0/3702608788 shutdown_connections 2024-05-10T10:59:19.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.579+0000 7f7bd3621b80 1 -- 172.21.15.107:0/3702608788 wait complete. 2024-05-10T10:59:19.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.579+0000 7f7bd3621b80 1 -- start start 2024-05-10T10:59:19.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.579+0000 7f7bd3621b80 1 Processor -- start 2024-05-10T10:59:19.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.579+0000 7f7bd3621b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e0967dc0 0x5615e0979c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:19.582 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.579+0000 7f7bd3621b80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e0976050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:19.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.579+0000 7f7bd3621b80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e096c8c0 0x5615e0976590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:19.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.579+0000 7f7bd3621b80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc41aeeb0 con 0x5615e096bfa0 2024-05-10T10:59:19.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.579+0000 7f7bd3621b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc41ae7e0 con 0x5615e0967dc0 2024-05-10T10:59:19.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.579+0000 7f7bd3621b80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc41aba40 con 0x5615e096c8c0 2024-05-10T10:59:19.583 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.579+0000 7f7bd3621b80 10 client.0 _ll_register_callbacks cb 0x5615e0851a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:59:19.583 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-05-10T10:59:19.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.579+0000 7f7bc1d9b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e0976050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:19.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.580+0000 7f7bc259c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e0967dc0 0x5615e0979c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:19.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.580+0000 7f7bc259c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e0967dc0 0x5615e0979c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.107:35806/0 (socket says 172.21.15.107:35806) 2024-05-10T10:59:19.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.580+0000 7f7bc259c700 1 -- 172.21.15.107:0/277489947 learned_addr learned my addr 172.21.15.107:0/277489947 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:59:19.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.580+0000 7f7bc2d9d700 1 --2- 172.21.15.107:0/277489947 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e096c8c0 0x5615e0976590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:19.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.580+0000 7f7bc259c700 1 -- 172.21.15.107:0/277489947 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e096c8c0 msgr2=0x5615e0976590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:19.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.580+0000 7f7bc259c700 1 --2- 172.21.15.107:0/277489947 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e096c8c0 0x5615e0976590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.584 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.580+0000 7f7bc259c700 1 -- 172.21.15.107:0/277489947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 msgr2=0x5615e0976050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:19.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.580+0000 7f7bc259c700 1 --2- 172.21.15.107:0/277489947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e0976050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.580+0000 7f7bc259c700 1 -- 172.21.15.107:0/277489947 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615e0976c90 con 0x5615e0967dc0 2024-05-10T10:59:19.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.580+0000 7f7bc259c700 1 --2- 172.21.15.107:0/277489947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e0967dc0 0x5615e0979c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4009390 tx=0x7f7bb40095e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2adc78a53577fdf5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:19.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.580+0000 7f7ba9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-05-10T10:59:19.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.580+0000 7f7ba9ffb700 1 -- 172.21.15.107:0/277489947 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4033070 con 0x5615e0967dc0 2024-05-10T10:59:19.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.580+0000 7f7bd3621b80 1 -- 172.21.15.107:0/277489947 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bb80a6b50 con 0x5615e0967dc0 2024-05-10T10:59:19.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.580+0000 7f7ba9ffb700 1 -- 172.21.15.107:0/277489947 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f7bb4014910 con 0x5615e0967dc0 2024-05-10T10:59:19.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.580+0000 7f7ba9ffb700 1 -- 172.21.15.107:0/277489947 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7bb403e050 con 0x5615e0967dc0 2024-05-10T10:59:19.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.581+0000 7f7bd3621b80 10 client.25196 fetch_fsmap learned FSMap version 28 2024-05-10T10:59:19.585 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.581+0000 7f7bd3621b80 1 -- 172.21.15.107:0/277489947 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5615e09eca50 con 0x5615e0967dc0 2024-05-10T10:59:19.585 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-05-10T10:59:19.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.581+0000 7f7ba9ffb700 1 -- 172.21.15.107:0/277489947 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7bb80a6b50 con 0x5615e0967dc0 2024-05-10T10:59:19.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.581+0000 7f7ba9ffb700 1 -- 172.21.15.107:0/277489947 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f7bb4013070 con 0x5615e0967dc0 2024-05-10T10:59:19.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.581+0000 7f7bd3621b80 10 client.25196 fetch_fsmap finished waiting for FSMap version 28 2024-05-10T10:59:19.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.581+0000 7f7bd3621b80 10 client.25196 resolve_mds: validated gid 24482 aka daemon mds.b 2024-05-10T10:59:19.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.581+0000 7f7bd3621b80 20 client.25196 populate_metadata read hostname 'smithi107' 2024-05-10T10:59:19.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.581+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/277489947 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5615e09ecfd0 0x5615e09ef3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:19.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.581+0000 7f7bd3621b80 4 client.25196 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "25edc73", "release": true, "await": true}] 2024-05-10T10:59:19.587 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.581+0000 7f7bd3621b80 1 -- 172.21.15.107:0/277489947 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "quiesce db", "set_id": "25edc73", "release": true, "await": true}) -- 0x5615e08c7340 con 0x5615e09ecfd0 2024-05-10T10:59:19.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.581+0000 7f7bc1d9b700 1 --2- 172.21.15.107:0/277489947 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5615e09ecfd0 0x5615e09ef3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:19.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.582+0000 7f7bc1d9b700 1 --2- 172.21.15.107:0/277489947 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5615e09ecfd0 0x5615e09ef3f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39faa2f403d6b54d server_cookie=f1feaffa47afd846 in_seq=0 out_seq=0 2024-05-10T10:59:19.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.582+0000 7f7ba9ffb700 10 client.25196 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:59:19.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.582+0000 7f7ba9ffb700 1 -- 172.21.15.107:0/277489947 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: -1 ) ==== 8+0+589 (crc 0 0 0) 0x5615e08c7340 con 0x5615e09ecfd0 2024-05-10T10:59:19.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.582+0000 7f7ba9ffb700 10 client.25196 handle_command_reply: tid=0 2024-05-10T10:59:19.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.582+0000 7f7bd3621b80 1 client.25196 shutdown 2024-05-10T10:59:19.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.582+0000 7f7bd3621b80 1 -- 172.21.15.107:0/277489947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e0967dc0 msgr2=0x5615e0979c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:19.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.582+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/277489947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e0967dc0 0x5615e0979c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4009390 tx=0x7f7bb40095e0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.582+0000 7f7bd3621b80 1 -- 172.21.15.107:0/277489947 shutdown_connections 2024-05-10T10:59:19.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.582+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/277489947 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5615e096c8c0 0x5615e0976590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.582+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/277489947 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5615e09ecfd0 0x5615e09ef3f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.582+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/277489947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5615e0967dc0 0x5615e0979c50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.582+0000 7f7bd3621b80 1 --2- 172.21.15.107:0/277489947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5615e096bfa0 0x5615e0976050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:19.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.582+0000 7f7ba9ffb700 0 client.25196 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:59:19.588 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.582+0000 7f7bd3621b80 1 -- 172.21.15.107:0/277489947 >> 172.21.15.107:0/277489947 conn(0x5615e0893200 msgr2=0x5615e096b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:19.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.582+0000 7f7bd3621b80 1 -- 172.21.15.107:0/277489947 shutdown_connections 2024-05-10T10:59:19.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.582+0000 7f7bd3621b80 1 -- 172.21.15.107:0/277489947 wait complete. 2024-05-10T10:59:19.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T10:59:19.582+0000 7f7bd3621b80 20 client.25196 trim_cache size 0 max 16384 2024-05-10T10:59:19.589 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T10:59:19.589 INFO:teuthology.orchestra.run.smithi107.stdout: "epoch": 28, 2024-05-10T10:59:19.589 INFO:teuthology.orchestra.run.smithi107.stdout: "leader": 24482, 2024-05-10T10:59:19.589 INFO:teuthology.orchestra.run.smithi107.stdout: "set_version": 11, 2024-05-10T10:59:19.589 INFO:teuthology.orchestra.run.smithi107.stdout: "sets": { 2024-05-10T10:59:19.589 INFO:teuthology.orchestra.run.smithi107.stdout: "25edc73": { 2024-05-10T10:59:19.589 INFO:teuthology.orchestra.run.smithi107.stdout: "version": 11, 2024-05-10T10:59:19.590 INFO:teuthology.orchestra.run.smithi107.stdout: "age_ref": 0.1, 2024-05-10T10:59:19.590 INFO:teuthology.orchestra.run.smithi107.stdout: "state": { 2024-05-10T10:59:19.590 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "EXPIRED", 2024-05-10T10:59:19.590 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0 2024-05-10T10:59:19.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T10:59:19.590 INFO:teuthology.orchestra.run.smithi107.stdout: "timeout": 60.0, 2024-05-10T10:59:19.590 INFO:teuthology.orchestra.run.smithi107.stdout: "expiration": 86.7, 2024-05-10T10:59:19.590 INFO:teuthology.orchestra.run.smithi107.stdout: "members": { 2024-05-10T10:59:19.590 INFO:teuthology.orchestra.run.smithi107.stdout: "file:/": { 2024-05-10T10:59:19.590 INFO:teuthology.orchestra.run.smithi107.stdout: "excluded": false, 2024-05-10T10:59:19.590 INFO:teuthology.orchestra.run.smithi107.stdout: "state": { 2024-05-10T10:59:19.590 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "QUIESCED", 2024-05-10T10:59:19.590 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.7 2024-05-10T10:59:19.590 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:59:19.590 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:59:19.591 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:59:19.591 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:59:19.591 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T10:59:19.591 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T10:59:19.591 INFO:teuthology.orchestra.run.smithi107.stderr:Error EPERM: 2024-05-10T10:59:19.592 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-05-10T10:59:19.592 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-05-10T10:59:19.592 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-05-10T10:59:19.592 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/EDID/ 2024-05-10T10:59:19.592 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-05-10T10:59:19.592 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-05-10T10:59:19.592 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-05-10T10:59:19.593 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-05-10T10:59:19.593 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-05-10T10:59:19.593 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-05-10T10:59:19.593 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-05-10T10:59:19.594 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-05-10T10:59:19.595 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-05-10T10:59:19.595 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/EDID/hex 2024-05-10T10:59:19.596 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/HOWTO 2024-05-10T10:59:19.597 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-05-10T10:59:19.598 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-05-10T10:59:19.599 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-05-10T10:59:19.600 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-05-10T10:59:19.601 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-05-10T10:59:19.602 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/Makefile 2024-05-10T10:59:19.603 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-05-10T10:59:19.604 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/PCI/ 2024-05-10T10:59:19.605 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-05-10T10:59:19.606 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-05-10T10:59:19.607 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-05-10T10:59:19.608 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-05-10T10:59:19.608 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-05-10T10:59:19.609 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-05-10T10:59:19.610 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-05-10T10:59:19.611 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/RCU/ 2024-05-10T10:59:19.613 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-05-10T10:59:19.613 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-05-10T10:59:19.614 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-05-10T10:59:19.615 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-05-10T10:59:19.616 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-05-10T10:59:19.617 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-05-10T10:59:19.618 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-05-10T10:59:19.619 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-05-10T10:59:19.620 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-05-10T10:59:19.621 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-05-10T10:59:19.623 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-05-10T10:59:19.624 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-05-10T10:59:19.625 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-05-10T10:59:19.626 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-05-10T10:59:19.626 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-05-10T10:59:19.627 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-05-10T10:59:19.628 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-05-10T10:59:19.629 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-05-10T10:59:19.630 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/SAK.txt 2024-05-10T10:59:19.631 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/SM501.txt 2024-05-10T10:59:19.632 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-05-10T10:59:19.633 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-05-10T10:59:19.634 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-05-10T10:59:19.635 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-05-10T10:59:19.636 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-05-10T10:59:19.637 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/accounting/ 2024-05-10T10:59:19.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:19 smithi184 ceph-mon[34585]: pgmap v497: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:59:19.638 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-05-10T10:59:19.639 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-05-10T10:59:19.640 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-05-10T10:59:19.641 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-05-10T10:59:19.641 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-05-10T10:59:19.642 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-05-10T10:59:19.643 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-05-10T10:59:19.644 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/acpi/ 2024-05-10T10:59:19.645 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-05-10T10:59:19.646 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-05-10T10:59:19.647 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-05-10T10:59:19.648 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-05-10T10:59:19.649 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-05-10T10:59:19.649 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-05-10T10:59:19.650 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-05-10T10:59:19.651 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-05-10T10:59:19.652 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-05-10T10:59:19.653 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-05-10T10:59:19.654 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-05-10T10:59:19.655 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-05-10T10:59:19.656 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-05-10T10:59:19.657 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/aoe/ 2024-05-10T10:59:19.659 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-05-10T10:59:19.660 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-05-10T10:59:19.661 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-05-10T10:59:19.661 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-05-10T10:59:19.662 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-05-10T10:59:19.663 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-05-10T10:59:19.664 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-05-10T10:59:19.665 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/ 2024-05-10T10:59:19.667 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-05-10T10:59:19.668 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-05-10T10:59:19.669 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-05-10T10:59:19.670 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Booting 2024-05-10T10:59:19.671 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-05-10T10:59:19.672 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-05-10T10:59:19.672 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-05-10T10:59:19.673 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-05-10T10:59:19.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:19 smithi107 ceph-mon[30373]: pgmap v497: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:59:19.674 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-05-10T10:59:19.675 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-05-10T10:59:19.676 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-05-10T10:59:19.677 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-05-10T10:59:19.677 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-05-10T10:59:19.678 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-05-10T10:59:19.679 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Porting 2024-05-10T10:59:19.680 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/README 2024-05-10T10:59:19.681 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-05-10T10:59:19.682 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-05-10T10:59:19.683 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-05-10T10:59:19.683 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-05-10T10:59:19.684 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-05-10T10:59:19.685 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-05-10T10:59:19.686 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-05-10T10:59:19.687 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-05-10T10:59:19.688 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-05-10T10:59:19.689 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-05-10T10:59:19.691 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-05-10T10:59:19.692 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-05-10T10:59:19.693 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-05-10T10:59:19.694 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-05-10T10:59:19.695 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-05-10T10:59:19.696 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-05-10T10:59:19.697 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-05-10T10:59:19.698 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-05-10T10:59:19.699 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-05-10T10:59:19.700 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-05-10T10:59:19.701 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-05-10T10:59:19.702 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-05-10T10:59:19.703 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-05-10T10:59:19.703 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-05-10T10:59:19.704 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-05-10T10:59:19.705 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-05-10T10:59:19.706 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-05-10T10:59:19.707 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-05-10T10:59:19.708 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-05-10T10:59:19.709 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-05-10T10:59:19.709 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-05-10T10:59:19.710 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-05-10T10:59:19.711 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-05-10T10:59:19.712 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-05-10T10:59:19.713 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-05-10T10:59:19.714 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-05-10T10:59:19.715 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-05-10T10:59:19.716 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-05-10T10:59:19.716 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-05-10T10:59:19.717 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-05-10T10:59:19.718 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-05-10T10:59:19.719 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-05-10T10:59:19.720 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-05-10T10:59:19.721 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/Setup 2024-05-10T10:59:19.722 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-05-10T10:59:19.722 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-05-10T10:59:19.723 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-05-10T10:59:19.725 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-05-10T10:59:19.726 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-05-10T10:59:19.727 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-05-10T10:59:19.728 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-05-10T10:59:19.728 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-05-10T10:59:19.729 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-05-10T10:59:19.730 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-05-10T10:59:19.731 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-05-10T10:59:19.732 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-05-10T10:59:19.733 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-05-10T10:59:19.733 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-05-10T10:59:19.734 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-05-10T10:59:19.735 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-05-10T10:59:19.736 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-05-10T10:59:19.737 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-05-10T10:59:19.738 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-05-10T10:59:19.739 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-05-10T10:59:19.739 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-05-10T10:59:19.740 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-05-10T10:59:19.741 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-05-10T10:59:19.742 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-05-10T10:59:19.743 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-05-10T10:59:19.744 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-05-10T10:59:19.745 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-05-10T10:59:19.746 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-05-10T10:59:19.746 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-05-10T10:59:19.747 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-05-10T10:59:19.749 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm64/ 2024-05-10T10:59:19.750 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-05-10T10:59:19.751 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-05-10T10:59:19.752 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-05-10T10:59:19.752 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-05-10T10:59:19.753 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-05-10T10:59:19.754 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-05-10T10:59:19.755 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-05-10T10:59:19.762 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-05-10T10:59:19.763 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-05-10T10:59:19.764 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-05-10T10:59:19.765 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-05-10T10:59:19.766 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-05-10T10:59:19.767 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/backlight/ 2024-05-10T10:59:19.769 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-05-10T10:59:19.769 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-05-10T10:59:19.770 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-05-10T10:59:19.771 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/bcache.txt 2024-05-10T10:59:19.772 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-05-10T10:59:19.774 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blackfin/ 2024-05-10T10:59:19.775 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-05-10T10:59:19.776 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-05-10T10:59:19.777 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-05-10T10:59:19.778 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-05-10T10:59:19.778 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-05-10T10:59:19.779 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/block/ 2024-05-10T10:59:19.781 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-05-10T10:59:19.782 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-05-10T10:59:19.783 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-05-10T10:59:19.784 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-05-10T10:59:19.785 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-05-10T10:59:19.786 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-05-10T10:59:19.788 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-05-10T10:59:19.788 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-05-10T10:59:19.788 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-05-10T10:59:19.789 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-05-10T10:59:19.790 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-05-10T10:59:19.791 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/block/request.txt 2024-05-10T10:59:19.792 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-05-10T10:59:19.793 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-05-10T10:59:19.794 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-05-10T10:59:19.795 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/ 2024-05-10T10:59:19.797 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-05-10T10:59:19.797 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-05-10T10:59:19.798 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-05-10T10:59:19.799 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-05-10T10:59:19.800 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-05-10T10:59:19.801 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-05-10T10:59:19.802 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-05-10T10:59:19.803 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-05-10T10:59:19.804 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-05-10T10:59:19.805 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-05-10T10:59:19.806 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-05-10T10:59:19.806 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-05-10T10:59:19.807 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-05-10T10:59:19.808 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-05-10T10:59:19.809 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-05-10T10:59:19.810 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-05-10T10:59:19.811 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-05-10T10:59:19.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:19 smithi196 ceph-mon[34872]: pgmap v497: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T10:59:19.813 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-05-10T10:59:19.813 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-05-10T10:59:19.815 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-05-10T10:59:19.816 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-05-10T10:59:19.817 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-05-10T10:59:19.818 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-05-10T10:59:19.819 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-05-10T10:59:19.820 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-05-10T10:59:19.821 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-05-10T10:59:19.822 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cdrom/ 2024-05-10T10:59:19.823 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-05-10T10:59:19.824 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-05-10T10:59:19.824 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-05-10T10:59:19.825 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-05-10T10:59:19.826 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-05-10T10:59:19.828 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cgroups/ 2024-05-10T10:59:19.829 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-05-10T10:59:19.830 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-05-10T10:59:19.830 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-05-10T10:59:19.835 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-05-10T10:59:19.835 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-05-10T10:59:19.835 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-05-10T10:59:19.835 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-05-10T10:59:19.836 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-05-10T10:59:19.836 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-05-10T10:59:19.837 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-05-10T10:59:19.838 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-05-10T10:59:19.839 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-05-10T10:59:19.840 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-05-10T10:59:19.841 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-05-10T10:59:19.842 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/clk.txt 2024-05-10T10:59:19.843 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-05-10T10:59:19.844 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/connector/ 2024-05-10T10:59:19.845 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-05-10T10:59:19.846 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-05-10T10:59:19.846 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-05-10T10:59:19.847 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-05-10T10:59:19.848 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-05-10T10:59:19.849 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/console/ 2024-05-10T10:59:19.850 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/console/console.txt 2024-05-10T10:59:19.851 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-05-10T10:59:19.852 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-05-10T10:59:19.853 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-05-10T10:59:19.854 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-05-10T10:59:19.855 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-05-10T10:59:19.856 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-05-10T10:59:19.857 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-05-10T10:59:19.858 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-05-10T10:59:19.859 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-05-10T10:59:19.860 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-05-10T10:59:19.861 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-05-10T10:59:19.862 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-05-10T10:59:19.863 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-05-10T10:59:19.864 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-05-10T10:59:19.865 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-05-10T10:59:19.867 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-05-10T10:59:19.868 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-05-10T10:59:19.869 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-05-10T10:59:19.869 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-05-10T10:59:19.870 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-05-10T10:59:19.871 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/crc32.txt 2024-05-10T10:59:19.872 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cris/ 2024-05-10T10:59:19.874 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/cris/README 2024-05-10T10:59:19.875 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/crypto/ 2024-05-10T10:59:19.876 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-05-10T10:59:19.877 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-05-10T10:59:19.878 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-05-10T10:59:19.879 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-05-10T10:59:19.880 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-05-10T10:59:19.881 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-05-10T10:59:19.882 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-05-10T10:59:19.883 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-05-10T10:59:19.884 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-05-10T10:59:19.886 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/development-process/ 2024-05-10T10:59:19.887 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-05-10T10:59:19.888 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-05-10T10:59:19.889 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-05-10T10:59:19.890 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-05-10T10:59:19.891 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-05-10T10:59:19.893 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-05-10T10:59:19.893 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-05-10T10:59:19.894 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-05-10T10:59:19.895 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-05-10T10:59:19.897 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-05-10T10:59:19.898 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-05-10T10:59:19.899 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-05-10T10:59:19.900 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-05-10T10:59:19.901 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-05-10T10:59:19.902 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-05-10T10:59:19.903 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-05-10T10:59:19.904 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-05-10T10:59:19.905 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-05-10T10:59:19.906 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-05-10T10:59:19.907 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-05-10T10:59:19.908 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-05-10T10:59:19.909 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-05-10T10:59:19.909 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-05-10T10:59:19.910 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-05-10T10:59:19.911 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-05-10T10:59:19.912 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-05-10T10:59:19.913 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-05-10T10:59:19.914 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-05-10T10:59:19.915 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-05-10T10:59:19.917 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-05-10T10:59:19.917 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-05-10T10:59:19.918 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devices.txt 2024-05-10T10:59:19.920 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/ 2024-05-10T10:59:19.921 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-05-10T10:59:19.922 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-05-10T10:59:19.923 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-05-10T10:59:19.924 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-05-10T10:59:19.925 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-05-10T10:59:19.926 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-05-10T10:59:19.928 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-05-10T10:59:19.929 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-05-10T10:59:19.930 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-05-10T10:59:19.931 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-05-10T10:59:19.931 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-05-10T10:59:19.933 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-05-10T10:59:19.934 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-05-10T10:59:19.934 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-05-10T10:59:19.935 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-05-10T10:59:19.936 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-05-10T10:59:19.937 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-05-10T10:59:19.938 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-05-10T10:59:19.939 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-05-10T10:59:19.940 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-05-10T10:59:19.941 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-05-10T10:59:19.942 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-05-10T10:59:19.942 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-05-10T10:59:19.943 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-05-10T10:59:19.944 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-05-10T10:59:19.945 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-05-10T10:59:19.946 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-05-10T10:59:19.947 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-05-10T10:59:19.947 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-05-10T10:59:19.949 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-05-10T10:59:19.950 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-05-10T10:59:19.951 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-05-10T10:59:19.953 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-05-10T10:59:19.954 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-05-10T10:59:19.956 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-05-10T10:59:19.957 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-05-10T10:59:19.958 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-05-10T10:59:19.960 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-05-10T10:59:19.962 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-05-10T10:59:19.963 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-05-10T10:59:19.964 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-05-10T10:59:19.966 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-05-10T10:59:19.967 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-05-10T10:59:19.969 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-05-10T10:59:19.970 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-05-10T10:59:19.972 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-05-10T10:59:19.973 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-05-10T10:59:19.974 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-05-10T10:59:19.976 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-05-10T10:59:19.977 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-05-10T10:59:19.979 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-05-10T10:59:19.980 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-05-10T10:59:19.981 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-05-10T10:59:19.983 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-05-10T10:59:19.984 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-05-10T10:59:19.985 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-05-10T10:59:19.986 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-05-10T10:59:19.988 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-05-10T10:59:19.989 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-05-10T10:59:19.990 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-05-10T10:59:19.991 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-05-10T10:59:19.992 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-05-10T10:59:19.993 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-05-10T10:59:19.994 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-05-10T10:59:19.995 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-05-10T10:59:19.997 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-05-10T10:59:19.998 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-05-10T10:59:19.999 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-05-10T10:59:20.000 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-05-10T10:59:20.001 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-05-10T10:59:20.002 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-05-10T10:59:20.004 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-05-10T10:59:20.005 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-05-10T10:59:20.007 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-05-10T10:59:20.008 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-05-10T10:59:20.009 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-05-10T10:59:20.011 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-05-10T10:59:20.012 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-05-10T10:59:20.014 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-05-10T10:59:20.015 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-05-10T10:59:20.016 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-05-10T10:59:20.017 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-05-10T10:59:20.018 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-05-10T10:59:20.019 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-05-10T10:59:20.020 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-05-10T10:59:20.021 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-05-10T10:59:20.022 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-05-10T10:59:20.024 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-05-10T10:59:20.025 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-05-10T10:59:20.026 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-05-10T10:59:20.027 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-05-10T10:59:20.028 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-05-10T10:59:20.030 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-05-10T10:59:20.031 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-05-10T10:59:20.032 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-05-10T10:59:20.034 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-05-10T10:59:20.037 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-05-10T10:59:20.037 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-05-10T10:59:20.038 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-05-10T10:59:20.038 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-05-10T10:59:20.039 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-05-10T10:59:20.040 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-05-10T10:59:20.041 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-05-10T10:59:20.043 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-05-10T10:59:20.044 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-05-10T10:59:20.045 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-05-10T10:59:20.046 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-05-10T10:59:20.047 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-05-10T10:59:20.048 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-05-10T10:59:20.050 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-05-10T10:59:20.051 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-05-10T10:59:20.052 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-05-10T10:59:20.053 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-05-10T10:59:20.054 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-05-10T10:59:20.055 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-05-10T10:59:20.057 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-05-10T10:59:20.058 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-05-10T10:59:20.059 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-05-10T10:59:20.061 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-05-10T10:59:20.062 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-05-10T10:59:20.063 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-05-10T10:59:20.065 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-05-10T10:59:20.066 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-05-10T10:59:20.068 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-05-10T10:59:20.069 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-05-10T10:59:20.070 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-05-10T10:59:20.072 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-05-10T10:59:20.073 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-05-10T10:59:20.075 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-05-10T10:59:20.076 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-05-10T10:59:20.077 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-05-10T10:59:20.079 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-05-10T10:59:20.080 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-05-10T10:59:20.081 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-05-10T10:59:20.083 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-05-10T10:59:20.084 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-05-10T10:59:20.086 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-05-10T10:59:20.087 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-05-10T10:59:20.089 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-05-10T10:59:20.090 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-05-10T10:59:20.091 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-05-10T10:59:20.092 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-05-10T10:59:20.094 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-05-10T10:59:20.095 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-05-10T10:59:20.097 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-05-10T10:59:20.098 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-05-10T10:59:20.100 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-05-10T10:59:20.101 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-05-10T10:59:20.102 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-05-10T10:59:20.104 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-05-10T10:59:20.105 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-05-10T10:59:20.106 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-05-10T10:59:20.108 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-05-10T10:59:20.109 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-05-10T10:59:20.111 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-05-10T10:59:20.112 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-05-10T10:59:20.113 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-05-10T10:59:20.115 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-05-10T10:59:20.116 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-05-10T10:59:20.118 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-05-10T10:59:20.119 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-05-10T10:59:20.120 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-05-10T10:59:20.122 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-05-10T10:59:20.123 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-05-10T10:59:20.124 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-05-10T10:59:20.126 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-05-10T10:59:20.127 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-05-10T10:59:20.129 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-05-10T10:59:20.130 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-05-10T10:59:20.132 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-05-10T10:59:20.133 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-05-10T10:59:20.134 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-05-10T10:59:20.136 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-05-10T10:59:20.137 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-05-10T10:59:20.139 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-05-10T10:59:20.140 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-05-10T10:59:20.142 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-05-10T10:59:20.143 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-05-10T10:59:20.144 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-05-10T10:59:20.146 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-05-10T10:59:20.147 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-05-10T10:59:20.148 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-05-10T10:59:20.150 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-05-10T10:59:20.151 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-05-10T10:59:20.153 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-05-10T10:59:20.154 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-05-10T10:59:20.156 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-05-10T10:59:20.157 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-05-10T10:59:20.158 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-05-10T10:59:20.160 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-05-10T10:59:20.161 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-05-10T10:59:20.163 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-05-10T10:59:20.164 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-05-10T10:59:20.165 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-05-10T10:59:20.167 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-05-10T10:59:20.168 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-05-10T10:59:20.169 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-05-10T10:59:20.171 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-05-10T10:59:20.172 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-05-10T10:59:20.173 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-05-10T10:59:20.175 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-05-10T10:59:20.176 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-05-10T10:59:20.178 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-05-10T10:59:20.179 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-05-10T10:59:20.181 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-05-10T10:59:20.182 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-05-10T10:59:20.184 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-05-10T10:59:20.185 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-05-10T10:59:20.186 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-05-10T10:59:20.188 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-05-10T10:59:20.189 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-05-10T10:59:20.191 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-05-10T10:59:20.192 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-05-10T10:59:20.194 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-05-10T10:59:20.195 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-05-10T10:59:20.196 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-05-10T10:59:20.198 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-05-10T10:59:20.199 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-05-10T10:59:20.201 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-05-10T10:59:20.202 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-05-10T10:59:20.203 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-05-10T10:59:20.205 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-05-10T10:59:20.206 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-05-10T10:59:20.208 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-05-10T10:59:20.209 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-05-10T10:59:20.210 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-05-10T10:59:20.212 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-05-10T10:59:20.213 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-05-10T10:59:20.215 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-05-10T10:59:20.216 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-05-10T10:59:20.217 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-05-10T10:59:20.218 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-05-10T10:59:20.220 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-05-10T10:59:20.221 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-05-10T10:59:20.223 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-05-10T10:59:20.224 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-05-10T10:59:20.226 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-05-10T10:59:20.227 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-05-10T10:59:20.228 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-05-10T10:59:20.230 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-05-10T10:59:20.231 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-05-10T10:59:20.233 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-05-10T10:59:20.234 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-05-10T10:59:20.235 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-05-10T10:59:20.237 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-05-10T10:59:20.238 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-05-10T10:59:20.239 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-05-10T10:59:20.241 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-05-10T10:59:20.242 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-05-10T10:59:20.244 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-05-10T10:59:20.245 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-05-10T10:59:20.246 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-05-10T10:59:20.247 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-05-10T10:59:20.249 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-05-10T10:59:20.250 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-05-10T10:59:20.252 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-05-10T10:59:20.253 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-05-10T10:59:20.254 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-05-10T10:59:20.256 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-05-10T10:59:20.257 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-05-10T10:59:20.258 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-05-10T10:59:20.260 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-05-10T10:59:20.261 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-05-10T10:59:20.262 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-05-10T10:59:20.264 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-05-10T10:59:20.265 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-05-10T10:59:20.267 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-05-10T10:59:20.268 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-05-10T10:59:20.269 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-05-10T10:59:20.271 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-05-10T10:59:20.272 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-05-10T10:59:20.273 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-05-10T10:59:20.275 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-05-10T10:59:20.276 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-05-10T10:59:20.278 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-05-10T10:59:20.279 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-05-10T10:59:20.280 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-05-10T10:59:20.282 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-05-10T10:59:20.283 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-05-10T10:59:20.285 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-05-10T10:59:20.286 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-05-10T10:59:20.287 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-05-10T10:59:20.289 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-05-10T10:59:20.290 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-05-10T10:59:20.291 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-05-10T10:59:20.293 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-05-10T10:59:20.294 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-05-10T10:59:20.296 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-05-10T10:59:20.297 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-05-10T10:59:20.298 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-05-10T10:59:20.300 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-05-10T10:59:20.301 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-05-10T10:59:20.302 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-05-10T10:59:20.304 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-05-10T10:59:20.305 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-05-10T10:59:20.306 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-05-10T10:59:20.308 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-05-10T10:59:20.309 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-05-10T10:59:20.311 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-05-10T10:59:20.312 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-05-10T10:59:20.313 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-05-10T10:59:20.315 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-05-10T10:59:20.316 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-05-10T10:59:20.317 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-05-10T10:59:20.319 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-05-10T10:59:20.320 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-05-10T10:59:20.321 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-05-10T10:59:20.323 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-05-10T10:59:20.324 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-05-10T10:59:20.326 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-05-10T10:59:20.327 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-05-10T10:59:20.328 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-05-10T10:59:20.330 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-05-10T10:59:20.331 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-05-10T10:59:20.332 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-05-10T10:59:20.334 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-05-10T10:59:20.335 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-05-10T10:59:20.336 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-05-10T10:59:20.338 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-05-10T10:59:20.339 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-05-10T10:59:20.340 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-05-10T10:59:20.342 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-05-10T10:59:20.343 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-05-10T10:59:20.345 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-05-10T10:59:20.346 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-05-10T10:59:20.347 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-05-10T10:59:20.349 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-05-10T10:59:20.350 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-05-10T10:59:20.351 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-05-10T10:59:20.353 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-05-10T10:59:20.354 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-05-10T10:59:20.355 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-05-10T10:59:20.357 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-05-10T10:59:20.358 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-05-10T10:59:20.359 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-05-10T10:59:20.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T10:59:20.361 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-05-10T10:59:20.362 ERROR:tasks.quiescer.fs.[cephfs]:Couldn't release set '25edc73' with rc: 1 (EPERM), stdout: { "epoch": 28, "leader": 24482, "set_version": 11, "sets": { "25edc73": { "version": 11, "age_ref": 0.1, "state": { "name": "EXPIRED", "age": 0.0 }, "timeout": 60.0, "expiration": 86.7, "members": { "file:/": { "excluded": false, "state": { "name": "QUIESCED", "age": 86.7 } } } } } } 2024-05-10T10:59:20.362 ERROR:tasks.quiescer.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_d39fa08867836ac070c47cb66c782fa559fd480b/qa/tasks/quiescer.py", line 354, in _run self.do_quiesce(d) File "/home/teuthworker/src/git.ceph.com_ceph-c_d39fa08867836ac070c47cb66c782fa559fd480b/qa/tasks/quiescer.py", line 330, in do_quiesce raise RuntimeError(f"Error releasing set '{set_id}': {rcinfo(rc)}") RuntimeError: Error releasing set '25edc73': 1 (EPERM) 2024-05-10T10:59:20.363 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-05-10T10:59:20.363 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-05-10T10:59:20.365 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-05-10T10:59:20.366 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-05-10T10:59:20.368 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-05-10T10:59:20.369 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-05-10T10:59:20.371 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-05-10T10:59:20.372 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-05-10T10:59:20.374 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-05-10T10:59:20.375 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-05-10T10:59:20.376 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-05-10T10:59:20.378 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-05-10T10:59:20.379 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-05-10T10:59:20.381 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-05-10T10:59:20.382 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-05-10T10:59:20.383 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-05-10T10:59:20.385 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-05-10T10:59:20.386 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-05-10T10:59:20.388 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-05-10T10:59:20.389 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-05-10T10:59:20.390 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-05-10T10:59:20.392 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-05-10T10:59:20.393 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-05-10T10:59:20.395 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-05-10T10:59:20.396 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-05-10T10:59:20.397 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-05-10T10:59:20.399 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-05-10T10:59:20.400 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-05-10T10:59:20.401 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-05-10T10:59:20.402 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-05-10T10:59:20.403 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-05-10T10:59:20.404 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-05-10T10:59:20.405 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-05-10T10:59:20.407 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-05-10T10:59:20.408 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-05-10T10:59:20.409 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-05-10T10:59:20.411 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-05-10T10:59:20.412 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-05-10T10:59:20.413 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-05-10T10:59:20.415 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-05-10T10:59:20.416 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-05-10T10:59:20.417 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-05-10T10:59:20.419 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-05-10T10:59:20.421 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-05-10T10:59:20.422 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-05-10T10:59:20.423 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-05-10T10:59:20.424 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-05-10T10:59:20.426 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-05-10T10:59:20.427 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-05-10T10:59:20.429 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-05-10T10:59:20.430 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-05-10T10:59:20.432 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-05-10T10:59:20.433 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-05-10T10:59:20.434 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-05-10T10:59:20.436 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-05-10T10:59:20.437 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-05-10T10:59:20.439 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-05-10T10:59:20.440 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-05-10T10:59:20.442 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-05-10T10:59:20.446 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-05-10T10:59:20.446 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-05-10T10:59:20.446 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-05-10T10:59:20.447 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-05-10T10:59:20.448 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-05-10T10:59:20.449 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-05-10T10:59:20.450 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-05-10T10:59:20.451 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-05-10T10:59:20.452 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-05-10T10:59:20.454 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-05-10T10:59:20.455 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-05-10T10:59:20.456 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-05-10T10:59:20.457 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-05-10T10:59:20.458 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-05-10T10:59:20.460 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-05-10T10:59:20.461 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-05-10T10:59:20.462 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-05-10T10:59:20.463 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-05-10T10:59:20.465 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-05-10T10:59:20.466 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-05-10T10:59:20.467 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-05-10T10:59:20.468 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-05-10T10:59:20.470 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-05-10T10:59:20.471 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-05-10T10:59:20.472 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-05-10T10:59:20.473 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-05-10T10:59:20.475 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-05-10T10:59:20.476 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-05-10T10:59:20.477 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-05-10T10:59:20.478 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-05-10T10:59:20.480 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-05-10T10:59:20.481 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-05-10T10:59:20.482 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-05-10T10:59:20.483 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-05-10T10:59:20.485 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-05-10T10:59:20.486 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-05-10T10:59:20.487 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-05-10T10:59:20.488 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-05-10T10:59:20.490 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-05-10T10:59:20.491 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-05-10T10:59:20.492 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-05-10T10:59:20.493 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-05-10T10:59:20.494 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-05-10T10:59:20.495 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-05-10T10:59:20.496 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-05-10T10:59:20.497 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-05-10T10:59:20.498 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-05-10T10:59:20.499 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-05-10T10:59:20.500 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-05-10T10:59:20.502 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-05-10T10:59:20.503 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-05-10T10:59:20.503 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-05-10T10:59:20.504 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-05-10T10:59:20.505 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-05-10T10:59:20.506 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-05-10T10:59:20.507 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-05-10T10:59:20.508 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-05-10T10:59:20.509 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-05-10T10:59:20.510 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-05-10T10:59:20.511 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-05-10T10:59:20.513 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-05-10T10:59:20.514 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-05-10T10:59:20.515 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-05-10T10:59:20.516 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-05-10T10:59:20.516 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-05-10T10:59:20.517 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-05-10T10:59:20.518 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-05-10T10:59:20.519 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-05-10T10:59:20.520 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-05-10T10:59:20.521 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-05-10T10:59:20.522 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-05-10T10:59:20.523 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-05-10T10:59:20.524 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-05-10T10:59:20.525 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-05-10T10:59:20.526 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-05-10T10:59:20.527 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-05-10T10:59:20.527 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-05-10T10:59:20.528 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-05-10T10:59:20.529 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-05-10T10:59:20.530 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-05-10T10:59:20.531 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-05-10T10:59:20.532 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-05-10T10:59:20.533 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-05-10T10:59:20.534 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-05-10T10:59:20.536 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-05-10T10:59:20.536 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-05-10T10:59:20.537 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-05-10T10:59:20.538 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-05-10T10:59:20.539 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-05-10T10:59:20.540 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-05-10T10:59:20.541 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-05-10T10:59:20.542 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-05-10T10:59:20.543 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-05-10T10:59:20.544 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-05-10T10:59:20.545 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-05-10T10:59:20.546 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-05-10T10:59:20.547 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-05-10T10:59:20.548 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-05-10T10:59:20.549 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-05-10T10:59:20.550 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-05-10T10:59:20.551 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-05-10T10:59:20.552 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-05-10T10:59:20.553 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-05-10T10:59:20.554 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-05-10T10:59:20.555 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-05-10T10:59:20.556 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-05-10T10:59:20.557 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-05-10T10:59:20.558 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-05-10T10:59:20.559 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-05-10T10:59:20.560 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-05-10T10:59:20.562 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-05-10T10:59:20.563 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-05-10T10:59:20.564 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-05-10T10:59:20.565 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-05-10T10:59:20.566 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-05-10T10:59:20.566 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-05-10T10:59:20.567 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-05-10T10:59:20.568 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-05-10T10:59:20.570 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-05-10T10:59:20.571 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-05-10T10:59:20.572 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-05-10T10:59:20.573 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-05-10T10:59:20.574 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-05-10T10:59:20.575 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-05-10T10:59:20.576 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-05-10T10:59:20.577 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-05-10T10:59:20.578 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-05-10T10:59:20.579 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-05-10T10:59:20.579 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-05-10T10:59:20.580 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-05-10T10:59:20.581 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-05-10T10:59:20.582 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-05-10T10:59:20.584 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-05-10T10:59:20.585 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-05-10T10:59:20.586 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-05-10T10:59:20.587 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-05-10T10:59:20.588 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-05-10T10:59:20.589 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-05-10T10:59:20.590 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-05-10T10:59:20.590 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-05-10T10:59:20.591 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-05-10T10:59:20.592 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-05-10T10:59:20.593 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-05-10T10:59:20.594 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-05-10T10:59:20.595 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-05-10T10:59:20.596 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-05-10T10:59:20.597 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-05-10T10:59:20.598 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-05-10T10:59:20.599 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-05-10T10:59:20.600 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-05-10T10:59:20.602 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-05-10T10:59:20.603 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-05-10T10:59:20.604 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-05-10T10:59:20.604 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-05-10T10:59:20.605 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-05-10T10:59:20.606 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-05-10T10:59:20.607 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-05-10T10:59:20.608 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-05-10T10:59:20.609 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-05-10T10:59:20.610 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-05-10T10:59:20.611 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-05-10T10:59:20.612 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-05-10T10:59:20.613 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-05-10T10:59:20.614 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-05-10T10:59:20.615 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-05-10T10:59:20.615 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-05-10T10:59:20.616 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-05-10T10:59:20.617 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-05-10T10:59:20.618 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-05-10T10:59:20.619 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-05-10T10:59:20.620 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-05-10T10:59:20.621 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-05-10T10:59:20.622 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-05-10T10:59:20.622 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-05-10T10:59:20.624 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-05-10T10:59:20.625 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-05-10T10:59:20.625 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-05-10T10:59:20.627 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-05-10T10:59:20.628 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-05-10T10:59:20.629 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-05-10T10:59:20.629 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-05-10T10:59:20.631 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-05-10T10:59:20.632 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-05-10T10:59:20.633 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-05-10T10:59:20.634 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-05-10T10:59:20.635 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-05-10T10:59:20.635 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-05-10T10:59:20.636 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-05-10T10:59:20.637 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-05-10T10:59:20.639 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-05-10T10:59:20.640 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-05-10T10:59:20.640 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-05-10T10:59:20.642 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-05-10T10:59:20.643 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-05-10T10:59:20.643 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-05-10T10:59:20.644 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-05-10T10:59:20.646 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-05-10T10:59:20.647 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-05-10T10:59:20.649 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-05-10T10:59:20.649 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-05-10T10:59:20.650 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-05-10T10:59:20.651 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-05-10T10:59:20.652 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-05-10T10:59:20.653 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-05-10T10:59:20.654 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-05-10T10:59:20.655 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-05-10T10:59:20.656 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-05-10T10:59:20.656 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-05-10T10:59:20.658 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-05-10T10:59:20.659 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-05-10T10:59:20.660 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-05-10T10:59:20.660 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-05-10T10:59:20.662 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-05-10T10:59:20.663 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-05-10T10:59:20.664 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-05-10T10:59:20.665 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-05-10T10:59:20.665 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-05-10T10:59:20.666 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-05-10T10:59:20.668 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-05-10T10:59:20.669 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-05-10T10:59:20.670 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-05-10T10:59:20.671 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-05-10T10:59:20.671 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-05-10T10:59:20.672 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-05-10T10:59:20.673 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-05-10T10:59:20.675 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-05-10T10:59:20.676 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-05-10T10:59:20.677 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-05-10T10:59:20.678 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-05-10T10:59:20.679 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-05-10T10:59:20.680 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-05-10T10:59:20.680 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-05-10T10:59:20.681 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-05-10T10:59:20.682 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-05-10T10:59:20.683 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-05-10T10:59:20.685 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-05-10T10:59:20.685 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-05-10T10:59:20.686 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-05-10T10:59:20.688 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-05-10T10:59:20.689 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-05-10T10:59:20.690 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-05-10T10:59:20.690 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-05-10T10:59:20.691 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-05-10T10:59:20.692 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-05-10T10:59:20.693 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-05-10T10:59:20.694 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-05-10T10:59:20.696 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-05-10T10:59:20.697 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-05-10T10:59:20.698 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-05-10T10:59:20.699 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-05-10T10:59:20.700 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-05-10T10:59:20.701 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-05-10T10:59:20.702 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-05-10T10:59:20.703 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-05-10T10:59:20.704 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-05-10T10:59:20.705 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-05-10T10:59:20.706 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-05-10T10:59:20.707 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-05-10T10:59:20.708 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-05-10T10:59:20.709 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-05-10T10:59:20.710 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-05-10T10:59:20.711 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-05-10T10:59:20.712 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-05-10T10:59:20.713 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-05-10T10:59:20.991 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-05-10T10:59:20.992 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-05-10T10:59:20.993 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-05-10T10:59:20.994 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-05-10T10:59:20.994 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-05-10T10:59:20.995 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-05-10T10:59:20.998 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-05-10T10:59:20.999 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-05-10T10:59:21.000 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-05-10T10:59:21.001 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-05-10T10:59:21.001 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-05-10T10:59:21.008 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-05-10T10:59:21.008 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-05-10T10:59:21.008 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-05-10T10:59:21.009 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-05-10T10:59:21.009 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-05-10T10:59:21.009 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-05-10T10:59:21.009 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-05-10T10:59:21.010 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-05-10T10:59:21.011 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-05-10T10:59:21.012 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-05-10T10:59:21.013 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-05-10T10:59:21.014 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-05-10T10:59:21.015 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-05-10T10:59:21.016 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-05-10T10:59:21.016 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-05-10T10:59:21.018 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-05-10T10:59:21.019 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-05-10T10:59:21.020 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-05-10T10:59:21.021 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-05-10T10:59:21.022 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-05-10T10:59:21.023 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-05-10T10:59:21.024 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-05-10T10:59:21.025 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-05-10T10:59:21.026 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-05-10T10:59:21.027 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-05-10T10:59:21.028 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-05-10T10:59:21.030 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-05-10T10:59:21.031 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-05-10T10:59:21.032 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-05-10T10:59:21.033 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-05-10T10:59:21.035 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-05-10T10:59:21.036 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-05-10T10:59:21.037 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-05-10T10:59:21.038 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-05-10T10:59:21.038 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-05-10T10:59:21.038 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-05-10T10:59:21.039 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-05-10T10:59:21.040 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-05-10T10:59:21.041 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-05-10T10:59:21.057 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-05-10T10:59:21.058 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-05-10T10:59:21.058 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-05-10T10:59:21.059 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-05-10T10:59:21.066 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-05-10T10:59:21.067 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-05-10T10:59:21.067 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-05-10T10:59:21.067 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-05-10T10:59:21.067 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-05-10T10:59:21.068 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-05-10T10:59:21.068 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-05-10T10:59:21.068 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-05-10T10:59:21.068 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-05-10T10:59:21.068 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-05-10T10:59:21.068 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-05-10T10:59:21.069 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-05-10T10:59:21.069 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-05-10T10:59:21.069 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-05-10T10:59:21.069 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-05-10T10:59:21.069 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-05-10T10:59:21.069 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-05-10T10:59:21.070 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-05-10T10:59:21.070 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-05-10T10:59:21.070 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-05-10T10:59:21.070 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-05-10T10:59:21.075 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-05-10T10:59:21.075 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-05-10T10:59:21.075 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-05-10T10:59:21.075 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-05-10T10:59:21.075 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-05-10T10:59:21.076 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-05-10T10:59:21.076 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-05-10T10:59:21.076 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-05-10T10:59:21.077 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-05-10T10:59:21.077 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-05-10T10:59:21.077 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-05-10T10:59:21.078 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-05-10T10:59:21.079 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-05-10T10:59:21.080 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-05-10T10:59:21.081 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-05-10T10:59:21.082 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-05-10T10:59:21.083 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-05-10T10:59:21.084 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-05-10T10:59:21.085 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-05-10T10:59:21.086 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-05-10T10:59:21.087 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-05-10T10:59:21.090 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-05-10T10:59:21.090 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-05-10T10:59:21.091 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-05-10T10:59:21.092 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-05-10T10:59:21.092 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-05-10T10:59:21.098 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-05-10T10:59:21.098 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-05-10T10:59:21.098 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-05-10T10:59:21.098 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-05-10T10:59:21.098 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-05-10T10:59:21.099 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-05-10T10:59:21.100 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-05-10T10:59:21.103 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-05-10T10:59:21.103 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-05-10T10:59:21.103 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-05-10T10:59:21.103 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-05-10T10:59:21.103 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-05-10T10:59:21.105 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-05-10T10:59:21.106 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-05-10T10:59:21.107 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-05-10T10:59:21.108 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-05-10T10:59:21.110 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-05-10T10:59:21.111 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-05-10T10:59:21.113 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-05-10T10:59:21.113 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-05-10T10:59:21.114 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-05-10T10:59:21.114 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-05-10T10:59:21.115 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-05-10T10:59:21.116 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-05-10T10:59:21.117 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-05-10T10:59:21.118 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-05-10T10:59:21.119 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-05-10T10:59:21.120 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-05-10T10:59:21.121 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-05-10T10:59:21.122 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-05-10T10:59:21.124 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-05-10T10:59:21.125 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-05-10T10:59:21.125 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-05-10T10:59:21.126 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-05-10T10:59:21.127 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-05-10T10:59:21.128 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-05-10T10:59:21.129 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-05-10T10:59:21.130 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-05-10T10:59:21.132 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-05-10T10:59:21.132 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-05-10T10:59:21.133 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-05-10T10:59:21.134 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-05-10T10:59:21.135 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-05-10T10:59:21.136 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-05-10T10:59:21.137 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-05-10T10:59:21.139 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-05-10T10:59:21.140 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-05-10T10:59:21.141 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-05-10T10:59:21.142 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-05-10T10:59:21.143 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-05-10T10:59:21.145 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-05-10T10:59:21.145 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-05-10T10:59:21.147 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-05-10T10:59:21.147 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-05-10T10:59:21.148 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-05-10T10:59:21.149 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-05-10T10:59:21.150 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-05-10T10:59:21.152 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-05-10T10:59:21.153 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-05-10T10:59:21.154 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-05-10T10:59:21.155 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-05-10T10:59:21.156 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-05-10T10:59:21.156 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-05-10T10:59:21.158 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-05-10T10:59:21.158 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-05-10T10:59:21.172 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-05-10T10:59:21.173 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-05-10T10:59:21.173 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-05-10T10:59:21.173 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-05-10T10:59:21.173 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-05-10T10:59:21.173 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-05-10T10:59:21.173 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-05-10T10:59:21.173 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-05-10T10:59:21.173 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-05-10T10:59:21.173 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-05-10T10:59:21.173 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-05-10T10:59:21.173 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-05-10T10:59:21.173 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-05-10T10:59:21.173 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-05-10T10:59:21.176 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-05-10T10:59:21.177 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-05-10T10:59:21.178 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-05-10T10:59:21.179 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-05-10T10:59:21.179 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-05-10T10:59:21.179 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-05-10T10:59:21.181 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-05-10T10:59:21.181 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-05-10T10:59:21.184 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-05-10T10:59:21.184 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-05-10T10:59:21.185 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-05-10T10:59:21.185 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-05-10T10:59:21.203 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-05-10T10:59:21.204 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-05-10T10:59:21.205 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-05-10T10:59:21.206 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-05-10T10:59:21.208 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-05-10T10:59:21.209 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-05-10T10:59:21.209 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-05-10T10:59:21.209 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-05-10T10:59:21.209 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-05-10T10:59:21.209 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-05-10T10:59:21.209 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-05-10T10:59:21.209 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-05-10T10:59:21.209 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-05-10T10:59:21.209 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-05-10T10:59:21.209 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-05-10T10:59:21.209 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-05-10T10:59:21.210 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-05-10T10:59:21.210 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-05-10T10:59:21.210 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-05-10T10:59:21.210 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-05-10T10:59:21.210 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-05-10T10:59:21.210 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-05-10T10:59:21.210 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-05-10T10:59:21.210 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-05-10T10:59:21.212 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-05-10T10:59:21.212 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-05-10T10:59:21.213 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-05-10T10:59:21.213 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-05-10T10:59:21.215 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-05-10T10:59:21.215 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-05-10T10:59:21.218 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-05-10T10:59:21.218 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-05-10T10:59:21.219 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-05-10T10:59:21.219 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-05-10T10:59:21.220 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-05-10T10:59:21.221 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-05-10T10:59:21.221 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-05-10T10:59:21.223 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-05-10T10:59:21.236 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-05-10T10:59:21.236 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-05-10T10:59:21.237 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-05-10T10:59:21.239 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-05-10T10:59:21.239 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-05-10T10:59:21.239 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-05-10T10:59:21.239 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-05-10T10:59:21.239 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-05-10T10:59:21.239 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-05-10T10:59:21.240 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-05-10T10:59:21.240 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-05-10T10:59:21.240 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-05-10T10:59:21.240 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-05-10T10:59:21.240 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-05-10T10:59:21.240 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-05-10T10:59:21.240 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-05-10T10:59:21.240 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-05-10T10:59:21.242 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-05-10T10:59:21.242 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-05-10T10:59:21.242 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-05-10T10:59:21.243 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-05-10T10:59:21.244 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-05-10T10:59:21.245 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-05-10T10:59:21.246 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-05-10T10:59:21.247 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-05-10T10:59:21.250 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-05-10T10:59:21.252 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-05-10T10:59:21.252 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-05-10T10:59:21.253 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-05-10T10:59:21.253 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-05-10T10:59:21.253 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-05-10T10:59:21.254 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-05-10T10:59:21.255 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-05-10T10:59:21.255 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-05-10T10:59:21.257 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-05-10T10:59:21.258 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-05-10T10:59:21.259 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-05-10T10:59:21.261 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-05-10T10:59:21.262 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-05-10T10:59:21.262 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-05-10T10:59:21.262 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-05-10T10:59:21.263 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-05-10T10:59:21.264 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-05-10T10:59:21.265 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-05-10T10:59:21.266 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-05-10T10:59:21.267 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-05-10T10:59:21.268 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-05-10T10:59:21.269 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-05-10T10:59:21.270 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-05-10T10:59:21.271 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-05-10T10:59:21.272 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-05-10T10:59:21.273 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-05-10T10:59:21.274 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-05-10T10:59:21.275 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-05-10T10:59:21.276 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-05-10T10:59:21.277 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-05-10T10:59:21.278 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-05-10T10:59:21.279 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-05-10T10:59:21.280 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-05-10T10:59:21.280 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-05-10T10:59:21.281 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-05-10T10:59:21.282 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-05-10T10:59:21.283 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-05-10T10:59:21.285 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-05-10T10:59:21.286 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-05-10T10:59:21.287 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-05-10T10:59:21.288 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-05-10T10:59:21.289 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-05-10T10:59:21.290 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-05-10T10:59:21.291 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-05-10T10:59:21.292 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-05-10T10:59:21.293 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-05-10T10:59:21.294 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-05-10T10:59:21.295 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-05-10T10:59:21.295 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-05-10T10:59:21.297 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-05-10T10:59:21.298 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-05-10T10:59:21.298 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-05-10T10:59:21.299 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-05-10T10:59:21.300 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-05-10T10:59:21.301 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-05-10T10:59:21.302 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-05-10T10:59:21.303 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-05-10T10:59:21.304 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-05-10T10:59:21.305 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-05-10T10:59:21.306 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-05-10T10:59:21.307 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-05-10T10:59:21.308 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-05-10T10:59:21.309 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-05-10T10:59:21.311 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-05-10T10:59:21.311 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-05-10T10:59:21.312 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-05-10T10:59:21.313 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-05-10T10:59:21.314 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-05-10T10:59:21.316 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-05-10T10:59:21.317 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-05-10T10:59:21.318 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-05-10T10:59:21.319 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-05-10T10:59:21.320 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-05-10T10:59:21.320 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-05-10T10:59:21.322 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-05-10T10:59:21.323 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-05-10T10:59:21.324 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-05-10T10:59:21.325 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-05-10T10:59:21.326 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-05-10T10:59:21.327 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-05-10T10:59:21.328 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-05-10T10:59:21.329 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-05-10T10:59:21.330 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-05-10T10:59:21.331 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-05-10T10:59:21.331 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-05-10T10:59:21.332 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-05-10T10:59:21.333 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-05-10T10:59:21.334 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-05-10T10:59:21.335 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-05-10T10:59:21.336 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-05-10T10:59:21.337 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-05-10T10:59:21.339 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-05-10T10:59:21.339 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-05-10T10:59:21.340 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-05-10T10:59:21.342 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-05-10T10:59:21.343 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-05-10T10:59:21.344 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-05-10T10:59:21.345 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-05-10T10:59:21.345 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-05-10T10:59:21.346 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-05-10T10:59:21.347 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-05-10T10:59:21.348 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-05-10T10:59:21.350 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-05-10T10:59:21.351 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-05-10T10:59:21.352 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-05-10T10:59:21.353 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-05-10T10:59:21.354 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-05-10T10:59:21.354 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-05-10T10:59:21.356 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-05-10T10:59:21.357 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-05-10T10:59:21.358 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-05-10T10:59:21.359 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-05-10T10:59:21.360 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-05-10T10:59:21.361 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-05-10T10:59:21.362 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-05-10T10:59:21.369 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-05-10T10:59:21.370 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-05-10T10:59:21.372 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-05-10T10:59:21.373 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-05-10T10:59:21.374 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-05-10T10:59:21.374 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-05-10T10:59:21.375 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-05-10T10:59:21.375 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-05-10T10:59:21.376 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-05-10T10:59:21.377 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-05-10T10:59:21.377 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-05-10T10:59:21.379 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-05-10T10:59:21.380 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-05-10T10:59:21.380 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-05-10T10:59:21.381 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-05-10T10:59:21.383 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-05-10T10:59:21.383 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-05-10T10:59:21.384 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-05-10T10:59:21.384 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-05-10T10:59:21.385 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-05-10T10:59:21.390 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-05-10T10:59:21.391 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-05-10T10:59:21.392 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-05-10T10:59:21.393 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-05-10T10:59:21.393 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-05-10T10:59:21.394 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-05-10T10:59:21.395 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-05-10T10:59:21.395 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-05-10T10:59:21.396 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-05-10T10:59:21.396 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-05-10T10:59:21.397 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-05-10T10:59:21.398 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-05-10T10:59:21.399 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-05-10T10:59:21.401 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-05-10T10:59:21.402 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-05-10T10:59:21.407 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-05-10T10:59:21.409 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-05-10T10:59:21.410 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-05-10T10:59:21.412 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-05-10T10:59:21.413 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-05-10T10:59:21.413 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-05-10T10:59:21.413 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-05-10T10:59:21.413 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-05-10T10:59:21.414 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-05-10T10:59:21.415 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-05-10T10:59:21.415 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-05-10T10:59:21.416 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-05-10T10:59:21.417 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-05-10T10:59:21.418 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-05-10T10:59:21.418 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-05-10T10:59:21.419 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-05-10T10:59:21.419 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-05-10T10:59:21.421 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-05-10T10:59:21.422 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-05-10T10:59:21.431 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-05-10T10:59:21.432 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-05-10T10:59:21.434 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-05-10T10:59:21.434 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-05-10T10:59:21.434 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-05-10T10:59:21.434 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-05-10T10:59:21.434 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-05-10T10:59:21.434 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-05-10T10:59:21.434 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-05-10T10:59:21.434 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-05-10T10:59:21.434 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-05-10T10:59:21.434 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-05-10T10:59:21.435 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-05-10T10:59:21.436 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-05-10T10:59:21.436 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-05-10T10:59:21.442 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-05-10T10:59:21.442 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-05-10T10:59:21.443 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-05-10T10:59:21.444 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-05-10T10:59:21.444 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-05-10T10:59:21.444 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-05-10T10:59:21.444 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-05-10T10:59:21.448 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-05-10T10:59:21.449 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-05-10T10:59:21.450 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-05-10T10:59:21.451 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-05-10T10:59:21.451 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-05-10T10:59:21.451 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-05-10T10:59:21.451 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-05-10T10:59:21.455 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-05-10T10:59:21.455 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-05-10T10:59:21.457 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-05-10T10:59:21.457 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-05-10T10:59:21.457 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-05-10T10:59:21.457 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-05-10T10:59:21.459 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-05-10T10:59:21.461 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-05-10T10:59:21.461 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-05-10T10:59:21.466 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-05-10T10:59:21.466 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-05-10T10:59:21.468 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-05-10T10:59:21.469 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-05-10T10:59:21.469 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-05-10T10:59:21.469 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-05-10T10:59:21.469 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-05-10T10:59:21.469 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-05-10T10:59:21.479 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-05-10T10:59:21.479 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-05-10T10:59:21.480 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-05-10T10:59:21.482 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-05-10T10:59:21.483 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-05-10T10:59:21.483 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-05-10T10:59:21.483 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-05-10T10:59:21.483 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-05-10T10:59:21.483 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-05-10T10:59:21.484 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-05-10T10:59:21.484 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-05-10T10:59:21.484 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-05-10T10:59:21.484 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-05-10T10:59:21.484 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-05-10T10:59:21.485 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-05-10T10:59:21.486 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-05-10T10:59:21.486 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-05-10T10:59:21.488 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-05-10T10:59:21.488 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-05-10T10:59:21.488 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-05-10T10:59:21.490 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-05-10T10:59:21.490 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-05-10T10:59:21.491 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-05-10T10:59:21.492 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-05-10T10:59:21.492 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-05-10T10:59:21.493 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-05-10T10:59:21.506 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-05-10T10:59:21.507 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-05-10T10:59:21.508 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-05-10T10:59:21.509 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-05-10T10:59:21.510 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-05-10T10:59:21.616 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:21 smithi196 ceph-mon[34872]: pgmap v498: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:59:21.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:21 smithi184 ceph-mon[34585]: pgmap v498: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:59:21.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:21 smithi107 ceph-mon[30373]: pgmap v498: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T10:59:21.704 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-05-10T10:59:21.705 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-05-10T10:59:21.706 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-05-10T10:59:21.707 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-05-10T10:59:21.707 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-05-10T10:59:21.708 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-05-10T10:59:21.709 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-05-10T10:59:21.710 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-05-10T10:59:21.711 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-05-10T10:59:21.712 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-05-10T10:59:21.713 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-05-10T10:59:21.714 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-05-10T10:59:21.716 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-05-10T10:59:21.716 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-05-10T10:59:21.717 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-05-10T10:59:21.718 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-05-10T10:59:21.719 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-05-10T10:59:21.720 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-05-10T10:59:21.721 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-05-10T10:59:21.722 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-05-10T10:59:21.723 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-05-10T10:59:21.725 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-05-10T10:59:21.726 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-05-10T10:59:21.727 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-05-10T10:59:21.727 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-05-10T10:59:21.728 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-05-10T10:59:21.729 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-05-10T10:59:21.730 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-05-10T10:59:21.731 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-05-10T10:59:21.731 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-05-10T10:59:21.732 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-05-10T10:59:21.733 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-05-10T10:59:21.734 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-05-10T10:59:21.735 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-05-10T10:59:21.736 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-05-10T10:59:21.737 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-05-10T10:59:21.738 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-05-10T10:59:21.739 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-05-10T10:59:21.739 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-05-10T10:59:21.740 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-05-10T10:59:21.741 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-05-10T10:59:21.742 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-05-10T10:59:21.743 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-05-10T10:59:21.744 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-05-10T10:59:21.745 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-05-10T10:59:21.746 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-05-10T10:59:21.747 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-05-10T10:59:21.748 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-05-10T10:59:21.749 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-05-10T10:59:21.750 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-05-10T10:59:21.752 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-05-10T10:59:21.752 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-05-10T10:59:21.753 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-05-10T10:59:21.754 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-05-10T10:59:21.755 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-05-10T10:59:21.756 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-05-10T10:59:21.757 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-05-10T10:59:21.758 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-05-10T10:59:21.759 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-05-10T10:59:21.760 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-05-10T10:59:21.761 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-05-10T10:59:21.761 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-05-10T10:59:21.763 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-05-10T10:59:21.764 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-05-10T10:59:21.765 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-05-10T10:59:21.765 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-05-10T10:59:21.767 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-05-10T10:59:21.768 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-05-10T10:59:21.769 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-05-10T10:59:21.770 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-05-10T10:59:21.771 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-05-10T10:59:21.772 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-05-10T10:59:21.773 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-05-10T10:59:21.774 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-05-10T10:59:21.775 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-05-10T10:59:21.776 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-05-10T10:59:21.776 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-05-10T10:59:21.777 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-05-10T10:59:21.779 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-05-10T10:59:21.780 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-05-10T10:59:21.780 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-05-10T10:59:21.781 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-05-10T10:59:21.782 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-05-10T10:59:21.783 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-05-10T10:59:21.784 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-05-10T10:59:21.785 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-05-10T10:59:21.785 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-05-10T10:59:21.786 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-05-10T10:59:21.787 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-05-10T10:59:21.789 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-05-10T10:59:21.790 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-05-10T10:59:21.790 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-05-10T10:59:21.791 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-05-10T10:59:21.792 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-05-10T10:59:21.793 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-05-10T10:59:21.793 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-05-10T10:59:21.794 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-05-10T10:59:21.795 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-05-10T10:59:21.796 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-05-10T10:59:21.797 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-05-10T10:59:21.798 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-05-10T10:59:21.799 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-05-10T10:59:21.800 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-05-10T10:59:21.801 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-05-10T10:59:21.802 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-05-10T10:59:21.803 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-05-10T10:59:21.805 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-05-10T10:59:21.806 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-05-10T10:59:21.807 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-05-10T10:59:21.808 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-05-10T10:59:21.809 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-05-10T10:59:21.810 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-05-10T10:59:21.811 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-05-10T10:59:21.811 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-05-10T10:59:21.812 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-05-10T10:59:21.813 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-05-10T10:59:21.814 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-05-10T10:59:21.815 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-05-10T10:59:21.816 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-05-10T10:59:21.818 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-05-10T10:59:21.819 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-05-10T10:59:21.820 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-05-10T10:59:21.820 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-05-10T10:59:21.822 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-05-10T10:59:21.823 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-05-10T10:59:21.824 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-05-10T10:59:21.825 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-05-10T10:59:21.826 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-05-10T10:59:21.827 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-05-10T10:59:21.828 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-05-10T10:59:21.829 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-05-10T10:59:21.829 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-05-10T10:59:21.830 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-05-10T10:59:21.831 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-05-10T10:59:21.832 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-05-10T10:59:21.834 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-05-10T10:59:21.835 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-05-10T10:59:21.836 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-05-10T10:59:21.837 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-05-10T10:59:21.838 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-05-10T10:59:21.839 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-05-10T10:59:21.840 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-05-10T10:59:21.840 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-05-10T10:59:21.842 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-05-10T10:59:21.843 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-05-10T10:59:21.844 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-05-10T10:59:21.845 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-05-10T10:59:21.846 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-05-10T10:59:21.846 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-05-10T10:59:21.847 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-05-10T10:59:21.848 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-05-10T10:59:21.849 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-05-10T10:59:21.850 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-05-10T10:59:21.851 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-05-10T10:59:21.852 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-05-10T10:59:21.853 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-05-10T10:59:21.854 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-05-10T10:59:21.855 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-05-10T10:59:21.856 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-05-10T10:59:21.857 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-05-10T10:59:21.858 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-05-10T10:59:21.859 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-05-10T10:59:21.860 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-05-10T10:59:21.861 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-05-10T10:59:21.862 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-05-10T10:59:21.864 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-05-10T10:59:21.864 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-05-10T10:59:21.865 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-05-10T10:59:21.866 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-05-10T10:59:21.867 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-05-10T10:59:21.868 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-05-10T10:59:21.869 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-05-10T10:59:21.870 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-05-10T10:59:21.871 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-05-10T10:59:21.872 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-05-10T10:59:21.873 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-05-10T10:59:21.873 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-05-10T10:59:21.874 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-05-10T10:59:21.875 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-05-10T10:59:21.876 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-05-10T10:59:21.877 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-05-10T10:59:21.878 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-05-10T10:59:21.879 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-05-10T10:59:21.880 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-05-10T10:59:21.881 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-05-10T10:59:21.882 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-05-10T10:59:21.883 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-05-10T10:59:21.884 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-05-10T10:59:21.885 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-05-10T10:59:21.886 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-05-10T10:59:21.886 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-05-10T10:59:21.887 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-05-10T10:59:21.888 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-05-10T10:59:21.889 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-05-10T10:59:21.890 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-05-10T10:59:21.891 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-05-10T10:59:21.892 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-05-10T10:59:21.892 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-05-10T10:59:21.893 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-05-10T10:59:21.895 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-05-10T10:59:21.896 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-05-10T10:59:21.897 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-05-10T10:59:21.898 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-05-10T10:59:21.899 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-05-10T10:59:21.899 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-05-10T10:59:21.901 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-05-10T10:59:21.902 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-05-10T10:59:21.902 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-05-10T10:59:21.904 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-05-10T10:59:21.904 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-05-10T10:59:21.906 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-05-10T10:59:21.907 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-05-10T10:59:21.908 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-05-10T10:59:21.909 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-05-10T10:59:21.910 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-05-10T10:59:21.910 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-05-10T10:59:21.912 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-05-10T10:59:21.913 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-05-10T10:59:21.915 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-05-10T10:59:21.915 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-05-10T10:59:21.916 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-05-10T10:59:21.916 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-05-10T10:59:21.917 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-05-10T10:59:21.918 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-05-10T10:59:21.919 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-05-10T10:59:21.920 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-05-10T10:59:21.921 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-05-10T10:59:21.921 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-05-10T10:59:21.922 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-05-10T10:59:21.923 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-05-10T10:59:21.924 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-05-10T10:59:21.925 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-05-10T10:59:21.927 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-05-10T10:59:21.928 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-05-10T10:59:21.929 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-05-10T10:59:21.930 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-05-10T10:59:21.931 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-05-10T10:59:21.932 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-05-10T10:59:21.933 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-05-10T10:59:21.934 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-05-10T10:59:21.935 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-05-10T10:59:21.936 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-05-10T10:59:21.936 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-05-10T10:59:21.938 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-05-10T10:59:21.939 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-05-10T10:59:21.940 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-05-10T10:59:21.941 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-05-10T10:59:21.942 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-05-10T10:59:21.942 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-05-10T10:59:21.943 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-05-10T10:59:21.944 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-05-10T10:59:21.945 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-05-10T10:59:21.946 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-05-10T10:59:21.947 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-05-10T10:59:21.948 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-05-10T10:59:21.950 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-05-10T10:59:21.950 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-05-10T10:59:21.951 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-05-10T10:59:21.952 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-05-10T10:59:21.953 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-05-10T10:59:21.953 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-05-10T10:59:21.954 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-05-10T10:59:21.955 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-05-10T10:59:21.956 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-05-10T10:59:21.957 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-05-10T10:59:21.959 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-05-10T10:59:21.959 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-05-10T10:59:21.960 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-05-10T10:59:21.961 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-05-10T10:59:21.963 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-05-10T10:59:21.964 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-05-10T10:59:21.964 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-05-10T10:59:21.966 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-05-10T10:59:21.967 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-05-10T10:59:21.968 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-05-10T10:59:21.969 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-05-10T10:59:21.970 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-05-10T10:59:21.970 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-05-10T10:59:21.972 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-05-10T10:59:21.973 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-05-10T10:59:21.974 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-05-10T10:59:21.975 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-05-10T10:59:21.976 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-05-10T10:59:21.977 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-05-10T10:59:21.978 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-05-10T10:59:21.978 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-05-10T10:59:21.980 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-05-10T10:59:21.981 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-05-10T10:59:21.982 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-05-10T10:59:21.982 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-05-10T10:59:21.984 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-05-10T10:59:21.985 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-05-10T10:59:21.986 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-05-10T10:59:21.987 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-05-10T10:59:21.988 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-05-10T10:59:21.989 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-05-10T10:59:21.990 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-05-10T10:59:21.991 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-05-10T10:59:21.992 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-05-10T10:59:21.993 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-05-10T10:59:21.994 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-05-10T10:59:21.994 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-05-10T10:59:21.996 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-05-10T10:59:21.997 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-05-10T10:59:21.998 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-05-10T10:59:21.999 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-05-10T10:59:22.000 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-05-10T10:59:22.005 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-05-10T10:59:22.005 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-05-10T10:59:22.005 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-05-10T10:59:22.005 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-05-10T10:59:22.006 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-05-10T10:59:22.007 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-05-10T10:59:22.007 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-05-10T10:59:22.008 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-05-10T10:59:22.008 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-05-10T10:59:22.009 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-05-10T10:59:22.010 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-05-10T10:59:22.011 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-05-10T10:59:22.012 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-05-10T10:59:22.013 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-05-10T10:59:22.015 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-05-10T10:59:22.016 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-05-10T10:59:22.017 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-05-10T10:59:22.018 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-05-10T10:59:22.019 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-05-10T10:59:22.020 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-05-10T10:59:22.021 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-05-10T10:59:22.022 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-05-10T10:59:22.023 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-05-10T10:59:22.024 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-05-10T10:59:22.026 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-05-10T10:59:22.027 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-05-10T10:59:22.027 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-05-10T10:59:22.028 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-05-10T10:59:22.030 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-05-10T10:59:22.031 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-05-10T10:59:22.032 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-05-10T10:59:22.033 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-05-10T10:59:22.033 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-05-10T10:59:22.035 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-05-10T10:59:22.037 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-05-10T10:59:22.037 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-05-10T10:59:22.039 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-05-10T10:59:22.040 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-05-10T10:59:22.040 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-05-10T10:59:22.041 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-05-10T10:59:22.042 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-05-10T10:59:22.043 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-05-10T10:59:22.043 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-05-10T10:59:22.044 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-05-10T10:59:22.045 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-05-10T10:59:22.047 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-05-10T10:59:22.048 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-05-10T10:59:22.049 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-05-10T10:59:22.049 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-05-10T10:59:22.050 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-05-10T10:59:22.051 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-05-10T10:59:22.052 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-05-10T10:59:22.054 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-05-10T10:59:22.055 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-05-10T10:59:22.056 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-05-10T10:59:22.057 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-05-10T10:59:22.057 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-05-10T10:59:22.059 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-05-10T10:59:22.060 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-05-10T10:59:22.061 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-05-10T10:59:22.062 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-05-10T10:59:22.063 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-05-10T10:59:22.064 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-05-10T10:59:22.065 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-05-10T10:59:22.066 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-05-10T10:59:22.067 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-05-10T10:59:22.068 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-05-10T10:59:22.068 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-05-10T10:59:22.069 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-05-10T10:59:22.070 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-05-10T10:59:22.071 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-05-10T10:59:22.073 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-05-10T10:59:22.074 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-05-10T10:59:22.075 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-05-10T10:59:22.078 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-05-10T10:59:22.078 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-05-10T10:59:22.078 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-05-10T10:59:22.079 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-05-10T10:59:22.080 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-05-10T10:59:22.081 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-05-10T10:59:22.082 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-05-10T10:59:22.083 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-05-10T10:59:22.084 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-05-10T10:59:22.085 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-05-10T10:59:22.086 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-05-10T10:59:22.087 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-05-10T10:59:22.088 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-05-10T10:59:22.089 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-05-10T10:59:22.089 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-05-10T10:59:22.090 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-05-10T10:59:22.092 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-05-10T10:59:22.092 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-05-10T10:59:22.094 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-05-10T10:59:22.094 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-05-10T10:59:22.096 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-05-10T10:59:22.096 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-05-10T10:59:22.098 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-05-10T10:59:22.099 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-05-10T10:59:22.100 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-05-10T10:59:22.101 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-05-10T10:59:22.102 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-05-10T10:59:22.103 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-05-10T10:59:22.104 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-05-10T10:59:22.105 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-05-10T10:59:22.106 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-05-10T10:59:22.107 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-05-10T10:59:22.108 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-05-10T10:59:22.109 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-05-10T10:59:22.110 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-05-10T10:59:22.111 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-05-10T10:59:22.112 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-05-10T10:59:22.114 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-05-10T10:59:22.115 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-05-10T10:59:22.115 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-05-10T10:59:22.116 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-05-10T10:59:22.118 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-05-10T10:59:22.119 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-05-10T10:59:22.120 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-05-10T10:59:22.121 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-05-10T10:59:22.122 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-05-10T10:59:22.123 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-05-10T10:59:22.124 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-05-10T10:59:22.125 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-05-10T10:59:22.126 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-05-10T10:59:22.127 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-05-10T10:59:22.128 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-05-10T10:59:22.129 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-05-10T10:59:22.130 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-05-10T10:59:22.131 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-05-10T10:59:22.132 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-05-10T10:59:22.133 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-05-10T10:59:22.136 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-05-10T10:59:22.396 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-05-10T10:59:22.466 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-05-10T10:59:22.500 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-05-10T10:59:22.513 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-05-10T10:59:22.519 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-05-10T10:59:22.523 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-05-10T10:59:22.526 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-05-10T10:59:22.528 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-05-10T10:59:22.530 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-05-10T10:59:22.533 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-05-10T10:59:22.536 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-05-10T10:59:22.539 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-05-10T10:59:22.543 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-05-10T10:59:22.546 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-05-10T10:59:22.550 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-05-10T10:59:22.553 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-05-10T10:59:22.556 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-05-10T10:59:22.560 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-05-10T10:59:22.565 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-05-10T10:59:22.570 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-05-10T10:59:22.573 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-05-10T10:59:22.577 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-05-10T10:59:22.580 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-05-10T10:59:22.583 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-05-10T10:59:22.586 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-05-10T10:59:22.589 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-05-10T10:59:22.592 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-05-10T10:59:22.595 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-05-10T10:59:22.599 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-05-10T10:59:22.602 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-05-10T10:59:22.606 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-05-10T10:59:22.610 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-05-10T10:59:22.613 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-05-10T10:59:22.616 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-05-10T10:59:22.619 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-05-10T10:59:22.621 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-05-10T10:59:22.624 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-05-10T10:59:22.626 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-05-10T10:59:22.629 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-05-10T10:59:22.633 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-05-10T10:59:22.637 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-05-10T10:59:22.641 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-05-10T10:59:22.644 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-05-10T10:59:22.647 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-05-10T10:59:22.654 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-05-10T10:59:22.657 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-05-10T10:59:22.658 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-05-10T10:59:22.660 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-05-10T10:59:22.661 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-05-10T10:59:22.663 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-05-10T10:59:22.669 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-05-10T10:59:22.677 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-05-10T10:59:22.683 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-05-10T10:59:22.689 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-05-10T10:59:22.691 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-05-10T10:59:22.694 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-05-10T10:59:22.697 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-05-10T10:59:22.700 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-05-10T10:59:22.702 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-05-10T10:59:22.705 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-05-10T10:59:22.710 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-05-10T10:59:22.712 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-05-10T10:59:22.716 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-05-10T10:59:22.717 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-05-10T10:59:22.720 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-05-10T10:59:22.726 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-05-10T10:59:22.728 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-05-10T10:59:22.732 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-05-10T10:59:22.738 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-05-10T10:59:22.741 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-05-10T10:59:22.745 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-05-10T10:59:22.755 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-05-10T10:59:22.764 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-05-10T10:59:22.767 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-05-10T10:59:22.770 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-05-10T10:59:22.773 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-05-10T10:59:22.775 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-05-10T10:59:22.779 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-05-10T10:59:22.783 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-05-10T10:59:22.785 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-05-10T10:59:22.788 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-05-10T10:59:22.792 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-05-10T10:59:22.795 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-05-10T10:59:22.798 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-05-10T10:59:22.801 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-05-10T10:59:22.804 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-05-10T10:59:22.819 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-05-10T10:59:22.824 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-05-10T10:59:22.832 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-05-10T10:59:22.837 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-05-10T10:59:22.840 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-05-10T10:59:22.844 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-05-10T10:59:22.846 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-05-10T10:59:22.848 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-05-10T10:59:22.852 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-05-10T10:59:22.857 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-05-10T10:59:22.862 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-05-10T10:59:22.866 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-05-10T10:59:22.869 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-05-10T10:59:22.873 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-05-10T10:59:22.877 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-05-10T10:59:22.882 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-05-10T10:59:22.886 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-05-10T10:59:22.890 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-05-10T10:59:22.895 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-05-10T10:59:22.898 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-05-10T10:59:22.909 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-05-10T10:59:22.917 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-05-10T10:59:22.920 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-05-10T10:59:22.928 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-05-10T10:59:22.931 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-05-10T10:59:22.935 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-05-10T10:59:22.937 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-05-10T10:59:22.938 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-05-10T10:59:22.940 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-05-10T10:59:22.942 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-05-10T10:59:22.949 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-05-10T10:59:22.954 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-05-10T10:59:22.956 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-05-10T10:59:22.957 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-05-10T10:59:22.958 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-05-10T10:59:22.959 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-05-10T10:59:22.986 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-05-10T10:59:22.989 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-05-10T10:59:22.990 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-05-10T10:59:22.995 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-05-10T10:59:22.999 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-05-10T10:59:23.001 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-05-10T10:59:23.003 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-05-10T10:59:23.005 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-05-10T10:59:23.007 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-05-10T10:59:23.009 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-05-10T10:59:23.011 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-05-10T10:59:23.013 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/digsig.txt 2024-05-10T10:59:23.020 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-05-10T10:59:23.024 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-05-10T10:59:23.028 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-05-10T10:59:23.030 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-05-10T10:59:23.031 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-05-10T10:59:23.035 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-05-10T10:59:23.037 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dontdiff 2024-05-10T10:59:23.038 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/driver-model/ 2024-05-10T10:59:23.041 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-05-10T10:59:23.043 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-05-10T10:59:23.046 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-05-10T10:59:23.047 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-05-10T10:59:23.049 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-05-10T10:59:23.051 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-05-10T10:59:23.052 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-05-10T10:59:23.054 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-05-10T10:59:23.056 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-05-10T10:59:23.057 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-05-10T10:59:23.063 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dvb/ 2024-05-10T10:59:23.066 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-05-10T10:59:23.067 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-05-10T10:59:23.068 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-05-10T10:59:23.071 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-05-10T10:59:23.073 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-05-10T10:59:23.075 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-05-10T10:59:23.076 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-05-10T10:59:23.078 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-05-10T10:59:23.079 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-05-10T10:59:23.081 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-05-10T10:59:23.082 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-05-10T10:59:23.084 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-05-10T10:59:23.085 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-05-10T10:59:23.088 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-05-10T10:59:23.089 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-05-10T10:59:23.091 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-05-10T10:59:23.094 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-05-10T10:59:23.097 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-05-10T10:59:23.097 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/edac.txt 2024-05-10T10:59:23.099 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-05-10T10:59:23.101 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/eisa.txt 2024-05-10T10:59:23.102 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-05-10T10:59:23.104 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/extcon/ 2024-05-10T10:59:23.106 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-05-10T10:59:23.108 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-05-10T10:59:23.112 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-05-10T10:59:23.114 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-05-10T10:59:23.116 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-05-10T10:59:23.118 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/ 2024-05-10T10:59:23.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:23 smithi184 ceph-mon[34585]: pgmap v499: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.3 KiB/s wr, 22 op/s 2024-05-10T10:59:23.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:23 smithi184 ceph-mon[34585]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:59:23.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:23 smithi107 ceph-mon[30373]: pgmap v499: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.3 KiB/s wr, 22 op/s 2024-05-10T10:59:23.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:23 smithi107 ceph-mon[30373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:59:23.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:23 smithi196 ceph-mon[34872]: pgmap v499: 97 pgs: 97 active+clean; 86 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.3 KiB/s wr, 22 op/s 2024-05-10T10:59:23.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:23 smithi196 ceph-mon[34872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:59:25.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:25 smithi184 ceph-mon[34585]: pgmap v500: 97 pgs: 97 active+clean; 86 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8.5 KiB/s wr, 26 op/s 2024-05-10T10:59:25.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:25 smithi107 ceph-mon[30373]: pgmap v500: 97 pgs: 97 active+clean; 86 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8.5 KiB/s wr, 26 op/s 2024-05-10T10:59:25.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:25 smithi196 ceph-mon[34872]: pgmap v500: 97 pgs: 97 active+clean; 86 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8.5 KiB/s wr, 26 op/s 2024-05-10T10:59:27.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:27 smithi184 ceph-mon[34585]: pgmap v501: 97 pgs: 97 active+clean; 92 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 615 KiB/s wr, 97 op/s 2024-05-10T10:59:27.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:27 smithi107 ceph-mon[30373]: pgmap v501: 97 pgs: 97 active+clean; 92 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 615 KiB/s wr, 97 op/s 2024-05-10T10:59:27.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:27 smithi196 ceph-mon[34872]: pgmap v501: 97 pgs: 97 active+clean; 92 MiB data, 659 MiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 615 KiB/s wr, 97 op/s 2024-05-10T10:59:28.070 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-05-10T10:59:28.071 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-05-10T10:59:28.072 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-05-10T10:59:28.073 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-05-10T10:59:28.074 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-05-10T10:59:28.076 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-05-10T10:59:28.077 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-05-10T10:59:28.078 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-05-10T10:59:28.079 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-05-10T10:59:28.080 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-05-10T10:59:28.081 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-05-10T10:59:28.082 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-05-10T10:59:28.083 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-05-10T10:59:28.083 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-05-10T10:59:28.084 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-05-10T10:59:28.085 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-05-10T10:59:28.086 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-05-10T10:59:28.087 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-05-10T10:59:28.088 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-05-10T10:59:28.089 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-05-10T10:59:28.091 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-05-10T10:59:28.092 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-05-10T10:59:28.093 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-05-10T10:59:28.093 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-05-10T10:59:28.094 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-05-10T10:59:28.095 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-05-10T10:59:28.096 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-05-10T10:59:28.097 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-05-10T10:59:28.098 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-05-10T10:59:28.098 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-05-10T10:59:28.099 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-05-10T10:59:28.100 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-05-10T10:59:28.101 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-05-10T10:59:28.102 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-05-10T10:59:28.103 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-05-10T10:59:28.104 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/ 2024-05-10T10:59:28.106 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-05-10T10:59:28.107 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-05-10T10:59:28.108 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-05-10T10:59:28.108 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-05-10T10:59:28.109 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-05-10T10:59:28.110 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-05-10T10:59:28.111 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-05-10T10:59:28.112 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-05-10T10:59:28.113 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-05-10T10:59:28.114 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-05-10T10:59:28.115 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-05-10T10:59:28.116 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-05-10T10:59:28.116 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-05-10T10:59:28.118 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-05-10T10:59:28.119 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-05-10T10:59:28.119 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-05-10T10:59:28.120 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-05-10T10:59:28.121 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-05-10T10:59:28.122 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-05-10T10:59:28.123 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-05-10T10:59:28.123 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-05-10T10:59:28.124 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-05-10T10:59:28.125 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-05-10T10:59:28.126 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-05-10T10:59:28.127 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-05-10T10:59:28.128 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-05-10T10:59:28.128 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-05-10T10:59:28.129 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-05-10T10:59:28.130 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-05-10T10:59:28.131 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-05-10T10:59:28.132 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-05-10T10:59:28.132 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-05-10T10:59:28.133 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-05-10T10:59:28.134 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-05-10T10:59:28.135 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-05-10T10:59:28.136 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-05-10T10:59:28.136 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-05-10T10:59:28.137 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-05-10T10:59:28.138 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-05-10T10:59:28.139 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-05-10T10:59:28.140 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-05-10T10:59:28.141 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-05-10T10:59:28.142 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-05-10T10:59:28.143 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-05-10T10:59:28.144 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-05-10T10:59:28.145 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-05-10T10:59:28.145 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-05-10T10:59:28.146 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-05-10T10:59:28.147 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-05-10T10:59:28.148 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-05-10T10:59:28.149 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-05-10T10:59:28.150 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-05-10T10:59:28.152 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-05-10T10:59:28.153 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-05-10T10:59:28.154 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-05-10T10:59:28.155 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-05-10T10:59:28.156 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-05-10T10:59:28.157 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-05-10T10:59:28.158 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-05-10T10:59:28.159 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-05-10T10:59:28.160 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-05-10T10:59:28.160 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-05-10T10:59:28.161 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-05-10T10:59:28.162 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-05-10T10:59:28.163 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-05-10T10:59:28.164 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-05-10T10:59:28.165 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-05-10T10:59:28.166 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-05-10T10:59:28.167 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-05-10T10:59:28.168 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-05-10T10:59:28.169 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-05-10T10:59:28.170 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-05-10T10:59:28.171 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-05-10T10:59:28.172 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-05-10T10:59:28.173 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-05-10T10:59:28.174 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-05-10T10:59:28.175 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-05-10T10:59:28.176 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-05-10T10:59:28.177 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-05-10T10:59:28.178 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-05-10T10:59:28.179 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-05-10T10:59:28.180 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-05-10T10:59:28.182 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-05-10T10:59:28.183 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-05-10T10:59:28.184 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-05-10T10:59:28.185 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-05-10T10:59:28.186 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-05-10T10:59:28.186 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-05-10T10:59:28.187 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-05-10T10:59:28.188 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-05-10T10:59:28.189 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-05-10T10:59:28.190 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-05-10T10:59:28.192 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-05-10T10:59:28.193 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-05-10T10:59:28.194 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-05-10T10:59:28.195 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-05-10T10:59:28.196 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-05-10T10:59:28.197 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-05-10T10:59:28.197 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-05-10T10:59:28.198 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-05-10T10:59:28.199 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-05-10T10:59:28.200 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-05-10T10:59:28.201 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-05-10T10:59:28.203 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-05-10T10:59:28.203 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-05-10T10:59:28.204 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-05-10T10:59:28.205 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-05-10T10:59:28.207 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-05-10T10:59:28.208 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-05-10T10:59:28.209 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-05-10T10:59:28.210 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-05-10T10:59:28.211 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-05-10T10:59:28.212 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-05-10T10:59:28.213 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-05-10T10:59:28.213 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-05-10T10:59:28.214 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-05-10T10:59:28.217 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-05-10T10:59:28.218 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-05-10T10:59:28.219 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-05-10T10:59:28.220 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fmc/ 2024-05-10T10:59:28.221 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-05-10T10:59:28.222 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-05-10T10:59:28.223 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-05-10T10:59:28.224 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-05-10T10:59:28.226 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-05-10T10:59:28.227 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-05-10T10:59:28.228 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-05-10T10:59:28.229 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-05-10T10:59:28.229 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-05-10T10:59:28.230 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-05-10T10:59:28.231 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-05-10T10:59:28.232 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/frv/ 2024-05-10T10:59:28.234 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-05-10T10:59:28.235 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-05-10T10:59:28.236 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-05-10T10:59:28.237 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-05-10T10:59:28.238 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-05-10T10:59:28.239 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-05-10T10:59:28.240 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-05-10T10:59:28.241 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-05-10T10:59:28.242 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-05-10T10:59:28.243 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-05-10T10:59:28.244 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-05-10T10:59:28.246 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/gcov.txt 2024-05-10T10:59:28.247 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-05-10T10:59:28.249 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/gpio/ 2024-05-10T10:59:28.251 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-05-10T10:59:28.252 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-05-10T10:59:28.253 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-05-10T10:59:28.255 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-05-10T10:59:28.256 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-05-10T10:59:28.257 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-05-10T10:59:28.258 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-05-10T10:59:28.258 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hid/ 2024-05-10T10:59:28.261 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-05-10T10:59:28.262 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-05-10T10:59:28.263 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-05-10T10:59:28.264 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-05-10T10:59:28.265 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-05-10T10:59:28.266 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/highuid.txt 2024-05-10T10:59:28.267 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hsi.txt 2024-05-10T10:59:28.269 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-05-10T10:59:28.270 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ 2024-05-10T10:59:28.272 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-05-10T10:59:28.273 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-05-10T10:59:28.274 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-05-10T10:59:28.275 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-05-10T10:59:28.276 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-05-10T10:59:28.277 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-05-10T10:59:28.278 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-05-10T10:59:28.279 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-05-10T10:59:28.280 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-05-10T10:59:28.281 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-05-10T10:59:28.282 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-05-10T10:59:28.283 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-05-10T10:59:28.284 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-05-10T10:59:28.285 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-05-10T10:59:28.286 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-05-10T10:59:28.286 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-05-10T10:59:28.287 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-05-10T10:59:28.289 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-05-10T10:59:28.290 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-05-10T10:59:28.291 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-05-10T10:59:28.292 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-05-10T10:59:28.293 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-05-10T10:59:28.294 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-05-10T10:59:28.294 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-05-10T10:59:28.296 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-05-10T10:59:28.296 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-05-10T10:59:28.297 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-05-10T10:59:28.298 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-05-10T10:59:28.299 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-05-10T10:59:28.300 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-05-10T10:59:28.301 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-05-10T10:59:28.302 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-05-10T10:59:28.304 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-05-10T10:59:28.305 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-05-10T10:59:28.306 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-05-10T10:59:28.307 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-05-10T10:59:28.308 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-05-10T10:59:28.309 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-05-10T10:59:28.310 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-05-10T10:59:28.311 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-05-10T10:59:28.311 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-05-10T10:59:28.312 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-05-10T10:59:28.313 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-05-10T10:59:28.314 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-05-10T10:59:28.315 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-05-10T10:59:28.316 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-05-10T10:59:28.317 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-05-10T10:59:28.319 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-05-10T10:59:28.320 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-05-10T10:59:28.321 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-05-10T10:59:28.323 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-05-10T10:59:28.325 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-05-10T10:59:28.326 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-05-10T10:59:28.327 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-05-10T10:59:28.329 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-05-10T10:59:28.330 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-05-10T10:59:28.332 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-05-10T10:59:28.333 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-05-10T10:59:28.335 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-05-10T10:59:28.336 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-05-10T10:59:28.338 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-05-10T10:59:28.339 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-05-10T10:59:28.340 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-05-10T10:59:28.342 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-05-10T10:59:28.343 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-05-10T10:59:28.344 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-05-10T10:59:28.345 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-05-10T10:59:28.346 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-05-10T10:59:28.347 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-05-10T10:59:28.347 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-05-10T10:59:28.348 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-05-10T10:59:28.349 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-05-10T10:59:28.350 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-05-10T10:59:28.351 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-05-10T10:59:28.352 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-05-10T10:59:28.353 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-05-10T10:59:28.354 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-05-10T10:59:28.355 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-05-10T10:59:28.355 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-05-10T10:59:28.356 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-05-10T10:59:28.357 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-05-10T10:59:28.358 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-05-10T10:59:28.359 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-05-10T10:59:28.360 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-05-10T10:59:28.361 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-05-10T10:59:28.362 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-05-10T10:59:28.363 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-05-10T10:59:28.364 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-05-10T10:59:28.365 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-05-10T10:59:28.366 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-05-10T10:59:28.367 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-05-10T10:59:28.368 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-05-10T10:59:28.369 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-05-10T10:59:28.369 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-05-10T10:59:28.370 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-05-10T10:59:28.371 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-05-10T10:59:28.372 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-05-10T10:59:28.373 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-05-10T10:59:28.374 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-05-10T10:59:28.375 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-05-10T10:59:28.376 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-05-10T10:59:28.376 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-05-10T10:59:28.377 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-05-10T10:59:28.378 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-05-10T10:59:28.379 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-05-10T10:59:28.379 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-05-10T10:59:28.380 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-05-10T10:59:28.381 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-05-10T10:59:28.382 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-05-10T10:59:28.383 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-05-10T10:59:28.384 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-05-10T10:59:28.385 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-05-10T10:59:28.386 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-05-10T10:59:28.387 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-05-10T10:59:28.388 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-05-10T10:59:28.389 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-05-10T10:59:28.389 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-05-10T10:59:28.390 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-05-10T10:59:28.391 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-05-10T10:59:28.392 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-05-10T10:59:28.393 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-05-10T10:59:28.394 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-05-10T10:59:28.395 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-05-10T10:59:28.396 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-05-10T10:59:28.397 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-05-10T10:59:28.398 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-05-10T10:59:28.400 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-05-10T10:59:28.401 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-05-10T10:59:28.402 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-05-10T10:59:28.403 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-05-10T10:59:28.404 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-05-10T10:59:28.404 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-05-10T10:59:28.405 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-05-10T10:59:28.406 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-05-10T10:59:28.407 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-05-10T10:59:28.408 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-05-10T10:59:28.409 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-05-10T10:59:28.411 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/ 2024-05-10T10:59:28.413 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-05-10T10:59:28.414 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-05-10T10:59:28.415 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-05-10T10:59:28.416 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-05-10T10:59:28.417 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-05-10T10:59:28.417 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-05-10T10:59:28.418 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-05-10T10:59:28.419 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-05-10T10:59:28.420 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-05-10T10:59:28.421 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-05-10T10:59:28.422 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-05-10T10:59:28.423 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-05-10T10:59:28.424 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-05-10T10:59:28.425 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-05-10T10:59:28.426 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-05-10T10:59:28.427 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-05-10T10:59:28.427 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-05-10T10:59:28.428 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-05-10T10:59:28.429 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-05-10T10:59:28.430 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-05-10T10:59:28.431 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-05-10T10:59:28.432 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-05-10T10:59:28.433 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-05-10T10:59:28.434 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-05-10T10:59:28.434 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-05-10T10:59:28.435 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-05-10T10:59:28.436 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-05-10T10:59:28.437 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-05-10T10:59:28.438 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-05-10T10:59:28.439 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-05-10T10:59:28.440 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-05-10T10:59:28.441 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-05-10T10:59:28.442 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/summary 2024-05-10T10:59:28.443 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-05-10T10:59:28.444 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-05-10T10:59:28.445 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-05-10T10:59:28.445 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2o/ 2024-05-10T10:59:28.447 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2o/README 2024-05-10T10:59:28.448 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-05-10T10:59:28.449 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ia64/ 2024-05-10T10:59:28.451 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-05-10T10:59:28.452 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-05-10T10:59:28.454 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-05-10T10:59:28.455 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ia64/README 2024-05-10T10:59:28.455 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-05-10T10:59:28.456 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-05-10T10:59:28.457 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-05-10T10:59:28.458 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-05-10T10:59:28.459 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-05-10T10:59:28.460 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-05-10T10:59:28.462 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-05-10T10:59:28.463 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-05-10T10:59:28.464 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ide/ 2024-05-10T10:59:28.465 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-05-10T10:59:28.466 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-05-10T10:59:28.467 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-05-10T10:59:28.468 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-05-10T10:59:28.469 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-05-10T10:59:28.470 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-05-10T10:59:28.471 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-05-10T10:59:28.472 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/infiniband/ 2024-05-10T10:59:28.475 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-05-10T10:59:28.475 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-05-10T10:59:28.476 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-05-10T10:59:28.477 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-05-10T10:59:28.478 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-05-10T10:59:28.479 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/init.txt 2024-05-10T10:59:28.481 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/initrd.txt 2024-05-10T10:59:28.482 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/ 2024-05-10T10:59:28.483 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-05-10T10:59:28.484 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-05-10T10:59:28.485 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-05-10T10:59:28.486 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-05-10T10:59:28.488 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-05-10T10:59:28.489 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-05-10T10:59:28.490 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-05-10T10:59:28.490 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-05-10T10:59:28.491 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-05-10T10:59:28.492 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-05-10T10:59:28.493 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-05-10T10:59:28.494 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-05-10T10:59:28.495 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-05-10T10:59:28.496 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-05-10T10:59:28.497 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-05-10T10:59:28.498 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-05-10T10:59:28.499 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-05-10T10:59:28.500 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/input.txt 2024-05-10T10:59:28.502 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-05-10T10:59:28.503 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-05-10T10:59:28.503 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-05-10T10:59:28.504 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-05-10T10:59:28.505 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-05-10T10:59:28.506 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-05-10T10:59:28.507 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-05-10T10:59:28.508 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-05-10T10:59:28.509 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-05-10T10:59:28.510 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-05-10T10:59:28.511 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-05-10T10:59:28.512 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-05-10T10:59:28.513 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-05-10T10:59:28.513 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-05-10T10:59:28.515 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-05-10T10:59:28.517 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-05-10T10:59:28.518 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ioctl/ 2024-05-10T10:59:28.519 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-05-10T10:59:28.520 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-05-10T10:59:28.521 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-05-10T10:59:28.522 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-05-10T10:59:28.523 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-05-10T10:59:28.524 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-05-10T10:59:28.525 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/iostats.txt 2024-05-10T10:59:28.526 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-05-10T10:59:28.528 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-05-10T10:59:28.529 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/ 2024-05-10T10:59:28.530 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-05-10T10:59:28.531 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-05-10T10:59:28.532 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-05-10T10:59:28.533 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-05-10T10:59:28.534 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-05-10T10:59:28.535 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-05-10T10:59:28.536 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/README 2024-05-10T10:59:28.538 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-05-10T10:59:28.538 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-05-10T10:59:28.539 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-05-10T10:59:28.540 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-05-10T10:59:28.541 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-05-10T10:59:28.542 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-05-10T10:59:28.543 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-05-10T10:59:28.544 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-05-10T10:59:28.545 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-05-10T10:59:28.546 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-05-10T10:59:28.547 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-05-10T10:59:28.548 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-05-10T10:59:28.549 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-05-10T10:59:28.550 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-05-10T10:59:28.551 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-05-10T10:59:28.552 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-05-10T10:59:28.553 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-05-10T10:59:28.554 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-05-10T10:59:28.555 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-05-10T10:59:28.556 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-05-10T10:59:28.557 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-05-10T10:59:28.558 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-05-10T10:59:28.559 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-05-10T10:59:28.559 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-05-10T10:59:28.560 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/java.txt 2024-05-10T10:59:28.562 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kasan.txt 2024-05-10T10:59:28.563 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kbuild/ 2024-05-10T10:59:28.565 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-05-10T10:59:28.566 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-05-10T10:59:28.567 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-05-10T10:59:28.568 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-05-10T10:59:28.568 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-05-10T10:59:28.569 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-05-10T10:59:28.571 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-05-10T10:59:28.572 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kdump/ 2024-05-10T10:59:28.573 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-05-10T10:59:28.574 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-05-10T10:59:28.575 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-05-10T10:59:28.576 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-05-10T10:59:28.577 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-05-10T10:59:28.580 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-05-10T10:59:28.581 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-05-10T10:59:28.583 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-05-10T10:59:28.765 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-05-10T10:59:28.767 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-05-10T10:59:28.768 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-05-10T10:59:28.768 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kobject.txt 2024-05-10T10:59:28.770 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-05-10T10:59:28.771 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kref.txt 2024-05-10T10:59:28.773 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-05-10T10:59:28.774 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/laptops/ 2024-05-10T10:59:28.776 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-05-10T10:59:28.776 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-05-10T10:59:28.777 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-05-10T10:59:28.778 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-05-10T10:59:28.779 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-05-10T10:59:28.780 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-05-10T10:59:28.781 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-05-10T10:59:28.782 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-05-10T10:59:28.783 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-05-10T10:59:28.784 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-05-10T10:59:28.785 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-05-10T10:59:28.786 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-05-10T10:59:28.787 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ldm.txt 2024-05-10T10:59:28.789 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/leds/ 2024-05-10T10:59:28.791 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-05-10T10:59:28.791 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-05-10T10:59:28.793 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-05-10T10:59:28.794 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-05-10T10:59:28.795 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-05-10T10:59:28.796 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-05-10T10:59:28.797 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-05-10T10:59:28.798 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-05-10T10:59:28.799 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-05-10T10:59:28.800 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-05-10T10:59:28.801 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-05-10T10:59:28.802 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-05-10T10:59:28.804 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/locking/ 2024-05-10T10:59:28.805 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-05-10T10:59:28.806 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-05-10T10:59:28.807 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-05-10T10:59:28.808 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-05-10T10:59:28.809 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-05-10T10:59:28.810 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-05-10T10:59:28.811 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-05-10T10:59:28.812 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-05-10T10:59:28.813 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-05-10T10:59:28.814 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-05-10T10:59:28.815 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-05-10T10:59:28.816 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/logo.gif 2024-05-10T10:59:28.818 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/logo.txt 2024-05-10T10:59:28.819 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/lzo.txt 2024-05-10T10:59:28.820 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/m68k/ 2024-05-10T10:59:28.822 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-05-10T10:59:28.822 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-05-10T10:59:28.824 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-05-10T10:59:28.824 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-05-10T10:59:28.826 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-05-10T10:59:28.830 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/md.txt 2024-05-10T10:59:28.831 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-05-10T10:59:28.831 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-05-10T10:59:28.865 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-05-10T10:59:28.867 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-05-10T10:59:28.868 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-05-10T10:59:28.870 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/metag/ 2024-05-10T10:59:28.872 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-05-10T10:59:28.873 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-05-10T10:59:28.873 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mic/ 2024-05-10T10:59:28.875 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-05-10T10:59:28.876 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-05-10T10:59:28.877 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-05-10T10:59:28.878 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-05-10T10:59:28.879 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-05-10T10:59:28.880 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-05-10T10:59:28.881 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-05-10T10:59:28.882 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-05-10T10:59:28.883 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-05-10T10:59:28.884 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-05-10T10:59:28.885 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mips/ 2024-05-10T10:59:28.887 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-05-10T10:59:28.889 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-05-10T10:59:28.889 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-05-10T10:59:28.891 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-05-10T10:59:28.892 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-05-10T10:59:28.893 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-05-10T10:59:28.894 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-05-10T10:59:28.895 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-05-10T10:59:28.895 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-05-10T10:59:28.896 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-05-10T10:59:28.897 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-05-10T10:59:28.898 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-05-10T10:59:28.899 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-05-10T10:59:28.900 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-05-10T10:59:28.901 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-05-10T10:59:28.901 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-05-10T10:59:28.902 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-05-10T10:59:28.903 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-05-10T10:59:28.904 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-05-10T10:59:28.905 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-05-10T10:59:28.906 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-05-10T10:59:28.907 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mmc/ 2024-05-10T10:59:28.909 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-05-10T10:59:28.909 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-05-10T10:59:28.910 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-05-10T10:59:28.911 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-05-10T10:59:28.912 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mn10300/ 2024-05-10T10:59:28.915 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-05-10T10:59:28.916 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-05-10T10:59:28.917 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-05-10T10:59:28.918 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mono.txt 2024-05-10T10:59:28.919 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mtd/ 2024-05-10T10:59:28.921 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-05-10T10:59:28.921 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-05-10T10:59:28.922 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-05-10T10:59:28.923 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-05-10T10:59:28.924 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/namespaces/ 2024-05-10T10:59:28.926 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-05-10T10:59:28.927 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-05-10T10:59:28.928 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/netlabel/ 2024-05-10T10:59:28.930 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-05-10T10:59:28.931 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-05-10T10:59:28.932 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-05-10T10:59:28.933 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-05-10T10:59:28.933 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-05-10T10:59:28.934 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/ 2024-05-10T10:59:28.936 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-05-10T10:59:28.937 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-05-10T10:59:28.937 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-05-10T10:59:28.938 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-05-10T10:59:28.940 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-05-10T10:59:28.940 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-05-10T10:59:28.942 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-05-10T10:59:28.942 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-05-10T10:59:28.943 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-05-10T10:59:28.944 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-05-10T10:59:28.945 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-05-10T10:59:28.946 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-05-10T10:59:28.948 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-05-10T10:59:28.949 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-05-10T10:59:28.950 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-05-10T10:59:28.951 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-05-10T10:59:28.952 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-05-10T10:59:28.953 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-05-10T10:59:28.953 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-05-10T10:59:28.954 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-05-10T10:59:28.956 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-05-10T10:59:28.957 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-05-10T10:59:28.957 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-05-10T10:59:28.958 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-05-10T10:59:28.959 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-05-10T10:59:28.960 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-05-10T10:59:28.961 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-05-10T10:59:28.962 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-05-10T10:59:28.963 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-05-10T10:59:28.964 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-05-10T10:59:28.965 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-05-10T10:59:28.966 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-05-10T10:59:28.966 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-05-10T10:59:28.967 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-05-10T10:59:28.968 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-05-10T10:59:28.969 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-05-10T10:59:28.970 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-05-10T10:59:28.971 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-05-10T10:59:28.971 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-05-10T10:59:28.972 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-05-10T10:59:28.973 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-05-10T10:59:28.974 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-05-10T10:59:28.975 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-05-10T10:59:28.975 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-05-10T10:59:28.976 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-05-10T10:59:28.977 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-05-10T10:59:28.978 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-05-10T10:59:28.979 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-05-10T10:59:28.980 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-05-10T10:59:28.981 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-05-10T10:59:28.982 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-05-10T10:59:28.983 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-05-10T10:59:28.984 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-05-10T10:59:28.985 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-05-10T10:59:28.986 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-05-10T10:59:28.987 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-05-10T10:59:28.988 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-05-10T10:59:28.988 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-05-10T10:59:28.989 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-05-10T10:59:28.991 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-05-10T10:59:28.991 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-05-10T10:59:28.992 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-05-10T10:59:28.993 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-05-10T10:59:28.994 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-05-10T10:59:28.995 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-05-10T10:59:28.996 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-05-10T10:59:28.997 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-05-10T10:59:28.999 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-05-10T10:59:28.999 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-05-10T10:59:29.000 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-05-10T10:59:29.001 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-05-10T10:59:29.002 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-05-10T10:59:29.003 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-05-10T10:59:29.004 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-05-10T10:59:29.005 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-05-10T10:59:29.006 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-05-10T10:59:29.007 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-05-10T10:59:29.008 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-05-10T10:59:29.009 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-05-10T10:59:29.010 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-05-10T10:59:29.011 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-05-10T10:59:29.012 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-05-10T10:59:29.013 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-05-10T10:59:29.014 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-05-10T10:59:29.015 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-05-10T10:59:29.016 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-05-10T10:59:29.016 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-05-10T10:59:29.017 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-05-10T10:59:29.018 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-05-10T10:59:29.020 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-05-10T10:59:29.020 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-05-10T10:59:29.021 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-05-10T10:59:29.023 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-05-10T10:59:29.023 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-05-10T10:59:29.024 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-05-10T10:59:29.026 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-05-10T10:59:29.027 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-05-10T10:59:29.029 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-05-10T10:59:29.029 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-05-10T10:59:29.035 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-05-10T10:59:29.035 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-05-10T10:59:29.035 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-05-10T10:59:29.035 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-05-10T10:59:29.035 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-05-10T10:59:29.035 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-05-10T10:59:29.036 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-05-10T10:59:29.036 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-05-10T10:59:29.037 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-05-10T10:59:29.038 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-05-10T10:59:29.039 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-05-10T10:59:29.040 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-05-10T10:59:29.041 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-05-10T10:59:29.041 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-05-10T10:59:29.042 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-05-10T10:59:29.043 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-05-10T10:59:29.044 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-05-10T10:59:29.045 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-05-10T10:59:29.046 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-05-10T10:59:29.047 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-05-10T10:59:29.047 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-05-10T10:59:29.048 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-05-10T10:59:29.049 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-05-10T10:59:29.050 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-05-10T10:59:29.051 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-05-10T10:59:29.052 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-05-10T10:59:29.053 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-05-10T10:59:29.054 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-05-10T10:59:29.055 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-05-10T10:59:29.056 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-05-10T10:59:29.057 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-05-10T10:59:29.058 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-05-10T10:59:29.059 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-05-10T10:59:29.060 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-05-10T10:59:29.061 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-05-10T10:59:29.062 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-05-10T10:59:29.063 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/nfc/ 2024-05-10T10:59:29.066 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-05-10T10:59:29.066 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-05-10T10:59:29.067 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/nios2/ 2024-05-10T10:59:29.070 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/nios2/README 2024-05-10T10:59:29.070 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-05-10T10:59:29.072 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/numastat.txt 2024-05-10T10:59:29.073 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-05-10T10:59:29.075 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/padata.txt 2024-05-10T10:59:29.076 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/parisc/ 2024-05-10T10:59:29.079 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-05-10T10:59:29.080 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-05-10T10:59:29.081 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/parisc/registers 2024-05-10T10:59:29.081 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-05-10T10:59:29.083 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/parport.txt 2024-05-10T10:59:29.085 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-05-10T10:59:29.087 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-05-10T10:59:29.088 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-05-10T10:59:29.089 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-05-10T10:59:29.090 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-05-10T10:59:29.090 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-05-10T10:59:29.091 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-05-10T10:59:29.092 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-05-10T10:59:29.093 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-05-10T10:59:29.095 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/phy.txt 2024-05-10T10:59:29.097 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/phy/ 2024-05-10T10:59:29.098 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-05-10T10:59:29.099 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-05-10T10:59:29.101 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-05-10T10:59:29.102 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/platform/ 2024-05-10T10:59:29.104 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-05-10T10:59:29.104 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/pnp.txt 2024-05-10T10:59:29.106 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/ 2024-05-10T10:59:29.107 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-05-10T10:59:29.108 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-05-10T10:59:29.108 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-05-10T10:59:29.109 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-05-10T10:59:29.110 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-05-10T10:59:29.111 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-05-10T10:59:29.112 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-05-10T10:59:29.113 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-05-10T10:59:29.114 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-05-10T10:59:29.115 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-05-10T10:59:29.116 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-05-10T10:59:29.117 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-05-10T10:59:29.118 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-05-10T10:59:29.119 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-05-10T10:59:29.120 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-05-10T10:59:29.121 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-05-10T10:59:29.122 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-05-10T10:59:29.123 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-05-10T10:59:29.123 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-05-10T10:59:29.124 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-05-10T10:59:29.125 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-05-10T10:59:29.126 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-05-10T10:59:29.127 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-05-10T10:59:29.128 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/states.txt 2024-05-10T10:59:29.129 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-05-10T10:59:29.130 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-05-10T10:59:29.131 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-05-10T10:59:29.132 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-05-10T10:59:29.134 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-05-10T10:59:29.135 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-05-10T10:59:29.136 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-05-10T10:59:29.137 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/power/video.txt 2024-05-10T10:59:29.138 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/powerpc/ 2024-05-10T10:59:29.140 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-05-10T10:59:29.141 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-05-10T10:59:29.141 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-05-10T10:59:29.142 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-05-10T10:59:29.143 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-05-10T10:59:29.144 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-05-10T10:59:29.145 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-05-10T10:59:29.146 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-05-10T10:59:29.147 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-05-10T10:59:29.148 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-05-10T10:59:29.149 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-05-10T10:59:29.150 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-05-10T10:59:29.151 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-05-10T10:59:29.152 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/pps/ 2024-05-10T10:59:29.154 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-05-10T10:59:29.155 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/prctl/ 2024-05-10T10:59:29.156 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-05-10T10:59:29.157 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-05-10T10:59:29.158 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-05-10T10:59:29.160 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-05-10T10:59:29.161 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-05-10T10:59:29.161 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-05-10T10:59:29.162 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-05-10T10:59:29.163 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-05-10T10:59:29.165 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-05-10T10:59:29.166 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/pti/ 2024-05-10T10:59:29.168 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-05-10T10:59:29.168 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ptp/ 2024-05-10T10:59:29.170 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-05-10T10:59:29.171 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-05-10T10:59:29.172 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-05-10T10:59:29.173 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-05-10T10:59:29.173 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-05-10T10:59:29.174 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/pwm.txt 2024-05-10T10:59:29.176 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-05-10T10:59:29.177 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/rapidio/ 2024-05-10T10:59:29.179 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-05-10T10:59:29.180 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-05-10T10:59:29.180 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-05-10T10:59:29.181 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-05-10T10:59:29.182 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-05-10T10:59:29.184 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-05-10T10:59:29.185 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-05-10T10:59:29.187 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-05-10T10:59:29.188 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-05-10T10:59:29.189 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/rtc.txt 2024-05-10T10:59:29.191 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/s390/ 2024-05-10T10:59:29.192 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-05-10T10:59:29.193 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-05-10T10:59:29.194 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-05-10T10:59:29.195 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-05-10T10:59:29.196 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/s390/DASD 2024-05-10T10:59:29.197 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-05-10T10:59:29.198 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-05-10T10:59:29.199 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-05-10T10:59:29.200 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-05-10T10:59:29.201 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-05-10T10:59:29.202 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-05-10T10:59:29.203 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-05-10T10:59:29.204 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-05-10T10:59:29.205 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-05-10T10:59:29.206 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scheduler/ 2024-05-10T10:59:29.208 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-05-10T10:59:29.208 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-05-10T10:59:29.209 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-05-10T10:59:29.210 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-05-10T10:59:29.211 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-05-10T10:59:29.212 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-05-10T10:59:29.213 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-05-10T10:59:29.215 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-05-10T10:59:29.215 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-05-10T10:59:29.216 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-05-10T10:59:29.217 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/ 2024-05-10T10:59:29.220 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-05-10T10:59:29.221 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-05-10T10:59:29.222 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-05-10T10:59:29.223 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-05-10T10:59:29.225 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-05-10T10:59:29.226 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-05-10T10:59:29.227 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-05-10T10:59:29.228 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-05-10T10:59:29.229 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-05-10T10:59:29.231 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-05-10T10:59:29.232 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-05-10T10:59:29.233 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-05-10T10:59:29.234 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-05-10T10:59:29.235 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-05-10T10:59:29.236 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-05-10T10:59:29.238 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-05-10T10:59:29.239 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-05-10T10:59:29.240 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-05-10T10:59:29.241 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-05-10T10:59:29.242 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-05-10T10:59:29.244 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-05-10T10:59:29.245 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-05-10T10:59:29.246 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-05-10T10:59:29.248 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-05-10T10:59:29.249 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-05-10T10:59:29.250 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-05-10T10:59:29.252 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-05-10T10:59:29.253 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-05-10T10:59:29.254 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-05-10T10:59:29.255 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-05-10T10:59:29.256 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-05-10T10:59:29.257 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-05-10T10:59:29.258 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-05-10T10:59:29.259 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-05-10T10:59:29.260 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-05-10T10:59:29.261 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-05-10T10:59:29.262 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-05-10T10:59:29.263 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-05-10T10:59:29.264 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-05-10T10:59:29.265 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-05-10T10:59:29.266 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-05-10T10:59:29.268 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-05-10T10:59:29.269 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-05-10T10:59:29.270 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-05-10T10:59:29.271 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-05-10T10:59:29.272 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-05-10T10:59:29.273 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-05-10T10:59:29.274 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-05-10T10:59:29.275 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-05-10T10:59:29.276 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-05-10T10:59:29.278 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-05-10T10:59:29.279 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-05-10T10:59:29.280 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-05-10T10:59:29.281 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-05-10T10:59:29.283 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-05-10T10:59:29.284 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-05-10T10:59:29.285 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-05-10T10:59:29.287 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-05-10T10:59:29.288 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-05-10T10:59:29.289 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/security/ 2024-05-10T10:59:29.293 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-05-10T10:59:29.294 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-05-10T10:59:29.296 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-05-10T10:59:29.297 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-05-10T10:59:29.299 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-05-10T10:59:29.300 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-05-10T10:59:29.301 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-05-10T10:59:29.303 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-05-10T10:59:29.304 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-05-10T10:59:29.306 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-05-10T10:59:29.307 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-05-10T10:59:29.308 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-05-10T10:59:29.310 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-05-10T10:59:29.311 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-05-10T10:59:29.313 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/serial/ 2024-05-10T10:59:29.315 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-05-10T10:59:29.316 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-05-10T10:59:29.317 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/serial/driver 2024-05-10T10:59:29.318 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-05-10T10:59:29.319 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-05-10T10:59:29.321 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-05-10T10:59:29.322 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-05-10T10:59:29.323 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-05-10T10:59:29.324 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-05-10T10:59:29.326 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sh/ 2024-05-10T10:59:29.328 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-05-10T10:59:29.329 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-05-10T10:59:29.330 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-05-10T10:59:29.332 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/ 2024-05-10T10:59:29.334 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-05-10T10:59:29.335 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-05-10T10:59:29.336 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-05-10T10:59:29.337 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-05-10T10:59:29.338 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-05-10T10:59:29.339 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-05-10T10:59:29.341 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-05-10T10:59:29.342 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-05-10T10:59:29.343 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-05-10T10:59:29.344 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-05-10T10:59:29.345 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-05-10T10:59:29.346 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-05-10T10:59:29.348 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-05-10T10:59:29.349 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-05-10T10:59:29.350 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-05-10T10:59:29.351 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-05-10T10:59:29.352 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-05-10T10:59:29.353 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-05-10T10:59:29.354 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-05-10T10:59:29.355 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-05-10T10:59:29.356 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-05-10T10:59:29.357 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-05-10T10:59:29.359 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-05-10T10:59:29.360 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-05-10T10:59:29.361 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-05-10T10:59:29.362 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-05-10T10:59:29.363 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-05-10T10:59:29.364 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-05-10T10:59:29.365 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-05-10T10:59:29.366 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-05-10T10:59:29.368 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-05-10T10:59:29.369 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-05-10T10:59:29.370 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-05-10T10:59:29.372 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-05-10T10:59:29.373 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-05-10T10:59:29.375 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-05-10T10:59:29.376 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-05-10T10:59:29.377 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-05-10T10:59:29.379 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-05-10T10:59:29.380 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-05-10T10:59:29.381 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-05-10T10:59:29.382 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-05-10T10:59:29.383 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-05-10T10:59:29.384 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-05-10T10:59:29.385 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-05-10T10:59:29.386 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-05-10T10:59:29.388 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-05-10T10:59:29.389 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-05-10T10:59:29.390 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-05-10T10:59:29.391 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-05-10T10:59:29.392 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-05-10T10:59:29.393 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-05-10T10:59:29.394 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-05-10T10:59:29.395 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-05-10T10:59:29.396 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-05-10T10:59:29.397 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-05-10T10:59:29.399 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-05-10T10:59:29.400 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-05-10T10:59:29.401 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-05-10T10:59:29.402 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-05-10T10:59:29.403 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-05-10T10:59:29.405 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-05-10T10:59:29.407 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sparse.txt 2024-05-10T10:59:29.409 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/spi/ 2024-05-10T10:59:29.412 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-05-10T10:59:29.413 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-05-10T10:59:29.415 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-05-10T10:59:29.417 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-05-10T10:59:29.418 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-05-10T10:59:29.420 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-05-10T10:59:29.422 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-05-10T10:59:29.423 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-05-10T10:59:29.425 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-05-10T10:59:29.427 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/spi/spidev 2024-05-10T10:59:29.428 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-05-10T10:59:29.430 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-05-10T10:59:29.431 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-05-10T10:59:29.434 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-05-10T10:59:29.435 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-05-10T10:59:29.437 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/svga.txt 2024-05-10T10:59:29.439 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sysctl/ 2024-05-10T10:59:29.441 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-05-10T10:59:29.442 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sysctl/README 2024-05-10T10:59:29.447 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-05-10T10:59:29.447 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-05-10T10:59:29.447 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-05-10T10:59:29.447 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-05-10T10:59:29.447 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-05-10T10:59:29.448 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-05-10T10:59:29.449 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-05-10T10:59:29.451 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-05-10T10:59:29.452 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/target/ 2024-05-10T10:59:29.454 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-05-10T10:59:29.455 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-05-10T10:59:29.456 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-05-10T10:59:29.458 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/thermal/ 2024-05-10T10:59:29.461 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-05-10T10:59:29.461 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-05-10T10:59:29.462 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-05-10T10:59:29.463 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-05-10T10:59:29.464 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-05-10T10:59:29.465 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-05-10T10:59:29.467 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-05-10T10:59:29.468 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-05-10T10:59:29.469 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/timers/ 2024-05-10T10:59:29.471 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-05-10T10:59:29.472 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-05-10T10:59:29.473 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-05-10T10:59:29.474 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-05-10T10:59:29.476 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-05-10T10:59:29.477 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-05-10T10:59:29.478 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-05-10T10:59:29.479 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-05-10T10:59:29.480 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-05-10T10:59:29.481 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-05-10T10:59:29.482 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-05-10T10:59:29.483 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/tpm/ 2024-05-10T10:59:29.486 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-05-10T10:59:29.487 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/trace/ 2024-05-10T10:59:29.489 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-05-10T10:59:29.490 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-05-10T10:59:29.491 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-05-10T10:59:29.492 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-05-10T10:59:29.494 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-05-10T10:59:29.495 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-05-10T10:59:29.496 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-05-10T10:59:29.498 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-05-10T10:59:29.499 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-05-10T10:59:29.500 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-05-10T10:59:29.501 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-05-10T10:59:29.502 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-05-10T10:59:29.503 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-05-10T10:59:29.504 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-05-10T10:59:29.505 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-05-10T10:59:29.506 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-05-10T10:59:29.507 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-05-10T10:59:29.508 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-05-10T10:59:29.510 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/unicode.txt 2024-05-10T10:59:29.511 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/unshare.txt 2024-05-10T10:59:29.512 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/ 2024-05-10T10:59:29.515 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-05-10T10:59:29.515 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-05-10T10:59:29.517 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-05-10T10:59:29.517 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-05-10T10:59:29.519 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-05-10T10:59:29.520 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-05-10T10:59:29.521 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-05-10T10:59:29.521 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-05-10T10:59:29.523 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-05-10T10:59:29.524 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-05-10T10:59:29.525 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-05-10T10:59:29.526 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-05-10T10:59:29.527 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-05-10T10:59:29.528 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-05-10T10:59:29.529 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-05-10T10:59:29.530 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-05-10T10:59:29.531 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-05-10T10:59:29.532 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-05-10T10:59:29.533 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-05-10T10:59:29.534 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-05-10T10:59:29.535 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-05-10T10:59:29.536 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-05-10T10:59:29.537 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-05-10T10:59:29.538 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-05-10T10:59:29.539 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-05-10T10:59:29.540 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-05-10T10:59:29.541 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-05-10T10:59:29.542 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-05-10T10:59:29.543 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-05-10T10:59:29.544 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-05-10T10:59:29.545 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-05-10T10:59:29.546 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-05-10T10:59:29.547 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-05-10T10:59:29.548 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-05-10T10:59:29.549 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-05-10T10:59:29.550 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-05-10T10:59:29.551 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vDSO/ 2024-05-10T10:59:29.554 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-05-10T10:59:29.555 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-05-10T10:59:29.556 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-05-10T10:59:29.557 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-05-10T10:59:29.558 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-05-10T10:59:29.559 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vfio.txt 2024-05-10T10:59:29.560 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-05-10T10:59:29.562 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video-output.txt 2024-05-10T10:59:29.563 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/ 2024-05-10T10:59:29.565 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-05-10T10:59:29.565 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-05-10T10:59:29.566 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-05-10T10:59:29.567 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-05-10T10:59:29.568 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-05-10T10:59:29.569 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-05-10T10:59:29.570 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-05-10T10:59:29.571 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-05-10T10:59:29.572 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-05-10T10:59:29.573 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-05-10T10:59:29.574 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-05-10T10:59:29.575 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-05-10T10:59:29.575 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-05-10T10:59:29.576 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-05-10T10:59:29.577 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-05-10T10:59:29.578 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-05-10T10:59:29.579 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-05-10T10:59:29.580 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-05-10T10:59:29.581 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-05-10T10:59:29.582 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-05-10T10:59:29.583 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-05-10T10:59:29.583 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-05-10T10:59:29.584 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-05-10T10:59:29.585 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-05-10T10:59:29.586 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-05-10T10:59:29.586 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-05-10T10:59:29.587 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-05-10T10:59:29.588 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-05-10T10:59:29.589 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-05-10T10:59:29.590 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-05-10T10:59:29.591 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-05-10T10:59:29.592 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-05-10T10:59:29.593 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-05-10T10:59:29.593 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-05-10T10:59:29.594 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-05-10T10:59:29.595 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-05-10T10:59:29.596 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-05-10T10:59:29.597 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-05-10T10:59:29.598 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-05-10T10:59:29.598 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-05-10T10:59:29.599 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-05-10T10:59:29.600 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-05-10T10:59:29.601 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-05-10T10:59:29.602 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-05-10T10:59:29.603 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-05-10T10:59:29.603 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-05-10T10:59:29.604 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-05-10T10:59:29.605 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-05-10T10:59:29.606 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-05-10T10:59:29.607 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-05-10T10:59:29.608 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-05-10T10:59:29.609 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-05-10T10:59:29.610 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-05-10T10:59:29.610 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-05-10T10:59:29.611 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-05-10T10:59:29.612 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-05-10T10:59:29.613 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-05-10T10:59:29.614 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-05-10T10:59:29.615 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-05-10T10:59:29.616 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-05-10T10:59:29.617 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-05-10T10:59:29.618 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-05-10T10:59:29.619 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-05-10T10:59:29.620 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-05-10T10:59:29.621 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-05-10T10:59:29.622 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-05-10T10:59:29.623 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-05-10T10:59:29.624 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-05-10T10:59:29.625 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-05-10T10:59:29.626 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-05-10T10:59:29.627 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-05-10T10:59:29.628 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-05-10T10:59:29.629 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-05-10T10:59:29.629 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-05-10T10:59:29.630 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-05-10T10:59:29.631 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-05-10T10:59:29.632 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-05-10T10:59:29.633 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-05-10T10:59:29.634 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/ 2024-05-10T10:59:29.636 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-05-10T10:59:29.637 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-05-10T10:59:29.638 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-05-10T10:59:29.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:29 smithi184 ceph-mon[34585]: pgmap v502: 97 pgs: 97 active+clean; 98 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 1.1 MiB/s wr, 159 op/s 2024-05-10T10:59:29.639 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-05-10T10:59:29.640 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-05-10T10:59:29.641 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-05-10T10:59:29.641 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-05-10T10:59:29.642 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-05-10T10:59:29.643 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-05-10T10:59:29.644 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-05-10T10:59:29.645 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-05-10T10:59:29.646 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-05-10T10:59:29.646 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-05-10T10:59:29.648 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-05-10T10:59:29.648 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-05-10T10:59:29.649 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-05-10T10:59:29.650 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-05-10T10:59:29.654 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-05-10T10:59:29.655 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-05-10T10:59:29.655 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-05-10T10:59:29.655 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-05-10T10:59:29.655 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-05-10T10:59:29.655 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-05-10T10:59:29.656 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-05-10T10:59:29.657 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-05-10T10:59:29.658 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/ 2024-05-10T10:59:29.660 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-05-10T10:59:29.661 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-05-10T10:59:29.662 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-05-10T10:59:29.663 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/balance 2024-05-10T10:59:29.664 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-05-10T10:59:29.665 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-05-10T10:59:29.666 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-05-10T10:59:29.666 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-05-10T10:59:29.667 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-05-10T10:59:29.668 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-05-10T10:59:29.669 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/numa 2024-05-10T10:59:29.671 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-05-10T10:59:29.671 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-05-10T10:59:29.672 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-05-10T10:59:29.673 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-05-10T10:59:29.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:29 smithi107 ceph-mon[30373]: pgmap v502: 97 pgs: 97 active+clean; 98 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 1.1 MiB/s wr, 159 op/s 2024-05-10T10:59:29.674 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-05-10T10:59:29.675 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-05-10T10:59:29.676 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-05-10T10:59:29.676 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-05-10T10:59:29.677 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-05-10T10:59:29.678 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-05-10T10:59:29.679 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-05-10T10:59:29.680 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-05-10T10:59:29.681 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-05-10T10:59:29.682 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-05-10T10:59:29.684 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/w1/ 2024-05-10T10:59:29.685 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-05-10T10:59:29.686 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-05-10T10:59:29.686 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-05-10T10:59:29.687 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-05-10T10:59:29.688 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-05-10T10:59:29.689 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-05-10T10:59:29.690 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-05-10T10:59:29.690 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-05-10T10:59:29.691 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-05-10T10:59:29.692 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-05-10T10:59:29.693 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-05-10T10:59:29.694 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-05-10T10:59:29.695 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-05-10T10:59:29.696 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-05-10T10:59:29.697 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-05-10T10:59:29.697 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-05-10T10:59:29.698 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/watchdog/ 2024-05-10T10:59:29.701 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-05-10T10:59:29.702 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-05-10T10:59:29.703 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-05-10T10:59:29.704 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-05-10T10:59:29.704 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-05-10T10:59:29.705 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-05-10T10:59:29.706 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-05-10T10:59:29.707 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-05-10T10:59:29.708 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-05-10T10:59:29.709 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-05-10T10:59:29.709 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-05-10T10:59:29.711 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-05-10T10:59:29.712 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-05-10T10:59:29.713 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/wimax/ 2024-05-10T10:59:29.714 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-05-10T10:59:29.715 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-05-10T10:59:29.716 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-05-10T10:59:29.718 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/ 2024-05-10T10:59:29.719 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-05-10T10:59:29.720 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-05-10T10:59:29.721 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-05-10T10:59:29.723 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-05-10T10:59:29.724 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-05-10T10:59:29.724 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-05-10T10:59:29.725 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-05-10T10:59:29.726 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-05-10T10:59:29.727 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-05-10T10:59:29.728 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-05-10T10:59:29.729 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-05-10T10:59:29.730 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-05-10T10:59:29.730 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-05-10T10:59:29.731 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-05-10T10:59:29.732 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-05-10T10:59:29.733 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-05-10T10:59:29.734 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-05-10T10:59:29.735 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-05-10T10:59:29.736 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-05-10T10:59:29.737 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-05-10T10:59:29.738 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-05-10T10:59:29.738 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-05-10T10:59:29.739 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-05-10T10:59:29.740 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-05-10T10:59:29.741 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/xtensa/ 2024-05-10T10:59:29.743 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-05-10T10:59:29.744 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-05-10T10:59:29.745 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/xz.txt 2024-05-10T10:59:29.747 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-05-10T10:59:29.749 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-05-10T10:59:29.750 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-05-10T10:59:29.750 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-05-10T10:59:29.751 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-05-10T10:59:29.752 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-05-10T10:59:29.753 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-05-10T10:59:29.754 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-05-10T10:59:29.755 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-05-10T10:59:29.756 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-05-10T10:59:29.757 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-05-10T10:59:29.759 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-05-10T10:59:29.760 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-05-10T10:59:29.762 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-05-10T10:59:29.763 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-05-10T10:59:29.765 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-05-10T10:59:29.766 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-05-10T10:59:29.767 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-05-10T10:59:29.769 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-05-10T10:59:29.770 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-05-10T10:59:29.771 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-05-10T10:59:29.773 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-05-10T10:59:29.774 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-05-10T10:59:29.776 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-05-10T10:59:29.777 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-05-10T10:59:29.779 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-05-10T10:59:29.780 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-05-10T10:59:29.781 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-05-10T10:59:29.783 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-05-10T10:59:29.785 INFO:tasks.workunit.client.0.smithi107.stdout:linux-4.0.5/Documentation/zorro.txt 2024-05-10T10:59:29.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:29 smithi196 ceph-mon[34872]: pgmap v502: 97 pgs: 97 active+clean; 98 MiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 1.1 MiB/s wr, 159 op/s 2024-05-10T10:59:31.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:31 smithi184 ceph-mon[34585]: pgmap v503: 97 pgs: 97 active+clean; 100 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 1.4 MiB/s wr, 237 op/s 2024-05-10T10:59:31.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:31 smithi184 ceph-mon[34585]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:59:31.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:31 smithi107 ceph-mon[30373]: pgmap v503: 97 pgs: 97 active+clean; 100 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 1.4 MiB/s wr, 237 op/s 2024-05-10T10:59:31.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:31 smithi107 ceph-mon[30373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:59:31.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:31 smithi196 ceph-mon[34872]: pgmap v503: 97 pgs: 97 active+clean; 100 MiB data, 696 MiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 1.4 MiB/s wr, 237 op/s 2024-05-10T10:59:31.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:31 smithi196 ceph-mon[34872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:59:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.649+0000 7fd2df637640 1 -- 172.21.15.107:0/561462163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2d81034c0 msgr2=0x7fd2d8109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.649+0000 7fd2df637640 1 --2- 172.21.15.107:0/561462163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2d81034c0 0x7fd2d8109d50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009ca0 tx=0x7fd2d002a8c0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.649+0000 7fd2df637640 1 -- 172.21.15.107:0/561462163 shutdown_connections 2024-05-10T10:59:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.649+0000 7fd2df637640 1 --2- 172.21.15.107:0/561462163 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2d81034c0 0x7fd2d8109d50 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.649+0000 7fd2df637640 1 --2- 172.21.15.107:0/561462163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2d8102b00 0x7fd2d8102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.649+0000 7fd2df637640 1 --2- 172.21.15.107:0/561462163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2d8101910 0x7fd2d8101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.649+0000 7fd2df637640 1 -- 172.21.15.107:0/561462163 >> 172.21.15.107:0/561462163 conn(0x7fd2d80fce80 msgr2=0x7fd2d80ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.649+0000 7fd2df637640 1 -- 172.21.15.107:0/561462163 shutdown_connections 2024-05-10T10:59:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.649+0000 7fd2df637640 1 -- 172.21.15.107:0/561462163 wait complete. 2024-05-10T10:59:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.649+0000 7fd2df637640 1 Processor -- start 2024-05-10T10:59:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.649+0000 7fd2df637640 1 -- start start 2024-05-10T10:59:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2df637640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2d8101910 0x7fd2d819ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2df637640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2d8102b00 0x7fd2d819b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2df637640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2d81034c0 0x7fd2d81a23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2df637640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d81108a0 con 0x7fd2d8102b00 2024-05-10T10:59:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2df637640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d8110720 con 0x7fd2d8101910 2024-05-10T10:59:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2df637640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d8110a20 con 0x7fd2d81034c0 2024-05-10T10:59:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2dcbd2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2d8102b00 0x7fd2d819b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2dcbd2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2d8102b00 0x7fd2d819b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33736/0 (socket says 172.21.15.107:33736) 2024-05-10T10:59:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2dcbd2640 1 -- 172.21.15.107:0/3235923057 learned_addr learned my addr 172.21.15.107:0/3235923057 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:59:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2dd3d3640 1 --2- 172.21.15.107:0/3235923057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2d8101910 0x7fd2d819ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2ddbd4640 1 --2- 172.21.15.107:0/3235923057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2d81034c0 0x7fd2d81a23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2dcbd2640 1 -- 172.21.15.107:0/3235923057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2d81034c0 msgr2=0x7fd2d81a23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2dcbd2640 1 --2- 172.21.15.107:0/3235923057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2d81034c0 0x7fd2d81a23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2dcbd2640 1 -- 172.21.15.107:0/3235923057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2d8101910 msgr2=0x7fd2d819ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2dcbd2640 1 --2- 172.21.15.107:0/3235923057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2d8101910 0x7fd2d819ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2dcbd2640 1 -- 172.21.15.107:0/3235923057 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d81a2a20 con 0x7fd2d8102b00 2024-05-10T10:59:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2dcbd2640 1 --2- 172.21.15.107:0/3235923057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2d8102b00 0x7fd2d819b390 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800d950 tx=0x7fd2c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:32.670 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2ce7fc640 1 -- 172.21.15.107:0/3235923057 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8017030 con 0x7fd2d8102b00 2024-05-10T10:59:32.670 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2df637640 1 -- 172.21.15.107:0/3235923057 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d81a2d10 con 0x7fd2d8102b00 2024-05-10T10:59:32.670 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2ce7fc640 1 -- 172.21.15.107:0/3235923057 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd2c8004020 con 0x7fd2d8102b00 2024-05-10T10:59:32.670 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2ce7fc640 1 -- 172.21.15.107:0/3235923057 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c80047a0 con 0x7fd2d8102b00 2024-05-10T10:59:32.670 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.650+0000 7fd2df637640 1 -- 172.21.15.107:0/3235923057 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d81a3200 con 0x7fd2d8102b00 2024-05-10T10:59:32.670 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.653+0000 7fd2e242b740 1 Processor -- start 2024-05-10T10:59:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.653+0000 7fd2e242b740 1 -- start start 2024-05-10T10:59:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.653+0000 7fd2ce7fc640 1 -- 172.21.15.107:0/3235923057 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7fd2c80041d0 con 0x7fd2d8102b00 2024-05-10T10:59:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.653+0000 7fd2e242b740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39e8db0 0x557af39e91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.653+0000 7fd2e242b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39e97a0 0x557af39ee2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.653+0000 7fd2e242b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39ee910 0x557af39f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.653+0000 7fd2e242b740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557af394d5d0 con 0x557af39e8db0 2024-05-10T10:59:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.653+0000 7fd2e242b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x557af3906890 con 0x557af39ee910 2024-05-10T10:59:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.653+0000 7fd2e242b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557af3949590 con 0x557af39e97a0 2024-05-10T10:59:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.654+0000 7fd2ddbd4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39e8db0 0x557af39e91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.654+0000 7fd2ddbd4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39e8db0 0x557af39e91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33738/0 (socket says 172.21.15.107:33738) 2024-05-10T10:59:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.654+0000 7fd2ddbd4640 1 -- 172.21.15.107:0/3120524004 learned_addr learned my addr 172.21.15.107:0/3120524004 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:59:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.654+0000 7fd2dd3d3640 1 --2- 172.21.15.107:0/3120524004 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39e97a0 0x557af39ee2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.654+0000 7fd2ddbd4640 1 -- 172.21.15.107:0/3120524004 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39e97a0 msgr2=0x557af39ee2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.654+0000 7fd2ddbd4640 1 --2- 172.21.15.107:0/3120524004 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39e97a0 0x557af39ee2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.654+0000 7fd2dcbd2640 1 --2- 172.21.15.107:0/3120524004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39ee910 0x557af39f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.654+0000 7fd2ddbd4640 1 -- 172.21.15.107:0/3120524004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39ee910 msgr2=0x557af39f0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.654+0000 7fd2ddbd4640 1 --2- 172.21.15.107:0/3120524004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39ee910 0x557af39f0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.654+0000 7fd2ddbd4640 1 -- 172.21.15.107:0/3120524004 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557af365f210 con 0x557af39e8db0 2024-05-10T10:59:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.654+0000 7fd2dcbd2640 1 --2- 172.21.15.107:0/3120524004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39ee910 0x557af39f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:59:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.654+0000 7fd2ddbd4640 1 --2- 172.21.15.107:0/3120524004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39e8db0 0x557af39e91d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd2d002aeb0 tx=0x7fd2d0009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c14171705b6b34 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.654+0000 7fd2ce7fc640 1 --2- 172.21.15.107:0/3235923057 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd2c40b28a0 0x7fd2c40b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.654+0000 7fd2c37fe640 1 -- 172.21.15.107:0/3120524004 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0031710 con 0x557af39e8db0 2024-05-10T10:59:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.654+0000 7fd2c37fe640 1 -- 172.21.15.107:0/3120524004 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd2d0036030 con 0x557af39e8db0 2024-05-10T10:59:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.654+0000 7fd2c37fe640 1 -- 172.21.15.107:0/3120524004 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0004830 con 0x557af39e8db0 2024-05-10T10:59:32.674 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.654+0000 7fd2dd3d3640 1 --2- 172.21.15.107:0/3235923057 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd2c40b28a0 0x7fd2c40b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.654+0000 7fd2ce7fc640 1 -- 172.21.15.107:0/3235923057 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fd2c80e1b10 con 0x7fd2d8102b00 2024-05-10T10:59:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.655+0000 7fd2e242b740 1 -- 172.21.15.107:0/3120524004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39e8db0 msgr2=0x557af39e91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.655+0000 7fd2dd3d3640 1 --2- 172.21.15.107:0/3235923057 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd2c40b28a0 0x7fd2c40b4d60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x557af39e9ba0 tx=0x7fd2d400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.655+0000 7fd2e242b740 1 --2- 172.21.15.107:0/3120524004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39e8db0 0x557af39e91d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd2d002aeb0 tx=0x7fd2d0009800 comp rx=0 tx=0).stop 2024-05-10T10:59:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.655+0000 7fd2e242b740 1 -- 172.21.15.107:0/3120524004 shutdown_connections 2024-05-10T10:59:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.655+0000 7fd2e242b740 1 --2- 172.21.15.107:0/3120524004 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39ee910 0x557af39f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.655+0000 7fd2e242b740 1 --2- 172.21.15.107:0/3120524004 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39e97a0 0x557af39ee2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.655+0000 7fd2e242b740 1 --2- 172.21.15.107:0/3120524004 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39e8db0 0x557af39e91d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.655+0000 7fd2e242b740 1 -- 172.21.15.107:0/3120524004 >> 172.21.15.107:0/3120524004 conn(0x557af39e4420 msgr2=0x557af39e4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.655+0000 7fd2e242b740 1 -- 172.21.15.107:0/3120524004 shutdown_connections 2024-05-10T10:59:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.655+0000 7fd2e242b740 1 -- 172.21.15.107:0/3120524004 wait complete. 2024-05-10T10:59:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2e242b740 1 -- start start 2024-05-10T10:59:32.676 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2e242b740 1 Processor -- start 2024-05-10T10:59:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2e242b740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39e8db0 0x557af39f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2e242b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39e97a0 0x557af39f3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2e242b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39ee910 0x557af39fa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2e242b740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x557af39f16e0 con 0x557af39e8db0 2024-05-10T10:59:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2e242b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x557af390a370 con 0x557af39e97a0 2024-05-10T10:59:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2e242b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x557af39f1860 con 0x557af39ee910 2024-05-10T10:59:32.677 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2e242b740 10 client.0 _ll_register_callbacks cb 0x557af365ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:59:32.678 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2dd3d3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39e8db0 0x557af39f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:32.678 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2dd3d3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39e8db0 0x557af39f2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33750/0 (socket says 172.21.15.107:33750) 2024-05-10T10:59:32.678 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2dd3d3640 1 -- 172.21.15.107:0/1940685132 learned_addr learned my addr 172.21.15.107:0/1940685132 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:59:32.678 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2dcbd2640 1 --2- 172.21.15.107:0/1940685132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39e97a0 0x557af39f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:32.678 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2ddbd4640 1 --2- 172.21.15.107:0/1940685132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39ee910 0x557af39fa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:32.678 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2dd3d3640 1 -- 172.21.15.107:0/1940685132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39ee910 msgr2=0x557af39fa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2dd3d3640 1 --2- 172.21.15.107:0/1940685132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39ee910 0x557af39fa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2dd3d3640 1 -- 172.21.15.107:0/1940685132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39e97a0 msgr2=0x557af39f3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2dd3d3640 1 --2- 172.21.15.107:0/1940685132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39e97a0 0x557af39f3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2dd3d3640 1 -- 172.21.15.107:0/1940685132 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557af372b620 con 0x557af39e8db0 2024-05-10T10:59:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.656+0000 7fd2ddbd4640 1 --2- 172.21.15.107:0/1940685132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39ee910 0x557af39fa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:59:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.657+0000 7fd2dd3d3640 1 --2- 172.21.15.107:0/1940685132 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39e8db0 0x557af39f2df0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4005b80 tx=0x7fd2d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc847a7d88fd1376 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.657+0000 7fd2c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:59:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.657+0000 7fd2c0ff9640 1 -- 172.21.15.107:0/1940685132 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d402c060 con 0x557af39e8db0 2024-05-10T10:59:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.657+0000 7fd2c0ff9640 1 -- 172.21.15.107:0/1940685132 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fd2d4017030 con 0x557af39e8db0 2024-05-10T10:59:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.657+0000 7fd2e242b740 1 -- 172.21.15.107:0/1940685132 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2d0036030 con 0x557af39e8db0 2024-05-10T10:59:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.657+0000 7fd2c0ff9640 1 -- 172.21.15.107:0/1940685132 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd2d401fc90 con 0x557af39e8db0 2024-05-10T10:59:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.657+0000 7fd2e242b740 10 client.15693 fetch_fsmap learned FSMap version 30 2024-05-10T10:59:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.657+0000 7fd2e242b740 1 -- 172.21.15.107:0/1940685132 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557af39fd390 con 0x557af39e8db0 2024-05-10T10:59:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.657+0000 7fd2c0ff9640 1 -- 172.21.15.107:0/1940685132 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd2d0036030 con 0x557af39e8db0 2024-05-10T10:59:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.657+0000 7fd2c0ff9640 1 -- 172.21.15.107:0/1940685132 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fd2d4031070 con 0x557af39e8db0 2024-05-10T10:59:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.657+0000 7fd2e242b740 10 client.15693 fetch_fsmap finished waiting for FSMap version 30 2024-05-10T10:59:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.657+0000 7fd2e242b740 10 client.15693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:59:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.657+0000 7fd2e242b740 20 client.15693 populate_metadata read hostname 'smithi107' 2024-05-10T10:59:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.657+0000 7fd2e242b740 1 --2- 172.21.15.107:0/1940685132 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x557af39feb40 0x557af3a00f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.657+0000 7fd2e242b740 4 client.15693 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:59:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.657+0000 7fd2e242b740 1 -- 172.21.15.107:0/1940685132 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557af395b1e0 con 0x557af39feb40 2024-05-10T10:59:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.658+0000 7fd2dcbd2640 1 --2- 172.21.15.107:0/1940685132 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x557af39feb40 0x557af3a00f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.658+0000 7fd2dcbd2640 1 --2- 172.21.15.107:0/1940685132 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x557af39feb40 0x557af3a00f70 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8954c4fa1387e30 server_cookie=5fd74e8ee174e26 in_seq=0 out_seq=0 2024-05-10T10:59:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.658+0000 7fd2c0ff9640 10 client.15693 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:59:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.659+0000 7fd2c0ff9640 1 -- 172.21.15.107:0/1940685132 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557af395b1e0 con 0x557af39feb40 2024-05-10T10:59:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.659+0000 7fd2c0ff9640 10 client.15693 handle_command_reply: tid=0 2024-05-10T10:59:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.659+0000 7fd2e242b740 1 client.15693 shutdown 2024-05-10T10:59:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.659+0000 7fd2e242b740 1 -- 172.21.15.107:0/1940685132 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39e8db0 msgr2=0x557af39f2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.659+0000 7fd2e242b740 1 --2- 172.21.15.107:0/1940685132 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39e8db0 0x557af39f2df0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4005b80 tx=0x7fd2d40046c0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.659+0000 7fd2e242b740 1 -- 172.21.15.107:0/1940685132 shutdown_connections 2024-05-10T10:59:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.659+0000 7fd2e242b740 1 --2- 172.21.15.107:0/1940685132 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x557af39feb40 0x557af3a00f70 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.659+0000 7fd2e242b740 1 --2- 172.21.15.107:0/1940685132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39ee910 0x557af39fa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.659+0000 7fd2e242b740 1 --2- 172.21.15.107:0/1940685132 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39e97a0 0x557af39f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.659+0000 7fd2e242b740 1 --2- 172.21.15.107:0/1940685132 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39e8db0 0x557af39f2df0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.659+0000 7fd2e242b740 1 -- 172.21.15.107:0/1940685132 >> 172.21.15.107:0/1940685132 conn(0x557af39e4420 msgr2=0x557af39e3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.659+0000 7fd2c0ff9640 0 client.15693 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:59:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.659+0000 7fd2e242b740 1 -- 172.21.15.107:0/1940685132 shutdown_connections 2024-05-10T10:59:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.659+0000 7fd2e242b740 1 -- 172.21.15.107:0/1940685132 wait complete. 2024-05-10T10:59:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.659+0000 7fd2e242b740 20 client.15693 trim_cache size 0 max 16384 2024-05-10T10:59:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.674+0000 7fd2e242b740 1 Processor -- start 2024-05-10T10:59:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.674+0000 7fd2e242b740 1 -- start start 2024-05-10T10:59:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.674+0000 7fd2e242b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39e8db0 0x557af39f2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:32.693 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.674+0000 7fd2e242b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39e97a0 0x557af39fa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:32.693 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.674+0000 7fd2e242b740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39ee910 0x557af39f2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:32.693 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.674+0000 7fd2e242b740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d81abef0 con 0x557af39ee910 2024-05-10T10:59:32.693 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.674+0000 7fd2e242b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d81adbb0 con 0x557af39e8db0 2024-05-10T10:59:32.693 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.674+0000 7fd2e242b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d81ac5c0 con 0x557af39e97a0 2024-05-10T10:59:32.693 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.674+0000 7fd2ddbd4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39ee910 0x557af39f2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.674+0000 7fd2ddbd4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39ee910 0x557af39f2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33756/0 (socket says 172.21.15.107:33756) 2024-05-10T10:59:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.674+0000 7fd2ddbd4640 1 -- 172.21.15.107:0/1381954460 learned_addr learned my addr 172.21.15.107:0/1381954460 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:59:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.675+0000 7fd2dd3d3640 1 --2- 172.21.15.107:0/1381954460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39e8db0 0x557af39f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.675+0000 7fd2ddbd4640 1 -- 172.21.15.107:0/1381954460 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39e97a0 msgr2=0x557af39fa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.675+0000 7fd2ddbd4640 1 --2- 172.21.15.107:0/1381954460 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39e97a0 0x557af39fa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.675+0000 7fd2ddbd4640 1 -- 172.21.15.107:0/1381954460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39e8db0 msgr2=0x557af39f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.675+0000 7fd2ddbd4640 1 --2- 172.21.15.107:0/1381954460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39e8db0 0x557af39f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.675+0000 7fd2ddbd4640 1 -- 172.21.15.107:0/1381954460 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557af39edc50 con 0x557af39ee910 2024-05-10T10:59:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.675+0000 7fd2dd3d3640 1 --2- 172.21.15.107:0/1381954460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39e8db0 0x557af39f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:59:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.675+0000 7fd2ddbd4640 1 --2- 172.21.15.107:0/1381954460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39ee910 0x557af39f2a00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd2d002aeb0 tx=0x7fd2d0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23680d867b0063ff server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.675+0000 7fd2c2ffd640 1 -- 172.21.15.107:0/1381954460 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d004a040 con 0x557af39ee910 2024-05-10T10:59:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.675+0000 7fd2c2ffd640 1 -- 172.21.15.107:0/1381954460 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd2d0036040 con 0x557af39ee910 2024-05-10T10:59:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.675+0000 7fd2c2ffd640 1 -- 172.21.15.107:0/1381954460 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00047a0 con 0x557af39ee910 2024-05-10T10:59:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.676+0000 7fd2e242b740 1 -- 172.21.15.107:0/1381954460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39ee910 msgr2=0x557af39f2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.676+0000 7fd2e242b740 1 --2- 172.21.15.107:0/1381954460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39ee910 0x557af39f2a00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd2d002aeb0 tx=0x7fd2d0000f40 comp rx=0 tx=0).stop 2024-05-10T10:59:32.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.676+0000 7fd2e242b740 1 -- 172.21.15.107:0/1381954460 shutdown_connections 2024-05-10T10:59:32.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.676+0000 7fd2e242b740 1 --2- 172.21.15.107:0/1381954460 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39ee910 0x557af39f2a00 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.676+0000 7fd2e242b740 1 --2- 172.21.15.107:0/1381954460 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39e97a0 0x557af39fa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.676+0000 7fd2e242b740 1 --2- 172.21.15.107:0/1381954460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39e8db0 0x557af39f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.676+0000 7fd2e242b740 1 -- 172.21.15.107:0/1381954460 >> 172.21.15.107:0/1381954460 conn(0x557af39e4420 msgr2=0x557af39f1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:32.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.676+0000 7fd2e242b740 1 -- 172.21.15.107:0/1381954460 shutdown_connections 2024-05-10T10:59:32.696 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.676+0000 7fd2e242b740 1 -- 172.21.15.107:0/1381954460 wait complete. 2024-05-10T10:59:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.676+0000 7fd2e242b740 1 -- start start 2024-05-10T10:59:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.676+0000 7fd2e242b740 1 Processor -- start 2024-05-10T10:59:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.676+0000 7fd2e242b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39e8db0 0x557af39f7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.676+0000 7fd2e242b740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39e97a0 0x557af39f77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.676+0000 7fd2e242b740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39ee910 0x557af3a67420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2e242b740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d81ad420 con 0x557af39ee910 2024-05-10T10:59:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2e242b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d81acd50 con 0x557af39e8db0 2024-05-10T10:59:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2e242b740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d81a9ed0 con 0x557af39e97a0 2024-05-10T10:59:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2e242b740 10 client.0 _ll_register_callbacks cb 0x7fd2d400b570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:59:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2ddbd4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39ee910 0x557af3a67420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2ddbd4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39ee910 0x557af3a67420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33770/0 (socket says 172.21.15.107:33770) 2024-05-10T10:59:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2ddbd4640 1 -- 172.21.15.107:0/968751224 learned_addr learned my addr 172.21.15.107:0/968751224 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:59:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2dcbd2640 1 --2- 172.21.15.107:0/968751224 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39e97a0 0x557af39f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2dd3d3640 1 --2- 172.21.15.107:0/968751224 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39e8db0 0x557af39f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2ddbd4640 1 -- 172.21.15.107:0/968751224 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39e97a0 msgr2=0x557af39f77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2ddbd4640 1 --2- 172.21.15.107:0/968751224 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39e97a0 0x557af39f77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2ddbd4640 1 -- 172.21.15.107:0/968751224 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39e8db0 msgr2=0x557af39f7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2ddbd4640 1 --2- 172.21.15.107:0/968751224 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39e8db0 0x557af39f7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2ddbd4640 1 -- 172.21.15.107:0/968751224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557af3a67960 con 0x557af39ee910 2024-05-10T10:59:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2dd3d3640 1 --2- 172.21.15.107:0/968751224 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39e8db0 0x557af39f7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T10:59:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2ddbd4640 1 --2- 172.21.15.107:0/968751224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39ee910 0x557af3a67420 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0005c10 tx=0x7fd2d00316c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f3f3a2ee6186 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:59:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2c0ff9640 1 -- 172.21.15.107:0/968751224 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d005d070 con 0x557af39ee910 2024-05-10T10:59:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2c0ff9640 1 -- 172.21.15.107:0/968751224 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fd2d00046e0 con 0x557af39ee910 2024-05-10T10:59:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2e242b740 1 -- 172.21.15.107:0/968751224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2d0036040 con 0x557af39ee910 2024-05-10T10:59:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2c0ff9640 1 -- 172.21.15.107:0/968751224 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd2d0069050 con 0x557af39ee910 2024-05-10T10:59:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2e242b740 10 client.15699 fetch_fsmap learned FSMap version 30 2024-05-10T10:59:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.677+0000 7fd2e242b740 1 -- 172.21.15.107:0/968751224 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557af3a68b30 con 0x557af39ee910 2024-05-10T10:59:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.678+0000 7fd2c0ff9640 1 -- 172.21.15.107:0/968751224 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd2d0036040 con 0x557af39ee910 2024-05-10T10:59:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.678+0000 7fd2c0ff9640 1 -- 172.21.15.107:0/968751224 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fd2d004d030 con 0x557af39ee910 2024-05-10T10:59:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.678+0000 7fd2e242b740 10 client.15699 fetch_fsmap finished waiting for FSMap version 30 2024-05-10T10:59:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.678+0000 7fd2e242b740 10 client.15699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:59:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.678+0000 7fd2e242b740 20 client.15699 populate_metadata read hostname 'smithi107' 2024-05-10T10:59:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.678+0000 7fd2e242b740 1 --2- 172.21.15.107:0/968751224 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x557af3a69240 0x557af3a6b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.678+0000 7fd2e242b740 4 client.15699 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T10:59:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.678+0000 7fd2e242b740 1 -- 172.21.15.107:0/968751224 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557af3955050 con 0x557af3a69240 2024-05-10T10:59:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.678+0000 7fd2dd3d3640 1 --2- 172.21.15.107:0/968751224 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x557af3a69240 0x557af3a6b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.678+0000 7fd2c0ff9640 10 client.15699 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:59:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.678+0000 7fd2dd3d3640 1 --2- 172.21.15.107:0/968751224 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x557af3a69240 0x557af3a6b660 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1884d1b00db207ad server_cookie=85d62c0c4875344b in_seq=0 out_seq=0 2024-05-10T10:59:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.724+0000 7fd2c0ff9640 1 -- 172.21.15.107:0/968751224 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557af3955050 con 0x557af3a69240 2024-05-10T10:59:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.725+0000 7fd2c0ff9640 10 client.15699 handle_command_reply: tid=0 2024-05-10T10:59:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.725+0000 7fd2e242b740 1 client.15699 shutdown 2024-05-10T10:59:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.725+0000 7fd2e242b740 1 -- 172.21.15.107:0/968751224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39ee910 msgr2=0x557af3a67420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.725+0000 7fd2e242b740 1 --2- 172.21.15.107:0/968751224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39ee910 0x557af3a67420 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0005c10 tx=0x7fd2d00316c0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.725+0000 7fd2e242b740 1 -- 172.21.15.107:0/968751224 shutdown_connections 2024-05-10T10:59:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.725+0000 7fd2e242b740 1 --2- 172.21.15.107:0/968751224 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x557af3a69240 0x557af3a6b660 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.725+0000 7fd2e242b740 1 --2- 172.21.15.107:0/968751224 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x557af39ee910 0x557af3a67420 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.725+0000 7fd2c0ff9640 0 client.15699 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:59:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.725+0000 7fd2e242b740 1 --2- 172.21.15.107:0/968751224 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x557af39e97a0 0x557af39f77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.725+0000 7fd2e242b740 1 --2- 172.21.15.107:0/968751224 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557af39e8db0 0x557af39f7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.725+0000 7fd2e242b740 1 -- 172.21.15.107:0/968751224 >> 172.21.15.107:0/968751224 conn(0x557af39e4420 msgr2=0x557af39f2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.725+0000 7fd2e242b740 1 -- 172.21.15.107:0/968751224 shutdown_connections 2024-05-10T10:59:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.725+0000 7fd2e242b740 1 -- 172.21.15.107:0/968751224 wait complete. 2024-05-10T10:59:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.725+0000 7fd2e242b740 20 client.15699 trim_cache size 0 max 16384 2024-05-10T10:59:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:{ 2024-05-10T10:59:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "message": "", 2024-05-10T10:59:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "return_code": 0 2024-05-10T10:59:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:} 2024-05-10T10:59:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.726+0000 7fd2df637640 1 -- 172.21.15.107:0/3235923057 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd2c40b28a0 msgr2=0x7fd2c40b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.726+0000 7fd2df637640 1 --2- 172.21.15.107:0/3235923057 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd2c40b28a0 0x7fd2c40b4d60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x557af39e9ba0 tx=0x7fd2d400b390 comp rx=0 tx=0).stop 2024-05-10T10:59:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.726+0000 7fd2df637640 1 -- 172.21.15.107:0/3235923057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2d8102b00 msgr2=0x7fd2d819b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.726+0000 7fd2df637640 1 --2- 172.21.15.107:0/3235923057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2d8102b00 0x7fd2d819b390 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800d950 tx=0x7fd2c800de10 comp rx=0 tx=0).stop 2024-05-10T10:59:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.726+0000 7fd2df637640 1 -- 172.21.15.107:0/3235923057 shutdown_connections 2024-05-10T10:59:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.726+0000 7fd2df637640 1 --2- 172.21.15.107:0/3235923057 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2d81034c0 0x7fd2d81a23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.726+0000 7fd2df637640 1 --2- 172.21.15.107:0/3235923057 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fd2c40b28a0 0x7fd2c40b4d60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.726+0000 7fd2df637640 1 --2- 172.21.15.107:0/3235923057 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd2d8102b00 0x7fd2d819b390 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.726+0000 7fd2df637640 1 --2- 172.21.15.107:0/3235923057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2d8101910 0x7fd2d819ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.726+0000 7fd2df637640 1 -- 172.21.15.107:0/3235923057 >> 172.21.15.107:0/3235923057 conn(0x7fd2d80fce80 msgr2=0x7fd2d8105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.726+0000 7fd2df637640 1 -- 172.21.15.107:0/3235923057 shutdown_connections 2024-05-10T10:59:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:32.726+0000 7fd2df637640 1 -- 172.21.15.107:0/3235923057 wait complete. 2024-05-10T10:59:33.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:33 smithi184 ceph-mon[34585]: pgmap v504: 97 pgs: 97 active+clean; 105 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 241 op/s 2024-05-10T10:59:33.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:33 smithi107 ceph-mon[30373]: pgmap v504: 97 pgs: 97 active+clean; 105 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 241 op/s 2024-05-10T10:59:33.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:33 smithi196 ceph-mon[34872]: pgmap v504: 97 pgs: 97 active+clean; 105 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 241 op/s 2024-05-10T10:59:34.651 INFO:tasks.workunit.client.0.smithi107.stderr:+ tar cf doc.tar linux-4.0.5 2024-05-10T10:59:34.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:34 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:59:34.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:34 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:59:34.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:34 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:59:34.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:34 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:59:34.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:34 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:59:34.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:34 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:59:34.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:34 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:59:34.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:34 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:59:34.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:34 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T10:59:34.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:34 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T10:59:34.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:34 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T10:59:34.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:34 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T10:59:35.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:35 smithi107 ceph-mon[30373]: pgmap v505: 97 pgs: 97 active+clean; 105 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 231 op/s 2024-05-10T10:59:35.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:35 smithi196 ceph-mon[34872]: pgmap v505: 97 pgs: 97 active+clean; 105 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 231 op/s 2024-05-10T10:59:35.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:35 smithi184 ceph-mon[34585]: pgmap v505: 97 pgs: 97 active+clean; 105 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 231 op/s 2024-05-10T10:59:36.457 INFO:tasks.workunit.client.0.smithi107.stderr:+ tar xf doc.tar 2024-05-10T10:59:37.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:37 smithi107 ceph-mon[30373]: pgmap v506: 97 pgs: 97 active+clean; 99 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 253 op/s 2024-05-10T10:59:37.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:37 smithi196 ceph-mon[34872]: pgmap v506: 97 pgs: 97 active+clean; 99 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 253 op/s 2024-05-10T10:59:37.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:37 smithi184 ceph-mon[34585]: pgmap v506: 97 pgs: 97 active+clean; 99 MiB data, 712 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 253 op/s 2024-05-10T10:59:39.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:39 smithi107 ceph-mon[30373]: pgmap v507: 97 pgs: 97 active+clean; 99 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.4 MiB/s wr, 202 op/s 2024-05-10T10:59:39.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:39 smithi196 ceph-mon[34872]: pgmap v507: 97 pgs: 97 active+clean; 99 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.4 MiB/s wr, 202 op/s 2024-05-10T10:59:39.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:39 smithi184 ceph-mon[34585]: pgmap v507: 97 pgs: 97 active+clean; 99 MiB data, 708 MiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.4 MiB/s wr, 202 op/s 2024-05-10T10:59:41.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:41 smithi107 ceph-mon[30373]: pgmap v508: 97 pgs: 97 active+clean; 102 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 189 op/s 2024-05-10T10:59:41.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:41 smithi196 ceph-mon[34872]: pgmap v508: 97 pgs: 97 active+clean; 102 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 189 op/s 2024-05-10T10:59:41.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:41 smithi184 ceph-mon[34585]: pgmap v508: 97 pgs: 97 active+clean; 102 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 189 op/s 2024-05-10T10:59:43.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:43 smithi107 ceph-mon[30373]: pgmap v509: 97 pgs: 97 active+clean; 101 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 892 KiB/s wr, 147 op/s 2024-05-10T10:59:43.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:43 smithi196 ceph-mon[34872]: pgmap v509: 97 pgs: 97 active+clean; 101 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 892 KiB/s wr, 147 op/s 2024-05-10T10:59:43.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:43 smithi184 ceph-mon[34585]: pgmap v509: 97 pgs: 97 active+clean; 101 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 892 KiB/s wr, 147 op/s 2024-05-10T10:59:45.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:45 smithi107 ceph-mon[30373]: pgmap v510: 97 pgs: 97 active+clean; 111 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 190 op/s 2024-05-10T10:59:45.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:45 smithi196 ceph-mon[34872]: pgmap v510: 97 pgs: 97 active+clean; 111 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 190 op/s 2024-05-10T10:59:45.817 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.815+0000 7fcfe4332640 1 -- 172.21.15.107:0/4176088046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfdc103c30 msgr2=0x7fcfdc1040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.815+0000 7fcfe4332640 1 --2- 172.21.15.107:0/4176088046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfdc103c30 0x7fcfdc1040b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009900 tx=0x7fcfcc02a410 comp rx=0 tx=0).stop 2024-05-10T10:59:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.815+0000 7fcfe4332640 1 -- 172.21.15.107:0/4176088046 shutdown_connections 2024-05-10T10:59:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.815+0000 7fcfe4332640 1 --2- 172.21.15.107:0/4176088046 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfdc1045f0 0x7fcfdc10ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.815+0000 7fcfe4332640 1 --2- 172.21.15.107:0/4176088046 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfdc103c30 0x7fcfdc1040b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.815+0000 7fcfe4332640 1 --2- 172.21.15.107:0/4176088046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfdc102a40 0x7fcfdc102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.815+0000 7fcfe4332640 1 -- 172.21.15.107:0/4176088046 >> 172.21.15.107:0/4176088046 conn(0x7fcfdc0fdfd0 msgr2=0x7fcfdc1003f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.815+0000 7fcfe4332640 1 -- 172.21.15.107:0/4176088046 shutdown_connections 2024-05-10T10:59:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.815+0000 7fcfe4332640 1 -- 172.21.15.107:0/4176088046 wait complete. 2024-05-10T10:59:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.816+0000 7fcfe4332640 1 Processor -- start 2024-05-10T10:59:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.816+0000 7fcfe4332640 1 -- start start 2024-05-10T10:59:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.816+0000 7fcfe4332640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfdc102a40 0x7fcfdc076760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:45.818 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.816+0000 7fcfe4332640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfdc103c30 0x7fcfdc074da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.816+0000 7fcfe4332640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfdc1045f0 0x7fcfdc0752e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.816+0000 7fcfe4332640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc10e6a0 con 0x7fcfdc102a40 2024-05-10T10:59:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.816+0000 7fcfe4332640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc10e520 con 0x7fcfdc1045f0 2024-05-10T10:59:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.816+0000 7fcfe4332640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc10e820 con 0x7fcfdc103c30 2024-05-10T10:59:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.816+0000 7fcfe20ce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfdc102a40 0x7fcfdc076760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.816+0000 7fcfe20ce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfdc102a40 0x7fcfdc076760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58416/0 (socket says 172.21.15.107:58416) 2024-05-10T10:59:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.816+0000 7fcfe20ce640 1 -- 172.21.15.107:0/383490999 learned_addr learned my addr 172.21.15.107:0/383490999 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:59:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.816+0000 7fcfe18cd640 1 --2- 172.21.15.107:0/383490999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfdc103c30 0x7fcfdc074da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.816+0000 7fcfe28cf640 1 --2- 172.21.15.107:0/383490999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfdc1045f0 0x7fcfdc0752e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.816+0000 7fcfe20ce640 1 -- 172.21.15.107:0/383490999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfdc103c30 msgr2=0x7fcfdc074da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:45.819 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.816+0000 7fcfe20ce640 1 --2- 172.21.15.107:0/383490999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfdc103c30 0x7fcfdc074da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.822 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.816+0000 7fcfe20ce640 1 -- 172.21.15.107:0/383490999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfdc1045f0 msgr2=0x7fcfdc0752e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:45.822 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.816+0000 7fcfe20ce640 1 --2- 172.21.15.107:0/383490999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfdc1045f0 0x7fcfdc0752e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.822 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.816+0000 7fcfe20ce640 1 -- 172.21.15.107:0/383490999 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfdc075b70 con 0x7fcfdc102a40 2024-05-10T10:59:45.822 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.816+0000 7fcfe20ce640 1 --2- 172.21.15.107:0/383490999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfdc102a40 0x7fcfdc076760 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800d770 tx=0x7fcfd800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:45.822 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.817+0000 7fcfd37fe640 1 -- 172.21.15.107:0/383490999 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8017070 con 0x7fcfdc102a40 2024-05-10T10:59:45.822 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.817+0000 7fcfd37fe640 1 -- 172.21.15.107:0/383490999 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcfd8009c30 con 0x7fcfdc102a40 2024-05-10T10:59:45.822 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.817+0000 7fcfe4332640 1 -- 172.21.15.107:0/383490999 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfdc1a2d70 con 0x7fcfdc102a40 2024-05-10T10:59:45.822 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.817+0000 7fcfd37fe640 1 -- 172.21.15.107:0/383490999 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8003d70 con 0x7fcfdc102a40 2024-05-10T10:59:45.822 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.817+0000 7fcfe4332640 1 -- 172.21.15.107:0/383490999 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfdc1a3180 con 0x7fcfdc102a40 2024-05-10T10:59:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.819+0000 7fcfd37fe640 1 -- 172.21.15.107:0/383490999 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7fcfd8003f10 con 0x7fcfdc102a40 2024-05-10T10:59:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.819+0000 7fcfe704e740 1 Processor -- start 2024-05-10T10:59:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfe704e740 1 -- start start 2024-05-10T10:59:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfe704e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2ae6db0 0x5648f2ae71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfe704e740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2ae77a0 0x5648f2aec2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:45.829 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfe704e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2aec910 0x5648f2aeeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfe704e740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5648f2a4b5d0 con 0x5648f2ae77a0 2024-05-10T10:59:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfe704e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5648f2a04890 con 0x5648f2aec910 2024-05-10T10:59:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfe704e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5648f2a47590 con 0x5648f2ae6db0 2024-05-10T10:59:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfe20ce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2ae77a0 0x5648f2aec2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfe28cf640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2ae6db0 0x5648f2ae71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfe28cf640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2ae6db0 0x5648f2ae71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.107:45742/0 (socket says 172.21.15.107:45742) 2024-05-10T10:59:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfe20ce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2ae77a0 0x5648f2aec2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58428/0 (socket says 172.21.15.107:58428) 2024-05-10T10:59:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfe28cf640 1 -- 172.21.15.107:0/2876374319 learned_addr learned my addr 172.21.15.107:0/2876374319 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:59:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfe18cd640 1 --2- 172.21.15.107:0/2876374319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2aec910 0x5648f2aeeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfe20ce640 1 -- 172.21.15.107:0/2876374319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2ae6db0 msgr2=0x5648f2ae71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfe20ce640 1 --2- 172.21.15.107:0/2876374319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2ae6db0 0x5648f2ae71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfd37fe640 1 --2- 172.21.15.107:0/383490999 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcfc80b28a0 0x7fcfc80b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:45.830 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfe20ce640 1 -- 172.21.15.107:0/2876374319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2aec910 msgr2=0x5648f2aeeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfe20ce640 1 --2- 172.21.15.107:0/2876374319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2aec910 0x5648f2aeeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfe20ce640 1 -- 172.21.15.107:0/2876374319 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648f275d210 con 0x5648f2ae77a0 2024-05-10T10:59:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.820+0000 7fcfe18cd640 1 --2- 172.21.15.107:0/2876374319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2aec910 0x5648f2aeeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T10:59:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.821+0000 7fcfe28cf640 1 --2- 172.21.15.107:0/383490999 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcfc80b28a0 0x7fcfc80b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.821+0000 7fcfe20ce640 1 --2- 172.21.15.107:0/2876374319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2ae77a0 0x5648f2aec2a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80df590 tx=0x7fcfd80a58a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25df2494226bbf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.821+0000 7fcfd37fe640 1 -- 172.21.15.107:0/383490999 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fcfd80e1a20 con 0x7fcfdc102a40 2024-05-10T10:59:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.821+0000 7fcfd0bfe640 1 -- 172.21.15.107:0/2876374319 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8020020 con 0x5648f2ae77a0 2024-05-10T10:59:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.821+0000 7fcfd0bfe640 1 -- 172.21.15.107:0/2876374319 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcfd80eb040 con 0x5648f2ae77a0 2024-05-10T10:59:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.821+0000 7fcfd0bfe640 1 -- 172.21.15.107:0/2876374319 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80ea070 con 0x5648f2ae77a0 2024-05-10T10:59:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe704e740 1 -- 172.21.15.107:0/2876374319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2ae77a0 msgr2=0x5648f2aec2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe28cf640 1 --2- 172.21.15.107:0/383490999 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcfc80b28a0 0x7fcfc80b4d60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x5648f2ae8000 tx=0x7fcfd4009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe704e740 1 --2- 172.21.15.107:0/2876374319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2ae77a0 0x5648f2aec2a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80df590 tx=0x7fcfd80a58a0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe704e740 1 -- 172.21.15.107:0/2876374319 shutdown_connections 2024-05-10T10:59:45.831 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe704e740 1 --2- 172.21.15.107:0/2876374319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2aec910 0x5648f2aeeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe704e740 1 --2- 172.21.15.107:0/2876374319 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2ae77a0 0x5648f2aec2a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe704e740 1 --2- 172.21.15.107:0/2876374319 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2ae6db0 0x5648f2ae71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe704e740 1 -- 172.21.15.107:0/2876374319 >> 172.21.15.107:0/2876374319 conn(0x5648f2ae2420 msgr2=0x5648f2ae2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe704e740 1 -- 172.21.15.107:0/2876374319 shutdown_connections 2024-05-10T10:59:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe704e740 1 -- 172.21.15.107:0/2876374319 wait complete. 2024-05-10T10:59:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe704e740 1 -- start start 2024-05-10T10:59:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe704e740 1 Processor -- start 2024-05-10T10:59:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe704e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2ae6db0 0x5648f2af1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe704e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2ae77a0 0x5648f2af15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe704e740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2aec910 0x5648f2af8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe704e740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5648f2aef8c0 con 0x5648f2aec910 2024-05-10T10:59:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe704e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5648f2a08370 con 0x5648f2ae6db0 2024-05-10T10:59:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe704e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5648f2aefa40 con 0x5648f2ae77a0 2024-05-10T10:59:45.832 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe704e740 10 client.0 _ll_register_callbacks cb 0x5648f275ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:59:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe28cf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2aec910 0x5648f2af8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe28cf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2aec910 0x5648f2af8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58438/0 (socket says 172.21.15.107:58438) 2024-05-10T10:59:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe28cf640 1 -- 172.21.15.107:0/3662385205 learned_addr learned my addr 172.21.15.107:0/3662385205 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:59:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.822+0000 7fcfe18cd640 1 --2- 172.21.15.107:0/3662385205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2ae77a0 0x5648f2af15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.823+0000 7fcfe28cf640 1 -- 172.21.15.107:0/3662385205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2ae77a0 msgr2=0x5648f2af15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.823+0000 7fcfe28cf640 1 --2- 172.21.15.107:0/3662385205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2ae77a0 0x5648f2af15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.823+0000 7fcfe20ce640 1 --2- 172.21.15.107:0/3662385205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2ae6db0 0x5648f2af1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.823+0000 7fcfe28cf640 1 -- 172.21.15.107:0/3662385205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2ae6db0 msgr2=0x5648f2af1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.823+0000 7fcfe28cf640 1 --2- 172.21.15.107:0/3662385205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2ae6db0 0x5648f2af1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.823+0000 7fcfe28cf640 1 -- 172.21.15.107:0/3662385205 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648f2829620 con 0x5648f2aec910 2024-05-10T10:59:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.823+0000 7fcfe28cf640 1 --2- 172.21.15.107:0/3662385205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2aec910 0x5648f2af8590 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009810 tx=0x7fcfd4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3697ec778951d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.823+0000 7fcfc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:59:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.823+0000 7fcfc5ffb640 1 -- 172.21.15.107:0/3662385205 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4003970 con 0x5648f2aec910 2024-05-10T10:59:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.823+0000 7fcfc5ffb640 1 -- 172.21.15.107:0/3662385205 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fcfd4017030 con 0x5648f2aec910 2024-05-10T10:59:45.833 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.823+0000 7fcfe704e740 1 -- 172.21.15.107:0/3662385205 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfd80eb040 con 0x5648f2aec910 2024-05-10T10:59:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.823+0000 7fcfc5ffb640 1 -- 172.21.15.107:0/3662385205 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcfd4003b10 con 0x5648f2aec910 2024-05-10T10:59:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.823+0000 7fcfe704e740 10 client.15711 fetch_fsmap learned FSMap version 30 2024-05-10T10:59:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.823+0000 7fcfe704e740 1 -- 172.21.15.107:0/3662385205 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5648f2afb5e0 con 0x5648f2aec910 2024-05-10T10:59:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.823+0000 7fcfc5ffb640 1 -- 172.21.15.107:0/3662385205 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcfd80eb040 con 0x5648f2aec910 2024-05-10T10:59:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.824+0000 7fcfc5ffb640 1 -- 172.21.15.107:0/3662385205 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fcfd40042d0 con 0x5648f2aec910 2024-05-10T10:59:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.824+0000 7fcfe704e740 10 client.15711 fetch_fsmap finished waiting for FSMap version 30 2024-05-10T10:59:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.824+0000 7fcfe704e740 10 client.15711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:59:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.824+0000 7fcfe704e740 20 client.15711 populate_metadata read hostname 'smithi107' 2024-05-10T10:59:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.824+0000 7fcfe704e740 1 --2- 172.21.15.107:0/3662385205 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5648f2afcd90 0x5648f2aff200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.824+0000 7fcfe704e740 4 client.15711 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:59:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.824+0000 7fcfe704e740 1 -- 172.21.15.107:0/3662385205 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648f2a591e0 con 0x5648f2afcd90 2024-05-10T10:59:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.824+0000 7fcfe20ce640 1 --2- 172.21.15.107:0/3662385205 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5648f2afcd90 0x5648f2aff200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.824+0000 7fcfc5ffb640 10 client.15711 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:59:45.834 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.824+0000 7fcfe20ce640 1 --2- 172.21.15.107:0/3662385205 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5648f2afcd90 0x5648f2aff200 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=290e2aa09de9214e server_cookie=8c5af1191babd7bd in_seq=0 out_seq=0 2024-05-10T10:59:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.825+0000 7fcfc5ffb640 1 -- 172.21.15.107:0/3662385205 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5648f2a591e0 con 0x5648f2afcd90 2024-05-10T10:59:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.825+0000 7fcfc5ffb640 10 client.15711 handle_command_reply: tid=0 2024-05-10T10:59:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.825+0000 7fcfe704e740 1 client.15711 shutdown 2024-05-10T10:59:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.825+0000 7fcfe704e740 1 -- 172.21.15.107:0/3662385205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2aec910 msgr2=0x5648f2af8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.825+0000 7fcfe704e740 1 --2- 172.21.15.107:0/3662385205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2aec910 0x5648f2af8590 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009810 tx=0x7fcfd4004ab0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.825+0000 7fcfe704e740 1 -- 172.21.15.107:0/3662385205 shutdown_connections 2024-05-10T10:59:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.825+0000 7fcfe704e740 1 --2- 172.21.15.107:0/3662385205 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5648f2afcd90 0x5648f2aff200 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.825+0000 7fcfe704e740 1 --2- 172.21.15.107:0/3662385205 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2aec910 0x5648f2af8590 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.825+0000 7fcfe704e740 1 --2- 172.21.15.107:0/3662385205 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2ae77a0 0x5648f2af15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.825+0000 7fcfc5ffb640 0 client.15711 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:59:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.825+0000 7fcfe704e740 1 --2- 172.21.15.107:0/3662385205 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2ae6db0 0x5648f2af1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.825+0000 7fcfe704e740 1 -- 172.21.15.107:0/3662385205 >> 172.21.15.107:0/3662385205 conn(0x5648f2ae2420 msgr2=0x5648f2ae1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.826+0000 7fcfe704e740 1 -- 172.21.15.107:0/3662385205 shutdown_connections 2024-05-10T10:59:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.826+0000 7fcfe704e740 1 -- 172.21.15.107:0/3662385205 wait complete. 2024-05-10T10:59:45.835 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.826+0000 7fcfe704e740 20 client.15711 trim_cache size 0 max 16384 2024-05-10T10:59:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.841+0000 7fcfe704e740 1 Processor -- start 2024-05-10T10:59:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.841+0000 7fcfe704e740 1 -- start start 2024-05-10T10:59:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.841+0000 7fcfe704e740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2ae6db0 0x5648f2af1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.841+0000 7fcfe704e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2ae77a0 0x5648f2af15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.841+0000 7fcfe704e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2aec910 0x5648f2ae8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.841+0000 7fcfe704e740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc1abf90 con 0x5648f2ae6db0 2024-05-10T10:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.841+0000 7fcfe704e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc1adc50 con 0x5648f2ae77a0 2024-05-10T10:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.841+0000 7fcfe704e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc1ac660 con 0x5648f2aec910 2024-05-10T10:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.841+0000 7fcfe20ce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2ae6db0 0x5648f2af1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.841+0000 7fcfe20ce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2ae6db0 0x5648f2af1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58446/0 (socket says 172.21.15.107:58446) 2024-05-10T10:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.841+0000 7fcfe20ce640 1 -- 172.21.15.107:0/3204621093 learned_addr learned my addr 172.21.15.107:0/3204621093 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.841+0000 7fcfe28cf640 1 --2- 172.21.15.107:0/3204621093 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2aec910 0x5648f2ae8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.842+0000 7fcfe18cd640 1 --2- 172.21.15.107:0/3204621093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2ae77a0 0x5648f2af15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.842+0000 7fcfe20ce640 1 -- 172.21.15.107:0/3204621093 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2aec910 msgr2=0x5648f2ae8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.842+0000 7fcfe20ce640 1 --2- 172.21.15.107:0/3204621093 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2aec910 0x5648f2ae8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.842+0000 7fcfe20ce640 1 -- 172.21.15.107:0/3204621093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2ae77a0 msgr2=0x5648f2af15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.842+0000 7fcfe20ce640 1 --2- 172.21.15.107:0/3204621093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2ae77a0 0x5648f2af15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.842+0000 7fcfe20ce640 1 -- 172.21.15.107:0/3204621093 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648f2ae2250 con 0x5648f2ae6db0 2024-05-10T10:59:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.842+0000 7fcfe20ce640 1 --2- 172.21.15.107:0/3204621093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2ae6db0 0x5648f2af1080 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80a9120 tx=0x7fcfd8005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96252150e6ca79f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.842+0000 7fcfc7fff640 1 -- 172.21.15.107:0/3204621093 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8020040 con 0x5648f2ae6db0 2024-05-10T10:59:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.842+0000 7fcfc7fff640 1 -- 172.21.15.107:0/3204621093 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcfd80a8ca0 con 0x5648f2ae6db0 2024-05-10T10:59:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.842+0000 7fcfc7fff640 1 -- 172.21.15.107:0/3204621093 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80ad490 con 0x5648f2ae6db0 2024-05-10T10:59:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.842+0000 7fcfe704e740 1 -- 172.21.15.107:0/3204621093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2ae6db0 msgr2=0x5648f2af1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.842+0000 7fcfe704e740 1 --2- 172.21.15.107:0/3204621093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2ae6db0 0x5648f2af1080 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80a9120 tx=0x7fcfd8005f30 comp rx=0 tx=0).stop 2024-05-10T10:59:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.842+0000 7fcfe704e740 1 -- 172.21.15.107:0/3204621093 shutdown_connections 2024-05-10T10:59:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe704e740 1 --2- 172.21.15.107:0/3204621093 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2aec910 0x5648f2ae8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe704e740 1 --2- 172.21.15.107:0/3204621093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2ae77a0 0x5648f2af15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe704e740 1 --2- 172.21.15.107:0/3204621093 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2ae6db0 0x5648f2af1080 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe704e740 1 -- 172.21.15.107:0/3204621093 >> 172.21.15.107:0/3204621093 conn(0x5648f2ae2420 msgr2=0x5648f2aec0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe704e740 1 -- 172.21.15.107:0/3204621093 shutdown_connections 2024-05-10T10:59:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe704e740 1 -- 172.21.15.107:0/3204621093 wait complete. 2024-05-10T10:59:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe704e740 1 -- start start 2024-05-10T10:59:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe704e740 1 Processor -- start 2024-05-10T10:59:45.848 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe704e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2ae6db0 0x5648f2af5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe704e740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2ae77a0 0x5648f2af56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe704e740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2aec910 0x5648f2af6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe704e740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc1ad4c0 con 0x5648f2aec910 2024-05-10T10:59:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe704e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc1acdf0 con 0x5648f2ae6db0 2024-05-10T10:59:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe704e740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc1a9f70 con 0x5648f2ae77a0 2024-05-10T10:59:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe704e740 10 client.0 _ll_register_callbacks cb 0x7fcfd4009760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:59:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe28cf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2aec910 0x5648f2af6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe18cd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2ae77a0 0x5648f2af56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe28cf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2aec910 0x5648f2af6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58456/0 (socket says 172.21.15.107:58456) 2024-05-10T10:59:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe28cf640 1 -- 172.21.15.107:0/154778835 learned_addr learned my addr 172.21.15.107:0/154778835 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:59:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe20ce640 1 --2- 172.21.15.107:0/154778835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2ae6db0 0x5648f2af5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe28cf640 1 -- 172.21.15.107:0/154778835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2ae77a0 msgr2=0x5648f2af56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe28cf640 1 --2- 172.21.15.107:0/154778835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2ae77a0 0x5648f2af56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe28cf640 1 -- 172.21.15.107:0/154778835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2ae6db0 msgr2=0x5648f2af5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe28cf640 1 --2- 172.21.15.107:0/154778835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2ae6db0 0x5648f2af5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.843+0000 7fcfe28cf640 1 -- 172.21.15.107:0/154778835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648f2af6c60 con 0x5648f2aec910 2024-05-10T10:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.844+0000 7fcfe28cf640 1 --2- 172.21.15.107:0/154778835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2aec910 0x5648f2af6670 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4004810 tx=0x7fcfd4020a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2443d24532c01b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.844+0000 7fcfc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.844+0000 7fcfc5ffb640 1 -- 172.21.15.107:0/154778835 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd403f060 con 0x5648f2aec910 2024-05-10T10:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.844+0000 7fcfc5ffb640 1 -- 172.21.15.107:0/154778835 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fcfd4003cb0 con 0x5648f2aec910 2024-05-10T10:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.844+0000 7fcfe704e740 1 -- 172.21.15.107:0/154778835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfd80a8ca0 con 0x5648f2aec910 2024-05-10T10:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.844+0000 7fcfc5ffb640 1 -- 172.21.15.107:0/154778835 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcfd4036070 con 0x5648f2aec910 2024-05-10T10:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.844+0000 7fcfe704e740 10 client.15717 fetch_fsmap learned FSMap version 30 2024-05-10T10:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.844+0000 7fcfe704e740 1 -- 172.21.15.107:0/154778835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5648f2af7fe0 con 0x5648f2aec910 2024-05-10T10:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.844+0000 7fcfc5ffb640 1 -- 172.21.15.107:0/154778835 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcfd80a8ca0 con 0x5648f2aec910 2024-05-10T10:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.844+0000 7fcfc5ffb640 1 -- 172.21.15.107:0/154778835 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 30) ==== 8386+0+0 (secure 0 0 0) 0x7fcfd4044070 con 0x5648f2aec910 2024-05-10T10:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.844+0000 7fcfe704e740 10 client.15717 fetch_fsmap finished waiting for FSMap version 30 2024-05-10T10:59:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.844+0000 7fcfe704e740 10 client.15717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.844+0000 7fcfe704e740 20 client.15717 populate_metadata read hostname 'smithi107' 2024-05-10T10:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.844+0000 7fcfe704e740 1 --2- 172.21.15.107:0/154778835 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5648f2b67fe0 0x5648f2b6a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.844+0000 7fcfe704e740 4 client.15717 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T10:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.844+0000 7fcfe704e740 1 -- 172.21.15.107:0/154778835 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5648f2a53050 con 0x5648f2b67fe0 2024-05-10T10:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.845+0000 7fcfe20ce640 1 --2- 172.21.15.107:0/154778835 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5648f2b67fe0 0x5648f2b6a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.845+0000 7fcfc5ffb640 10 client.15717 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:59:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.845+0000 7fcfe20ce640 1 --2- 172.21.15.107:0/154778835 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5648f2b67fe0 0x5648f2b6a400 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e08726db8ff74665 server_cookie=8882a3874f73b197 in_seq=0 out_seq=0 2024-05-10T10:59:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.877+0000 7fcfc5ffb640 1 -- 172.21.15.107:0/154778835 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5648f2a53050 con 0x5648f2b67fe0 2024-05-10T10:59:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.877+0000 7fcfc5ffb640 10 client.15717 handle_command_reply: tid=0 2024-05-10T10:59:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.877+0000 7fcfe704e740 1 client.15717 shutdown 2024-05-10T10:59:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.877+0000 7fcfe704e740 1 -- 172.21.15.107:0/154778835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2aec910 msgr2=0x5648f2af6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.877+0000 7fcfe704e740 1 --2- 172.21.15.107:0/154778835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2aec910 0x5648f2af6670 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4004810 tx=0x7fcfd4020a40 comp rx=0 tx=0).stop 2024-05-10T10:59:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.877+0000 7fcfe704e740 1 -- 172.21.15.107:0/154778835 shutdown_connections 2024-05-10T10:59:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.877+0000 7fcfe704e740 1 --2- 172.21.15.107:0/154778835 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5648f2b67fe0 0x5648f2b6a400 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.878 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.877+0000 7fcfe704e740 1 --2- 172.21.15.107:0/154778835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5648f2aec910 0x5648f2af6670 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.877+0000 7fcfe704e740 1 --2- 172.21.15.107:0/154778835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5648f2ae77a0 0x5648f2af56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.877+0000 7fcfe704e740 1 --2- 172.21.15.107:0/154778835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5648f2ae6db0 0x5648f2af5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.877+0000 7fcfc5ffb640 0 client.15717 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:59:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.877+0000 7fcfe704e740 1 -- 172.21.15.107:0/154778835 >> 172.21.15.107:0/154778835 conn(0x5648f2ae2420 msgr2=0x5648f2ae8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.877+0000 7fcfe704e740 1 -- 172.21.15.107:0/154778835 shutdown_connections 2024-05-10T10:59:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.877+0000 7fcfe704e740 1 -- 172.21.15.107:0/154778835 wait complete. 2024-05-10T10:59:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.877+0000 7fcfe704e740 20 client.15717 trim_cache size 0 max 16384 2024-05-10T10:59:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:{ 2024-05-10T10:59:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "message": "", 2024-05-10T10:59:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "return_code": 0 2024-05-10T10:59:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:} 2024-05-10T10:59:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.878+0000 7fcfe4332640 1 -- 172.21.15.107:0/383490999 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcfc80b28a0 msgr2=0x7fcfc80b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.878+0000 7fcfe4332640 1 --2- 172.21.15.107:0/383490999 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcfc80b28a0 0x7fcfc80b4d60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x5648f2ae8000 tx=0x7fcfd4009500 comp rx=0 tx=0).stop 2024-05-10T10:59:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.878+0000 7fcfe4332640 1 -- 172.21.15.107:0/383490999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfdc102a40 msgr2=0x7fcfdc076760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.878+0000 7fcfe4332640 1 --2- 172.21.15.107:0/383490999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfdc102a40 0x7fcfdc076760 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800d770 tx=0x7fcfd800dc30 comp rx=0 tx=0).stop 2024-05-10T10:59:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.878+0000 7fcfe4332640 1 -- 172.21.15.107:0/383490999 shutdown_connections 2024-05-10T10:59:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.878+0000 7fcfe4332640 1 --2- 172.21.15.107:0/383490999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfdc1045f0 0x7fcfdc0752e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.878+0000 7fcfe4332640 1 --2- 172.21.15.107:0/383490999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcfdc103c30 0x7fcfdc074da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.878+0000 7fcfe4332640 1 --2- 172.21.15.107:0/383490999 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fcfc80b28a0 0x7fcfc80b4d60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.878+0000 7fcfe4332640 1 --2- 172.21.15.107:0/383490999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcfdc102a40 0x7fcfdc076760 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.878+0000 7fcfe4332640 1 -- 172.21.15.107:0/383490999 >> 172.21.15.107:0/383490999 conn(0x7fcfdc0fdfd0 msgr2=0x7fcfdc106ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.878+0000 7fcfe4332640 1 -- 172.21.15.107:0/383490999 shutdown_connections 2024-05-10T10:59:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:45.878+0000 7fcfe4332640 1 -- 172.21.15.107:0/383490999 wait complete. 2024-05-10T10:59:45.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:45 smithi184 ceph-mon[34585]: pgmap v510: 97 pgs: 97 active+clean; 111 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 190 op/s 2024-05-10T10:59:47.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:47 smithi107 ceph-mon[30373]: pgmap v511: 97 pgs: 97 active+clean; 139 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.8 MiB/s wr, 392 op/s 2024-05-10T10:59:47.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:47 smithi196 ceph-mon[34872]: pgmap v511: 97 pgs: 97 active+clean; 139 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.8 MiB/s wr, 392 op/s 2024-05-10T10:59:47.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:47 smithi184 ceph-mon[34585]: pgmap v511: 97 pgs: 97 active+clean; 139 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.8 MiB/s wr, 392 op/s 2024-05-10T10:59:49.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:49 smithi107 ceph-mon[30373]: pgmap v512: 97 pgs: 97 active+clean; 150 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.6 MiB/s wr, 466 op/s 2024-05-10T10:59:49.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:49 smithi196 ceph-mon[34872]: pgmap v512: 97 pgs: 97 active+clean; 150 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.6 MiB/s wr, 466 op/s 2024-05-10T10:59:49.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:49 smithi184 ceph-mon[34585]: pgmap v512: 97 pgs: 97 active+clean; 150 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.6 MiB/s wr, 466 op/s 2024-05-10T10:59:51.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:51 smithi107 ceph-mon[30373]: pgmap v513: 97 pgs: 97 active+clean; 149 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 501 op/s 2024-05-10T10:59:51.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:51 smithi196 ceph-mon[34872]: pgmap v513: 97 pgs: 97 active+clean; 149 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 501 op/s 2024-05-10T10:59:51.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:51 smithi184 ceph-mon[34585]: pgmap v513: 97 pgs: 97 active+clean; 149 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.8 MiB/s wr, 501 op/s 2024-05-10T10:59:52.910 INFO:tasks.workunit.client.0.smithi107.stderr:+ sync 2024-05-10T10:59:53.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:53 smithi107 ceph-mon[30373]: pgmap v514: 97 pgs: 97 active+clean; 147 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 496 op/s 2024-05-10T10:59:53.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:53 smithi196 ceph-mon[34872]: pgmap v514: 97 pgs: 97 active+clean; 147 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 496 op/s 2024-05-10T10:59:53.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:53 smithi184 ceph-mon[34585]: pgmap v514: 97 pgs: 97 active+clean; 147 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.8 MiB/s wr, 496 op/s 2024-05-10T10:59:54.484 INFO:tasks.workunit.client.0.smithi107.stderr:+ tar c linux-4.0.5 2024-05-10T10:59:54.852 INFO:tasks.workunit.client.0.smithi107.stderr:+ rm -rf linux-4.0.5 2024-05-10T10:59:55.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:55 smithi107 ceph-mon[30373]: pgmap v515: 97 pgs: 97 active+clean; 151 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.3 MiB/s wr, 503 op/s 2024-05-10T10:59:55.690 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:55 smithi184 ceph-mon[34585]: pgmap v515: 97 pgs: 97 active+clean; 151 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.3 MiB/s wr, 503 op/s 2024-05-10T10:59:55.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:55 smithi196 ceph-mon[34872]: pgmap v515: 97 pgs: 97 active+clean; 151 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.3 MiB/s wr, 503 op/s 2024-05-10T10:59:57.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:57 smithi107 ceph-mon[30373]: pgmap v516: 97 pgs: 97 active+clean; 162 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 630 op/s 2024-05-10T10:59:57.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:57 smithi196 ceph-mon[34872]: pgmap v516: 97 pgs: 97 active+clean; 162 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 630 op/s 2024-05-10T10:59:57.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:57 smithi184 ceph-mon[34585]: pgmap v516: 97 pgs: 97 active+clean; 162 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 630 op/s 2024-05-10T10:59:58.983 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.968+0000 7f7046d46640 1 -- 172.21.15.107:0/3391593035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7040102b00 msgr2=0x7f7040102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:58.984 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.968+0000 7f7046d46640 1 --2- 172.21.15.107:0/3391593035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7040102b00 0x7f7040102f80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f702c009900 tx=0x7f702c02a410 comp rx=0 tx=0).stop 2024-05-10T10:59:58.984 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.968+0000 7f7046d46640 1 -- 172.21.15.107:0/3391593035 shutdown_connections 2024-05-10T10:59:58.984 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.968+0000 7f7046d46640 1 --2- 172.21.15.107:0/3391593035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70401034c0 0x7f7040109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:58.984 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.968+0000 7f7046d46640 1 --2- 172.21.15.107:0/3391593035 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7040102b00 0x7f7040102f80 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.968+0000 7f7046d46640 1 --2- 172.21.15.107:0/3391593035 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7040101910 0x7f7040101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.968+0000 7f7046d46640 1 -- 172.21.15.107:0/3391593035 >> 172.21.15.107:0/3391593035 conn(0x7f70400fce80 msgr2=0x7f70400ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.968+0000 7f7046d46640 1 -- 172.21.15.107:0/3391593035 shutdown_connections 2024-05-10T10:59:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.968+0000 7f7046d46640 1 -- 172.21.15.107:0/3391593035 wait complete. 2024-05-10T10:59:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.968+0000 7f7046d46640 1 Processor -- start 2024-05-10T10:59:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f7046d46640 1 -- start start 2024-05-10T10:59:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f7046d46640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7040101910 0x7f704006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f7046d46640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7040102b00 0x7f704019d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f7046d46640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70401034c0 0x7f704019ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f7046d46640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f704010d570 con 0x7f7040102b00 2024-05-10T10:59:58.985 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f7046d46640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f704010d3f0 con 0x7f70401034c0 2024-05-10T10:59:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f7046d46640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f704010d6f0 con 0x7f7040101910 2024-05-10T10:59:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f703ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7040102b00 0x7f704019d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f7044ae2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7040101910 0x7f704006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f703ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7040102b00 0x7f704019d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58348/0 (socket says 172.21.15.107:58348) 2024-05-10T10:59:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f703ffff640 1 -- 172.21.15.107:0/975805758 learned_addr learned my addr 172.21.15.107:0/975805758 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:59:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f70452e3640 1 --2- 172.21.15.107:0/975805758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70401034c0 0x7f704019ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f703ffff640 1 -- 172.21.15.107:0/975805758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7040101910 msgr2=0x7f704006abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f703ffff640 1 --2- 172.21.15.107:0/975805758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7040101910 0x7f704006abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f703ffff640 1 -- 172.21.15.107:0/975805758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70401034c0 msgr2=0x7f704019ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f703ffff640 1 --2- 172.21.15.107:0/975805758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70401034c0 0x7f704019ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f703ffff640 1 -- 172.21.15.107:0/975805758 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70401a08e0 con 0x7f7040102b00 2024-05-10T10:59:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f703ffff640 1 --2- 172.21.15.107:0/975805758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7040102b00 0x7f704019d9b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f702c005940 tx=0x7f702c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f703dffb640 1 -- 172.21.15.107:0/975805758 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c03f030 con 0x7f7040102b00 2024-05-10T10:59:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f7046d46640 1 -- 172.21.15.107:0/975805758 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70401a0b10 con 0x7f7040102b00 2024-05-10T10:59:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f703dffb640 1 -- 172.21.15.107:0/975805758 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f702c003cd0 con 0x7f7040102b00 2024-05-10T10:59:58.987 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.969+0000 7f703dffb640 1 -- 172.21.15.107:0/975805758 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c035070 con 0x7f7040102b00 2024-05-10T10:59:58.988 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.970+0000 7f7046d46640 1 -- 172.21.15.107:0/975805758 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70401a1000 con 0x7f7040102b00 2024-05-10T10:59:58.988 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.972+0000 7f703dffb640 1 -- 172.21.15.107:0/975805758 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f702c042030 con 0x7f7040102b00 2024-05-10T10:59:58.988 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.972+0000 7f7049a68740 1 Processor -- start 2024-05-10T10:59:58.988 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.972+0000 7f7049a68740 1 -- start start 2024-05-10T10:59:58.988 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f7049a68740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b31c0 0x56264e9b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:58.988 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f7049a68740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b3bb0 0x56264e9b86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f7049a68740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b8d20 0x56264e9bb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f7049a68740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56264e9135d0 con 0x56264e9b31c0 2024-05-10T10:59:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f7049a68740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56264e8cc890 con 0x56264e9b8d20 2024-05-10T10:59:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f7049a68740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56264e90f590 con 0x56264e9b3bb0 2024-05-10T10:59:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f70452e3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b31c0 0x56264e9b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f7044ae2640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b3bb0 0x56264e9b86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f70452e3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b31c0 0x56264e9b35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58360/0 (socket says 172.21.15.107:58360) 2024-05-10T10:59:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f70452e3640 1 -- 172.21.15.107:0/1705605811 learned_addr learned my addr 172.21.15.107:0/1705605811 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:59:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f703ffff640 1 --2- 172.21.15.107:0/1705605811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b8d20 0x56264e9bb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f70452e3640 1 -- 172.21.15.107:0/1705605811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b3bb0 msgr2=0x56264e9b86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f70452e3640 1 --2- 172.21.15.107:0/1705605811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b3bb0 0x56264e9b86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f70452e3640 1 -- 172.21.15.107:0/1705605811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b8d20 msgr2=0x56264e9bb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f70452e3640 1 --2- 172.21.15.107:0/1705605811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b8d20 0x56264e9bb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f70452e3640 1 -- 172.21.15.107:0/1705605811 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56264e625210 con 0x56264e9b31c0 2024-05-10T10:59:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f7044ae2640 1 --2- 172.21.15.107:0/1705605811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b3bb0 0x56264e9b86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:59:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f703dffb640 1 --2- 172.21.15.107:0/975805758 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f70300b28a0 0x7f70300b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f70452e3640 1 --2- 172.21.15.107:0/1705605811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b31c0 0x56264e9b35e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f7038009f70 tx=0x7f7038010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f0ae302ab73fd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f7044ae2640 1 --2- 172.21.15.107:0/975805758 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f70300b28a0 0x7f70300b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:58.991 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f703dffb640 1 -- 172.21.15.107:0/975805758 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f702c1026c0 con 0x7f7040102b00 2024-05-10T10:59:58.991 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f702affd640 1 -- 172.21.15.107:0/1705605811 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7038016070 con 0x56264e9b31c0 2024-05-10T10:59:58.991 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f702affd640 1 -- 172.21.15.107:0/1705605811 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7038004d20 con 0x56264e9b31c0 2024-05-10T10:59:58.991 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.973+0000 7f702affd640 1 -- 172.21.15.107:0/1705605811 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7038012850 con 0x56264e9b31c0 2024-05-10T10:59:58.991 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.974+0000 7f7049a68740 1 -- 172.21.15.107:0/1705605811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b31c0 msgr2=0x56264e9b35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:58.991 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.974+0000 7f7044ae2640 1 --2- 172.21.15.107:0/975805758 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f70300b28a0 0x7f70300b4d60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x56264e9b3fb0 tx=0x7f703400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:58.991 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.974+0000 7f7049a68740 1 --2- 172.21.15.107:0/1705605811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b31c0 0x56264e9b35e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f7038009f70 tx=0x7f7038010800 comp rx=0 tx=0).stop 2024-05-10T10:59:58.991 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.974+0000 7f7049a68740 1 -- 172.21.15.107:0/1705605811 shutdown_connections 2024-05-10T10:59:58.991 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.974+0000 7f7049a68740 1 --2- 172.21.15.107:0/1705605811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b8d20 0x56264e9bb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:58.992 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.974+0000 7f7049a68740 1 --2- 172.21.15.107:0/1705605811 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b3bb0 0x56264e9b86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:58.992 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.974+0000 7f7049a68740 1 --2- 172.21.15.107:0/1705605811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b31c0 0x56264e9b35e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:58.992 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.974+0000 7f7049a68740 1 -- 172.21.15.107:0/1705605811 >> 172.21.15.107:0/1705605811 conn(0x56264e9aa420 msgr2=0x56264e9aa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:58.992 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.974+0000 7f7049a68740 1 -- 172.21.15.107:0/1705605811 shutdown_connections 2024-05-10T10:59:58.992 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.974+0000 7f7049a68740 1 -- 172.21.15.107:0/1705605811 wait complete. 2024-05-10T10:59:58.992 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.975+0000 7f7049a68740 1 -- start start 2024-05-10T10:59:58.993 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.975+0000 7f7049a68740 1 Processor -- start 2024-05-10T10:59:58.993 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.975+0000 7f7049a68740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b31c0 0x56264e9bd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:58.993 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.975+0000 7f7049a68740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b3bb0 0x56264e9bd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:58.993 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.975+0000 7f7049a68740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b8d20 0x56264e9c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:58.993 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.975+0000 7f7049a68740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x56264e9bbcd0 con 0x56264e9b3bb0 2024-05-10T10:59:58.993 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.975+0000 7f7049a68740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56264e8d0370 con 0x56264e9b31c0 2024-05-10T10:59:58.994 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.975+0000 7f7049a68740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x56264e9bbe50 con 0x56264e9b8d20 2024-05-10T10:59:58.994 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.975+0000 7f7049a68740 10 client.0 _ll_register_callbacks cb 0x56264e624a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:59:58.994 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.975+0000 7f703ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b3bb0 0x56264e9bd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:58.994 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.975+0000 7f7044ae2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b31c0 0x56264e9bd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:58.994 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.975+0000 7f703ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b3bb0 0x56264e9bd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58374/0 (socket says 172.21.15.107:58374) 2024-05-10T10:59:58.994 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.975+0000 7f703ffff640 1 -- 172.21.15.107:0/1722974939 learned_addr learned my addr 172.21.15.107:0/1722974939 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:59:58.994 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.975+0000 7f70452e3640 1 --2- 172.21.15.107:0/1722974939 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b8d20 0x56264e9c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:58.994 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.975+0000 7f703ffff640 1 -- 172.21.15.107:0/1722974939 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b8d20 msgr2=0x56264e9c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:58.995 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.975+0000 7f703ffff640 1 --2- 172.21.15.107:0/1722974939 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b8d20 0x56264e9c4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:58.995 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.975+0000 7f703ffff640 1 -- 172.21.15.107:0/1722974939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b31c0 msgr2=0x56264e9bd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:58.995 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.975+0000 7f703ffff640 1 --2- 172.21.15.107:0/1722974939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b31c0 0x56264e9bd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:58.995 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.976+0000 7f703ffff640 1 -- 172.21.15.107:0/1722974939 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56264e6f1620 con 0x56264e9b3bb0 2024-05-10T10:59:58.995 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.976+0000 7f703ffff640 1 --2- 172.21.15.107:0/1722974939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b3bb0 0x56264e9bd9e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f702c0c70a0 tx=0x7f702c009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918d20afca87e3b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:58.995 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.976+0000 7f701ffff640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T10:59:58.995 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.976+0000 7f701ffff640 1 -- 172.21.15.107:0/1722974939 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c049070 con 0x56264e9b3bb0 2024-05-10T10:59:58.995 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.976+0000 7f701ffff640 1 -- 172.21.15.107:0/1722974939 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f702c03b4f0 con 0x56264e9b3bb0 2024-05-10T10:59:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.976+0000 7f7049a68740 1 -- 172.21.15.107:0/1722974939 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7038004d20 con 0x56264e9b3bb0 2024-05-10T10:59:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.976+0000 7f701ffff640 1 -- 172.21.15.107:0/1722974939 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f702c0c9c00 con 0x56264e9b3bb0 2024-05-10T10:59:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.976+0000 7f7049a68740 10 client.15729 fetch_fsmap learned FSMap version 31 2024-05-10T10:59:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.976+0000 7f7049a68740 1 -- 172.21.15.107:0/1722974939 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56264e9c7a00 con 0x56264e9b3bb0 2024-05-10T10:59:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.976+0000 7f701ffff640 1 -- 172.21.15.107:0/1722974939 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7038004d20 con 0x56264e9b3bb0 2024-05-10T10:59:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.976+0000 7f701ffff640 1 -- 172.21.15.107:0/1722974939 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 31) ==== 8390+0+0 (secure 0 0 0) 0x7f702c0ca090 con 0x56264e9b3bb0 2024-05-10T10:59:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.976+0000 7f7049a68740 10 client.15729 fetch_fsmap finished waiting for FSMap version 31 2024-05-10T10:59:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.976+0000 7f7049a68740 10 client.15729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:59:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.976+0000 7f7049a68740 20 client.15729 populate_metadata read hostname 'smithi107' 2024-05-10T10:59:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.976+0000 7f7049a68740 1 --2- 172.21.15.107:0/1722974939 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x56264e9c9190 0x56264e9cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.976+0000 7f7049a68740 4 client.15729 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T10:59:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.976+0000 7f7049a68740 1 -- 172.21.15.107:0/1722974939 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56264e9211e0 con 0x56264e9c9190 2024-05-10T10:59:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.977+0000 7f7044ae2640 1 --2- 172.21.15.107:0/1722974939 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x56264e9c9190 0x56264e9cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.977+0000 7f7044ae2640 1 --2- 172.21.15.107:0/1722974939 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x56264e9c9190 0x56264e9cb610 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89947bd6c04ce82b server_cookie=3bc50c2a1c300465 in_seq=0 out_seq=0 2024-05-10T10:59:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.977+0000 7f701ffff640 10 client.15729 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:59:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.977+0000 7f701ffff640 1 -- 172.21.15.107:0/1722974939 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56264e9211e0 con 0x56264e9c9190 2024-05-10T10:59:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.977+0000 7f701ffff640 10 client.15729 handle_command_reply: tid=0 2024-05-10T10:59:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.978+0000 7f7049a68740 1 client.15729 shutdown 2024-05-10T10:59:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.978+0000 7f7049a68740 1 -- 172.21.15.107:0/1722974939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b3bb0 msgr2=0x56264e9bd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.978+0000 7f7049a68740 1 --2- 172.21.15.107:0/1722974939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b3bb0 0x56264e9bd9e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f702c0c70a0 tx=0x7f702c009230 comp rx=0 tx=0).stop 2024-05-10T10:59:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.978+0000 7f7049a68740 1 -- 172.21.15.107:0/1722974939 shutdown_connections 2024-05-10T10:59:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.978+0000 7f7049a68740 1 --2- 172.21.15.107:0/1722974939 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x56264e9c9190 0x56264e9cb610 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.978+0000 7f7049a68740 1 --2- 172.21.15.107:0/1722974939 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b8d20 0x56264e9c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.978+0000 7f701ffff640 0 client.15729 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:59:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.978+0000 7f7049a68740 1 --2- 172.21.15.107:0/1722974939 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b3bb0 0x56264e9bd9e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.978+0000 7f7049a68740 1 --2- 172.21.15.107:0/1722974939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b31c0 0x56264e9bd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.978+0000 7f7049a68740 1 -- 172.21.15.107:0/1722974939 >> 172.21.15.107:0/1722974939 conn(0x56264e9aa420 msgr2=0x56264e9a9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.978+0000 7f7049a68740 1 -- 172.21.15.107:0/1722974939 shutdown_connections 2024-05-10T10:59:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.978+0000 7f7049a68740 1 -- 172.21.15.107:0/1722974939 wait complete. 2024-05-10T10:59:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.978+0000 7f7049a68740 20 client.15729 trim_cache size 0 max 16384 2024-05-10T10:59:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.993+0000 7f7049a68740 1 Processor -- start 2024-05-10T10:59:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.993+0000 7f7049a68740 1 -- start start 2024-05-10T10:59:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f7049a68740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b31c0 0x56264e9b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f7049a68740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b3bb0 0x56264e9b5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f7049a68740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b8d20 0x56264e9ad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f7049a68740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f70401a7ae0 con 0x56264e9b3bb0 2024-05-10T10:59:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f7049a68740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f70401a97d0 con 0x56264e9b31c0 2024-05-10T10:59:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f7049a68740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f70401a81b0 con 0x56264e9b8d20 2024-05-10T10:59:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f703ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b3bb0 0x56264e9b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f703ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b3bb0 0x56264e9b5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58384/0 (socket says 172.21.15.107:58384) 2024-05-10T10:59:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f703ffff640 1 -- 172.21.15.107:0/2970895000 learned_addr learned my addr 172.21.15.107:0/2970895000 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:59:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f7044ae2640 1 --2- 172.21.15.107:0/2970895000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b31c0 0x56264e9b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f70452e3640 1 --2- 172.21.15.107:0/2970895000 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b8d20 0x56264e9ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f703ffff640 1 -- 172.21.15.107:0/2970895000 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b8d20 msgr2=0x56264e9ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f703ffff640 1 --2- 172.21.15.107:0/2970895000 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b8d20 0x56264e9ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f703ffff640 1 -- 172.21.15.107:0/2970895000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b31c0 msgr2=0x56264e9b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f703ffff640 1 --2- 172.21.15.107:0/2970895000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b31c0 0x56264e9b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f703ffff640 1 -- 172.21.15.107:0/2970895000 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56264e9ab0f0 con 0x56264e9b3bb0 2024-05-10T10:59:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f7044ae2640 1 --2- 172.21.15.107:0/2970895000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b31c0 0x56264e9b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:59:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f703ffff640 1 --2- 172.21.15.107:0/2970895000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b3bb0 0x56264e9b5370 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f702c0096c0 tx=0x7f702c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2e11c7c46ae8bb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f702a7fc640 1 -- 172.21.15.107:0/2970895000 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c0e9070 con 0x56264e9b3bb0 2024-05-10T10:59:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f702a7fc640 1 -- 172.21.15.107:0/2970895000 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f702c0c9e30 con 0x56264e9b3bb0 2024-05-10T10:59:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.994+0000 7f702a7fc640 1 -- 172.21.15.107:0/2970895000 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c049040 con 0x56264e9b3bb0 2024-05-10T10:59:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.995+0000 7f7049a68740 1 -- 172.21.15.107:0/2970895000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b3bb0 msgr2=0x56264e9b5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.995+0000 7f7049a68740 1 --2- 172.21.15.107:0/2970895000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b3bb0 0x56264e9b5370 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f702c0096c0 tx=0x7f702c02a410 comp rx=0 tx=0).stop 2024-05-10T10:59:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.995+0000 7f7049a68740 1 -- 172.21.15.107:0/2970895000 shutdown_connections 2024-05-10T10:59:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.995+0000 7f7049a68740 1 --2- 172.21.15.107:0/2970895000 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b8d20 0x56264e9ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.995+0000 7f7049a68740 1 --2- 172.21.15.107:0/2970895000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b3bb0 0x56264e9b5370 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.995+0000 7f7049a68740 1 --2- 172.21.15.107:0/2970895000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b31c0 0x56264e9b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.995+0000 7f7049a68740 1 -- 172.21.15.107:0/2970895000 >> 172.21.15.107:0/2970895000 conn(0x56264e9aa420 msgr2=0x56264e9b84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.995+0000 7f7049a68740 1 -- 172.21.15.107:0/2970895000 shutdown_connections 2024-05-10T10:59:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.995+0000 7f7049a68740 1 -- 172.21.15.107:0/2970895000 wait complete. 2024-05-10T10:59:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.996+0000 7f7049a68740 1 -- start start 2024-05-10T10:59:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.996+0000 7f7049a68740 1 Processor -- start 2024-05-10T10:59:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.996+0000 7f7049a68740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b31c0 0x56264e9c1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.996+0000 7f7049a68740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b3bb0 0x56264e9c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.996+0000 7f7049a68740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b8d20 0x56264e9c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.996+0000 7f7049a68740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f70401a9040 con 0x56264e9b31c0 2024-05-10T10:59:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.996+0000 7f7049a68740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f70401a8940 con 0x56264e9b8d20 2024-05-10T10:59:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.996+0000 7f7049a68740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f70401a5ae0 con 0x56264e9b3bb0 2024-05-10T10:59:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.996+0000 7f7049a68740 10 client.0 _ll_register_callbacks cb 0x7f702c032a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T10:59:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.996+0000 7f703ffff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b3bb0 0x56264e9c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.996+0000 7f70452e3640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b8d20 0x56264e9c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.996+0000 7f7044ae2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b31c0 0x56264e9c1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.996+0000 7f703ffff640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b3bb0 0x56264e9c1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.107:38988/0 (socket says 172.21.15.107:38988) 2024-05-10T10:59:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.996+0000 7f703ffff640 1 -- 172.21.15.107:0/844768500 learned_addr learned my addr 172.21.15.107:0/844768500 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T10:59:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.997+0000 7f70452e3640 1 -- 172.21.15.107:0/844768500 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b3bb0 msgr2=0x56264e9c1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:59.012 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.997+0000 7f70452e3640 1 --2- 172.21.15.107:0/844768500 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b3bb0 0x56264e9c1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:59.012 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.997+0000 7f70452e3640 1 -- 172.21.15.107:0/844768500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b31c0 msgr2=0x56264e9c1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T10:59:59.012 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.997+0000 7f70452e3640 1 --2- 172.21.15.107:0/844768500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b31c0 0x56264e9c1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:59.012 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.997+0000 7f70452e3640 1 -- 172.21.15.107:0/844768500 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56264e9c3560 con 0x56264e9b8d20 2024-05-10T10:59:59.012 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.997+0000 7f703ffff640 1 --2- 172.21.15.107:0/844768500 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b3bb0 0x56264e9c1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:59:59.012 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.997+0000 7f7044ae2640 1 --2- 172.21.15.107:0/844768500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b31c0 0x56264e9c1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T10:59:59.012 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.997+0000 7f70452e3640 1 --2- 172.21.15.107:0/844768500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b8d20 0x56264e9c2f70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7038011010 tx=0x7f7038004d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df2935a2985f5f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T10:59:59.012 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.997+0000 7f701ffff640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-05-10T10:59:59.012 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.997+0000 7f701ffff640 1 -- 172.21.15.107:0/844768500 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7038016070 con 0x56264e9b8d20 2024-05-10T10:59:59.012 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.997+0000 7f7049a68740 1 -- 172.21.15.107:0/844768500 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f702c0c9e30 con 0x56264e9b8d20 2024-05-10T10:59:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.997+0000 7f701ffff640 1 -- 172.21.15.107:0/844768500 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f7038005450 con 0x56264e9b8d20 2024-05-10T10:59:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.997+0000 7f701ffff640 1 -- 172.21.15.107:0/844768500 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7038005650 con 0x56264e9b8d20 2024-05-10T10:59:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.997+0000 7f7049a68740 10 client.25238 fetch_fsmap learned FSMap version 31 2024-05-10T10:59:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.997+0000 7f7049a68740 1 -- 172.21.15.107:0/844768500 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56264ea33d60 con 0x56264e9b8d20 2024-05-10T10:59:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.998+0000 7f701ffff640 1 -- 172.21.15.107:0/844768500 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f702c0c9e30 con 0x56264e9b8d20 2024-05-10T10:59:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.998+0000 7f701ffff640 1 -- 172.21.15.107:0/844768500 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 31) ==== 8390+0+0 (secure 0 0 0) 0x7f703802e050 con 0x56264e9b8d20 2024-05-10T10:59:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.998+0000 7f7049a68740 10 client.25238 fetch_fsmap finished waiting for FSMap version 31 2024-05-10T10:59:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.998+0000 7f7049a68740 10 client.25238 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T10:59:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.998+0000 7f7049a68740 20 client.25238 populate_metadata read hostname 'smithi107' 2024-05-10T10:59:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.998+0000 7f7049a68740 1 --2- 172.21.15.107:0/844768500 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x56264ea343d0 0x56264ea367f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T10:59:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.998+0000 7f7049a68740 4 client.25238 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T10:59:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.998+0000 7f7049a68740 1 -- 172.21.15.107:0/844768500 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56264e91b050 con 0x56264ea343d0 2024-05-10T10:59:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.998+0000 7f7044ae2640 1 --2- 172.21.15.107:0/844768500 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x56264ea343d0 0x56264ea367f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T10:59:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.998+0000 7f7044ae2640 1 --2- 172.21.15.107:0/844768500 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x56264ea343d0 0x56264ea367f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adfc95ef8bbfa563 server_cookie=7e76986a3e485840 in_seq=0 out_seq=0 2024-05-10T10:59:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:58.998+0000 7f701ffff640 10 client.25238 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T10:59:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.037+0000 7f701ffff640 1 -- 172.21.15.107:0/844768500 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56264e91b050 con 0x56264ea343d0 2024-05-10T10:59:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.037+0000 7f701ffff640 10 client.25238 handle_command_reply: tid=0 2024-05-10T10:59:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.037+0000 7f7049a68740 1 client.25238 shutdown 2024-05-10T10:59:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.037+0000 7f7049a68740 1 -- 172.21.15.107:0/844768500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b8d20 msgr2=0x56264e9c2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.037+0000 7f7049a68740 1 --2- 172.21.15.107:0/844768500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b8d20 0x56264e9c2f70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7038011010 tx=0x7f7038004d70 comp rx=0 tx=0).stop 2024-05-10T10:59:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.037+0000 7f7049a68740 1 -- 172.21.15.107:0/844768500 shutdown_connections 2024-05-10T10:59:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.037+0000 7f7049a68740 1 --2- 172.21.15.107:0/844768500 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x56264ea343d0 0x56264ea367f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.037+0000 7f7049a68740 1 --2- 172.21.15.107:0/844768500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56264e9b8d20 0x56264e9c2f70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.037+0000 7f7049a68740 1 --2- 172.21.15.107:0/844768500 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56264e9b3bb0 0x56264e9c1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.037+0000 7f701ffff640 0 client.25238 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T10:59:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.037+0000 7f7049a68740 1 --2- 172.21.15.107:0/844768500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x56264e9b31c0 0x56264e9c1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.037+0000 7f7049a68740 1 -- 172.21.15.107:0/844768500 >> 172.21.15.107:0/844768500 conn(0x56264e9aa420 msgr2=0x56264e9bd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.037+0000 7f7049a68740 1 -- 172.21.15.107:0/844768500 shutdown_connections 2024-05-10T10:59:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.037+0000 7f7049a68740 1 -- 172.21.15.107:0/844768500 wait complete. 2024-05-10T10:59:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.037+0000 7f7049a68740 20 client.25238 trim_cache size 0 max 16384 2024-05-10T10:59:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:{ 2024-05-10T10:59:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "message": "", 2024-05-10T10:59:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "return_code": 0 2024-05-10T10:59:59.040 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:} 2024-05-10T10:59:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.038+0000 7f7046d46640 1 -- 172.21.15.107:0/975805758 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f70300b28a0 msgr2=0x7f70300b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.038+0000 7f7046d46640 1 --2- 172.21.15.107:0/975805758 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f70300b28a0 0x7f70300b4d60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x56264e9b3fb0 tx=0x7f703400b410 comp rx=0 tx=0).stop 2024-05-10T10:59:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.038+0000 7f7046d46640 1 -- 172.21.15.107:0/975805758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7040102b00 msgr2=0x7f704019d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T10:59:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.038+0000 7f7046d46640 1 --2- 172.21.15.107:0/975805758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7040102b00 0x7f704019d9b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f702c005940 tx=0x7f702c0043b0 comp rx=0 tx=0).stop 2024-05-10T10:59:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.038+0000 7f7046d46640 1 -- 172.21.15.107:0/975805758 shutdown_connections 2024-05-10T10:59:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.038+0000 7f7046d46640 1 --2- 172.21.15.107:0/975805758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70401034c0 0x7f704019ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.038+0000 7f7046d46640 1 --2- 172.21.15.107:0/975805758 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f70300b28a0 0x7f70300b4d60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.038+0000 7f7046d46640 1 --2- 172.21.15.107:0/975805758 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7040102b00 0x7f704019d9b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.038+0000 7f7046d46640 1 --2- 172.21.15.107:0/975805758 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7040101910 0x7f704006abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T10:59:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.038+0000 7f7046d46640 1 -- 172.21.15.107:0/975805758 >> 172.21.15.107:0/975805758 conn(0x7f70400fce80 msgr2=0x7f7040105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T10:59:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.038+0000 7f7046d46640 1 -- 172.21.15.107:0/975805758 shutdown_connections 2024-05-10T10:59:59.041 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T10:59:59.038+0000 7f7046d46640 1 -- 172.21.15.107:0/975805758 wait complete. 2024-05-10T10:59:59.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:59 smithi196 ceph-mon[34872]: pgmap v517: 97 pgs: 97 active+clean; 167 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 504 op/s 2024-05-10T10:59:59.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 10:59:59 smithi196 ceph-mon[34872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:59:59.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:59 smithi184 ceph-mon[34585]: pgmap v517: 97 pgs: 97 active+clean; 167 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 504 op/s 2024-05-10T10:59:59.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 10:59:59 smithi184 ceph-mon[34585]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T10:59:59.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:59 smithi107 ceph-mon[30373]: pgmap v517: 97 pgs: 97 active+clean; 167 MiB data, 967 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 504 op/s 2024-05-10T10:59:59.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 10:59:59 smithi107 ceph-mon[30373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T11:00:00.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:00 smithi196 ceph-mon[34872]: overall HEALTH_OK 2024-05-10T11:00:00.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:00 smithi184 ceph-mon[34585]: overall HEALTH_OK 2024-05-10T11:00:00.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:00 smithi107 ceph-mon[30373]: overall HEALTH_OK 2024-05-10T11:00:01.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:01 smithi196 ceph-mon[34872]: pgmap v518: 97 pgs: 97 active+clean; 169 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 472 op/s 2024-05-10T11:00:01.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:01 smithi196 ceph-mon[34872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T11:00:01.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:01 smithi184 ceph-mon[34585]: pgmap v518: 97 pgs: 97 active+clean; 169 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 472 op/s 2024-05-10T11:00:01.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:01 smithi184 ceph-mon[34585]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T11:00:01.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:01 smithi107 ceph-mon[30373]: pgmap v518: 97 pgs: 97 active+clean; 169 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 472 op/s 2024-05-10T11:00:01.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:01 smithi107 ceph-mon[30373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T11:00:03.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:03 smithi196 ceph-mon[34872]: pgmap v519: 97 pgs: 97 active+clean; 169 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 478 op/s 2024-05-10T11:00:03.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:03 smithi184 ceph-mon[34585]: pgmap v519: 97 pgs: 97 active+clean; 169 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 478 op/s 2024-05-10T11:00:03.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:03 smithi107 ceph-mon[30373]: pgmap v519: 97 pgs: 97 active+clean; 169 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 478 op/s 2024-05-10T11:00:05.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:05 smithi196 ceph-mon[34872]: pgmap v520: 97 pgs: 97 active+clean; 174 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.4 MiB/s wr, 488 op/s 2024-05-10T11:00:05.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:05 smithi184 ceph-mon[34585]: pgmap v520: 97 pgs: 97 active+clean; 174 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.4 MiB/s wr, 488 op/s 2024-05-10T11:00:05.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:05 smithi107 ceph-mon[30373]: pgmap v520: 97 pgs: 97 active+clean; 174 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.4 MiB/s wr, 488 op/s 2024-05-10T11:00:06.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:06 smithi196 ceph-mon[34872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T11:00:06.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:06 smithi184 ceph-mon[34585]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T11:00:06.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:06 smithi107 ceph-mon[30373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T11:00:06.964 INFO:tasks.workunit.client.0.smithi107.stderr:+ tar xf doc.tar 2024-05-10T11:00:07.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:07 smithi196 ceph-mon[34872]: pgmap v521: 97 pgs: 97 active+clean; 170 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 534 op/s 2024-05-10T11:00:07.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:07 smithi184 ceph-mon[34585]: pgmap v521: 97 pgs: 97 active+clean; 170 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 534 op/s 2024-05-10T11:00:07.927 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:07 smithi107 ceph-mon[30373]: pgmap v521: 97 pgs: 97 active+clean; 170 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 534 op/s 2024-05-10T11:00:09.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:09 smithi196 ceph-mon[34872]: pgmap v522: 97 pgs: 97 active+clean; 169 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 417 op/s 2024-05-10T11:00:09.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:09 smithi196 ceph-mon[34872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T11:00:09.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:09 smithi184 ceph-mon[34585]: pgmap v522: 97 pgs: 97 active+clean; 169 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 417 op/s 2024-05-10T11:00:09.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:09 smithi184 ceph-mon[34585]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T11:00:09.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:09 smithi107 ceph-mon[30373]: pgmap v522: 97 pgs: 97 active+clean; 169 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 417 op/s 2024-05-10T11:00:09.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:09 smithi107 ceph-mon[30373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T11:00:11.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:11 smithi196 ceph-mon[34872]: pgmap v523: 97 pgs: 97 active+clean; 167 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 397 op/s 2024-05-10T11:00:11.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:11 smithi184 ceph-mon[34585]: pgmap v523: 97 pgs: 97 active+clean; 167 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 397 op/s 2024-05-10T11:00:11.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:11 smithi107 ceph-mon[30373]: pgmap v523: 97 pgs: 97 active+clean; 167 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 397 op/s 2024-05-10T11:00:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.131+0000 7f0c71a83640 1 -- 172.21.15.107:0/3775507641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c6c1087a0 msgr2=0x7f0c6c10abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.131+0000 7f0c71a83640 1 --2- 172.21.15.107:0/3775507641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c6c1087a0 0x7f0c6c10abf0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009900 tx=0x7f0c6402a410 comp rx=0 tx=0).stop 2024-05-10T11:00:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.131+0000 7f0c71a83640 1 -- 172.21.15.107:0/3775507641 shutdown_connections 2024-05-10T11:00:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.131+0000 7f0c71a83640 1 --2- 172.21.15.107:0/3775507641 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c6c1087a0 0x7f0c6c10abf0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.131+0000 7f0c71a83640 1 --2- 172.21.15.107:0/3775507641 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c6c105e70 0x7f0c6c108260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.131+0000 7f0c71a83640 1 --2- 172.21.15.107:0/3775507641 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c6c103540 0x7f0c6c105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.131+0000 7f0c71a83640 1 -- 172.21.15.107:0/3775507641 >> 172.21.15.107:0/3775507641 conn(0x7f0c6c0fcf30 msgr2=0x7f0c6c0ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:12.132 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.131+0000 7f0c71a83640 1 -- 172.21.15.107:0/3775507641 shutdown_connections 2024-05-10T11:00:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.131+0000 7f0c71a83640 1 -- 172.21.15.107:0/3775507641 wait complete. 2024-05-10T11:00:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.132+0000 7f0c71a83640 1 Processor -- start 2024-05-10T11:00:12.133 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.132+0000 7f0c71a83640 1 -- start start 2024-05-10T11:00:12.134 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.132+0000 7f0c71a83640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c6c103540 0x7f0c6c198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.132+0000 7f0c71a83640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c6c105e70 0x7f0c6c199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.132+0000 7f0c71a83640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c6c1087a0 0x7f0c6c1a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.132+0000 7f0c71a83640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c10e6d0 con 0x7f0c6c1087a0 2024-05-10T11:00:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.132+0000 7f0c71a83640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c10e550 con 0x7f0c6c105e70 2024-05-10T11:00:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.132+0000 7f0c71a83640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c10e850 con 0x7f0c6c103540 2024-05-10T11:00:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.132+0000 7f0c6bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c6c1087a0 0x7f0c6c1a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.132+0000 7f0c6bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c6c1087a0 0x7f0c6c1a0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45728/0 (socket says 172.21.15.107:45728) 2024-05-10T11:00:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.132+0000 7f0c6bfff640 1 -- 172.21.15.107:0/3087930497 learned_addr learned my addr 172.21.15.107:0/3087930497 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.132+0000 7f0c6b7fe640 1 --2- 172.21.15.107:0/3087930497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c6c103540 0x7f0c6c198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.132+0000 7f0c6affd640 1 --2- 172.21.15.107:0/3087930497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c6c105e70 0x7f0c6c199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.133+0000 7f0c6bfff640 1 -- 172.21.15.107:0/3087930497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c6c103540 msgr2=0x7f0c6c198c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.133+0000 7f0c6bfff640 1 --2- 172.21.15.107:0/3087930497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c6c103540 0x7f0c6c198c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.133+0000 7f0c6bfff640 1 -- 172.21.15.107:0/3087930497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c6c105e70 msgr2=0x7f0c6c199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:12.135 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.133+0000 7f0c6bfff640 1 --2- 172.21.15.107:0/3087930497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c6c105e70 0x7f0c6c199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.133+0000 7f0c6bfff640 1 -- 172.21.15.107:0/3087930497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6c1a0830 con 0x7f0c6c1087a0 2024-05-10T11:00:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.133+0000 7f0c6bfff640 1 --2- 172.21.15.107:0/3087930497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c6c1087a0 0x7f0c6c1a0190 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0c64031570 tx=0x7f0c64004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.133+0000 7f0c68ff9640 1 -- 172.21.15.107:0/3087930497 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6403f030 con 0x7f0c6c1087a0 2024-05-10T11:00:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.133+0000 7f0c68ff9640 1 -- 172.21.15.107:0/3087930497 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0c64003cd0 con 0x7f0c6c1087a0 2024-05-10T11:00:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.133+0000 7f0c68ff9640 1 -- 172.21.15.107:0/3087930497 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c64035070 con 0x7f0c6c1087a0 2024-05-10T11:00:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.133+0000 7f0c71a83640 1 -- 172.21.15.107:0/3087930497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6c1a0ac0 con 0x7f0c6c1087a0 2024-05-10T11:00:12.136 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.133+0000 7f0c71a83640 1 -- 172.21.15.107:0/3087930497 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c6c1a0f30 con 0x7f0c6c1087a0 2024-05-10T11:00:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.135+0000 7f0c68ff9640 1 -- 172.21.15.107:0/3087930497 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f0c64042030 con 0x7f0c6c1087a0 2024-05-10T11:00:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.135+0000 7f0c747a7740 1 Processor -- start 2024-05-10T11:00:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.135+0000 7f0c747a7740 1 -- start start 2024-05-10T11:00:12.142 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c747a7740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebd61c0 0x5593eebd65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c747a7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebd6bb0 0x5593eebdb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c747a7740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebdbd20 0x5593eebde1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c747a7740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5593eeb365d0 con 0x5593eebdbd20 2024-05-10T11:00:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c747a7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5593eeaef890 con 0x5593eebd6bb0 2024-05-10T11:00:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c747a7740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5593eeb32590 con 0x5593eebd61c0 2024-05-10T11:00:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c6affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebdbd20 0x5593eebde1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c6b7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebd6bb0 0x5593eebdb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:12.143 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c6affd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebd61c0 0x5593eebd65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c6b7fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebd6bb0 0x5593eebdb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.107:39092/0 (socket says 172.21.15.107:39092) 2024-05-10T11:00:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c6b7fe640 1 -- 172.21.15.107:0/1207618182 learned_addr learned my addr 172.21.15.107:0/1207618182 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c68ff9640 1 --2- 172.21.15.107:0/3087930497 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0c540b28a0 0x7f0c540b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c6affd640 1 -- 172.21.15.107:0/1207618182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebd6bb0 msgr2=0x5593eebdb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c6affd640 1 --2- 172.21.15.107:0/1207618182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebd6bb0 0x5593eebdb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c6affd640 1 -- 172.21.15.107:0/1207618182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebdbd20 msgr2=0x5593eebde1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c6affd640 1 --2- 172.21.15.107:0/1207618182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebdbd20 0x5593eebde1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c6affd640 1 -- 172.21.15.107:0/1207618182 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593ee848210 con 0x5593eebd61c0 2024-05-10T11:00:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c6bfff640 1 --2- 172.21.15.107:0/3087930497 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0c540b28a0 0x7f0c540b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c68ff9640 1 -- 172.21.15.107:0/3087930497 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f0c64102820 con 0x7f0c6c1087a0 2024-05-10T11:00:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.136+0000 7f0c6affd640 1 --2- 172.21.15.107:0/1207618182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebd61c0 0x5593eebd65e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c60005fd0 tx=0x7f0c60004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=148ad5827b63d5f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.137+0000 7f0c51ffb640 1 -- 172.21.15.107:0/1207618182 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60011c70 con 0x5593eebd61c0 2024-05-10T11:00:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.137+0000 7f0c6bfff640 1 --2- 172.21.15.107:0/3087930497 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0c540b28a0 0x7f0c540b4d60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0c640c5ed0 tx=0x7f0c640be720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:12.144 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.137+0000 7f0c51ffb640 1 -- 172.21.15.107:0/1207618182 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0c60011e10 con 0x5593eebd61c0 2024-05-10T11:00:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.137+0000 7f0c51ffb640 1 -- 172.21.15.107:0/1207618182 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60005580 con 0x5593eebd61c0 2024-05-10T11:00:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.137+0000 7f0c747a7740 1 -- 172.21.15.107:0/1207618182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebd61c0 msgr2=0x5593eebd65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.138+0000 7f0c747a7740 1 --2- 172.21.15.107:0/1207618182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebd61c0 0x5593eebd65e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c60005fd0 tx=0x7f0c60004a40 comp rx=0 tx=0).stop 2024-05-10T11:00:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.138+0000 7f0c747a7740 1 -- 172.21.15.107:0/1207618182 shutdown_connections 2024-05-10T11:00:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.138+0000 7f0c747a7740 1 --2- 172.21.15.107:0/1207618182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebdbd20 0x5593eebde1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.138+0000 7f0c747a7740 1 --2- 172.21.15.107:0/1207618182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebd6bb0 0x5593eebdb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.138+0000 7f0c747a7740 1 --2- 172.21.15.107:0/1207618182 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebd61c0 0x5593eebd65e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.138+0000 7f0c747a7740 1 -- 172.21.15.107:0/1207618182 >> 172.21.15.107:0/1207618182 conn(0x5593eebcd420 msgr2=0x5593eebcd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.138+0000 7f0c747a7740 1 -- 172.21.15.107:0/1207618182 shutdown_connections 2024-05-10T11:00:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.138+0000 7f0c747a7740 1 -- 172.21.15.107:0/1207618182 wait complete. 2024-05-10T11:00:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.138+0000 7f0c747a7740 1 -- start start 2024-05-10T11:00:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.138+0000 7f0c747a7740 1 Processor -- start 2024-05-10T11:00:12.145 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.138+0000 7f0c747a7740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebd61c0 0x5593eebe0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:12.146 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.138+0000 7f0c747a7740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebd6bb0 0x5593eebe0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:12.146 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.138+0000 7f0c747a7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebdbd20 0x5593eebe7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:12.146 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.138+0000 7f0c747a7740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x5593eebdecd0 con 0x5593eebd6bb0 2024-05-10T11:00:12.146 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c747a7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5593eeaf3370 con 0x5593eebdbd20 2024-05-10T11:00:12.146 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c747a7740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x5593eebdee50 con 0x5593eebd61c0 2024-05-10T11:00:12.146 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c747a7740 10 client.0 _ll_register_callbacks cb 0x5593ee847a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:00:12.146 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c6b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebd6bb0 0x5593eebe0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:12.146 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c6b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebd6bb0 0x5593eebe0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45746/0 (socket says 172.21.15.107:45746) 2024-05-10T11:00:12.146 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c6b7fe640 1 -- 172.21.15.107:0/2500981886 learned_addr learned my addr 172.21.15.107:0/2500981886 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:12.146 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c6affd640 1 --2- 172.21.15.107:0/2500981886 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebd61c0 0x5593eebe0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c6affd640 1 --2- 172.21.15.107:0/2500981886 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebdbd20 0x5593eebe7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c6b7fe640 1 -- 172.21.15.107:0/2500981886 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebd61c0 msgr2=0x5593eebe0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c6b7fe640 1 --2- 172.21.15.107:0/2500981886 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebd61c0 0x5593eebe0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c6b7fe640 1 -- 172.21.15.107:0/2500981886 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebdbd20 msgr2=0x5593eebe7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c6b7fe640 1 --2- 172.21.15.107:0/2500981886 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebdbd20 0x5593eebe7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c6b7fe640 1 -- 172.21.15.107:0/2500981886 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593ee914620 con 0x5593eebd6bb0 2024-05-10T11:00:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c6b7fe640 1 --2- 172.21.15.107:0/2500981886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebd6bb0 0x5593eebe0940 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c00ba30 tx=0x7f0c5c00bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b643ef677327f291 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c4affd640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T11:00:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c4affd640 1 -- 172.21.15.107:0/2500981886 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c005020 con 0x5593eebd6bb0 2024-05-10T11:00:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c4affd640 1 -- 172.21.15.107:0/2500981886 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f0c5c0051c0 con 0x5593eebd6bb0 2024-05-10T11:00:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c747a7740 1 -- 172.21.15.107:0/2500981886 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c60011e10 con 0x5593eebd6bb0 2024-05-10T11:00:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c4affd640 1 -- 172.21.15.107:0/2500981886 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0c5c0053e0 con 0x5593eebd6bb0 2024-05-10T11:00:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c747a7740 10 client.15747 fetch_fsmap learned FSMap version 34 2024-05-10T11:00:12.147 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.139+0000 7f0c747a7740 1 -- 172.21.15.107:0/2500981886 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5593eebeaa10 con 0x5593eebd6bb0 2024-05-10T11:00:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.140+0000 7f0c4affd640 1 -- 172.21.15.107:0/2500981886 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0c60011e10 con 0x5593eebd6bb0 2024-05-10T11:00:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.140+0000 7f0c4affd640 1 -- 172.21.15.107:0/2500981886 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 34) ==== 8414+0+0 (secure 0 0 0) 0x7f0c5c01b5b0 con 0x5593eebd6bb0 2024-05-10T11:00:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.140+0000 7f0c747a7740 10 client.15747 fetch_fsmap finished waiting for FSMap version 34 2024-05-10T11:00:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.140+0000 7f0c747a7740 10 client.15747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T11:00:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.140+0000 7f0c747a7740 20 client.15747 populate_metadata read hostname 'smithi107' 2024-05-10T11:00:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.140+0000 7f0c747a7740 1 --2- 172.21.15.107:0/2500981886 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5593eebec1c0 0x5593eebee5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.140+0000 7f0c747a7740 4 client.15747 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:00:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.140+0000 7f0c747a7740 1 -- 172.21.15.107:0/2500981886 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593eeb441e0 con 0x5593eebec1c0 2024-05-10T11:00:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.140+0000 7f0c6affd640 1 --2- 172.21.15.107:0/2500981886 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5593eebec1c0 0x5593eebee5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.140+0000 7f0c4affd640 10 client.15747 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T11:00:12.148 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.140+0000 7f0c6affd640 1 --2- 172.21.15.107:0/2500981886 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5593eebec1c0 0x5593eebee5f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=555753db5b28ee16 server_cookie=8ab11edbb9ff97c1 in_seq=0 out_seq=0 2024-05-10T11:00:12.149 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.145+0000 7f0c4affd640 1 -- 172.21.15.107:0/2500981886 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5593eeb441e0 con 0x5593eebec1c0 2024-05-10T11:00:12.149 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.145+0000 7f0c4affd640 10 client.15747 handle_command_reply: tid=0 2024-05-10T11:00:12.150 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.145+0000 7f0c747a7740 1 client.15747 shutdown 2024-05-10T11:00:12.150 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.145+0000 7f0c747a7740 1 -- 172.21.15.107:0/2500981886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebd6bb0 msgr2=0x5593eebe0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:12.150 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.145+0000 7f0c747a7740 1 --2- 172.21.15.107:0/2500981886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebd6bb0 0x5593eebe0940 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c00ba30 tx=0x7f0c5c00bef0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.150 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.146+0000 7f0c747a7740 1 -- 172.21.15.107:0/2500981886 shutdown_connections 2024-05-10T11:00:12.150 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.146+0000 7f0c747a7740 1 --2- 172.21.15.107:0/2500981886 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5593eebec1c0 0x5593eebee5f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.150 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.146+0000 7f0c747a7740 1 --2- 172.21.15.107:0/2500981886 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebdbd20 0x5593eebe7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.150 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.146+0000 7f0c747a7740 1 --2- 172.21.15.107:0/2500981886 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebd6bb0 0x5593eebe0940 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.150 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.146+0000 7f0c4affd640 0 client.15747 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T11:00:12.150 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.146+0000 7f0c747a7740 1 --2- 172.21.15.107:0/2500981886 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebd61c0 0x5593eebe0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.150 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.146+0000 7f0c747a7740 1 -- 172.21.15.107:0/2500981886 >> 172.21.15.107:0/2500981886 conn(0x5593eebcd420 msgr2=0x5593eebcc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:12.150 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.146+0000 7f0c747a7740 1 -- 172.21.15.107:0/2500981886 shutdown_connections 2024-05-10T11:00:12.150 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.146+0000 7f0c747a7740 1 -- 172.21.15.107:0/2500981886 wait complete. 2024-05-10T11:00:12.150 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.146+0000 7f0c747a7740 20 client.15747 trim_cache size 0 max 16384 2024-05-10T11:00:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.161+0000 7f0c747a7740 1 Processor -- start 2024-05-10T11:00:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.161+0000 7f0c747a7740 1 -- start start 2024-05-10T11:00:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.161+0000 7f0c747a7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebd61c0 0x5593eebd0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.161+0000 7f0c747a7740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebd6bb0 0x5593eebe7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.161+0000 7f0c747a7740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebdbd20 0x5593eebd0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.161+0000 7f0c747a7740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c1a79f0 con 0x5593eebd6bb0 2024-05-10T11:00:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.161+0000 7f0c747a7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c1a9770 con 0x5593eebd61c0 2024-05-10T11:00:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.161+0000 7f0c747a7740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c1a80f0 con 0x5593eebdbd20 2024-05-10T11:00:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.161+0000 7f0c6b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebd6bb0 0x5593eebe7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.161+0000 7f0c6b7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebd6bb0 0x5593eebe7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45752/0 (socket says 172.21.15.107:45752) 2024-05-10T11:00:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.161+0000 7f0c6b7fe640 1 -- 172.21.15.107:0/2665757201 learned_addr learned my addr 172.21.15.107:0/2665757201 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.162+0000 7f0c6affd640 1 --2- 172.21.15.107:0/2665757201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebd61c0 0x5593eebd0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.162+0000 7f0c6affd640 1 --2- 172.21.15.107:0/2665757201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebdbd20 0x5593eebd0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.162+0000 7f0c6b7fe640 1 -- 172.21.15.107:0/2665757201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebdbd20 msgr2=0x5593eebd0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.162+0000 7f0c6b7fe640 1 --2- 172.21.15.107:0/2665757201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebdbd20 0x5593eebd0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.162+0000 7f0c6b7fe640 1 -- 172.21.15.107:0/2665757201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebd61c0 msgr2=0x5593eebd0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.162+0000 7f0c6b7fe640 1 --2- 172.21.15.107:0/2665757201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebd61c0 0x5593eebd0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.162+0000 7f0c6b7fe640 1 -- 172.21.15.107:0/2665757201 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593eebeec70 con 0x5593eebd6bb0 2024-05-10T11:00:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.162+0000 7f0c6affd640 1 --2- 172.21.15.107:0/2665757201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebd61c0 0x5593eebd0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:00:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.162+0000 7f0c6b7fe640 1 --2- 172.21.15.107:0/2665757201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebd6bb0 0x5593eebe7940 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c011460 tx=0x7f0c5c003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8562360f500fa1b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.162+0000 7f0c517fa640 1 -- 172.21.15.107:0/2665757201 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c034070 con 0x5593eebd6bb0 2024-05-10T11:00:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.162+0000 7f0c517fa640 1 -- 172.21.15.107:0/2665757201 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0c5c005580 con 0x5593eebd6bb0 2024-05-10T11:00:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.162+0000 7f0c517fa640 1 -- 172.21.15.107:0/2665757201 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c02b070 con 0x5593eebd6bb0 2024-05-10T11:00:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.163+0000 7f0c747a7740 1 -- 172.21.15.107:0/2665757201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebd6bb0 msgr2=0x5593eebe7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.163+0000 7f0c747a7740 1 --2- 172.21.15.107:0/2665757201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebd6bb0 0x5593eebe7940 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c011460 tx=0x7f0c5c003a80 comp rx=0 tx=0).stop 2024-05-10T11:00:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.163+0000 7f0c747a7740 1 -- 172.21.15.107:0/2665757201 shutdown_connections 2024-05-10T11:00:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.163+0000 7f0c747a7740 1 --2- 172.21.15.107:0/2665757201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebdbd20 0x5593eebd0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.163+0000 7f0c747a7740 1 --2- 172.21.15.107:0/2665757201 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebd6bb0 0x5593eebe7940 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.163+0000 7f0c747a7740 1 --2- 172.21.15.107:0/2665757201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebd61c0 0x5593eebd0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.163+0000 7f0c747a7740 1 -- 172.21.15.107:0/2665757201 >> 172.21.15.107:0/2665757201 conn(0x5593eebcd420 msgr2=0x5593eebd7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.163+0000 7f0c747a7740 1 -- 172.21.15.107:0/2665757201 shutdown_connections 2024-05-10T11:00:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.163+0000 7f0c747a7740 1 -- 172.21.15.107:0/2665757201 wait complete. 2024-05-10T11:00:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.163+0000 7f0c747a7740 1 -- start start 2024-05-10T11:00:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.163+0000 7f0c747a7740 1 Processor -- start 2024-05-10T11:00:12.169 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c747a7740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebd61c0 0x5593eebe50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:12.169 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c747a7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebd6bb0 0x5593eebe5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:12.169 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c747a7740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebdbd20 0x5593eebe6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:12.169 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c747a7740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c1a8fe0 con 0x5593eebdbd20 2024-05-10T11:00:12.169 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c747a7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c1a8880 con 0x5593eebd6bb0 2024-05-10T11:00:12.169 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c747a7740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c1a59d0 con 0x5593eebd61c0 2024-05-10T11:00:12.169 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c747a7740 10 client.0 _ll_register_callbacks cb 0x7f0c5c004330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:00:12.169 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c6affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebdbd20 0x5593eebe6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:12.169 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c6affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebdbd20 0x5593eebe6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:45760/0 (socket says 172.21.15.107:45760) 2024-05-10T11:00:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c6affd640 1 -- 172.21.15.107:0/3148420835 learned_addr learned my addr 172.21.15.107:0/3148420835 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c6affd640 1 --2- 172.21.15.107:0/3148420835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebd61c0 0x5593eebe50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c6b7fe640 1 --2- 172.21.15.107:0/3148420835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebd6bb0 0x5593eebe5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c6affd640 1 -- 172.21.15.107:0/3148420835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebd61c0 msgr2=0x5593eebe50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c6affd640 1 --2- 172.21.15.107:0/3148420835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebd61c0 0x5593eebe50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c6affd640 1 -- 172.21.15.107:0/3148420835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebd6bb0 msgr2=0x5593eebe5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c6affd640 1 --2- 172.21.15.107:0/3148420835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebd6bb0 0x5593eebe5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c6affd640 1 -- 172.21.15.107:0/3148420835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593eebd0e90 con 0x5593eebdbd20 2024-05-10T11:00:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c6affd640 1 --2- 172.21.15.107:0/3148420835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebdbd20 0x5593eebe6610 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0c60014bf0 tx=0x7f0c60023040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc79ed169f94c04b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c4affd640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T11:00:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c4affd640 1 -- 172.21.15.107:0/3148420835 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60009b50 con 0x5593eebdbd20 2024-05-10T11:00:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c4affd640 1 -- 172.21.15.107:0/3148420835 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f0c60030c70 con 0x5593eebdbd20 2024-05-10T11:00:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.164+0000 7f0c747a7740 1 -- 172.21.15.107:0/3148420835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c5c005580 con 0x5593eebdbd20 2024-05-10T11:00:12.170 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.165+0000 7f0c4affd640 1 -- 172.21.15.107:0/3148420835 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0c60014110 con 0x5593eebdbd20 2024-05-10T11:00:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.165+0000 7f0c747a7740 10 client.15753 fetch_fsmap learned FSMap version 34 2024-05-10T11:00:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.165+0000 7f0c747a7740 1 -- 172.21.15.107:0/3148420835 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5593eebcd250 con 0x5593eebdbd20 2024-05-10T11:00:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.165+0000 7f0c4affd640 1 -- 172.21.15.107:0/3148420835 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0c5c005580 con 0x5593eebdbd20 2024-05-10T11:00:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.165+0000 7f0c4affd640 1 -- 172.21.15.107:0/3148420835 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 34) ==== 8414+0+0 (secure 0 0 0) 0x7f0c60030350 con 0x5593eebdbd20 2024-05-10T11:00:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.165+0000 7f0c747a7740 10 client.15753 fetch_fsmap finished waiting for FSMap version 34 2024-05-10T11:00:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.165+0000 7f0c747a7740 10 client.15753 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T11:00:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.165+0000 7f0c747a7740 20 client.15753 populate_metadata read hostname 'smithi107' 2024-05-10T11:00:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.165+0000 7f0c747a7740 1 --2- 172.21.15.107:0/3148420835 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5593eec56f40 0x5593eec59360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.165+0000 7f0c747a7740 4 client.15753 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T11:00:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.165+0000 7f0c747a7740 1 -- 172.21.15.107:0/3148420835 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5593eeb3e050 con 0x5593eec56f40 2024-05-10T11:00:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.165+0000 7f0c6b7fe640 1 --2- 172.21.15.107:0/3148420835 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5593eec56f40 0x5593eec59360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.166+0000 7f0c6b7fe640 1 --2- 172.21.15.107:0/3148420835 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5593eec56f40 0x5593eec59360 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b71754cbdd30f88 server_cookie=2b15dab1233a79a8 in_seq=0 out_seq=0 2024-05-10T11:00:12.171 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.166+0000 7f0c4affd640 10 client.15753 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T11:00:12.969 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.968+0000 7f0c4affd640 1 -- 172.21.15.107:0/3148420835 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5593eeb3e050 con 0x5593eec56f40 2024-05-10T11:00:12.998 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.968+0000 7f0c4affd640 10 client.15753 handle_command_reply: tid=0 2024-05-10T11:00:12.998 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.968+0000 7f0c747a7740 1 client.15753 shutdown 2024-05-10T11:00:12.998 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.968+0000 7f0c747a7740 1 -- 172.21.15.107:0/3148420835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebdbd20 msgr2=0x5593eebe6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:12.998 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.968+0000 7f0c747a7740 1 --2- 172.21.15.107:0/3148420835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebdbd20 0x5593eebe6610 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0c60014bf0 tx=0x7f0c60023040 comp rx=0 tx=0).stop 2024-05-10T11:00:12.999 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.968+0000 7f0c747a7740 1 -- 172.21.15.107:0/3148420835 shutdown_connections 2024-05-10T11:00:12.999 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.968+0000 7f0c747a7740 1 --2- 172.21.15.107:0/3148420835 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x5593eec56f40 0x5593eec59360 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.999 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.968+0000 7f0c747a7740 1 --2- 172.21.15.107:0/3148420835 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x5593eebdbd20 0x5593eebe6610 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.999 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.968+0000 7f0c747a7740 1 --2- 172.21.15.107:0/3148420835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5593eebd6bb0 0x5593eebe5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.999 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.968+0000 7f0c747a7740 1 --2- 172.21.15.107:0/3148420835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x5593eebd61c0 0x5593eebe50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:12.999 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.968+0000 7f0c4affd640 0 client.15753 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T11:00:12.999 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.968+0000 7f0c747a7740 1 -- 172.21.15.107:0/3148420835 >> 172.21.15.107:0/3148420835 conn(0x5593eebcd420 msgr2=0x5593eebd7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:12.999 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.969+0000 7f0c747a7740 1 -- 172.21.15.107:0/3148420835 shutdown_connections 2024-05-10T11:00:12.999 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.969+0000 7f0c747a7740 1 -- 172.21.15.107:0/3148420835 wait complete. 2024-05-10T11:00:12.999 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.969+0000 7f0c747a7740 20 client.15753 trim_cache size 0 max 16384 2024-05-10T11:00:13.000 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:{ 2024-05-10T11:00:13.000 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "message": "", 2024-05-10T11:00:13.000 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "return_code": 0 2024-05-10T11:00:13.000 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:} 2024-05-10T11:00:13.001 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.969+0000 7f0c71a83640 1 -- 172.21.15.107:0/3087930497 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0c540b28a0 msgr2=0x7f0c540b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:13.001 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.969+0000 7f0c71a83640 1 --2- 172.21.15.107:0/3087930497 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0c540b28a0 0x7f0c540b4d60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0c640c5ed0 tx=0x7f0c640be720 comp rx=0 tx=0).stop 2024-05-10T11:00:13.001 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.969+0000 7f0c71a83640 1 -- 172.21.15.107:0/3087930497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c6c1087a0 msgr2=0x7f0c6c1a0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:13.001 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.969+0000 7f0c71a83640 1 --2- 172.21.15.107:0/3087930497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c6c1087a0 0x7f0c6c1a0190 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0c64031570 tx=0x7f0c64004360 comp rx=0 tx=0).stop 2024-05-10T11:00:13.001 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.969+0000 7f0c71a83640 1 -- 172.21.15.107:0/3087930497 shutdown_connections 2024-05-10T11:00:13.001 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.969+0000 7f0c71a83640 1 --2- 172.21.15.107:0/3087930497 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0c540b28a0 0x7f0c540b4d60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:13.001 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.969+0000 7f0c71a83640 1 --2- 172.21.15.107:0/3087930497 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0c6c1087a0 0x7f0c6c1a0190 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:13.001 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.969+0000 7f0c71a83640 1 --2- 172.21.15.107:0/3087930497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c6c105e70 0x7f0c6c199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:13.001 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.969+0000 7f0c71a83640 1 --2- 172.21.15.107:0/3087930497 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0c6c103540 0x7f0c6c198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:13.001 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.969+0000 7f0c71a83640 1 -- 172.21.15.107:0/3087930497 >> 172.21.15.107:0/3087930497 conn(0x7f0c6c0fcf30 msgr2=0x7f0c6c103e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:13.001 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.969+0000 7f0c71a83640 1 -- 172.21.15.107:0/3087930497 shutdown_connections 2024-05-10T11:00:13.001 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:12.969+0000 7f0c71a83640 1 -- 172.21.15.107:0/3087930497 wait complete. 2024-05-10T11:00:13.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:13 smithi196 ceph-mon[34872]: pgmap v524: 97 pgs: 97 active+clean; 165 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 362 op/s 2024-05-10T11:00:13.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:13 smithi184 ceph-mon[34585]: pgmap v524: 97 pgs: 97 active+clean; 165 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 362 op/s 2024-05-10T11:00:13.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:13 smithi107 ceph-mon[30373]: pgmap v524: 97 pgs: 97 active+clean; 165 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 362 op/s 2024-05-10T11:00:15.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:15 smithi196 ceph-mon[34872]: pgmap v525: 97 pgs: 97 active+clean; 167 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 359 op/s 2024-05-10T11:00:15.890 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:15 smithi184 ceph-mon[34585]: pgmap v525: 97 pgs: 97 active+clean; 167 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 359 op/s 2024-05-10T11:00:15.909 INFO:tasks.workunit.client.0.smithi107.stderr:+ sync 2024-05-10T11:00:15.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:15 smithi107 ceph-mon[30373]: pgmap v525: 97 pgs: 97 active+clean; 167 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 359 op/s 2024-05-10T11:00:17.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:17 smithi196 ceph-mon[34872]: pgmap v526: 97 pgs: 97 active+clean; 168 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 651 op/s 2024-05-10T11:00:17.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:17 smithi184 ceph-mon[34585]: pgmap v526: 97 pgs: 97 active+clean; 168 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 651 op/s 2024-05-10T11:00:17.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:17 smithi107 ceph-mon[30373]: pgmap v526: 97 pgs: 97 active+clean; 168 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 651 op/s 2024-05-10T11:00:18.942 INFO:tasks.workunit.client.0.smithi107.stderr:+ tar c linux-4.0.5 2024-05-10T11:00:19.514 INFO:tasks.workunit.client.0.smithi107.stdout:Ok 2024-05-10T11:00:19.516 INFO:tasks.workunit.client.0.smithi107.stderr:+ echo Ok 2024-05-10T11:00:19.516 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-10T11:00:19.517 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-10T11:00:19.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:19 smithi196 ceph-mon[34872]: pgmap v527: 97 pgs: 97 active+clean; 168 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 797 op/s 2024-05-10T11:00:19.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:19 smithi184 ceph-mon[34585]: pgmap v527: 97 pgs: 97 active+clean; 168 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 797 op/s 2024-05-10T11:00:19.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:19 smithi107 ceph-mon[30373]: pgmap v527: 97 pgs: 97 active+clean; 168 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 797 op/s 2024-05-10T11:00:21.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:21 smithi196 ceph-mon[34872]: pgmap v528: 97 pgs: 97 active+clean; 178 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 2.4 MiB/s wr, 894 op/s 2024-05-10T11:00:21.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:21 smithi184 ceph-mon[34585]: pgmap v528: 97 pgs: 97 active+clean; 178 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 2.4 MiB/s wr, 894 op/s 2024-05-10T11:00:21.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:21 smithi107 ceph-mon[30373]: pgmap v528: 97 pgs: 97 active+clean; 178 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 2.4 MiB/s wr, 894 op/s 2024-05-10T11:00:23.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:23 smithi196 ceph-mon[34872]: pgmap v529: 97 pgs: 97 active+clean; 179 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 930 op/s 2024-05-10T11:00:23.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:23 smithi184 ceph-mon[34585]: pgmap v529: 97 pgs: 97 active+clean; 179 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 930 op/s 2024-05-10T11:00:23.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:23 smithi107 ceph-mon[30373]: pgmap v529: 97 pgs: 97 active+clean; 179 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 930 op/s 2024-05-10T11:00:24.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:24 smithi196 ceph-mon[34872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T11:00:24.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:24 smithi184 ceph-mon[34585]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T11:00:24.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:24 smithi107 ceph-mon[30373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T11:00:25.789 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:25 smithi184 ceph-mon[34585]: pgmap v530: 97 pgs: 97 active+clean; 158 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 925 op/s 2024-05-10T11:00:25.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:25 smithi196 ceph-mon[34872]: pgmap v530: 97 pgs: 97 active+clean; 158 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 925 op/s 2024-05-10T11:00:25.926 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:25 smithi107 ceph-mon[30373]: pgmap v530: 97 pgs: 97 active+clean; 158 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 925 op/s 2024-05-10T11:00:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.080+0000 7ffb172bd640 1 -- 172.21.15.107:0/3378228342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb101019c0 msgr2=0x7ffb10101de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.080+0000 7ffb172bd640 1 --2- 172.21.15.107:0/3378228342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb101019c0 0x7ffb10101de0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009900 tx=0x7ffb0c02a410 comp rx=0 tx=0).stop 2024-05-10T11:00:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.080+0000 7ffb172bd640 1 -- 172.21.15.107:0/3378228342 shutdown_connections 2024-05-10T11:00:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.080+0000 7ffb172bd640 1 --2- 172.21.15.107:0/3378228342 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb10103570 0x7ffb10109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.080+0000 7ffb172bd640 1 --2- 172.21.15.107:0/3378228342 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb10102bb0 0x7ffb10103030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.080+0000 7ffb172bd640 1 --2- 172.21.15.107:0/3378228342 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb101019c0 0x7ffb10101de0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.080+0000 7ffb172bd640 1 -- 172.21.15.107:0/3378228342 >> 172.21.15.107:0/3378228342 conn(0x7ffb100fcf30 msgr2=0x7ffb100ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.080+0000 7ffb172bd640 1 -- 172.21.15.107:0/3378228342 shutdown_connections 2024-05-10T11:00:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.080+0000 7ffb172bd640 1 -- 172.21.15.107:0/3378228342 wait complete. 2024-05-10T11:00:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.081+0000 7ffb172bd640 1 Processor -- start 2024-05-10T11:00:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.081+0000 7ffb172bd640 1 -- start start 2024-05-10T11:00:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.081+0000 7ffb172bd640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb101019c0 0x7ffb10198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.081+0000 7ffb172bd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb10102bb0 0x7ffb10199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.081+0000 7ffb172bd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb10103570 0x7ffb101a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.081+0000 7ffb172bd640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1010d5a0 con 0x7ffb10103570 2024-05-10T11:00:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.081+0000 7ffb172bd640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1010d420 con 0x7ffb10102bb0 2024-05-10T11:00:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.081+0000 7ffb172bd640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1010d720 con 0x7ffb101019c0 2024-05-10T11:00:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.081+0000 7ffb1585a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb10103570 0x7ffb101a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.081+0000 7ffb1585a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb10103570 0x7ffb101a0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47848/0 (socket says 172.21.15.107:47848) 2024-05-10T11:00:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.081+0000 7ffb1585a640 1 -- 172.21.15.107:0/1108242534 learned_addr learned my addr 172.21.15.107:0/1108242534 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.081+0000 7ffb15059640 1 --2- 172.21.15.107:0/1108242534 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb101019c0 0x7ffb10198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.081+0000 7ffb14858640 1 --2- 172.21.15.107:0/1108242534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb10102bb0 0x7ffb10199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.081+0000 7ffb1585a640 1 -- 172.21.15.107:0/1108242534 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb101019c0 msgr2=0x7ffb10198ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.081+0000 7ffb1585a640 1 --2- 172.21.15.107:0/1108242534 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb101019c0 0x7ffb10198ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.081+0000 7ffb1585a640 1 -- 172.21.15.107:0/1108242534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb10102bb0 msgr2=0x7ffb10199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.081+0000 7ffb1585a640 1 --2- 172.21.15.107:0/1108242534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb10102bb0 0x7ffb10199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.081+0000 7ffb1585a640 1 -- 172.21.15.107:0/1108242534 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb101a08d0 con 0x7ffb10103570 2024-05-10T11:00:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.082+0000 7ffb1585a640 1 --2- 172.21.15.107:0/1108242534 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb10103570 0x7ffb101a0230 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009fd0 tx=0x7ffb0800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.082+0000 7ffb067fc640 1 -- 172.21.15.107:0/1108242534 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08017070 con 0x7ffb10103570 2024-05-10T11:00:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.082+0000 7ffb067fc640 1 -- 172.21.15.107:0/1108242534 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffb08003e40 con 0x7ffb10103570 2024-05-10T11:00:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.082+0000 7ffb172bd640 1 -- 172.21.15.107:0/1108242534 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb101a0bc0 con 0x7ffb10103570 2024-05-10T11:00:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.082+0000 7ffb067fc640 1 -- 172.21.15.107:0/1108242534 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08004820 con 0x7ffb10103570 2024-05-10T11:00:26.085 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.082+0000 7ffb172bd640 1 -- 172.21.15.107:0/1108242534 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb101a1110 con 0x7ffb10103570 2024-05-10T11:00:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.085+0000 7ffb19fd1740 1 Processor -- start 2024-05-10T11:00:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.085+0000 7ffb067fc640 1 -- 172.21.15.107:0/1108242534 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7ffb08003970 con 0x7ffb10103570 2024-05-10T11:00:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.085+0000 7ffb19fd1740 1 -- start start 2024-05-10T11:00:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.085+0000 7ffb19fd1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6d5db0 0x55fa5b6d61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.085+0000 7ffb19fd1740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6db2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.085+0000 7ffb19fd1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6db910 0x55fa5b6ddda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.085+0000 7ffb19fd1740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fa5b63a5d0 con 0x55fa5b6d67a0 2024-05-10T11:00:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.085+0000 7ffb19fd1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fa5b5f3890 con 0x55fa5b6db910 2024-05-10T11:00:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.085+0000 7ffb19fd1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55fa5b636590 con 0x55fa5b6d5db0 2024-05-10T11:00:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.085+0000 7ffb15059640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6db2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.085+0000 7ffb15059640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6db2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47856/0 (socket says 172.21.15.107:47856) 2024-05-10T11:00:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.085+0000 7ffb15059640 1 -- 172.21.15.107:0/2396857461 learned_addr learned my addr 172.21.15.107:0/2396857461 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.085+0000 7ffb14858640 1 --2- 172.21.15.107:0/2396857461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6db910 0x55fa5b6ddda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.086+0000 7ffb14858640 1 --2- 172.21.15.107:0/2396857461 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6d5db0 0x55fa5b6d61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.086+0000 7ffb15059640 1 -- 172.21.15.107:0/2396857461 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6d5db0 msgr2=0x55fa5b6d61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.086+0000 7ffb15059640 1 --2- 172.21.15.107:0/2396857461 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6d5db0 0x55fa5b6d61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.086+0000 7ffb15059640 1 -- 172.21.15.107:0/2396857461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6db910 msgr2=0x55fa5b6ddda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.086+0000 7ffb15059640 1 --2- 172.21.15.107:0/2396857461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6db910 0x55fa5b6ddda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.086+0000 7ffb15059640 1 -- 172.21.15.107:0/2396857461 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa5b34c210 con 0x55fa5b6d67a0 2024-05-10T11:00:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.086+0000 7ffb067fc640 1 --2- 172.21.15.107:0/1108242534 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ffafc0b2920 0x7ffafc0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.086+0000 7ffb15059640 1 --2- 172.21.15.107:0/2396857461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6db2a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ffb10102a10 tx=0x7ffb0c005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898783a0198b93c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.086+0000 7ffb14858640 1 --2- 172.21.15.107:0/1108242534 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ffafc0b2920 0x7ffafc0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.086+0000 7ffafb7fe640 1 -- 172.21.15.107:0/2396857461 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c040070 con 0x55fa5b6d67a0 2024-05-10T11:00:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.086+0000 7ffb067fc640 1 -- 172.21.15.107:0/1108242534 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7ffb080e1e70 con 0x7ffb10103570 2024-05-10T11:00:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.086+0000 7ffafb7fe640 1 -- 172.21.15.107:0/2396857461 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffb0c004030 con 0x55fa5b6d67a0 2024-05-10T11:00:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.086+0000 7ffafb7fe640 1 -- 172.21.15.107:0/2396857461 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c035040 con 0x55fa5b6d67a0 2024-05-10T11:00:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.087+0000 7ffb19fd1740 1 -- 172.21.15.107:0/2396857461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 msgr2=0x55fa5b6db2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.087+0000 7ffb14858640 1 --2- 172.21.15.107:0/1108242534 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ffafc0b2920 0x7ffafc0b4de0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55fa5b6d7000 tx=0x7ffb000096c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.087+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/2396857461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6db2a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ffb10102a10 tx=0x7ffb0c005c00 comp rx=0 tx=0).stop 2024-05-10T11:00:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.087+0000 7ffb19fd1740 1 -- 172.21.15.107:0/2396857461 shutdown_connections 2024-05-10T11:00:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.087+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/2396857461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6db910 0x55fa5b6ddda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.087+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/2396857461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6db2a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.087+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/2396857461 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6d5db0 0x55fa5b6d61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.087+0000 7ffb19fd1740 1 -- 172.21.15.107:0/2396857461 >> 172.21.15.107:0/2396857461 conn(0x55fa5b6d1420 msgr2=0x55fa5b6d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.087+0000 7ffb19fd1740 1 -- 172.21.15.107:0/2396857461 shutdown_connections 2024-05-10T11:00:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.087+0000 7ffb19fd1740 1 -- 172.21.15.107:0/2396857461 wait complete. 2024-05-10T11:00:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.087+0000 7ffb19fd1740 1 -- start start 2024-05-10T11:00:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.087+0000 7ffb19fd1740 1 Processor -- start 2024-05-10T11:00:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffb19fd1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6d5db0 0x55fa5b6dff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffb19fd1740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6e0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffb19fd1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6db910 0x55fa5b6e7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffb19fd1740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55fa5b6de860 con 0x55fa5b6d67a0 2024-05-10T11:00:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffb19fd1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fa5b5f7370 con 0x55fa5b6d5db0 2024-05-10T11:00:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffb19fd1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55fa5b6de9e0 con 0x55fa5b6db910 2024-05-10T11:00:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffb19fd1740 10 client.0 _ll_register_callbacks cb 0x55fa5b34ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:00:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffb14858640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6e0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffb15059640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6d5db0 0x55fa5b6dff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffb14858640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6e0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47868/0 (socket says 172.21.15.107:47868) 2024-05-10T11:00:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffb14858640 1 -- 172.21.15.107:0/1065151412 learned_addr learned my addr 172.21.15.107:0/1065151412 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffb1585a640 1 --2- 172.21.15.107:0/1065151412 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6db910 0x55fa5b6e7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffb14858640 1 -- 172.21.15.107:0/1065151412 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6db910 msgr2=0x55fa5b6e7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffb14858640 1 --2- 172.21.15.107:0/1065151412 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6db910 0x55fa5b6e7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffb14858640 1 -- 172.21.15.107:0/1065151412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6d5db0 msgr2=0x55fa5b6dff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:26.095 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffb14858640 1 --2- 172.21.15.107:0/1065151412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6d5db0 0x55fa5b6dff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffb14858640 1 -- 172.21.15.107:0/1065151412 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa5b418620 con 0x55fa5b6d67a0 2024-05-10T11:00:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffb14858640 1 --2- 172.21.15.107:0/1065151412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6e0450 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ffb00003b10 tx=0x7ffb00004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edad3f5bdb842a87 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffaf8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T11:00:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffaf8ff9640 1 -- 172.21.15.107:0/1065151412 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0002f060 con 0x55fa5b6d67a0 2024-05-10T11:00:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffaf8ff9640 1 -- 172.21.15.107:0/1065151412 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7ffb0001a070 con 0x55fa5b6d67a0 2024-05-10T11:00:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.088+0000 7ffb19fd1740 1 -- 172.21.15.107:0/1065151412 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb0c004030 con 0x55fa5b6d67a0 2024-05-10T11:00:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.089+0000 7ffaf8ff9640 1 -- 172.21.15.107:0/1065151412 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7ffb0001f890 con 0x55fa5b6d67a0 2024-05-10T11:00:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.089+0000 7ffb19fd1740 10 client.15765 fetch_fsmap learned FSMap version 36 2024-05-10T11:00:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.089+0000 7ffb19fd1740 1 -- 172.21.15.107:0/1065151412 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55fa5b6ea4e0 con 0x55fa5b6d67a0 2024-05-10T11:00:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.089+0000 7ffaf8ff9640 1 -- 172.21.15.107:0/1065151412 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffb0c004030 con 0x55fa5b6d67a0 2024-05-10T11:00:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.089+0000 7ffaf8ff9640 1 -- 172.21.15.107:0/1065151412 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 36) ==== 8422+0+0 (secure 0 0 0) 0x7ffb00034070 con 0x55fa5b6d67a0 2024-05-10T11:00:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.089+0000 7ffb19fd1740 10 client.15765 fetch_fsmap finished waiting for FSMap version 36 2024-05-10T11:00:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.089+0000 7ffb19fd1740 10 client.15765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T11:00:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.089+0000 7ffb19fd1740 20 client.15765 populate_metadata read hostname 'smithi107' 2024-05-10T11:00:26.096 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.089+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/1065151412 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55fa5b6ebc90 0x55fa5b6ee130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.089+0000 7ffb19fd1740 4 client.15765 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:00:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.089+0000 7ffb19fd1740 1 -- 172.21.15.107:0/1065151412 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa5b6481e0 con 0x55fa5b6ebc90 2024-05-10T11:00:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.089+0000 7ffb15059640 1 --2- 172.21.15.107:0/1065151412 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55fa5b6ebc90 0x55fa5b6ee130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.090+0000 7ffaf8ff9640 10 client.15765 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T11:00:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.090+0000 7ffb15059640 1 --2- 172.21.15.107:0/1065151412 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55fa5b6ebc90 0x55fa5b6ee130 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6c08ed0fcc197c6 server_cookie=bb74a4afe0007859 in_seq=0 out_seq=0 2024-05-10T11:00:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.090+0000 7ffaf8ff9640 1 -- 172.21.15.107:0/1065151412 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fa5b6481e0 con 0x55fa5b6ebc90 2024-05-10T11:00:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.090+0000 7ffaf8ff9640 10 client.15765 handle_command_reply: tid=0 2024-05-10T11:00:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.090+0000 7ffb19fd1740 1 client.15765 shutdown 2024-05-10T11:00:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.090+0000 7ffb19fd1740 1 -- 172.21.15.107:0/1065151412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 msgr2=0x55fa5b6e0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.090+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/1065151412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6e0450 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ffb00003b10 tx=0x7ffb00004730 comp rx=0 tx=0).stop 2024-05-10T11:00:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.090+0000 7ffb19fd1740 1 -- 172.21.15.107:0/1065151412 shutdown_connections 2024-05-10T11:00:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.090+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/1065151412 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55fa5b6ebc90 0x55fa5b6ee130 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.090+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/1065151412 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6db910 0x55fa5b6e7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.090+0000 7ffaf8ff9640 0 client.15765 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T11:00:26.098 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.090+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/1065151412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6e0450 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.098 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.090+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/1065151412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6d5db0 0x55fa5b6dff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.098 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.090+0000 7ffb19fd1740 1 -- 172.21.15.107:0/1065151412 >> 172.21.15.107:0/1065151412 conn(0x55fa5b6d1420 msgr2=0x55fa5b6d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:26.098 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.091+0000 7ffb19fd1740 1 -- 172.21.15.107:0/1065151412 shutdown_connections 2024-05-10T11:00:26.098 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.091+0000 7ffb19fd1740 1 -- 172.21.15.107:0/1065151412 wait complete. 2024-05-10T11:00:26.098 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.091+0000 7ffb19fd1740 20 client.15765 trim_cache size 0 max 16384 2024-05-10T11:00:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.106+0000 7ffb19fd1740 1 Processor -- start 2024-05-10T11:00:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.106+0000 7ffb19fd1740 1 -- start start 2024-05-10T11:00:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.106+0000 7ffb19fd1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6d5db0 0x55fa5b6dff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.106+0000 7ffb19fd1740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6e0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.106+0000 7ffb19fd1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6db910 0x55fa5b6e7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.106+0000 7ffb19fd1740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ffb101a9cc0 con 0x55fa5b6d67a0 2024-05-10T11:00:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.106+0000 7ffb19fd1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ffb101abaa0 con 0x55fa5b6d5db0 2024-05-10T11:00:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.106+0000 7ffb19fd1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffb101aa3f0 con 0x55fa5b6db910 2024-05-10T11:00:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.106+0000 7ffb14858640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6e0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.106+0000 7ffb14858640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6e0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47872/0 (socket says 172.21.15.107:47872) 2024-05-10T11:00:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.106+0000 7ffb14858640 1 -- 172.21.15.107:0/2876648710 learned_addr learned my addr 172.21.15.107:0/2876648710 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.106+0000 7ffb15059640 1 --2- 172.21.15.107:0/2876648710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6d5db0 0x55fa5b6dff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.106+0000 7ffb14858640 1 -- 172.21.15.107:0/2876648710 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6db910 msgr2=0x55fa5b6e7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.106+0000 7ffb14858640 1 --2- 172.21.15.107:0/2876648710 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6db910 0x55fa5b6e7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.106+0000 7ffb14858640 1 -- 172.21.15.107:0/2876648710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6d5db0 msgr2=0x55fa5b6dff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.106+0000 7ffb14858640 1 --2- 172.21.15.107:0/2876648710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6d5db0 0x55fa5b6dff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.106+0000 7ffb14858640 1 -- 172.21.15.107:0/2876648710 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa5b6daba0 con 0x55fa5b6d67a0 2024-05-10T11:00:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.107+0000 7ffb14858640 1 --2- 172.21.15.107:0/2876648710 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6e0450 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ffb00004010 tx=0x7ffb000353e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d373533f230c5b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.107+0000 7ffafaffd640 1 -- 172.21.15.107:0/2876648710 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0003a070 con 0x55fa5b6d67a0 2024-05-10T11:00:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.107+0000 7ffafaffd640 1 -- 172.21.15.107:0/2876648710 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffb00003900 con 0x55fa5b6d67a0 2024-05-10T11:00:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.107+0000 7ffafaffd640 1 -- 172.21.15.107:0/2876648710 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb000051a0 con 0x55fa5b6d67a0 2024-05-10T11:00:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.107+0000 7ffb19fd1740 1 -- 172.21.15.107:0/2876648710 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 msgr2=0x55fa5b6e0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.107+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/2876648710 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6e0450 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ffb00004010 tx=0x7ffb000353e0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.107+0000 7ffb19fd1740 1 -- 172.21.15.107:0/2876648710 shutdown_connections 2024-05-10T11:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.107+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/2876648710 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6db910 0x55fa5b6e7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.107+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/2876648710 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6e0450 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.107+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/2876648710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6d5db0 0x55fa5b6dff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.107+0000 7ffb19fd1740 1 -- 172.21.15.107:0/2876648710 >> 172.21.15.107:0/2876648710 conn(0x55fa5b6d1420 msgr2=0x55fa5b6cc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.107+0000 7ffb19fd1740 1 -- 172.21.15.107:0/2876648710 shutdown_connections 2024-05-10T11:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.108+0000 7ffb19fd1740 1 -- 172.21.15.107:0/2876648710 wait complete. 2024-05-10T11:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.108+0000 7ffb19fd1740 1 -- start start 2024-05-10T11:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.108+0000 7ffb19fd1740 1 Processor -- start 2024-05-10T11:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.108+0000 7ffb19fd1740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6d5db0 0x55fa5b6e4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.108+0000 7ffb19fd1740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6e5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.108+0000 7ffb19fd1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6db910 0x55fa5b6e6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.108+0000 7ffb19fd1740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ffb101ab310 con 0x55fa5b6d67a0 2024-05-10T11:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.108+0000 7ffb19fd1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ffb101aab80 con 0x55fa5b6db910 2024-05-10T11:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.108+0000 7ffb19fd1740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ffb101a7ca0 con 0x55fa5b6d5db0 2024-05-10T11:00:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.108+0000 7ffb19fd1740 10 client.0 _ll_register_callbacks cb 0x7ffb00009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:00:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.108+0000 7ffb14858640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6e5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.108+0000 7ffb14858640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6e5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:47880/0 (socket says 172.21.15.107:47880) 2024-05-10T11:00:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.108+0000 7ffb14858640 1 -- 172.21.15.107:0/797877624 learned_addr learned my addr 172.21.15.107:0/797877624 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.108+0000 7ffb1585a640 1 --2- 172.21.15.107:0/797877624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6db910 0x55fa5b6e6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.109+0000 7ffb15059640 1 --2- 172.21.15.107:0/797877624 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6d5db0 0x55fa5b6e4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.109+0000 7ffb14858640 1 -- 172.21.15.107:0/797877624 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6d5db0 msgr2=0x55fa5b6e4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.109+0000 7ffb14858640 1 --2- 172.21.15.107:0/797877624 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6d5db0 0x55fa5b6e4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.109+0000 7ffb14858640 1 -- 172.21.15.107:0/797877624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6db910 msgr2=0x55fa5b6e6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.109+0000 7ffb14858640 1 --2- 172.21.15.107:0/797877624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6db910 0x55fa5b6e6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.109+0000 7ffb14858640 1 -- 172.21.15.107:0/797877624 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa5b6e6660 con 0x55fa5b6d67a0 2024-05-10T11:00:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.109+0000 7ffb15059640 1 --2- 172.21.15.107:0/797877624 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6d5db0 0x55fa5b6e4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:00:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.109+0000 7ffb14858640 1 --2- 172.21.15.107:0/797877624 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6e5060 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ffb0002a650 tx=0x7ffb0002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab675cda706763ab server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.109+0000 7ffaf8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T11:00:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.109+0000 7ffaf8ff9640 1 -- 172.21.15.107:0/797877624 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00044070 con 0x55fa5b6d67a0 2024-05-10T11:00:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.109+0000 7ffaf8ff9640 1 -- 172.21.15.107:0/797877624 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7ffb0001a040 con 0x55fa5b6d67a0 2024-05-10T11:00:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.109+0000 7ffb19fd1740 1 -- 172.21.15.107:0/797877624 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fa5b642050 con 0x55fa5b6d67a0 2024-05-10T11:00:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.109+0000 7ffaf8ff9640 1 -- 172.21.15.107:0/797877624 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7ffb00050050 con 0x55fa5b6d67a0 2024-05-10T11:00:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.109+0000 7ffb19fd1740 10 client.15771 fetch_fsmap learned FSMap version 36 2024-05-10T11:00:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.109+0000 7ffb19fd1740 1 -- 172.21.15.107:0/797877624 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55fa5b7565f0 con 0x55fa5b6d67a0 2024-05-10T11:00:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.109+0000 7ffaf8ff9640 1 -- 172.21.15.107:0/797877624 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x55fa5b642050 con 0x55fa5b6d67a0 2024-05-10T11:00:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.109+0000 7ffaf8ff9640 1 -- 172.21.15.107:0/797877624 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 36) ==== 8422+0+0 (secure 0 0 0) 0x7ffb00034050 con 0x55fa5b6d67a0 2024-05-10T11:00:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.109+0000 7ffb19fd1740 10 client.15771 fetch_fsmap finished waiting for FSMap version 36 2024-05-10T11:00:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.109+0000 7ffb19fd1740 10 client.15771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-10T11:00:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.110+0000 7ffb19fd1740 20 client.15771 populate_metadata read hostname 'smithi107' 2024-05-10T11:00:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.110+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/797877624 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55fa5b6ebc90 0x55fa5b758fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.110+0000 7ffb19fd1740 4 client.15771 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-10T11:00:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.110+0000 7ffb19fd1740 1 -- 172.21.15.107:0/797877624 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fa5b5bd5f0 con 0x55fa5b6ebc90 2024-05-10T11:00:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.110+0000 7ffb15059640 1 --2- 172.21.15.107:0/797877624 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55fa5b6ebc90 0x55fa5b758fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.110+0000 7ffb15059640 1 --2- 172.21.15.107:0/797877624 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55fa5b6ebc90 0x55fa5b758fb0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a587a33441dc531 server_cookie=ced905fb58ced1dd in_seq=0 out_seq=0 2024-05-10T11:00:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.110+0000 7ffaf8ff9640 10 client.15771 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T11:00:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.437+0000 7ffaf8ff9640 1 -- 172.21.15.107:0/797877624 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fa5b5bd5f0 con 0x55fa5b6ebc90 2024-05-10T11:00:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.438+0000 7ffaf8ff9640 10 client.15771 handle_command_reply: tid=0 2024-05-10T11:00:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.438+0000 7ffb19fd1740 1 client.15771 shutdown 2024-05-10T11:00:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.438+0000 7ffb19fd1740 1 -- 172.21.15.107:0/797877624 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 msgr2=0x55fa5b6e5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.438+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/797877624 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6e5060 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ffb0002a650 tx=0x7ffb0002a680 comp rx=0 tx=0).stop 2024-05-10T11:00:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.438+0000 7ffb19fd1740 1 -- 172.21.15.107:0/797877624 shutdown_connections 2024-05-10T11:00:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.438+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/797877624 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55fa5b6ebc90 0x55fa5b758fb0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.438+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/797877624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fa5b6db910 0x55fa5b6e6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.438+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/797877624 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55fa5b6d67a0 0x55fa5b6e5060 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.438+0000 7ffaf8ff9640 0 client.15771 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T11:00:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.438+0000 7ffb19fd1740 1 --2- 172.21.15.107:0/797877624 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55fa5b6d5db0 0x55fa5b6e4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.438+0000 7ffb19fd1740 1 -- 172.21.15.107:0/797877624 >> 172.21.15.107:0/797877624 conn(0x55fa5b6d1420 msgr2=0x55fa5b6d7920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.438+0000 7ffb19fd1740 1 -- 172.21.15.107:0/797877624 shutdown_connections 2024-05-10T11:00:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.438+0000 7ffb19fd1740 1 -- 172.21.15.107:0/797877624 wait complete. 2024-05-10T11:00:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.438+0000 7ffb19fd1740 20 client.15771 trim_cache size 0 max 16384 2024-05-10T11:00:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:{ 2024-05-10T11:00:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "message": "", 2024-05-10T11:00:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout: "return_code": 0 2024-05-10T11:00:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stdout:} 2024-05-10T11:00:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.439+0000 7ffb172bd640 1 -- 172.21.15.107:0/1108242534 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ffafc0b2920 msgr2=0x7ffafc0b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.439+0000 7ffb172bd640 1 --2- 172.21.15.107:0/1108242534 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ffafc0b2920 0x7ffafc0b4de0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x55fa5b6d7000 tx=0x7ffb000096c0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.439+0000 7ffb172bd640 1 -- 172.21.15.107:0/1108242534 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb10103570 msgr2=0x7ffb101a0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.439+0000 7ffb172bd640 1 --2- 172.21.15.107:0/1108242534 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb10103570 0x7ffb101a0230 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009fd0 tx=0x7ffb0800b260 comp rx=0 tx=0).stop 2024-05-10T11:00:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.439+0000 7ffb172bd640 1 -- 172.21.15.107:0/1108242534 shutdown_connections 2024-05-10T11:00:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.439+0000 7ffb172bd640 1 --2- 172.21.15.107:0/1108242534 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ffafc0b2920 0x7ffafc0b4de0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.439+0000 7ffb172bd640 1 --2- 172.21.15.107:0/1108242534 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ffb10103570 0x7ffb101a0230 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.439+0000 7ffb172bd640 1 --2- 172.21.15.107:0/1108242534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb10102bb0 0x7ffb10199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.439+0000 7ffb172bd640 1 --2- 172.21.15.107:0/1108242534 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb101019c0 0x7ffb10198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.439+0000 7ffb172bd640 1 -- 172.21.15.107:0/1108242534 >> 172.21.15.107:0/1108242534 conn(0x7ffb100fcf30 msgr2=0x7ffb100fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.439+0000 7ffb172bd640 1 -- 172.21.15.107:0/1108242534 shutdown_connections 2024-05-10T11:00:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi107.front.sepia.ceph.com.smithi107.stderr:2024-05-10T11:00:26.439+0000 7ffb172bd640 1 -- 172.21.15.107:0/1108242534 wait complete. 2024-05-10T11:00:26.810 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:26 smithi184 ceph-mon[34585]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T11:00:26.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:26 smithi196 ceph-mon[34872]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T11:00:26.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:26 smithi107 ceph-mon[30373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-10T11:00:27.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:27 smithi196 ceph-mon[34872]: pgmap v531: 97 pgs: 97 active+clean; 95 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 946 op/s 2024-05-10T11:00:27.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:27 smithi184 ceph-mon[34585]: pgmap v531: 97 pgs: 97 active+clean; 95 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 946 op/s 2024-05-10T11:00:27.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:27 smithi107 ceph-mon[30373]: pgmap v531: 97 pgs: 97 active+clean; 95 MiB data, 731 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 946 op/s 2024-05-10T11:00:29.747 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:29 smithi107 ceph-mon[30373]: pgmap v532: 97 pgs: 97 active+clean; 89 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 690 op/s 2024-05-10T11:00:29.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:29 smithi196 ceph-mon[34872]: pgmap v532: 97 pgs: 97 active+clean; 89 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 690 op/s 2024-05-10T11:00:29.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:29 smithi184 ceph-mon[34585]: pgmap v532: 97 pgs: 97 active+clean; 89 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 690 op/s 2024-05-10T11:00:31.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:31 smithi196 ceph-mon[34872]: pgmap v533: 97 pgs: 97 active+clean; 90 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 614 op/s 2024-05-10T11:00:31.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:31 smithi184 ceph-mon[34585]: pgmap v533: 97 pgs: 97 active+clean; 90 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 614 op/s 2024-05-10T11:00:31.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:31 smithi107 ceph-mon[30373]: pgmap v533: 97 pgs: 97 active+clean; 90 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 614 op/s 2024-05-10T11:00:32.677 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-05-10T11:00:32.677 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-10T11:00:32.949 DEBUG:teuthology.parallel:result is None 2024-05-10T11:00:32.949 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-10T11:00:32.984 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-10T11:00:32.984 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-05-10T11:00:32.995 INFO:tasks.quiescer:joining Quiescers 2024-05-10T11:00:32.995 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-05-10T11:00:32.996 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T11:00:33.284 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T11:00:33.674 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:33 smithi107 ceph-mon[30373]: pgmap v534: 97 pgs: 97 active+clean; 79 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 574 op/s 2024-05-10T11:00:33.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:33 smithi196 ceph-mon[34872]: pgmap v534: 97 pgs: 97 active+clean; 79 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 574 op/s 2024-05-10T11:00:33.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:33 smithi184 ceph-mon[34585]: pgmap v534: 97 pgs: 97 active+clean; 79 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 574 op/s 2024-05-10T11:00:34.803 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:34 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T11:00:34.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:34 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T11:00:34.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:34 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T11:00:35.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.174+0000 7f87e677a700 1 -- 172.21.15.107:0/2421978863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e0102450 msgr2=0x7f87e0110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:35.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.174+0000 7f87e677a700 1 --2- 172.21.15.107:0/2421978863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e0102450 0x7f87e0110340 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f87d800b0a0 tx=0x7f87d800b3b0 comp rx=0 tx=0).stop 2024-05-10T11:00:35.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.175+0000 7f87e677a700 1 -- 172.21.15.107:0/2421978863 shutdown_connections 2024-05-10T11:00:35.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.175+0000 7f87e677a700 1 --2- 172.21.15.107:0/2421978863 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e0102450 0x7f87e0110340 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:35.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.175+0000 7f87e677a700 1 --2- 172.21.15.107:0/2421978863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e0109520 0x7f87e0109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:35.175 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.175+0000 7f87e677a700 1 --2- 172.21.15.107:0/2421978863 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87e0101a90 0x7f87e0101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:35.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.175+0000 7f87e677a700 1 -- 172.21.15.107:0/2421978863 >> 172.21.15.107:0/2421978863 conn(0x7f87e0078a10 msgr2=0x7f87e00ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:35.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.175+0000 7f87e677a700 1 -- 172.21.15.107:0/2421978863 shutdown_connections 2024-05-10T11:00:35.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.175+0000 7f87e677a700 1 -- 172.21.15.107:0/2421978863 wait complete. 2024-05-10T11:00:35.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.175+0000 7f87e677a700 1 Processor -- start 2024-05-10T11:00:35.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.175+0000 7f87e677a700 1 -- start start 2024-05-10T11:00:35.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.176+0000 7f87e677a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e0101a90 0x7f87e019f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:35.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.176+0000 7f87e677a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87e0102450 0x7f87e019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:35.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.176+0000 7f87e677a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e0109520 0x7f87e01999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:35.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.176+0000 7f87e677a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f87e01137d0 con 0x7f87e0101a90 2024-05-10T11:00:35.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.176+0000 7f87e677a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f87e0113650 con 0x7f87e0109520 2024-05-10T11:00:35.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.176+0000 7f87e677a700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f87e0113950 con 0x7f87e0102450 2024-05-10T11:00:35.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.176+0000 7f87dffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e0101a90 0x7f87e019f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:35.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.176+0000 7f87dffff700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e0101a90 0x7f87e019f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49048/0 (socket says 172.21.15.107:49048) 2024-05-10T11:00:35.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.176+0000 7f87dffff700 1 -- 172.21.15.107:0/3324735754 learned_addr learned my addr 172.21.15.107:0/3324735754 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:35.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.176+0000 7f87df7fe700 1 --2- 172.21.15.107:0/3324735754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87e0102450 0x7f87e019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:35.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.176+0000 7f87e4d17700 1 --2- 172.21.15.107:0/3324735754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e0109520 0x7f87e01999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:35.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.176+0000 7f87dffff700 1 -- 172.21.15.107:0/3324735754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87e0102450 msgr2=0x7f87e019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:35.178 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.176+0000 7f87dffff700 1 --2- 172.21.15.107:0/3324735754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87e0102450 0x7f87e019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:35.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.176+0000 7f87dffff700 1 -- 172.21.15.107:0/3324735754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e0109520 msgr2=0x7f87e01999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:35.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.176+0000 7f87dffff700 1 --2- 172.21.15.107:0/3324735754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e0109520 0x7f87e01999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:35.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.176+0000 7f87dffff700 1 -- 172.21.15.107:0/3324735754 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e019a110 con 0x7f87e0101a90 2024-05-10T11:00:35.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.176+0000 7f87dffff700 1 --2- 172.21.15.107:0/3324735754 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e0101a90 0x7f87e019f7a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f87d000d980 tx=0x7f87d000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:35.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.177+0000 7f87dd7fa700 1 -- 172.21.15.107:0/3324735754 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d0016070 con 0x7f87e0101a90 2024-05-10T11:00:35.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.177+0000 7f87e677a700 1 -- 172.21.15.107:0/3324735754 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e019a400 con 0x7f87e0101a90 2024-05-10T11:00:35.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.177+0000 7f87dd7fa700 1 -- 172.21.15.107:0/3324735754 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f87d0004d00 con 0x7f87e0101a90 2024-05-10T11:00:35.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.177+0000 7f87dd7fa700 1 -- 172.21.15.107:0/3324735754 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d0005690 con 0x7f87e0101a90 2024-05-10T11:00:35.179 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.177+0000 7f87e677a700 1 -- 172.21.15.107:0/3324735754 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e01a6670 con 0x7f87e0101a90 2024-05-10T11:00:35.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.178+0000 7f87e677a700 1 -- 172.21.15.107:0/3324735754 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87e006a190 con 0x7f87e0101a90 2024-05-10T11:00:35.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.179+0000 7f87dd7fa700 1 -- 172.21.15.107:0/3324735754 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f87d0004750 con 0x7f87e0101a90 2024-05-10T11:00:35.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.180+0000 7f87dd7fa700 1 --2- 172.21.15.107:0/3324735754 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87c80b2880 0x7f87c80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:35.180 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.180+0000 7f87df7fe700 1 --2- 172.21.15.107:0/3324735754 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87c80b2880 0x7f87c80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:35.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.180+0000 7f87dd7fa700 1 -- 172.21.15.107:0/3324735754 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f87d00e2330 con 0x7f87e0101a90 2024-05-10T11:00:35.181 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.180+0000 7f87df7fe700 1 --2- 172.21.15.107:0/3324735754 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87c80b2880 0x7f87c80b4d40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f87e0108b60 tx=0x7f87d400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:35.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.183+0000 7f87dd7fa700 1 -- 172.21.15.107:0/3324735754 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f87d001f020 con 0x7f87e0101a90 2024-05-10T11:00:35.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.434+0000 7f87e677a700 1 -- 172.21.15.107:0/3324735754 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87e002e510 con 0x7f87e0101a90 2024-05-10T11:00:35.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.434+0000 7f87dd7fa700 1 -- 172.21.15.107:0/3324735754 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11980 (secure 0 0 0) 0x7f87d00aa0f0 con 0x7f87e0101a90 2024-05-10T11:00:35.435 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T11:00:35.435 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T10:52:17.367732+0000","modified":"2024-05-10T11:00:24.832630+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24482,"mds_1":24449,"mds_2":24442,"mds_3":24431,"mds_4":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/2332963094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":2332963094},{"type":"v1","addr":"172.21.15.107:6841","nonce":2332963094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[0,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.184:6839/16501252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":16501252},{"type":"v1","addr":"172.21.15.184:6839","nonce":16501252}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24442,24449,24482,24430,24431]},"id":1}]} 2024-05-10T11:00:35.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.437+0000 7f87e677a700 1 -- 172.21.15.107:0/3324735754 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87c80b2880 msgr2=0x7f87c80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:35.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.437+0000 7f87e677a700 1 --2- 172.21.15.107:0/3324735754 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87c80b2880 0x7f87c80b4d40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f87e0108b60 tx=0x7f87d400a380 comp rx=0 tx=0).stop 2024-05-10T11:00:35.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.437+0000 7f87e677a700 1 -- 172.21.15.107:0/3324735754 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e0101a90 msgr2=0x7f87e019f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:35.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.437+0000 7f87e677a700 1 --2- 172.21.15.107:0/3324735754 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e0101a90 0x7f87e019f7a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f87d000d980 tx=0x7f87d000dc90 comp rx=0 tx=0).stop 2024-05-10T11:00:35.437 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.437+0000 7f87e677a700 1 -- 172.21.15.107:0/3324735754 shutdown_connections 2024-05-10T11:00:35.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.437+0000 7f87e677a700 1 --2- 172.21.15.107:0/3324735754 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f87c80b2880 0x7f87c80b4d40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:35.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.437+0000 7f87e677a700 1 --2- 172.21.15.107:0/3324735754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87e0109520 0x7f87e01999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:35.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.437+0000 7f87e677a700 1 --2- 172.21.15.107:0/3324735754 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f87e0101a90 0x7f87e019f7a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:35.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.437+0000 7f87e677a700 1 --2- 172.21.15.107:0/3324735754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87e0102450 0x7f87e019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:35.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.437+0000 7f87e677a700 1 -- 172.21.15.107:0/3324735754 >> 172.21.15.107:0/3324735754 conn(0x7f87e0078a10 msgr2=0x7f87e0100050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:35.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.437+0000 7f87e677a700 1 -- 172.21.15.107:0/3324735754 shutdown_connections 2024-05-10T11:00:35.438 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:35.437+0000 7f87e677a700 1 -- 172.21.15.107:0/3324735754 wait complete. 2024-05-10T11:00:35.438 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 36 2024-05-10T11:00:35.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:35 smithi196 ceph-mon[34872]: pgmap v535: 97 pgs: 97 active+clean; 80 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 525 op/s 2024-05-10T11:00:35.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:00:35.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:00:35.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:00:35.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:00:35.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T11:00:35.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T11:00:35.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T11:00:35.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:35 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3324735754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T11:00:35.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:35 smithi107 ceph-mon[30373]: pgmap v535: 97 pgs: 97 active+clean; 80 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 525 op/s 2024-05-10T11:00:35.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:00:35.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:00:35.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:00:35.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:00:35.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T11:00:35.831 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T11:00:35.832 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T11:00:35.832 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:35 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3324735754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T11:00:35.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:35 smithi184 ceph-mon[34585]: pgmap v535: 97 pgs: 97 active+clean; 80 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 525 op/s 2024-05-10T11:00:35.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:00:35.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:00:35.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:00:35.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:00:35.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T11:00:35.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T11:00:35.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T11:00:35.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:35 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3324735754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T11:00:36.098 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24482 quiesce db --cancel --all' 2024-05-10T11:00:36.098 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- timeout 75 ceph tell mds.24482 quiesce db --cancel --all 2024-05-10T11:00:36.346 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T11:00:36.795 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:36 smithi107 ceph-mon[30373]: Adjusting osd_memory_target on smithi107 to 176.1M 2024-05-10T11:00:36.795 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:36 smithi107 ceph-mon[30373]: Unable to set osd_memory_target on smithi107 to 184708608: error parsing value: Value '184708608' is below minimum 939524096 2024-05-10T11:00:36.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:36 smithi196 ceph-mon[34872]: Adjusting osd_memory_target on smithi107 to 176.1M 2024-05-10T11:00:36.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:36 smithi196 ceph-mon[34872]: Unable to set osd_memory_target on smithi107 to 184708608: error parsing value: Value '184708608' is below minimum 939524096 2024-05-10T11:00:36.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:36 smithi184 ceph-mon[34585]: Adjusting osd_memory_target on smithi107 to 176.1M 2024-05-10T11:00:36.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:36 smithi184 ceph-mon[34585]: Unable to set osd_memory_target on smithi107 to 184708608: error parsing value: Value '184708608' is below minimum 939524096 2024-05-10T11:00:37.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:37 smithi196 ceph-mon[34872]: pgmap v536: 97 pgs: 97 active+clean; 77 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 582 op/s 2024-05-10T11:00:37.859 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:37 smithi107 ceph-mon[30373]: pgmap v536: 97 pgs: 97 active+clean; 77 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 582 op/s 2024-05-10T11:00:37.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:37 smithi184 ceph-mon[34585]: pgmap v536: 97 pgs: 97 active+clean; 77 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 582 op/s 2024-05-10T11:00:38.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.149+0000 7f0cdd3c9700 1 -- 172.21.15.107:0/2882743547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd8103780 msgr2=0x7f0cd8103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:38.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.149+0000 7f0cdd3c9700 1 --2- 172.21.15.107:0/2882743547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd8103780 0x7f0cd8103b60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80099c0 tx=0x7f0cc8009cd0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.149+0000 7f0cdd3c9700 1 -- 172.21.15.107:0/2882743547 shutdown_connections 2024-05-10T11:00:38.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.149+0000 7f0cdd3c9700 1 --2- 172.21.15.107:0/2882743547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0cd8108870 0x7f0cd81103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.149+0000 7f0cdd3c9700 1 --2- 172.21.15.107:0/2882743547 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd8103780 0x7f0cd8103b60 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.149+0000 7f0cdd3c9700 1 --2- 172.21.15.107:0/2882743547 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cd8104130 0x7f0cd8108140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.149+0000 7f0cdd3c9700 1 -- 172.21.15.107:0/2882743547 >> 172.21.15.107:0/2882743547 conn(0x7f0cd807a610 msgr2=0x7f0cd807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:38.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.149+0000 7f0cdd3c9700 1 -- 172.21.15.107:0/2882743547 shutdown_connections 2024-05-10T11:00:38.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.149+0000 7f0cdd3c9700 1 -- 172.21.15.107:0/2882743547 wait complete. 2024-05-10T11:00:38.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.149+0000 7f0cdd3c9700 1 Processor -- start 2024-05-10T11:00:38.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.150+0000 7f0cdd3c9700 1 -- start start 2024-05-10T11:00:38.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.150+0000 7f0cdd3c9700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cd8103780 0x7f0cd80757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:38.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.150+0000 7f0cdd3c9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0cd8104130 0x7f0cd8075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:38.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.150+0000 7f0cdd3c9700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd8108870 0x7f0cd8076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:38.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.150+0000 7f0cdd3c9700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd8113770 con 0x7f0cd8108870 2024-05-10T11:00:38.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.150+0000 7f0cdd3c9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81135f0 con 0x7f0cd8104130 2024-05-10T11:00:38.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.150+0000 7f0cdd3c9700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81138f0 con 0x7f0cd8103780 2024-05-10T11:00:38.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.150+0000 7f0cd77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd8108870 0x7f0cd8076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:38.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.150+0000 7f0cd77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd8108870 0x7f0cd8076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54412/0 (socket says 172.21.15.107:54412) 2024-05-10T11:00:38.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.150+0000 7f0cd77fe700 1 -- 172.21.15.107:0/745929854 learned_addr learned my addr 172.21.15.107:0/745929854 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:38.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.150+0000 7f0cd67fc700 1 --2- 172.21.15.107:0/745929854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0cd8104130 0x7f0cd8075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:38.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.150+0000 7f0cd6ffd700 1 --2- 172.21.15.107:0/745929854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cd8103780 0x7f0cd80757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:38.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.150+0000 7f0cd77fe700 1 -- 172.21.15.107:0/745929854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cd8103780 msgr2=0x7f0cd80757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:38.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.150+0000 7f0cd77fe700 1 --2- 172.21.15.107:0/745929854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cd8103780 0x7f0cd80757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.150+0000 7f0cd77fe700 1 -- 172.21.15.107:0/745929854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0cd8104130 msgr2=0x7f0cd8075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:38.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.150+0000 7f0cd77fe700 1 --2- 172.21.15.107:0/745929854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0cd8104130 0x7f0cd8075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.150+0000 7f0cd77fe700 1 -- 172.21.15.107:0/745929854 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd81a7fe0 con 0x7f0cd8108870 2024-05-10T11:00:38.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.150+0000 7f0cd6ffd700 1 --2- 172.21.15.107:0/745929854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cd8103780 0x7f0cd80757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:00:38.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.150+0000 7f0cd77fe700 1 --2- 172.21.15.107:0/745929854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd8108870 0x7f0cd8076220 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0007d70 tx=0x7f0cd000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:38.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.151+0000 7f0cbffff700 1 -- 172.21.15.107:0/745929854 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0016020 con 0x7f0cd8108870 2024-05-10T11:00:38.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.151+0000 7f0cbffff700 1 -- 172.21.15.107:0/745929854 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0cd000ad40 con 0x7f0cd8108870 2024-05-10T11:00:38.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.151+0000 7f0cdd3c9700 1 -- 172.21.15.107:0/745929854 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd81a82d0 con 0x7f0cd8108870 2024-05-10T11:00:38.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.151+0000 7f0cbffff700 1 -- 172.21.15.107:0/745929854 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0011620 con 0x7f0cd8108870 2024-05-10T11:00:38.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.151+0000 7f0cdd3c9700 1 -- 172.21.15.107:0/745929854 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd81a87c0 con 0x7f0cd8108870 2024-05-10T11:00:38.153 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.153+0000 7f0cbffff700 1 -- 172.21.15.107:0/745929854 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f0cd0019020 con 0x7f0cd8108870 2024-05-10T11:00:38.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.154+0000 7f0cbffff700 1 --2- 172.21.15.107:0/745929854 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0cc00b2880 0x7f0cc00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:38.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.154+0000 7f0cd6ffd700 1 --2- 172.21.15.107:0/745929854 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0cc00b2880 0x7f0cc00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:38.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.154+0000 7f0cbffff700 1 -- 172.21.15.107:0/745929854 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f0cd00e2100 con 0x7f0cd8108870 2024-05-10T11:00:38.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.154+0000 7f0ce7c5cb80 1 Processor -- start 2024-05-10T11:00:38.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.154+0000 7f0cd6ffd700 1 --2- 172.21.15.107:0/745929854 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0cc00b2880 0x7f0cc00b4d40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8005b40 tx=0x7f0cc8005ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:38.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.154+0000 7f0ce7c5cb80 1 -- start start 2024-05-10T11:00:38.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.155+0000 7f0ce7c5cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 0x55e815728b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:38.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.155+0000 7f0ce7c5cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e8157229e0 0x55e815722e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:38.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.155+0000 7f0ce7c5cb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157233a0 0x55e81572f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:38.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.155+0000 7f0ce7c5cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e8156749b0 con 0x55e815728730 2024-05-10T11:00:38.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.155+0000 7f0ce7c5cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e8155d9e10 con 0x55e8157229e0 2024-05-10T11:00:38.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.155+0000 7f0ce7c5cb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55e815670970 con 0x55e8157233a0 2024-05-10T11:00:38.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.155+0000 7f0cd6ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 0x55e815728b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:38.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.155+0000 7f0cd6ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 0x55e815728b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54428/0 (socket says 172.21.15.107:54428) 2024-05-10T11:00:38.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.155+0000 7f0cd6ffd700 1 -- 172.21.15.107:0/3073598069 learned_addr learned my addr 172.21.15.107:0/3073598069 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:38.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.155+0000 7f0cd67fc700 1 --2- 172.21.15.107:0/3073598069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e8157229e0 0x55e815722e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:38.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.155+0000 7f0cd77fe700 1 --2- 172.21.15.107:0/3073598069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157233a0 0x55e81572f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:38.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.155+0000 7f0cd6ffd700 1 -- 172.21.15.107:0/3073598069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157233a0 msgr2=0x55e81572f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:38.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.155+0000 7f0cd6ffd700 1 --2- 172.21.15.107:0/3073598069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157233a0 0x55e81572f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.155+0000 7f0cd6ffd700 1 -- 172.21.15.107:0/3073598069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e8157229e0 msgr2=0x55e815722e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:38.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.155+0000 7f0cd6ffd700 1 --2- 172.21.15.107:0/3073598069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e8157229e0 0x55e815722e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.155+0000 7f0cd6ffd700 1 -- 172.21.15.107:0/3073598069 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8155c1940 con 0x55e815728730 2024-05-10T11:00:38.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.155+0000 7f0cd6ffd700 1 --2- 172.21.15.107:0/3073598069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 0x55e815728b10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80099c0 tx=0x7f0cc801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb202d196e8c571 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:38.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.155+0000 7f0cbd7fa700 1 -- 172.21.15.107:0/3073598069 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc800f460 con 0x55e815728730 2024-05-10T11:00:38.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.156+0000 7f0cbd7fa700 1 -- 172.21.15.107:0/3073598069 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0cc800fad0 con 0x55e815728730 2024-05-10T11:00:38.157 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.156+0000 7f0cbd7fa700 1 -- 172.21.15.107:0/3073598069 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8024ac0 con 0x55e815728730 2024-05-10T11:00:38.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.156+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/3073598069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 msgr2=0x55e815728b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:38.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.156+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/3073598069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 0x55e815728b10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80099c0 tx=0x7f0cc801f000 comp rx=0 tx=0).stop 2024-05-10T11:00:38.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.156+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/3073598069 shutdown_connections 2024-05-10T11:00:38.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.156+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/3073598069 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157233a0 0x55e81572f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.156+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/3073598069 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 0x55e815728b10 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.156+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/3073598069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e8157229e0 0x55e815722e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.156+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/3073598069 >> 172.21.15.107:0/3073598069 conn(0x55e81564ebe0 msgr2=0x55e81571d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:38.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.156+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/3073598069 shutdown_connections 2024-05-10T11:00:38.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.156+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/3073598069 wait complete. 2024-05-10T11:00:38.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.157+0000 7f0ce7c5cb80 1 -- start start 2024-05-10T11:00:38.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.157+0000 7f0ce7c5cb80 1 Processor -- start 2024-05-10T11:00:38.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.157+0000 7f0ce7c5cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e8157229e0 0x55e81572f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:38.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.157+0000 7f0ce7c5cb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157233a0 0x55e81572c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:38.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.157+0000 7f0ce7c5cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e815728730 0x55e81572c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:38.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.157+0000 7f0ce7c5cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55e81572fa30 con 0x55e8157229e0 2024-05-10T11:00:38.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.157+0000 7f0ce7c5cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e81562df40 con 0x55e815728730 2024-05-10T11:00:38.162 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.157+0000 7f0ce7c5cb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x55e81572fbb0 con 0x55e8157233a0 2024-05-10T11:00:38.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.157+0000 7f0ce7c5cb80 10 client.0 _ll_register_callbacks cb 0x55e815608620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:00:38.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.157+0000 7f0cd6ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e8157229e0 0x55e81572f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:38.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.157+0000 7f0cd6ffd700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e8157229e0 0x55e81572f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54430/0 (socket says 172.21.15.107:54430) 2024-05-10T11:00:38.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.157+0000 7f0cd6ffd700 1 -- 172.21.15.107:0/1484222670 learned_addr learned my addr 172.21.15.107:0/1484222670 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:38.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.157+0000 7f0cd77fe700 1 --2- 172.21.15.107:0/1484222670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e815728730 0x55e81572c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:38.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.157+0000 7f0cd67fc700 1 --2- 172.21.15.107:0/1484222670 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157233a0 0x55e81572c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:38.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.157+0000 7f0cd6ffd700 1 -- 172.21.15.107:0/1484222670 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157233a0 msgr2=0x55e81572c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:38.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.157+0000 7f0cd6ffd700 1 --2- 172.21.15.107:0/1484222670 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157233a0 0x55e81572c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.157+0000 7f0cd6ffd700 1 -- 172.21.15.107:0/1484222670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e815728730 msgr2=0x55e81572c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:38.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.157+0000 7f0cd6ffd700 1 --2- 172.21.15.107:0/1484222670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e815728730 0x55e81572c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.157+0000 7f0cd6ffd700 1 -- 172.21.15.107:0/1484222670 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e81562b7d0 con 0x55e8157229e0 2024-05-10T11:00:38.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.158+0000 7f0cd6ffd700 1 --2- 172.21.15.107:0/1484222670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e8157229e0 0x55e81572f0c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80098e0 tx=0x7f0cc800f760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62bd51586b5b38f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:38.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.158+0000 7f0cbaff5700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T11:00:38.163 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.158+0000 7f0cbaff5700 1 -- 172.21.15.107:0/1484222670 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc803c060 con 0x55e8157229e0 2024-05-10T11:00:38.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.158+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/1484222670 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cc800fad0 con 0x55e8157229e0 2024-05-10T11:00:38.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.158+0000 7f0cbaff5700 1 -- 172.21.15.107:0/1484222670 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f0cc8024620 con 0x55e8157229e0 2024-05-10T11:00:38.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.158+0000 7f0cbaff5700 1 -- 172.21.15.107:0/1484222670 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0cc800b940 con 0x55e8157229e0 2024-05-10T11:00:38.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.158+0000 7f0ce7c5cb80 10 client.15789 fetch_fsmap learned FSMap version 36 2024-05-10T11:00:38.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.158+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/1484222670 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55e81573a0a0 con 0x55e8157229e0 2024-05-10T11:00:38.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.158+0000 7f0cbaff5700 1 -- 172.21.15.107:0/1484222670 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0cc800fad0 con 0x55e8157229e0 2024-05-10T11:00:38.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.158+0000 7f0cbaff5700 1 -- 172.21.15.107:0/1484222670 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 36) ==== 8422+0+0 (secure 0 0 0) 0x7f0cc802f8f0 con 0x55e8157229e0 2024-05-10T11:00:38.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.158+0000 7f0ce7c5cb80 10 client.15789 fetch_fsmap finished waiting for FSMap version 36 2024-05-10T11:00:38.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.158+0000 7f0ce7c5cb80 10 client.15789 resolve_mds: validated gid 24482 aka daemon mds.b 2024-05-10T11:00:38.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.158+0000 7f0ce7c5cb80 20 client.15789 populate_metadata read hostname 'smithi107' 2024-05-10T11:00:38.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.158+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/1484222670 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55e81573c570 0x55e81573e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:38.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.158+0000 7f0ce7c5cb80 4 client.15789 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T11:00:38.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.158+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/1484222670 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e815682390 con 0x55e81573c570 2024-05-10T11:00:38.164 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.159+0000 7f0cd67fc700 1 --2- 172.21.15.107:0/1484222670 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55e81573c570 0x55e81573e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:38.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.159+0000 7f0cbaff5700 10 client.15789 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T11:00:38.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.159+0000 7f0cd67fc700 1 --2- 172.21.15.107:0/1484222670 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55e81573c570 0x55e81573e960 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6e5f6bcebbfc89d server_cookie=7ca5828339a2cc9d in_seq=0 out_seq=0 2024-05-10T11:00:38.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.160+0000 7f0cbaff5700 1 -- 172.21.15.107:0/1484222670 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e815682390 con 0x55e81573c570 2024-05-10T11:00:38.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.160+0000 7f0cbaff5700 10 client.15789 handle_command_reply: tid=0 2024-05-10T11:00:38.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.160+0000 7f0ce7c5cb80 1 client.15789 shutdown 2024-05-10T11:00:38.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.160+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/1484222670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e8157229e0 msgr2=0x55e81572f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:38.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.160+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/1484222670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e8157229e0 0x55e81572f0c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80098e0 tx=0x7f0cc800f760 comp rx=0 tx=0).stop 2024-05-10T11:00:38.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.160+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/1484222670 shutdown_connections 2024-05-10T11:00:38.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.160+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/1484222670 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55e81573c570 0x55e81573e960 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.160+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/1484222670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e815728730 0x55e81572c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.160+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/1484222670 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e8157229e0 0x55e81572f0c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.160+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/1484222670 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157233a0 0x55e81572c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.160+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/1484222670 >> 172.21.15.107:0/1484222670 conn(0x55e81564ebe0 msgr2=0x55e815727ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:38.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.160+0000 7f0cbaff5700 0 client.15789 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T11:00:38.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.160+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/1484222670 shutdown_connections 2024-05-10T11:00:38.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.160+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/1484222670 wait complete. 2024-05-10T11:00:38.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.160+0000 7f0ce7c5cb80 20 client.15789 trim_cache size 0 max 16384 2024-05-10T11:00:38.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0ce7c5cb80 1 Processor -- start 2024-05-10T11:00:38.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0ce7c5cb80 1 -- start start 2024-05-10T11:00:38.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0ce7c5cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e8157229e0 0x55e81572e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:38.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0ce7c5cb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157233a0 0x55e81572e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:38.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0ce7c5cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 0x55e8157415a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:38.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0ce7c5cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81afc60 con 0x55e815728730 2024-05-10T11:00:38.185 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0ce7c5cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81b1a40 con 0x55e8157229e0 2024-05-10T11:00:38.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0ce7c5cb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81b0390 con 0x55e8157233a0 2024-05-10T11:00:38.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0cd77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 0x55e8157415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:38.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0cd77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 0x55e8157415a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54442/0 (socket says 172.21.15.107:54442) 2024-05-10T11:00:38.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0cd77fe700 1 -- 172.21.15.107:0/2091809240 learned_addr learned my addr 172.21.15.107:0/2091809240 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:38.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0cd6ffd700 1 --2- 172.21.15.107:0/2091809240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e8157229e0 0x55e81572e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:38.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0cd67fc700 1 --2- 172.21.15.107:0/2091809240 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157233a0 0x55e81572e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:38.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0cd77fe700 1 -- 172.21.15.107:0/2091809240 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157233a0 msgr2=0x55e81572e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:38.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0cd77fe700 1 --2- 172.21.15.107:0/2091809240 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157233a0 0x55e81572e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0cd77fe700 1 -- 172.21.15.107:0/2091809240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e8157229e0 msgr2=0x55e81572e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:38.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0cd77fe700 1 --2- 172.21.15.107:0/2091809240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e8157229e0 0x55e81572e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0cd77fe700 1 -- 172.21.15.107:0/2091809240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e81572ed00 con 0x55e815728730 2024-05-10T11:00:38.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0cd6ffd700 1 --2- 172.21.15.107:0/2091809240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e8157229e0 0x55e81572e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:00:38.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0cd67fc700 1 --2- 172.21.15.107:0/2091809240 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157233a0 0x55e81572e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T11:00:38.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0cd77fe700 1 --2- 172.21.15.107:0/2091809240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 0x55e8157415a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00dfca0 tx=0x7f0cd00b2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda95a0cbc0c229e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:38.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.180+0000 7f0cbcff9700 1 -- 172.21.15.107:0/2091809240 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00adb70 con 0x55e815728730 2024-05-10T11:00:38.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.181+0000 7f0cbcff9700 1 -- 172.21.15.107:0/2091809240 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0cd00b2620 con 0x55e815728730 2024-05-10T11:00:38.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.181+0000 7f0cbcff9700 1 -- 172.21.15.107:0/2091809240 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00a8c80 con 0x55e815728730 2024-05-10T11:00:38.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.181+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/2091809240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 msgr2=0x55e8157415a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:38.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.181+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/2091809240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 0x55e8157415a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00dfca0 tx=0x7f0cd00b2040 comp rx=0 tx=0).stop 2024-05-10T11:00:38.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.181+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/2091809240 shutdown_connections 2024-05-10T11:00:38.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.181+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/2091809240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 0x55e8157415a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.181+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/2091809240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e8157229e0 0x55e81572e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.181+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/2091809240 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157233a0 0x55e81572e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.181+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/2091809240 >> 172.21.15.107:0/2091809240 conn(0x55e81564ebe0 msgr2=0x55e81572da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:38.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.181+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/2091809240 shutdown_connections 2024-05-10T11:00:38.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.181+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/2091809240 wait complete. 2024-05-10T11:00:38.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.181+0000 7f0ce7c5cb80 1 -- start start 2024-05-10T11:00:38.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0ce7c5cb80 1 Processor -- start 2024-05-10T11:00:38.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0ce7c5cb80 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157229e0 0x55e815741a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:38.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0ce7c5cb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e8157233a0 0x55e81573fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:38.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0ce7c5cb80 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 0x55e815740330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:38.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0ce7c5cb80 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81b12b0 con 0x55e815728730 2024-05-10T11:00:38.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0ce7c5cb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81b0b20 con 0x55e8157233a0 2024-05-10T11:00:38.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0ce7c5cb80 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd81adc20 con 0x55e8157229e0 2024-05-10T11:00:38.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0cd77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 0x55e815740330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:38.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0ce7c5cb80 10 client.0 _ll_register_callbacks cb 0x55e815608620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T11:00:38.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0cd77fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 0x55e815740330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54456/0 (socket says 172.21.15.107:54456) 2024-05-10T11:00:38.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0cd77fe700 1 -- 172.21.15.107:0/3284163799 learned_addr learned my addr 172.21.15.107:0/3284163799 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:38.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0cd67fc700 1 --2- 172.21.15.107:0/3284163799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e8157233a0 0x55e81573fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:38.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0cd6ffd700 1 --2- 172.21.15.107:0/3284163799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157229e0 0x55e815741a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:38.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0cd77fe700 1 -- 172.21.15.107:0/3284163799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157229e0 msgr2=0x55e815741a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:38.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0cd77fe700 1 --2- 172.21.15.107:0/3284163799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157229e0 0x55e815741a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0cd77fe700 1 -- 172.21.15.107:0/3284163799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e8157233a0 msgr2=0x55e81573fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T11:00:38.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0cd77fe700 1 --2- 172.21.15.107:0/3284163799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e8157233a0 0x55e81573fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0cd77fe700 1 -- 172.21.15.107:0/3284163799 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e815740b70 con 0x55e815728730 2024-05-10T11:00:38.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0cd77fe700 1 --2- 172.21.15.107:0/3284163799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 0x55e815740330 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00a94c0 tx=0x7f0cd0007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f69c8e3f68a486 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:38.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0cbaff5700 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-10T11:00:38.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.182+0000 7f0cbaff5700 1 -- 172.21.15.107:0/3284163799 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00b2190 con 0x55e815728730 2024-05-10T11:00:38.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.183+0000 7f0cbaff5700 1 -- 172.21.15.107:0/3284163799 <== mon.0 v2:172.21.15.107:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f0cd00b2330 con 0x55e815728730 2024-05-10T11:00:38.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.183+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/3284163799 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cd00b2620 con 0x55e815728730 2024-05-10T11:00:38.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.183+0000 7f0cbaff5700 1 -- 172.21.15.107:0/3284163799 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0cd00a8a20 con 0x55e815728730 2024-05-10T11:00:38.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.183+0000 7f0ce7c5cb80 10 client.15795 fetch_fsmap learned FSMap version 36 2024-05-10T11:00:38.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.183+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/3284163799 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55e8157a7950 con 0x55e815728730 2024-05-10T11:00:38.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.183+0000 7f0cbaff5700 1 -- 172.21.15.107:0/3284163799 <== mon.0 v2:172.21.15.107:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0cd00b2620 con 0x55e815728730 2024-05-10T11:00:38.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.183+0000 7f0cbaff5700 1 -- 172.21.15.107:0/3284163799 <== mon.0 v2:172.21.15.107:3300/0 5 ==== fsmap(e 36) ==== 8422+0+0 (secure 0 0 0) 0x7f0cd00a5130 con 0x55e815728730 2024-05-10T11:00:38.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.183+0000 7f0ce7c5cb80 10 client.15795 fetch_fsmap finished waiting for FSMap version 36 2024-05-10T11:00:38.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.183+0000 7f0ce7c5cb80 10 client.15795 resolve_mds: validated gid 24482 aka daemon mds.b 2024-05-10T11:00:38.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.183+0000 7f0ce7c5cb80 20 client.15795 populate_metadata read hostname 'smithi107' 2024-05-10T11:00:38.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.183+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/3284163799 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55e8157a80a0 0x55e8157aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:38.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.183+0000 7f0ce7c5cb80 4 client.15795 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-05-10T11:00:38.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.183+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/3284163799 --> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55e81567c430 con 0x55e8157a80a0 2024-05-10T11:00:38.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.183+0000 7f0cd6ffd700 1 --2- 172.21.15.107:0/3284163799 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55e8157a80a0 0x55e8157aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:38.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.184+0000 7f0cbaff5700 10 client.15795 ms_handle_connect on v2:172.21.15.184:6838/16501252 2024-05-10T11:00:38.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.184+0000 7f0cd6ffd700 1 --2- 172.21.15.107:0/3284163799 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55e8157a80a0 0x55e8157aa4c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=476ff0b86e8b4eb5 server_cookie=87f6aa690683545c in_seq=0 out_seq=0 2024-05-10T11:00:38.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.184+0000 7f0cbaff5700 1 -- 172.21.15.107:0/3284163799 <== mds.0 v2:172.21.15.184:6838/16501252 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55e81567c430 con 0x55e8157a80a0 2024-05-10T11:00:38.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.184+0000 7f0cbaff5700 10 client.15795 handle_command_reply: tid=0 2024-05-10T11:00:38.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.184+0000 7f0ce7c5cb80 1 client.15795 shutdown 2024-05-10T11:00:38.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.184+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/3284163799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 msgr2=0x55e815740330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:38.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.184+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/3284163799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 0x55e815740330 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00a94c0 tx=0x7f0cd0007ec0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.184+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/3284163799 shutdown_connections 2024-05-10T11:00:38.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.184+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/3284163799 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55e8157229e0 0x55e815741a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.184+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/3284163799 >> [v2:172.21.15.184:6838/16501252,v1:172.21.15.184:6839/16501252] conn(0x55e8157a80a0 0x55e8157aa4c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.184+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/3284163799 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55e815728730 0x55e815740330 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.184+0000 7f0cbaff5700 0 client.15795 ms_handle_reset on v2:172.21.15.184:6838/16501252 2024-05-10T11:00:38.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.184+0000 7f0ce7c5cb80 1 --2- 172.21.15.107:0/3284163799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e8157233a0 0x55e81573fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.184+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/3284163799 >> 172.21.15.107:0/3284163799 conn(0x55e81564ebe0 msgr2=0x55e81572e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:38.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.184+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/3284163799 shutdown_connections 2024-05-10T11:00:38.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.184+0000 7f0ce7c5cb80 1 -- 172.21.15.107:0/3284163799 wait complete. 2024-05-10T11:00:38.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.184+0000 7f0ce7c5cb80 20 client.15795 trim_cache size 0 max 16384 2024-05-10T11:00:38.191 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T11:00:38.191 INFO:teuthology.orchestra.run.smithi107.stdout: "epoch": 36, 2024-05-10T11:00:38.192 INFO:teuthology.orchestra.run.smithi107.stdout: "leader": 24482, 2024-05-10T11:00:38.192 INFO:teuthology.orchestra.run.smithi107.stdout: "set_version": 11, 2024-05-10T11:00:38.192 INFO:teuthology.orchestra.run.smithi107.stdout: "sets": {} 2024-05-10T11:00:38.192 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T11:00:38.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.185+0000 7f0cdd3c9700 1 -- 172.21.15.107:0/745929854 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0cc00b2880 msgr2=0x7f0cc00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:38.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.185+0000 7f0cdd3c9700 1 --2- 172.21.15.107:0/745929854 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0cc00b2880 0x7f0cc00b4d40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8005b40 tx=0x7f0cc8005ab0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.185+0000 7f0cdd3c9700 1 -- 172.21.15.107:0/745929854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd8108870 msgr2=0x7f0cd8076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:38.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.185+0000 7f0cdd3c9700 1 --2- 172.21.15.107:0/745929854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd8108870 0x7f0cd8076220 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0007d70 tx=0x7f0cd000a340 comp rx=0 tx=0).stop 2024-05-10T11:00:38.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.185+0000 7f0cdd3c9700 1 -- 172.21.15.107:0/745929854 shutdown_connections 2024-05-10T11:00:38.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.185+0000 7f0cdd3c9700 1 --2- 172.21.15.107:0/745929854 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f0cc00b2880 0x7f0cc00b4d40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.185+0000 7f0cdd3c9700 1 --2- 172.21.15.107:0/745929854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0cd8103780 0x7f0cd80757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.185+0000 7f0cdd3c9700 1 --2- 172.21.15.107:0/745929854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0cd8108870 0x7f0cd8076220 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.185+0000 7f0cdd3c9700 1 --2- 172.21.15.107:0/745929854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0cd8104130 0x7f0cd8075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:38.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.185+0000 7f0cdd3c9700 1 -- 172.21.15.107:0/745929854 >> 172.21.15.107:0/745929854 conn(0x7f0cd807a610 msgr2=0x7f0cd81014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:38.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.185+0000 7f0cdd3c9700 1 -- 172.21.15.107:0/745929854 shutdown_connections 2024-05-10T11:00:38.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:38.185+0000 7f0cdd3c9700 1 -- 172.21.15.107:0/745929854 wait complete. 2024-05-10T11:00:38.871 ERROR:teuthology.run_tasks:Manager failed: quiescer Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_d39fa08867836ac070c47cb66c782fa559fd480b/qa/tasks/quiescer.py", line 419, in task stop_all_quiescers(ctx.ceph[cluster_name].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_d39fa08867836ac070c47cb66c782fa559fd480b/qa/tasks/quiescer.py", line 378, in stop_all_quiescers raise RuntimeError(f"error during quiesce thrashing: {thrasher.exception}") RuntimeError: error during quiesce thrashing: Error releasing set '25edc73': 1 (EPERM) 2024-05-10T11:00:38.872 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-05-10T11:00:38.912 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi107.front.sepia.ceph.com 2024-05-10T11:00:38.921 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-05-10T11:00:38.970 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T11:00:39.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.077+0000 7fceb6791640 1 -- 172.21.15.107:0/1960093090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fceb0103560 msgr2=0x7fceb0109df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:39.081 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.077+0000 7fceb6791640 1 --2- 172.21.15.107:0/1960093090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fceb0103560 0x7fceb0109df0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fcea8009ca0 tx=0x7fcea802a8c0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.077+0000 7fceb6791640 1 -- 172.21.15.107:0/1960093090 shutdown_connections 2024-05-10T11:00:39.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.077+0000 7fceb6791640 1 --2- 172.21.15.107:0/1960093090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fceb0103560 0x7fceb0109df0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.077+0000 7fceb6791640 1 --2- 172.21.15.107:0/1960093090 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceb0102ba0 0x7fceb0103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.077+0000 7fceb6791640 1 --2- 172.21.15.107:0/1960093090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fceb0101e90 0x7fceb01022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.077+0000 7fceb6791640 1 -- 172.21.15.107:0/1960093090 >> 172.21.15.107:0/1960093090 conn(0x7fceb00fc660 msgr2=0x7fceb00feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:39.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.077+0000 7fceb6791640 1 -- 172.21.15.107:0/1960093090 shutdown_connections 2024-05-10T11:00:39.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.077+0000 7fceb6791640 1 -- 172.21.15.107:0/1960093090 wait complete. 2024-05-10T11:00:39.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.077+0000 7fceb6791640 1 Processor -- start 2024-05-10T11:00:39.082 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.078+0000 7fceb6791640 1 -- start start 2024-05-10T11:00:39.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.078+0000 7fceb6791640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fceb0101e90 0x7fceb0101550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:39.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.078+0000 7fceb6791640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fceb0102ba0 0x7fceb019d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:39.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.078+0000 7fceb6791640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceb0103560 0x7fceb019ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:39.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.078+0000 7fceb6791640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fceb010d590 con 0x7fceb0102ba0 2024-05-10T11:00:39.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.078+0000 7fceb6791640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fceb010d410 con 0x7fceb0101e90 2024-05-10T11:00:39.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.078+0000 7fceb6791640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fceb010d710 con 0x7fceb0103560 2024-05-10T11:00:39.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.078+0000 7fceaf7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fceb0102ba0 0x7fceb019d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:39.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.078+0000 7fceaf7fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fceb0102ba0 0x7fceb019d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54478/0 (socket says 172.21.15.107:54478) 2024-05-10T11:00:39.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.078+0000 7fceaf7fe640 1 -- 172.21.15.107:0/4040379924 learned_addr learned my addr 172.21.15.107:0/4040379924 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:39.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.078+0000 7fceb4d2e640 1 --2- 172.21.15.107:0/4040379924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceb0103560 0x7fceb019ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:39.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.078+0000 7fceaffff640 1 --2- 172.21.15.107:0/4040379924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fceb0101e90 0x7fceb0101550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:39.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.078+0000 7fceaf7fe640 1 -- 172.21.15.107:0/4040379924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceb0103560 msgr2=0x7fceb019ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:39.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.078+0000 7fceaf7fe640 1 --2- 172.21.15.107:0/4040379924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceb0103560 0x7fceb019ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.078+0000 7fceaf7fe640 1 -- 172.21.15.107:0/4040379924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fceb0101e90 msgr2=0x7fceb0101550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:39.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.078+0000 7fceaf7fe640 1 --2- 172.21.15.107:0/4040379924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fceb0101e90 0x7fceb0101550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.078+0000 7fceaf7fe640 1 -- 172.21.15.107:0/4040379924 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceb01a08e0 con 0x7fceb0102ba0 2024-05-10T11:00:39.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.078+0000 7fceb4d2e640 1 --2- 172.21.15.107:0/4040379924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceb0103560 0x7fceb019ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:00:39.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.078+0000 7fceaf7fe640 1 --2- 172.21.15.107:0/4040379924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fceb0102ba0 0x7fceb019d9b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fcea400d770 tx=0x7fcea400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:39.084 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.079+0000 7fcead7fa640 1 -- 172.21.15.107:0/4040379924 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea4017070 con 0x7fceb0102ba0 2024-05-10T11:00:39.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.079+0000 7fceb6791640 1 -- 172.21.15.107:0/4040379924 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceb01a0b70 con 0x7fceb0102ba0 2024-05-10T11:00:39.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.079+0000 7fcead7fa640 1 -- 172.21.15.107:0/4040379924 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcea40054f0 con 0x7fceb0102ba0 2024-05-10T11:00:39.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.079+0000 7fcead7fa640 1 -- 172.21.15.107:0/4040379924 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea4004de0 con 0x7fceb0102ba0 2024-05-10T11:00:39.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.079+0000 7fceb6791640 1 -- 172.21.15.107:0/4040379924 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceb01a1070 con 0x7fceb0102ba0 2024-05-10T11:00:39.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.080+0000 7fceb6791640 1 -- 172.21.15.107:0/4040379924 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceb0108c70 con 0x7fceb0102ba0 2024-05-10T11:00:39.085 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.081+0000 7fcead7fa640 1 -- 172.21.15.107:0/4040379924 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7fcea4004f80 con 0x7fceb0102ba0 2024-05-10T11:00:39.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.082+0000 7fcead7fa640 1 --2- 172.21.15.107:0/4040379924 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fce980b27f0 0x7fce980b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:39.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.082+0000 7fceaffff640 1 --2- 172.21.15.107:0/4040379924 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fce980b27f0 0x7fce980b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:39.086 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.082+0000 7fcead7fa640 1 -- 172.21.15.107:0/4040379924 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fcea40e20a0 con 0x7fceb0102ba0 2024-05-10T11:00:39.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.082+0000 7fceaffff640 1 --2- 172.21.15.107:0/4040379924 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fce980b27f0 0x7fce980b4cb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcea0005d00 tx=0x7fcea0005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:39.087 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.085+0000 7fcead7fa640 1 -- 172.21.15.107:0/4040379924 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fcea40a9e60 con 0x7fceb0102ba0 2024-05-10T11:00:39.270 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.269+0000 7fceb6791640 1 -- 172.21.15.107:0/4040379924 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fceb002dd50 con 0x7fceb0102ba0 2024-05-10T11:00:39.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.271+0000 7fcead7fa640 1 -- 172.21.15.107:0/4040379924 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22560 (secure 0 0 0) 0x7fcea40a9760 con 0x7fceb0102ba0 2024-05-10T11:00:39.272 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T11:00:39.273 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":82,"fsid":"0ba8a8e4-0eba-11ef-bc98-c7b262605968","created":"2024-05-10T10:44:13.064379+0000","modified":"2024-05-10T10:53:08.899432+0000","last_up_change":"2024-05-10T10:51:12.979718+0000","last_in_change":"2024-05-10T10:50:53.297651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T10:47:31.600062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T10:52:10.705022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T10:52:14.377732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"503f960c-a74b-4979-9bf9-42c90a2885a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6803","nonce":4213004004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6805","nonce":4213004004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6809","nonce":4213004004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6807","nonce":4213004004}]},"public_addr":"172.21.15.107:6803/4213004004","cluster_addr":"172.21.15.107:6805/4213004004","heartbeat_back_addr":"172.21.15.107:6809/4213004004","heartbeat_front_addr":"172.21.15.107:6807/4213004004","state":["exists","up"]},{"osd":1,"uuid":"f0f89167-1aa1-40a1-b122-c7f203c587d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6801","nonce":3242825160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6803","nonce":3242825160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6807","nonce":3242825160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6805","nonce":3242825160}]},"public_addr":"172.21.15.184:6801/3242825160","cluster_addr":"172.21.15.184:6803/3242825160","heartbeat_back_addr":"172.21.15.184:6807/3242825160","heartbeat_front_addr":"172.21.15.184:6805/3242825160","state":["exists","up"]},{"osd":2,"uuid":"7588b9be-b935-450a-944f-3feca69c029c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6801","nonce":137473043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6803","nonce":137473043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6807","nonce":137473043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6805","nonce":137473043}]},"public_addr":"172.21.15.196:6801/137473043","cluster_addr":"172.21.15.196:6803/137473043","heartbeat_back_addr":"172.21.15.196:6807/137473043","heartbeat_front_addr":"172.21.15.196:6805/137473043","state":["exists","up"]},{"osd":3,"uuid":"589ec3bb-884a-4441-a9d2-1f34ab372cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6811","nonce":1995642021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6813","nonce":1995642021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6817","nonce":1995642021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6815","nonce":1995642021}]},"public_addr":"172.21.15.107:6811/1995642021","cluster_addr":"172.21.15.107:6813/1995642021","heartbeat_back_addr":"172.21.15.107:6817/1995642021","heartbeat_front_addr":"172.21.15.107:6815/1995642021","state":["exists","up"]},{"osd":4,"uuid":"b72cdb50-492b-4406-8f21-37e4b2cf5a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6809","nonce":271550329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6811","nonce":271550329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6815","nonce":271550329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6813","nonce":271550329}]},"public_addr":"172.21.15.184:6809/271550329","cluster_addr":"172.21.15.184:6811/271550329","heartbeat_back_addr":"172.21.15.184:6815/271550329","heartbeat_front_addr":"172.21.15.184:6813/271550329","state":["exists","up"]},{"osd":5,"uuid":"05b6ad82-9153-44df-ae64-50c82d304429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6809","nonce":3681130435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6811","nonce":3681130435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6815","nonce":3681130435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6813","nonce":3681130435}]},"public_addr":"172.21.15.196:6809/3681130435","cluster_addr":"172.21.15.196:6811/3681130435","heartbeat_back_addr":"172.21.15.196:6815/3681130435","heartbeat_front_addr":"172.21.15.196:6813/3681130435","state":["exists","up"]},{"osd":6,"uuid":"bceadd7a-20bf-4482-aaab-46a2539cf37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6819","nonce":4223253757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6821","nonce":4223253757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6825","nonce":4223253757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6823","nonce":4223253757}]},"public_addr":"172.21.15.107:6819/4223253757","cluster_addr":"172.21.15.107:6821/4223253757","heartbeat_back_addr":"172.21.15.107:6825/4223253757","heartbeat_front_addr":"172.21.15.107:6823/4223253757","state":["exists","up"]},{"osd":7,"uuid":"0d9243a6-0e16-4677-a0b0-010be4162148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6817","nonce":2850715284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6819","nonce":2850715284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6823","nonce":2850715284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6821","nonce":2850715284}]},"public_addr":"172.21.15.184:6817/2850715284","cluster_addr":"172.21.15.184:6819/2850715284","heartbeat_back_addr":"172.21.15.184:6823/2850715284","heartbeat_front_addr":"172.21.15.184:6821/2850715284","state":["exists","up"]},{"osd":8,"uuid":"24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6817","nonce":504426486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6819","nonce":504426486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6823","nonce":504426486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6821","nonce":504426486}]},"public_addr":"172.21.15.196:6817/504426486","cluster_addr":"172.21.15.196:6819/504426486","heartbeat_back_addr":"172.21.15.196:6823/504426486","heartbeat_front_addr":"172.21.15.196:6821/504426486","state":["exists","up"]},{"osd":9,"uuid":"8bcb03ec-1342-4679-9343-fcefd28dd69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6827","nonce":1533051760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6829","nonce":1533051760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6833","nonce":1533051760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6831","nonce":1533051760}]},"public_addr":"172.21.15.107:6827/1533051760","cluster_addr":"172.21.15.107:6829/1533051760","heartbeat_back_addr":"172.21.15.107:6833/1533051760","heartbeat_front_addr":"172.21.15.107:6831/1533051760","state":["exists","up"]},{"osd":10,"uuid":"78374015-aa7f-4288-b5ae-be64a5182bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6825","nonce":1387541139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6827","nonce":1387541139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6831","nonce":1387541139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6829","nonce":1387541139}]},"public_addr":"172.21.15.184:6825/1387541139","cluster_addr":"172.21.15.184:6827/1387541139","heartbeat_back_addr":"172.21.15.184:6831/1387541139","heartbeat_front_addr":"172.21.15.184:6829/1387541139","state":["exists","up"]},{"osd":11,"uuid":"4aeb2b1a-f35e-44ea-be64-f60c31a096e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6825","nonce":3861964533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6827","nonce":3861964533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6831","nonce":3861964533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6829","nonce":3861964533}]},"public_addr":"172.21.15.196:6825/3861964533","cluster_addr":"172.21.15.196:6827/3861964533","heartbeat_back_addr":"172.21.15.196:6831/3861964533","heartbeat_front_addr":"172.21.15.196:6829/3861964533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:46:42.110232+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:06.232727+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:29.623425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:53.466546+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:17.927564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:41.913454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:06.610629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:31.048807+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:54.922097+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:20.727547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:46.072303+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:51:11.022775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:0/3518338734":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/4092342993":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6800/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:6800/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3761740075":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/2215024983":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/2124974715":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3361930986":"2024-05-11T10:44:40.339608+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:00:39.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.273+0000 7fceb6791640 1 -- 172.21.15.107:0/4040379924 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fce980b27f0 msgr2=0x7fce980b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:39.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.273+0000 7fceb6791640 1 --2- 172.21.15.107:0/4040379924 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fce980b27f0 0x7fce980b4cb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcea0005d00 tx=0x7fcea0005c50 comp rx=0 tx=0).stop 2024-05-10T11:00:39.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.273+0000 7fceb6791640 1 -- 172.21.15.107:0/4040379924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fceb0102ba0 msgr2=0x7fceb019d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:39.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.273+0000 7fceb6791640 1 --2- 172.21.15.107:0/4040379924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fceb0102ba0 0x7fceb019d9b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fcea400d770 tx=0x7fcea400dc30 comp rx=0 tx=0).stop 2024-05-10T11:00:39.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.273+0000 7fceb6791640 1 -- 172.21.15.107:0/4040379924 shutdown_connections 2024-05-10T11:00:39.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.273+0000 7fceb6791640 1 --2- 172.21.15.107:0/4040379924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceb0103560 0x7fceb019ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.273+0000 7fceb6791640 1 --2- 172.21.15.107:0/4040379924 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fce980b27f0 0x7fce980b4cb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.273+0000 7fceb6791640 1 --2- 172.21.15.107:0/4040379924 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fceb0102ba0 0x7fceb019d9b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.273+0000 7fceb6791640 1 --2- 172.21.15.107:0/4040379924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fceb0101e90 0x7fceb0101550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.273+0000 7fceb6791640 1 -- 172.21.15.107:0/4040379924 >> 172.21.15.107:0/4040379924 conn(0x7fceb00fc660 msgr2=0x7fceb0105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:39.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.273+0000 7fceb6791640 1 -- 172.21.15.107:0/4040379924 shutdown_connections 2024-05-10T11:00:39.276 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.273+0000 7fceb6791640 1 -- 172.21.15.107:0/4040379924 wait complete. 2024-05-10T11:00:39.286 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T10:47:31.600062+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T10:52:10.705022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T10:52:14.377732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T11:00:39.287 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T11:00:39.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.394+0000 7f14d85a4640 1 -- 172.21.15.107:0/4277053231 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14d0102520 msgr2=0x7f14d0109dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:39.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.394+0000 7f14d85a4640 1 --2- 172.21.15.107:0/4277053231 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14d0102520 0x7f14d0109dc0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009ca0 tx=0x7f14c802a8c0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.394+0000 7f14d85a4640 1 -- 172.21.15.107:0/4277053231 shutdown_connections 2024-05-10T11:00:39.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.394+0000 7f14d85a4640 1 --2- 172.21.15.107:0/4277053231 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14d0102520 0x7f14d0109dc0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.394+0000 7f14d85a4640 1 --2- 172.21.15.107:0/4277053231 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14d0101b60 0x7f14d0101fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.394+0000 7f14d85a4640 1 --2- 172.21.15.107:0/4277053231 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14d0102f10 0x7f14d0103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.394+0000 7f14d85a4640 1 -- 172.21.15.107:0/4277053231 >> 172.21.15.107:0/4277053231 conn(0x7f14d00fc5f0 msgr2=0x7f14d00fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:39.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.394+0000 7f14d85a4640 1 -- 172.21.15.107:0/4277053231 shutdown_connections 2024-05-10T11:00:39.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.394+0000 7f14d85a4640 1 -- 172.21.15.107:0/4277053231 wait complete. 2024-05-10T11:00:39.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.395+0000 7f14d85a4640 1 Processor -- start 2024-05-10T11:00:39.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.395+0000 7f14d85a4640 1 -- start start 2024-05-10T11:00:39.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.395+0000 7f14d85a4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14d0101b60 0x7f14d01015c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:39.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.395+0000 7f14d85a4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14d0102520 0x7f14d019d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:39.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.395+0000 7f14d85a4640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14d0102f10 0x7f14d019fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:39.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.395+0000 7f14d85a4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f14d010d580 con 0x7f14d0102520 2024-05-10T11:00:39.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.395+0000 7f14d85a4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f14d010d400 con 0x7f14d0101b60 2024-05-10T11:00:39.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.395+0000 7f14d85a4640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f14d010d700 con 0x7f14d0102f10 2024-05-10T11:00:39.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.395+0000 7f14d5b3f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14d0102520 0x7f14d019d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:39.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.395+0000 7f14d5b3f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14d0102520 0x7f14d019d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54494/0 (socket says 172.21.15.107:54494) 2024-05-10T11:00:39.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.395+0000 7f14d6b41640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14d0102f10 0x7f14d019fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:39.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.395+0000 7f14d5b3f640 1 -- 172.21.15.107:0/737455197 learned_addr learned my addr 172.21.15.107:0/737455197 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:39.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.395+0000 7f14d6340640 1 --2- 172.21.15.107:0/737455197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14d0101b60 0x7f14d01015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:39.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.395+0000 7f14d5b3f640 1 -- 172.21.15.107:0/737455197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14d0102f10 msgr2=0x7f14d019fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:39.398 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.395+0000 7f14d5b3f640 1 --2- 172.21.15.107:0/737455197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14d0102f10 0x7f14d019fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.395+0000 7f14d5b3f640 1 -- 172.21.15.107:0/737455197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14d0101b60 msgr2=0x7f14d01015c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:39.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.395+0000 7f14d5b3f640 1 --2- 172.21.15.107:0/737455197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14d0101b60 0x7f14d01015c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.396+0000 7f14d5b3f640 1 -- 172.21.15.107:0/737455197 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d01a0900 con 0x7f14d0102520 2024-05-10T11:00:39.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.396+0000 7f14d5b3f640 1 --2- 172.21.15.107:0/737455197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14d0102520 0x7f14d019d9d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f14c000d950 tx=0x7f14c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:39.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.396+0000 7f14c77fe640 1 -- 172.21.15.107:0/737455197 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c0017020 con 0x7f14d0102520 2024-05-10T11:00:39.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.396+0000 7f14c77fe640 1 -- 172.21.15.107:0/737455197 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f14c0009c30 con 0x7f14d0102520 2024-05-10T11:00:39.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.396+0000 7f14d85a4640 1 -- 172.21.15.107:0/737455197 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14d01a0b90 con 0x7f14d0102520 2024-05-10T11:00:39.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.396+0000 7f14c77fe640 1 -- 172.21.15.107:0/737455197 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c000f740 con 0x7f14d0102520 2024-05-10T11:00:39.399 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.396+0000 7f14d85a4640 1 -- 172.21.15.107:0/737455197 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14d01a10e0 con 0x7f14d0102520 2024-05-10T11:00:39.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.397+0000 7f14d85a4640 1 -- 172.21.15.107:0/737455197 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14d0108c40 con 0x7f14d0102520 2024-05-10T11:00:39.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.398+0000 7f14c77fe640 1 -- 172.21.15.107:0/737455197 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f14c001a020 con 0x7f14d0102520 2024-05-10T11:00:39.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.399+0000 7f14c77fe640 1 --2- 172.21.15.107:0/737455197 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f14bc0b27f0 0x7f14bc0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:39.400 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.399+0000 7f14c77fe640 1 -- 172.21.15.107:0/737455197 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f14c00e20c0 con 0x7f14d0102520 2024-05-10T11:00:39.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.399+0000 7f14d6340640 1 --2- 172.21.15.107:0/737455197 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f14bc0b27f0 0x7f14bc0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:39.401 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.399+0000 7f14d6340640 1 --2- 172.21.15.107:0/737455197 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f14bc0b27f0 0x7f14bc0b4cb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f14d006add0 tx=0x7f14cc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:39.403 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.402+0000 7f14c77fe640 1 -- 172.21.15.107:0/737455197 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f14c0009de0 con 0x7f14d0102520 2024-05-10T11:00:39.589 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.589+0000 7f14d85a4640 1 -- 172.21.15.107:0/737455197 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f14d002db50 con 0x7f14d0102520 2024-05-10T11:00:39.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.589+0000 7f14c77fe640 1 -- 172.21.15.107:0/737455197 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f14c00a9e80 con 0x7f14d0102520 2024-05-10T11:00:39.590 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-05-10T11:00:39.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.591+0000 7f14d85a4640 1 -- 172.21.15.107:0/737455197 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f14bc0b27f0 msgr2=0x7f14bc0b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:39.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.591+0000 7f14d85a4640 1 --2- 172.21.15.107:0/737455197 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f14bc0b27f0 0x7f14bc0b4cb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f14d006add0 tx=0x7f14cc005f90 comp rx=0 tx=0).stop 2024-05-10T11:00:39.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.591+0000 7f14d85a4640 1 -- 172.21.15.107:0/737455197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14d0102520 msgr2=0x7f14d019d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:39.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.591+0000 7f14d85a4640 1 --2- 172.21.15.107:0/737455197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14d0102520 0x7f14d019d9d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f14c000d950 tx=0x7f14c000de10 comp rx=0 tx=0).stop 2024-05-10T11:00:39.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.591+0000 7f14d85a4640 1 -- 172.21.15.107:0/737455197 shutdown_connections 2024-05-10T11:00:39.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.591+0000 7f14d85a4640 1 --2- 172.21.15.107:0/737455197 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14d0102f10 0x7f14d019fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.591+0000 7f14d85a4640 1 --2- 172.21.15.107:0/737455197 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f14bc0b27f0 0x7f14bc0b4cb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.591+0000 7f14d85a4640 1 --2- 172.21.15.107:0/737455197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14d0102520 0x7f14d019d9d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.591+0000 7f14d85a4640 1 --2- 172.21.15.107:0/737455197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14d0101b60 0x7f14d01015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.591+0000 7f14d85a4640 1 -- 172.21.15.107:0/737455197 >> 172.21.15.107:0/737455197 conn(0x7f14d00fc5f0 msgr2=0x7f14d0105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:39.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.591+0000 7f14d85a4640 1 -- 172.21.15.107:0/737455197 shutdown_connections 2024-05-10T11:00:39.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.591+0000 7f14d85a4640 1 -- 172.21.15.107:0/737455197 wait complete. 2024-05-10T11:00:39.604 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:39 smithi107 ceph-mon[30373]: pgmap v537: 97 pgs: 97 active+clean; 76 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 525 op/s 2024-05-10T11:00:39.604 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:39 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/4040379924' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T11:00:39.606 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T11:00:39.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.711+0000 7fe69730a640 1 -- 172.21.15.107:0/3211939246 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe690102ae0 msgr2=0x7fe690102f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:39.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.711+0000 7fe69730a640 1 --2- 172.21.15.107:0/3211939246 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe690102ae0 0x7fe690102f60 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe680009900 tx=0x7fe68002a410 comp rx=0 tx=0).stop 2024-05-10T11:00:39.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.711+0000 7fe69730a640 1 -- 172.21.15.107:0/3211939246 shutdown_connections 2024-05-10T11:00:39.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.711+0000 7fe69730a640 1 --2- 172.21.15.107:0/3211939246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6901034a0 0x7fe690109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.711+0000 7fe69730a640 1 --2- 172.21.15.107:0/3211939246 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe690102ae0 0x7fe690102f60 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.712+0000 7fe69730a640 1 --2- 172.21.15.107:0/3211939246 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6901018f0 0x7fe690101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.712+0000 7fe69730a640 1 -- 172.21.15.107:0/3211939246 >> 172.21.15.107:0/3211939246 conn(0x7fe6900fce60 msgr2=0x7fe6900ff2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:39.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.712+0000 7fe69730a640 1 -- 172.21.15.107:0/3211939246 shutdown_connections 2024-05-10T11:00:39.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.712+0000 7fe69730a640 1 -- 172.21.15.107:0/3211939246 wait complete. 2024-05-10T11:00:39.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.712+0000 7fe69730a640 1 Processor -- start 2024-05-10T11:00:39.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.712+0000 7fe69730a640 1 -- start start 2024-05-10T11:00:39.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.712+0000 7fe69730a640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6901018f0 0x7fe69006a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:39.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.712+0000 7fe69730a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe690102ae0 0x7fe69019db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:39.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.712+0000 7fe69730a640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6901034a0 0x7fe6901a0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:39.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.712+0000 7fe69730a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe69010d5d0 con 0x7fe690102ae0 2024-05-10T11:00:39.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.712+0000 7fe69730a640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe69010d450 con 0x7fe6901034a0 2024-05-10T11:00:39.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.712+0000 7fe69730a640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fe69010d750 con 0x7fe6901018f0 2024-05-10T11:00:39.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.712+0000 7fe6948a5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe690102ae0 0x7fe69019db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:39.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.712+0000 7fe6948a5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe690102ae0 0x7fe69019db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54512/0 (socket says 172.21.15.107:54512) 2024-05-10T11:00:39.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.713+0000 7fe6948a5640 1 -- 172.21.15.107:0/1241001008 learned_addr learned my addr 172.21.15.107:0/1241001008 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:39.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.713+0000 7fe6950a6640 1 --2- 172.21.15.107:0/1241001008 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6901018f0 0x7fe69006a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:39.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.713+0000 7fe6958a7640 1 --2- 172.21.15.107:0/1241001008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6901034a0 0x7fe6901a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:39.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.713+0000 7fe6948a5640 1 -- 172.21.15.107:0/1241001008 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6901018f0 msgr2=0x7fe69006a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:39.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.713+0000 7fe6948a5640 1 --2- 172.21.15.107:0/1241001008 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6901018f0 0x7fe69006a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.713+0000 7fe6948a5640 1 -- 172.21.15.107:0/1241001008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6901034a0 msgr2=0x7fe6901a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:39.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.713+0000 7fe6948a5640 1 --2- 172.21.15.107:0/1241001008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6901034a0 0x7fe6901a0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.713+0000 7fe6948a5640 1 -- 172.21.15.107:0/1241001008 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6901a0a50 con 0x7fe690102ae0 2024-05-10T11:00:39.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.713+0000 7fe6948a5640 1 --2- 172.21.15.107:0/1241001008 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe690102ae0 0x7fe69019db20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe680005940 tx=0x7fe6800043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:39.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.713+0000 7fe6867fc640 1 -- 172.21.15.107:0/1241001008 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68003f030 con 0x7fe690102ae0 2024-05-10T11:00:39.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.713+0000 7fe6867fc640 1 -- 172.21.15.107:0/1241001008 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe680003cd0 con 0x7fe690102ae0 2024-05-10T11:00:39.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.713+0000 7fe69730a640 1 -- 172.21.15.107:0/1241001008 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6901a0c80 con 0x7fe690102ae0 2024-05-10T11:00:39.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.713+0000 7fe6867fc640 1 -- 172.21.15.107:0/1241001008 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680035070 con 0x7fe690102ae0 2024-05-10T11:00:39.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.713+0000 7fe69730a640 1 -- 172.21.15.107:0/1241001008 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6901a1170 con 0x7fe690102ae0 2024-05-10T11:00:39.717 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.714+0000 7fe69730a640 1 -- 172.21.15.107:0/1241001008 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe690108d50 con 0x7fe690102ae0 2024-05-10T11:00:39.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.715+0000 7fe6867fc640 1 -- 172.21.15.107:0/1241001008 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7fe680042030 con 0x7fe690102ae0 2024-05-10T11:00:39.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.716+0000 7fe6867fc640 1 --2- 172.21.15.107:0/1241001008 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe67c0b27f0 0x7fe67c0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:39.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.716+0000 7fe6950a6640 1 --2- 172.21.15.107:0/1241001008 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe67c0b27f0 0x7fe67c0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:39.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.716+0000 7fe6867fc640 1 -- 172.21.15.107:0/1241001008 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fe680102950 con 0x7fe690102ae0 2024-05-10T11:00:39.719 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.717+0000 7fe6950a6640 1 --2- 172.21.15.107:0/1241001008 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe67c0b27f0 0x7fe67c0b4cb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe690102940 tx=0x7fe68c009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:39.720 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.720+0000 7fe6867fc640 1 -- 172.21.15.107:0/1241001008 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe6800ca710 con 0x7fe690102ae0 2024-05-10T11:00:39.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:39 smithi196 ceph-mon[34872]: pgmap v537: 97 pgs: 97 active+clean; 76 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 525 op/s 2024-05-10T11:00:39.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:39 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/4040379924' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T11:00:39.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:39 smithi184 ceph-mon[34585]: pgmap v537: 97 pgs: 97 active+clean; 76 MiB data, 655 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 525 op/s 2024-05-10T11:00:39.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:39 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/4040379924' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T11:00:39.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.903+0000 7fe69730a640 1 -- 172.21.15.107:0/1241001008 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe69002dd50 con 0x7fe690102ae0 2024-05-10T11:00:39.904 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.904+0000 7fe6867fc640 1 -- 172.21.15.107:0/1241001008 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7fe6800ca010 con 0x7fe690102ae0 2024-05-10T11:00:39.904 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 32 2024-05-10T11:00:39.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.906+0000 7fe69730a640 1 -- 172.21.15.107:0/1241001008 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe67c0b27f0 msgr2=0x7fe67c0b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:39.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.906+0000 7fe69730a640 1 --2- 172.21.15.107:0/1241001008 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe67c0b27f0 0x7fe67c0b4cb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe690102940 tx=0x7fe68c009110 comp rx=0 tx=0).stop 2024-05-10T11:00:39.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.906+0000 7fe69730a640 1 -- 172.21.15.107:0/1241001008 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe690102ae0 msgr2=0x7fe69019db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:39.906 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.906+0000 7fe69730a640 1 --2- 172.21.15.107:0/1241001008 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe690102ae0 0x7fe69019db20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe680005940 tx=0x7fe6800043b0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.906+0000 7fe69730a640 1 -- 172.21.15.107:0/1241001008 shutdown_connections 2024-05-10T11:00:39.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.906+0000 7fe69730a640 1 --2- 172.21.15.107:0/1241001008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6901034a0 0x7fe6901a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.906+0000 7fe69730a640 1 --2- 172.21.15.107:0/1241001008 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fe67c0b27f0 0x7fe67c0b4cb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.906+0000 7fe69730a640 1 --2- 172.21.15.107:0/1241001008 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe690102ae0 0x7fe69019db20 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.906+0000 7fe69730a640 1 --2- 172.21.15.107:0/1241001008 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe6901018f0 0x7fe69006a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:39.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.906+0000 7fe69730a640 1 -- 172.21.15.107:0/1241001008 >> 172.21.15.107:0/1241001008 conn(0x7fe6900fce60 msgr2=0x7fe690105f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:39.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.906+0000 7fe69730a640 1 -- 172.21.15.107:0/1241001008 shutdown_connections 2024-05-10T11:00:39.907 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:39.906+0000 7fe69730a640 1 -- 172.21.15.107:0/1241001008 wait complete. 2024-05-10T11:00:39.917 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T11:00:40.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.021+0000 7f4fa2808640 1 -- 172.21.15.107:0/3978418944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9c103c90 msgr2=0x7f4f9c104110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:40.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.021+0000 7f4fa2808640 1 --2- 172.21.15.107:0/3978418944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9c103c90 0x7f4f9c104110 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009930 tx=0x7f4f9002a420 comp rx=0 tx=0).stop 2024-05-10T11:00:40.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.021+0000 7f4fa2808640 1 -- 172.21.15.107:0/3978418944 shutdown_connections 2024-05-10T11:00:40.024 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.021+0000 7f4fa2808640 1 --2- 172.21.15.107:0/3978418944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f9c104650 0x7f4f9c10aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:40.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.021+0000 7f4fa2808640 1 --2- 172.21.15.107:0/3978418944 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9c103c90 0x7f4f9c104110 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:40.025 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.021+0000 7f4fa2808640 1 --2- 172.21.15.107:0/3978418944 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f9c100cc0 0x7f4f9c1010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:40.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.021+0000 7f4fa2808640 1 -- 172.21.15.107:0/3978418944 >> 172.21.15.107:0/3978418944 conn(0x7f4f9c0fc5f0 msgr2=0x7f4f9c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:40.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.021+0000 7f4fa2808640 1 -- 172.21.15.107:0/3978418944 shutdown_connections 2024-05-10T11:00:40.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.021+0000 7f4fa2808640 1 -- 172.21.15.107:0/3978418944 wait complete. 2024-05-10T11:00:40.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.022+0000 7f4fa2808640 1 Processor -- start 2024-05-10T11:00:40.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.022+0000 7f4fa2808640 1 -- start start 2024-05-10T11:00:40.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.022+0000 7f4fa2808640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f9c100cc0 0x7f4f9c198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:40.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.022+0000 7f4fa2808640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f9c103c90 0x7f4f9c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:40.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.022+0000 7f4fa2808640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9c104650 0x7f4f9c1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:40.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.022+0000 7f4fa2808640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c10e680 con 0x7f4f9c104650 2024-05-10T11:00:40.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.022+0000 7f4fa2808640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c10e500 con 0x7f4f9c103c90 2024-05-10T11:00:40.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.022+0000 7f4fa2808640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c10e800 con 0x7f4f9c100cc0 2024-05-10T11:00:40.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.022+0000 7f4fa0da5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9c104650 0x7f4f9c1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:40.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.022+0000 7f4fa0da5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9c104650 0x7f4f9c1a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54532/0 (socket says 172.21.15.107:54532) 2024-05-10T11:00:40.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.022+0000 7f4fa0da5640 1 -- 172.21.15.107:0/4119429198 learned_addr learned my addr 172.21.15.107:0/4119429198 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:40.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.022+0000 7f4f9bfff640 1 --2- 172.21.15.107:0/4119429198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f9c100cc0 0x7f4f9c198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:40.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.022+0000 7f4f9b7fe640 1 --2- 172.21.15.107:0/4119429198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f9c103c90 0x7f4f9c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:40.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.022+0000 7f4fa0da5640 1 -- 172.21.15.107:0/4119429198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f9c100cc0 msgr2=0x7f4f9c198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:40.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.022+0000 7f4fa0da5640 1 --2- 172.21.15.107:0/4119429198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f9c100cc0 0x7f4f9c198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:40.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.022+0000 7f4fa0da5640 1 -- 172.21.15.107:0/4119429198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f9c103c90 msgr2=0x7f4f9c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:40.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.022+0000 7f4fa0da5640 1 --2- 172.21.15.107:0/4119429198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f9c103c90 0x7f4f9c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:40.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.022+0000 7f4fa0da5640 1 -- 172.21.15.107:0/4119429198 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9c1a09b0 con 0x7f4f9c104650 2024-05-10T11:00:40.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.022+0000 7f4f9b7fe640 1 --2- 172.21.15.107:0/4119429198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f9c103c90 0x7f4f9c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:00:40.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.023+0000 7f4fa0da5640 1 --2- 172.21.15.107:0/4119429198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9c104650 0x7f4f9c1a0310 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009fd0 tx=0x7f4f9400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:40.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.023+0000 7f4f997fa640 1 -- 172.21.15.107:0/4119429198 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f94017070 con 0x7f4f9c104650 2024-05-10T11:00:40.027 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.023+0000 7f4fa2808640 1 -- 172.21.15.107:0/4119429198 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9c1a0ca0 con 0x7f4f9c104650 2024-05-10T11:00:40.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.023+0000 7f4f997fa640 1 -- 172.21.15.107:0/4119429198 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4f94003e40 con 0x7f4f9c104650 2024-05-10T11:00:40.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.023+0000 7f4f997fa640 1 -- 172.21.15.107:0/4119429198 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f94004820 con 0x7f4f9c104650 2024-05-10T11:00:40.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.023+0000 7f4fa2808640 1 -- 172.21.15.107:0/4119429198 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f9c1a11a0 con 0x7f4f9c104650 2024-05-10T11:00:40.028 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.024+0000 7f4fa2808640 1 -- 172.21.15.107:0/4119429198 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f9c109e90 con 0x7f4f9c104650 2024-05-10T11:00:40.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.026+0000 7f4f997fa640 1 -- 172.21.15.107:0/4119429198 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f4f94003970 con 0x7f4f9c104650 2024-05-10T11:00:40.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.027+0000 7f4f997fa640 1 --2- 172.21.15.107:0/4119429198 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4f840b27f0 0x7f4f840b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:40.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.027+0000 7f4f9bfff640 1 --2- 172.21.15.107:0/4119429198 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4f840b27f0 0x7f4f840b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:40.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.027+0000 7f4f997fa640 1 -- 172.21.15.107:0/4119429198 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f4f940e20d0 con 0x7f4f9c104650 2024-05-10T11:00:40.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.027+0000 7f4f9bfff640 1 --2- 172.21.15.107:0/4119429198 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4f840b27f0 0x7f4f840b4cb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c005fd0 tx=0x7f4f8c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:40.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.030+0000 7f4f997fa640 1 -- 172.21.15.107:0/4119429198 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4f94003c60 con 0x7f4f9c104650 2024-05-10T11:00:40.212 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.212+0000 7f4fa2808640 1 -- 172.21.15.107:0/4119429198 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4f9c02dd20 con 0x7f4f9c104650 2024-05-10T11:00:40.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.212+0000 7f4f997fa640 1 -- 172.21.15.107:0/4119429198 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7f4f940a3e20 con 0x7f4f9c104650 2024-05-10T11:00:40.213 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 64 2024-05-10T11:00:40.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.214+0000 7f4fa2808640 1 -- 172.21.15.107:0/4119429198 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4f840b27f0 msgr2=0x7f4f840b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:40.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.214+0000 7f4fa2808640 1 --2- 172.21.15.107:0/4119429198 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4f840b27f0 0x7f4f840b4cb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c005fd0 tx=0x7f4f8c005850 comp rx=0 tx=0).stop 2024-05-10T11:00:40.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.214+0000 7f4fa2808640 1 -- 172.21.15.107:0/4119429198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9c104650 msgr2=0x7f4f9c1a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:40.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.214+0000 7f4fa2808640 1 --2- 172.21.15.107:0/4119429198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9c104650 0x7f4f9c1a0310 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009fd0 tx=0x7f4f9400b260 comp rx=0 tx=0).stop 2024-05-10T11:00:40.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.214+0000 7f4fa2808640 1 -- 172.21.15.107:0/4119429198 shutdown_connections 2024-05-10T11:00:40.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.214+0000 7f4fa2808640 1 --2- 172.21.15.107:0/4119429198 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f4f840b27f0 0x7f4f840b4cb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:40.215 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.214+0000 7f4fa2808640 1 --2- 172.21.15.107:0/4119429198 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f9c104650 0x7f4f9c1a0310 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:40.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.214+0000 7f4fa2808640 1 --2- 172.21.15.107:0/4119429198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f9c103c90 0x7f4f9c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:40.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.214+0000 7f4fa2808640 1 --2- 172.21.15.107:0/4119429198 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4f9c100cc0 0x7f4f9c198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:40.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.215+0000 7f4fa2808640 1 -- 172.21.15.107:0/4119429198 >> 172.21.15.107:0/4119429198 conn(0x7f4f9c0fc5f0 msgr2=0x7f4f9c107060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:40.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.215+0000 7f4fa2808640 1 -- 172.21.15.107:0/4119429198 shutdown_connections 2024-05-10T11:00:40.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.215+0000 7f4fa2808640 1 -- 172.21.15.107:0/4119429198 wait complete. 2024-05-10T11:00:40.226 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-05-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.327+0000 7f8d39625640 1 -- 172.21.15.107:0/495021183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d34102b20 msgr2=0x7f8d34102fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.327+0000 7f8d39625640 1 --2- 172.21.15.107:0/495021183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d34102b20 0x7f8d34102fa0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8d24009900 tx=0x7f8d2402a410 comp rx=0 tx=0).stop 2024-05-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.327+0000 7f8d39625640 1 -- 172.21.15.107:0/495021183 shutdown_connections 2024-05-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.327+0000 7f8d39625640 1 --2- 172.21.15.107:0/495021183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d341034e0 0x7f8d34109d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.327+0000 7f8d39625640 1 --2- 172.21.15.107:0/495021183 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d34102b20 0x7f8d34102fa0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.327+0000 7f8d39625640 1 --2- 172.21.15.107:0/495021183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d34101930 0x7f8d34101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:40.330 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.327+0000 7f8d39625640 1 -- 172.21.15.107:0/495021183 >> 172.21.15.107:0/495021183 conn(0x7f8d340fcea0 msgr2=0x7f8d340ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.327+0000 7f8d39625640 1 -- 172.21.15.107:0/495021183 shutdown_connections 2024-05-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.327+0000 7f8d39625640 1 -- 172.21.15.107:0/495021183 wait complete. 2024-05-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.327+0000 7f8d39625640 1 Processor -- start 2024-05-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.328+0000 7f8d39625640 1 -- start start 2024-05-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.328+0000 7f8d39625640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d34101930 0x7f8d341058c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.328+0000 7f8d39625640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d34102b20 0x7f8d34103f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.328+0000 7f8d39625640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d341034e0 0x7f8d34104440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.328+0000 7f8d39625640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3410d590 con 0x7f8d34101930 2024-05-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.328+0000 7f8d39625640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3410d410 con 0x7f8d34102b20 2024-05-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.328+0000 7f8d39625640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3410d710 con 0x7f8d341034e0 2024-05-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.328+0000 7f8d32ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d34101930 0x7f8d341058c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.328+0000 7f8d32ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d34101930 0x7f8d341058c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:54556/0 (socket says 172.21.15.107:54556) 2024-05-10T11:00:40.331 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.328+0000 7f8d32ffd640 1 -- 172.21.15.107:0/2448134954 learned_addr learned my addr 172.21.15.107:0/2448134954 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:00:40.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.328+0000 7f8d327fc640 1 --2- 172.21.15.107:0/2448134954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d34102b20 0x7f8d34103f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:40.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.328+0000 7f8d32ffd640 1 -- 172.21.15.107:0/2448134954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d341034e0 msgr2=0x7f8d34104440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:40.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.328+0000 7f8d32ffd640 1 --2- 172.21.15.107:0/2448134954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d341034e0 0x7f8d34104440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:40.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.328+0000 7f8d32ffd640 1 -- 172.21.15.107:0/2448134954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d34102b20 msgr2=0x7f8d34103f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:40.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.328+0000 7f8d32ffd640 1 --2- 172.21.15.107:0/2448134954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d34102b20 0x7f8d34103f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:40.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.328+0000 7f8d32ffd640 1 -- 172.21.15.107:0/2448134954 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d34104cd0 con 0x7f8d34101930 2024-05-10T11:00:40.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.328+0000 7f8d327fc640 1 --2- 172.21.15.107:0/2448134954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d34102b20 0x7f8d34103f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:00:40.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.328+0000 7f8d32ffd640 1 --2- 172.21.15.107:0/2448134954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d34101930 0x7f8d341058c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00d950 tx=0x7f8d1c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:40.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.329+0000 7f8d2bfff640 1 -- 172.21.15.107:0/2448134954 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c017070 con 0x7f8d34101930 2024-05-10T11:00:40.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.329+0000 7f8d2bfff640 1 -- 172.21.15.107:0/2448134954 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8d1c009c30 con 0x7f8d34101930 2024-05-10T11:00:40.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.329+0000 7f8d39625640 1 -- 172.21.15.107:0/2448134954 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d341a2e90 con 0x7f8d34101930 2024-05-10T11:00:40.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.329+0000 7f8d2bfff640 1 -- 172.21.15.107:0/2448134954 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c00f620 con 0x7f8d34101930 2024-05-10T11:00:40.332 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.329+0000 7f8d39625640 1 -- 172.21.15.107:0/2448134954 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d341a3240 con 0x7f8d34101930 2024-05-10T11:00:40.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.330+0000 7f8d39625640 1 -- 172.21.15.107:0/2448134954 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d341a34d0 con 0x7f8d34101930 2024-05-10T11:00:40.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.331+0000 7f8d2bfff640 1 -- 172.21.15.107:0/2448134954 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f8d1c01a070 con 0x7f8d34101930 2024-05-10T11:00:40.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.331+0000 7f8d2bfff640 1 --2- 172.21.15.107:0/2448134954 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8d200b27f0 0x7f8d200b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:00:40.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.332+0000 7f8d327fc640 1 --2- 172.21.15.107:0/2448134954 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8d200b27f0 0x7f8d200b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:00:40.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.332+0000 7f8d2bfff640 1 -- 172.21.15.107:0/2448134954 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f8d1c0e1c70 con 0x7f8d34101930 2024-05-10T11:00:40.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.332+0000 7f8d327fc640 1 --2- 172.21.15.107:0/2448134954 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8d200b27f0 0x7f8d200b4cb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8d24031440 tx=0x7f8d24031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:00:40.336 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.336+0000 7f8d2bfff640 1 -- 172.21.15.107:0/2448134954 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8d1c009de0 con 0x7f8d34101930 2024-05-10T11:00:40.572 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.572+0000 7f8d39625640 1 -- 172.21.15.107:0/2448134954 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f8d341a3860 con 0x7f8d34101930 2024-05-10T11:00:40.581 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.581+0000 7f8d2bfff640 1 -- 172.21.15.107:0/2448134954 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+815649 (secure 0 0 0) 0x7f8d1c0a9a30 con 0x7f8d34101930 2024-05-10T11:00:40.593 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T11:00:40.593 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T11:00:40.593 INFO:teuthology.orchestra.run.smithi107.stdout: "epoch": 20, 2024-05-10T11:00:40.593 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.593 INFO:teuthology.orchestra.run.smithi107.stdout: "active_gid": 14152, 2024-05-10T11:00:40.593 INFO:teuthology.orchestra.run.smithi107.stdout: "active_name": "x", 2024-05-10T11:00:40.593 INFO:teuthology.orchestra.run.smithi107.stdout: "active_addrs": { 2024-05-10T11:00:40.593 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ 2024-05-10T11:00:40.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.593 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v2", 2024-05-10T11:00:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:6800", 2024-05-10T11:00:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 2062256859 2024-05-10T11:00:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v1", 2024-05-10T11:00:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:6801", 2024-05-10T11:00:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 2062256859 2024-05-10T11:00:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-10T11:00:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: "active_addr": "172.21.15.107:6801/2062256859", 2024-05-10T11:00:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: "active_change": "2024-05-10T10:45:07.518869+0000", 2024-05-10T11:00:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: "active_mgr_features": 4540701547738038271, 2024-05-10T11:00:40.594 INFO:teuthology.orchestra.run.smithi107.stdout: "available": true, 2024-05-10T11:00:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: "standbys": [ 2024-05-10T11:00:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: "gid": 24109, 2024-05-10T11:00:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "z", 2024-05-10T11:00:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr_features": 4540701547738038271, 2024-05-10T11:00:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: "available_modules": [ 2024-05-10T11:00:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "alerts", 2024-05-10T11:00:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2024-05-10T11:00:40.595 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2024-05-10T11:00:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2024-05-10T11:00:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How frequently to reexamine health status", 2024-05-10T11:00:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.597 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.598 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.599 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.600 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_destination": { 2024-05-10T11:00:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_destination", 2024-05-10T11:00:40.601 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Email address to send alerts to", 2024-05-10T11:00:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_from_name": { 2024-05-10T11:00:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_from_name", 2024-05-10T11:00:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.602 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "Ceph", 2024-05-10T11:00:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Email From: name", 2024-05-10T11:00:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_host": { 2024-05-10T11:00:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_host", 2024-05-10T11:00:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.603 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SMTP server", 2024-05-10T11:00:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_password": { 2024-05-10T11:00:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_password", 2024-05-10T11:00:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.604 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Password to authenticate with", 2024-05-10T11:00:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_port": { 2024-05-10T11:00:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_port", 2024-05-10T11:00:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.605 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "465", 2024-05-10T11:00:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SMTP port", 2024-05-10T11:00:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_sender": { 2024-05-10T11:00:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_sender", 2024-05-10T11:00:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.606 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SMTP envelope sender", 2024-05-10T11:00:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_ssl": { 2024-05-10T11:00:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_ssl", 2024-05-10T11:00:40.607 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-10T11:00:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_user": { 2024-05-10T11:00:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_user", 2024-05-10T11:00:40.608 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "User to authenticate as", 2024-05-10T11:00:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.609 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "balancer", 2024-05-10T11:00:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "active": { 2024-05-10T11:00:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "active", 2024-05-10T11:00:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "automatically balance PGs across cluster", 2024-05-10T11:00:40.611 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "begin_time": { 2024-05-10T11:00:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "begin_time", 2024-05-10T11:00:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0000", 2024-05-10T11:00:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "beginning time of day to automatically balance", 2024-05-10T11:00:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-10T11:00:40.612 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "begin_weekday": { 2024-05-10T11:00:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "begin_weekday", 2024-05-10T11:00:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2024-05-10T11:00:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "0", 2024-05-10T11:00:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "6", 2024-05-10T11:00:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-10T11:00:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-10T11:00:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "crush_compat_max_iterations": { 2024-05-10T11:00:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crush_compat_max_iterations", 2024-05-10T11:00:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2024-05-10T11:00:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "25", 2024-05-10T11:00:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2024-05-10T11:00:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "250", 2024-05-10T11:00:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-10T11:00:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "crush_compat_metrics": { 2024-05-10T11:00:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crush_compat_metrics", 2024-05-10T11:00:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "pgs,objects,bytes", 2024-05-10T11:00:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-10T11:00:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-10T11:00:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "crush_compat_step": { 2024-05-10T11:00:40.615 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crush_compat_step", 2024-05-10T11:00:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0.5", 2024-05-10T11:00:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "0.001", 2024-05-10T11:00:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "0.999", 2024-05-10T11:00:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "aggressiveness of optimization", 2024-05-10T11:00:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-10T11:00:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "end_time": { 2024-05-10T11:00:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_time", 2024-05-10T11:00:40.616 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "2359", 2024-05-10T11:00:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "ending time of day to automatically balance", 2024-05-10T11:00:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-10T11:00:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "end_weekday": { 2024-05-10T11:00:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_weekday", 2024-05-10T11:00:40.617 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2024-05-10T11:00:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "0", 2024-05-10T11:00:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "6", 2024-05-10T11:00:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-10T11:00:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-10T11:00:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.618 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.619 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.621 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.622 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "min_score": { 2024-05-10T11:00:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "min_score", 2024-05-10T11:00:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.623 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-10T11:00:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "mode": { 2024-05-10T11:00:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mode", 2024-05-10T11:00:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.624 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "upmap", 2024-05-10T11:00:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "crush-compat", 2024-05-10T11:00:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "none", 2024-05-10T11:00:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "read", 2024-05-10T11:00:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap", 2024-05-10T11:00:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap-read" 2024-05-10T11:00:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Balancer mode", 2024-05-10T11:00:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.625 INFO:teuthology.orchestra.run.smithi107.stdout: "pool_ids": { 2024-05-10T11:00:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pool_ids", 2024-05-10T11:00:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-10T11:00:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.626 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2024-05-10T11:00:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2024-05-10T11:00:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2024-05-10T11:00:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-10T11:00:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.627 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap_max_deviation": { 2024-05-10T11:00:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "upmap_max_deviation", 2024-05-10T11:00:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.628 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2024-05-10T11:00:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2024-05-10T11:00:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-10T11:00:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-10T11:00:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap_max_optimizations": { 2024-05-10T11:00:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "upmap_max_optimizations", 2024-05-10T11:00:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2024-05-10T11:00:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.629 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-10T11:00:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cephadm", 2024-05-10T11:00:40.630 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "agent_down_multiplier": { 2024-05-10T11:00:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "agent_down_multiplier", 2024-05-10T11:00:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "3.0", 2024-05-10T11:00:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-10T11:00:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.632 INFO:teuthology.orchestra.run.smithi107.stdout: "agent_refresh_rate": { 2024-05-10T11:00:40.632 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "agent_refresh_rate", 2024-05-10T11:00:40.632 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:40.632 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.632 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.632 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "20", 2024-05-10T11:00:40.632 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.632 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.632 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.632 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-10T11:00:40.632 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.632 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "agent_starting_port": { 2024-05-10T11:00:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "agent_starting_port", 2024-05-10T11:00:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "4721", 2024-05-10T11:00:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-10T11:00:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.633 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "allow_ptrace": { 2024-05-10T11:00:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "allow_ptrace", 2024-05-10T11:00:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-10T11:00:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-10T11:00:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.634 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "autotune_interval": { 2024-05-10T11:00:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "autotune_interval", 2024-05-10T11:00:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2024-05-10T11:00:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-10T11:00:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.635 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "autotune_memory_target_ratio": { 2024-05-10T11:00:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "autotune_memory_target_ratio", 2024-05-10T11:00:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0.7", 2024-05-10T11:00:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-10T11:00:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.636 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "cephadm_log_destination": { 2024-05-10T11:00:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cephadm_log_destination", 2024-05-10T11:00:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "file", 2024-05-10T11:00:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "file,syslog", 2024-05-10T11:00:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "syslog" 2024-05-10T11:00:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.637 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-10T11:00:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "cgroups_split": { 2024-05-10T11:00:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cgroups_split", 2024-05-10T11:00:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.638 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-10T11:00:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "config_checks_enabled": { 2024-05-10T11:00:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "config_checks_enabled", 2024-05-10T11:00:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-10T11:00:40.639 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "config_dashboard": { 2024-05-10T11:00:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "config_dashboard", 2024-05-10T11:00:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-10T11:00:40.640 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_alertmanager": { 2024-05-10T11:00:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_alertmanager", 2024-05-10T11:00:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-10T11:00:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2024-05-10T11:00:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.641 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_base": { 2024-05-10T11:00:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_base", 2024-05-10T11:00:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-10T11:00:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Container image name, without the tag", 2024-05-10T11:00:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_elasticsearch": { 2024-05-10T11:00:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_elasticsearch", 2024-05-10T11:00:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-10T11:00:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "elasticsearch container image", 2024-05-10T11:00:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.643 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_grafana": { 2024-05-10T11:00:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_grafana", 2024-05-10T11:00:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-10T11:00:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2024-05-10T11:00:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.644 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_haproxy": { 2024-05-10T11:00:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_haproxy", 2024-05-10T11:00:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-10T11:00:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "HAproxy container image", 2024-05-10T11:00:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_jaeger_agent": { 2024-05-10T11:00:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_jaeger_agent", 2024-05-10T11:00:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-10T11:00:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Jaeger agent container image", 2024-05-10T11:00:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_jaeger_collector": { 2024-05-10T11:00:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_jaeger_collector", 2024-05-10T11:00:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-10T11:00:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Jaeger collector container image", 2024-05-10T11:00:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.647 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_jaeger_query": { 2024-05-10T11:00:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_jaeger_query", 2024-05-10T11:00:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-10T11:00:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Jaeger query container image", 2024-05-10T11:00:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_keepalived": { 2024-05-10T11:00:40.648 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_keepalived", 2024-05-10T11:00:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-10T11:00:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Keepalived container image", 2024-05-10T11:00:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_loki": { 2024-05-10T11:00:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_loki", 2024-05-10T11:00:40.649 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-10T11:00:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Loki container image", 2024-05-10T11:00:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_node_exporter": { 2024-05-10T11:00:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_node_exporter", 2024-05-10T11:00:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.650 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-10T11:00:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2024-05-10T11:00:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_nvmeof": { 2024-05-10T11:00:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_nvmeof", 2024-05-10T11:00:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.651 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-10T11:00:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Nvme-of container image", 2024-05-10T11:00:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_prometheus": { 2024-05-10T11:00:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_prometheus", 2024-05-10T11:00:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-10T11:00:40.652 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2024-05-10T11:00:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_promtail": { 2024-05-10T11:00:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_promtail", 2024-05-10T11:00:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-10T11:00:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.653 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Promtail container image", 2024-05-10T11:00:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_samba": { 2024-05-10T11:00:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_samba", 2024-05-10T11:00:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-10T11:00:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.654 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Samba/SMB container image", 2024-05-10T11:00:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_snmp_gateway": { 2024-05-10T11:00:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_snmp_gateway", 2024-05-10T11:00:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-10T11:00:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.655 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SNMP Gateway container image", 2024-05-10T11:00:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "container_init": { 2024-05-10T11:00:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_init", 2024-05-10T11:00:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.656 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Run podman/docker with `--init`", 2024-05-10T11:00:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "daemon_cache_timeout": { 2024-05-10T11:00:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "daemon_cache_timeout", 2024-05-10T11:00:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2024-05-10T11:00:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-10T11:00:40.657 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "default_cephadm_command_timeout": { 2024-05-10T11:00:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "default_cephadm_command_timeout", 2024-05-10T11:00:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "900", 2024-05-10T11:00:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-10T11:00:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.658 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "default_registry": { 2024-05-10T11:00:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "default_registry", 2024-05-10T11:00:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io", 2024-05-10T11:00:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-10T11:00:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.659 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "device_cache_timeout": { 2024-05-10T11:00:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "device_cache_timeout", 2024-05-10T11:00:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "1800", 2024-05-10T11:00:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache device inventory", 2024-05-10T11:00:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "device_enhanced_scan": { 2024-05-10T11:00:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "device_enhanced_scan", 2024-05-10T11:00:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-10T11:00:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "facts_cache_timeout": { 2024-05-10T11:00:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "facts_cache_timeout", 2024-05-10T11:00:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2024-05-10T11:00:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache host facts data", 2024-05-10T11:00:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "grafana_dashboards_path": { 2024-05-10T11:00:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "grafana_dashboards_path", 2024-05-10T11:00:40.662 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-10T11:00:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-10T11:00:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "host_check_interval": { 2024-05-10T11:00:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "host_check_interval", 2024-05-10T11:00:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:40.663 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2024-05-10T11:00:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to perform a host check", 2024-05-10T11:00:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "hw_monitoring": { 2024-05-10T11:00:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "hw_monitoring", 2024-05-10T11:00:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.664 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-10T11:00:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "inventory_list_all": { 2024-05-10T11:00:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "inventory_list_all", 2024-05-10T11:00:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.665 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-10T11:00:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.666 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "log_refresh_metadata": { 2024-05-10T11:00:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_refresh_metadata", 2024-05-10T11:00:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-10T11:00:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.668 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-10T11:00:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.669 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.670 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.671 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-10T11:00:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-10T11:00:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-10T11:00:40.672 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-10T11:00:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-10T11:00:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "*", 2024-05-10T11:00:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-10T11:00:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.673 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "max_count_per_host": { 2024-05-10T11:00:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_count_per_host", 2024-05-10T11:00:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "max number of daemons per service per host", 2024-05-10T11:00:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.674 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "max_osd_draining_count": { 2024-05-10T11:00:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_osd_draining_count", 2024-05-10T11:00:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-10T11:00:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "migration_current": { 2024-05-10T11:00:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "migration_current", 2024-05-10T11:00:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "internal - do not modify", 2024-05-10T11:00:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.676 INFO:teuthology.orchestra.run.smithi107.stdout: "mode": { 2024-05-10T11:00:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mode", 2024-05-10T11:00:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "root", 2024-05-10T11:00:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: "cephadm-package", 2024-05-10T11:00:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: "root" 2024-05-10T11:00:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "mode for remote execution of cephadm", 2024-05-10T11:00:40.677 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "oob_default_addr": { 2024-05-10T11:00:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "oob_default_addr", 2024-05-10T11:00:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "169.254.1.1", 2024-05-10T11:00:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.678 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-10T11:00:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "prometheus_alerts_path": { 2024-05-10T11:00:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prometheus_alerts_path", 2024-05-10T11:00:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-10T11:00:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.679 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-10T11:00:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_insecure": { 2024-05-10T11:00:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_insecure", 2024-05-10T11:00:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.680 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-10T11:00:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_password": { 2024-05-10T11:00:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_password", 2024-05-10T11:00:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.681 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-10T11:00:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_url": { 2024-05-10T11:00:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_url", 2024-05-10T11:00:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.682 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-10T11:00:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_username": { 2024-05-10T11:00:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_username", 2024-05-10T11:00:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.683 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-10T11:00:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "secure_monitoring_stack": { 2024-05-10T11:00:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "secure_monitoring_stack", 2024-05-10T11:00:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.684 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-10T11:00:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "service_discovery_port": { 2024-05-10T11:00:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "service_discovery_port", 2024-05-10T11:00:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8765", 2024-05-10T11:00:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "cephadm service discovery port", 2024-05-10T11:00:40.685 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.686 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "ssh_config_file": { 2024-05-10T11:00:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssh_config_file", 2024-05-10T11:00:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-10T11:00:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.687 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "use_agent": { 2024-05-10T11:00:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_agent", 2024-05-10T11:00:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-10T11:00:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.688 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: "use_repo_digest": { 2024-05-10T11:00:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_repo_digest", 2024-05-10T11:00:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-10T11:00:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_on_failed_host_check": { 2024-05-10T11:00:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_on_failed_host_check", 2024-05-10T11:00:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise a health warning if the host check fails", 2024-05-10T11:00:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.690 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_on_stray_daemons": { 2024-05-10T11:00:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_on_stray_daemons", 2024-05-10T11:00:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-10T11:00:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_on_stray_hosts": { 2024-05-10T11:00:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_on_stray_hosts", 2024-05-10T11:00:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-10T11:00:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.692 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crash", 2024-05-10T11:00:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.693 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.694 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.694 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.694 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.694 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.694 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.694 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.694 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.694 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.694 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.698 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.699 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.700 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "retain_interval": { 2024-05-10T11:00:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retain_interval", 2024-05-10T11:00:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "31536000", 2024-05-10T11:00:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.701 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-10T11:00:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.702 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_recent_interval": { 2024-05-10T11:00:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_recent_interval", 2024-05-10T11:00:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "1209600", 2024-05-10T11:00:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.703 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-10T11:00:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "dashboard", 2024-05-10T11:00:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-10T11:00:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-10T11:00:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.704 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "ALERTMANAGER_API_HOST": { 2024-05-10T11:00:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-10T11:00:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.705 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-10T11:00:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-10T11:00:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.706 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "AUDIT_API_ENABLED": { 2024-05-10T11:00:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "AUDIT_API_ENABLED", 2024-05-10T11:00:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.707 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-10T11:00:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-10T11:00:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.708 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "ENABLE_BROWSABLE_API": { 2024-05-10T11:00:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-10T11:00:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.709 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-10T11:00:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-10T11:00:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.710 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-10T11:00:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-10T11:00:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.711 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-10T11:00:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-10T11:00:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.712 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-10T11:00:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-10T11:00:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.713 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-10T11:00:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-10T11:00:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.714 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-10T11:00:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-10T11:00:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.715 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-10T11:00:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-10T11:00:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-10T11:00:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-10T11:00:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.717 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_PASSWORD": { 2024-05-10T11:00:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-10T11:00:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2024-05-10T11:00:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.718 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-10T11:00:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-10T11:00:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_URL": { 2024-05-10T11:00:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_URL", 2024-05-10T11:00:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.720 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_USERNAME": { 2024-05-10T11:00:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-10T11:00:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2024-05-10T11:00:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-10T11:00:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-10T11:00:40.721 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-10T11:00:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-10T11:00:40.722 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-10T11:00:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-10T11:00:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.723 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-10T11:00:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-10T11:00:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.724 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-10T11:00:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-10T11:00:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "[]", 2024-05-10T11:00:40.725 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "MULTICLUSTER_CONFIG": { 2024-05-10T11:00:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-10T11:00:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "{}", 2024-05-10T11:00:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.726 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "PROMETHEUS_API_HOST": { 2024-05-10T11:00:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-10T11:00:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.727 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-10T11:00:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-10T11:00:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.728 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-10T11:00:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-10T11:00:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.729 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-10T11:00:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-10T11:00:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.730 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-10T11:00:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-10T11:00:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.731 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-10T11:00:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-10T11:00:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.732 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-10T11:00:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-10T11:00:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-10T11:00:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-10T11:00:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-10T11:00:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-10T11:00:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.735 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_ENABLED": { 2024-05-10T11:00:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-10T11:00:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-10T11:00:40.736 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-10T11:00:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-10T11:00:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-10T11:00:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-10T11:00:40.737 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-10T11:00:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-10T11:00:40.738 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8", 2024-05-10T11:00:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-10T11:00:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-10T11:00:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.739 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "45", 2024-05-10T11:00:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_ACCESS_KEY": { 2024-05-10T11:00:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-10T11:00:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.740 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-10T11:00:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-10T11:00:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.741 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2024-05-10T11:00:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_SECRET_KEY": { 2024-05-10T11:00:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-10T11:00:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.742 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_SSL_VERIFY": { 2024-05-10T11:00:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-10T11:00:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.743 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "UNSAFE_TLS_v1_2": { 2024-05-10T11:00:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-10T11:00:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.744 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-10T11:00:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-10T11:00:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.745 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-10T11:00:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-10T11:00:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.746 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-10T11:00:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-10T11:00:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2024-05-10T11:00:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.747 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "cross_origin_url": { 2024-05-10T11:00:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cross_origin_url", 2024-05-10T11:00:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.748 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "crt_file": { 2024-05-10T11:00:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crt_file", 2024-05-10T11:00:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.749 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "debug": { 2024-05-10T11:00:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "debug", 2024-05-10T11:00:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Enable/disable debug options", 2024-05-10T11:00:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "jwt_token_ttl": { 2024-05-10T11:00:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "jwt_token_ttl", 2024-05-10T11:00:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "28800", 2024-05-10T11:00:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.751 INFO:teuthology.orchestra.run.smithi107.stdout: "key_file": { 2024-05-10T11:00:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "key_file", 2024-05-10T11:00:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.752 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.753 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.754 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.755 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.756 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "motd": { 2024-05-10T11:00:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "motd", 2024-05-10T11:00:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.757 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "The message of the day", 2024-05-10T11:00:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "redirect_resolve_ip_addr": { 2024-05-10T11:00:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "redirect_resolve_ip_addr", 2024-05-10T11:00:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.758 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "server_addr": { 2024-05-10T11:00:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_addr", 2024-05-10T11:00:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "::", 2024-05-10T11:00:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.759 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "server_port": { 2024-05-10T11:00:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_port", 2024-05-10T11:00:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8080", 2024-05-10T11:00:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.760 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.761 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "ssl": { 2024-05-10T11:00:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssl", 2024-05-10T11:00:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.762 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "ssl_server_port": { 2024-05-10T11:00:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssl_server_port", 2024-05-10T11:00:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8443", 2024-05-10T11:00:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.763 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_behaviour": { 2024-05-10T11:00:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_behaviour", 2024-05-10T11:00:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "redirect", 2024-05-10T11:00:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: "redirect" 2024-05-10T11:00:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.764 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_error_status_code": { 2024-05-10T11:00:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_error_status_code", 2024-05-10T11:00:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "500", 2024-05-10T11:00:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "400", 2024-05-10T11:00:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "599", 2024-05-10T11:00:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.765 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "url_prefix": { 2024-05-10T11:00:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "url_prefix", 2024-05-10T11:00:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.766 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", 2024-05-10T11:00:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: "enable_monitoring": { 2024-05-10T11:00:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enable_monitoring", 2024-05-10T11:00:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.767 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "monitor device health metrics", 2024-05-10T11:00:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.768 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.769 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.770 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.771 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.772 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "mark_out_threshold": { 2024-05-10T11:00:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mark_out_threshold", 2024-05-10T11:00:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "2419200", 2024-05-10T11:00:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-10T11:00:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.773 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "pool_name": { 2024-05-10T11:00:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pool_name", 2024-05-10T11:00:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "device_health_metrics", 2024-05-10T11:00:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-10T11:00:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.774 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "retention_period": { 2024-05-10T11:00:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retention_period", 2024-05-10T11:00:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "15552000", 2024-05-10T11:00:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how long to retain device health metrics", 2024-05-10T11:00:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.775 INFO:teuthology.orchestra.run.smithi107.stdout: "scrape_frequency": { 2024-05-10T11:00:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "scrape_frequency", 2024-05-10T11:00:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "86400", 2024-05-10T11:00:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-10T11:00:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "self_heal": { 2024-05-10T11:00:40.776 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "self_heal", 2024-05-10T11:00:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-10T11:00:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2024-05-10T11:00:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2024-05-10T11:00:40.777 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2024-05-10T11:00:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to wake up and check device health", 2024-05-10T11:00:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.778 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_threshold": { 2024-05-10T11:00:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_threshold", 2024-05-10T11:00:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.779 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "7257600", 2024-05-10T11:00:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-10T11:00:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "diskprediction_local", 2024-05-10T11:00:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.780 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.781 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.782 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.783 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.785 INFO:teuthology.orchestra.run.smithi107.stdout: "predict_interval": { 2024-05-10T11:00:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "predict_interval", 2024-05-10T11:00:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "86400", 2024-05-10T11:00:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.786 INFO:teuthology.orchestra.run.smithi107.stdout: "predictor_model": { 2024-05-10T11:00:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "predictor_model", 2024-05-10T11:00:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "prophetstor", 2024-05-10T11:00:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2024-05-10T11:00:40.787 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2024-05-10T11:00:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2024-05-10T11:00:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.788 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.789 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "influx", 2024-05-10T11:00:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": false, 2024-05-10T11:00:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "influxdb python module not found", 2024-05-10T11:00:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "batch_size": { 2024-05-10T11:00:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "batch_size", 2024-05-10T11:00:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5000", 2024-05-10T11:00:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-10T11:00:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "database": { 2024-05-10T11:00:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "database", 2024-05-10T11:00:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "ceph", 2024-05-10T11:00:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-10T11:00:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.791 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: "hostname": { 2024-05-10T11:00:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "hostname", 2024-05-10T11:00:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server hostname", 2024-05-10T11:00:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2024-05-10T11:00:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2024-05-10T11:00:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "30", 2024-05-10T11:00:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "5", 2024-05-10T11:00:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-10T11:00:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.793 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.794 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.794 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.794 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.794 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.794 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.794 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.794 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.794 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.794 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.794 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.794 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.794 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.795 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.796 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.797 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "password": { 2024-05-10T11:00:40.798 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "password", 2024-05-10T11:00:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "password of InfluxDB server user", 2024-05-10T11:00:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "port": { 2024-05-10T11:00:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "port", 2024-05-10T11:00:40.799 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8086", 2024-05-10T11:00:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server port", 2024-05-10T11:00:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.800 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "ssl": { 2024-05-10T11:00:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssl", 2024-05-10T11:00:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.801 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "false", 2024-05-10T11:00:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-10T11:00:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: "threads": { 2024-05-10T11:00:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "threads", 2024-05-10T11:00:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2024-05-10T11:00:40.802 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2024-05-10T11:00:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "32", 2024-05-10T11:00:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-10T11:00:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "username": { 2024-05-10T11:00:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "username", 2024-05-10T11:00:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.803 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "username of InfluxDB server user", 2024-05-10T11:00:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "verify_ssl": { 2024-05-10T11:00:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "verify_ssl", 2024-05-10T11:00:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "true", 2024-05-10T11:00:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.804 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-10T11:00:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "insights", 2024-05-10T11:00:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.805 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.806 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.807 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.808 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.809 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.810 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "iostat", 2024-05-10T11:00:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.811 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.812 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.813 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.814 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.815 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.816 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "k8sevents", 2024-05-10T11:00:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.817 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_event_retention_days": { 2024-05-10T11:00:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ceph_event_retention_days", 2024-05-10T11:00:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "7", 2024-05-10T11:00:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-10T11:00:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.818 INFO:teuthology.orchestra.run.smithi107.stdout: "config_check_secs": { 2024-05-10T11:00:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "config_check_secs", 2024-05-10T11:00:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "10", 2024-05-10T11:00:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-10T11:00:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.820 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.821 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.822 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.823 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.824 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "localpool", 2024-05-10T11:00:40.825 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "failure_domain": { 2024-05-10T11:00:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "failure_domain", 2024-05-10T11:00:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "host", 2024-05-10T11:00:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "failure domain for any created local pool", 2024-05-10T11:00:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-10T11:00:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.826 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.827 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.828 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.829 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.830 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "min_size": { 2024-05-10T11:00:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "min_size", 2024-05-10T11:00:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.831 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "default min_size for any created local pool", 2024-05-10T11:00:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-10T11:00:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: "num_rep": { 2024-05-10T11:00:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "num_rep", 2024-05-10T11:00:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.832 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "3", 2024-05-10T11:00:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "default replica count for any created local pool", 2024-05-10T11:00:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "pg_num": { 2024-05-10T11:00:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pg_num", 2024-05-10T11:00:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.833 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "128", 2024-05-10T11:00:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "default pg_num for any created local pool", 2024-05-10T11:00:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "prefix": { 2024-05-10T11:00:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prefix", 2024-05-10T11:00:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.834 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "name prefix for any created local pool", 2024-05-10T11:00:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.835 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "subtree": { 2024-05-10T11:00:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "subtree", 2024-05-10T11:00:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "rack", 2024-05-10T11:00:40.836 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-10T11:00:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-10T11:00:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mds_autoscaler", 2024-05-10T11:00:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.837 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.838 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.839 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.840 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.841 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.842 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mirroring", 2024-05-10T11:00:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.843 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.844 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.845 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.846 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.847 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.848 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "nfs", 2024-05-10T11:00:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.849 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.850 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.851 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.852 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.853 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.854 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "orchestrator", 2024-05-10T11:00:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.855 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "fail_fs": { 2024-05-10T11:00:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "fail_fs", 2024-05-10T11:00:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-10T11:00:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.856 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.857 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.858 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.859 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.860 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "orchestrator": { 2024-05-10T11:00:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "orchestrator", 2024-05-10T11:00:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.861 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "cephadm", 2024-05-10T11:00:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "rook", 2024-05-10T11:00:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "test_orchestrator" 2024-05-10T11:00:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Orchestrator backend", 2024-05-10T11:00:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.862 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "osd_perf_query", 2024-05-10T11:00:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.864 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.865 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.866 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.868 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "osd_support", 2024-05-10T11:00:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.870 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.871 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.872 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.873 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.874 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.875 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pg_autoscaler", 2024-05-10T11:00:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.876 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.877 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.878 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.879 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.880 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2024-05-10T11:00:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2024-05-10T11:00:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2024-05-10T11:00:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.881 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "threshold": { 2024-05-10T11:00:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "threshold", 2024-05-10T11:00:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "3.0", 2024-05-10T11:00:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1.0", 2024-05-10T11:00:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "scaling threshold", 2024-05-10T11:00:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-10T11:00:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.883 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "progress", 2024-05-10T11:00:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: "allow_pg_recovery_event": { 2024-05-10T11:00:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "allow_pg_recovery_event", 2024-05-10T11:00:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.884 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-10T11:00:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": { 2024-05-10T11:00:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enabled", 2024-05-10T11:00:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.885 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.886 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.887 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.888 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.889 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.890 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "max_completed_events": { 2024-05-10T11:00:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_completed_events", 2024-05-10T11:00:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "50", 2024-05-10T11:00:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "number of past completed events to remember", 2024-05-10T11:00:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.891 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2024-05-10T11:00:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2024-05-10T11:00:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2024-05-10T11:00:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how long the module is going to sleep", 2024-05-10T11:00:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prometheus", 2024-05-10T11:00:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "cache": { 2024-05-10T11:00:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cache", 2024-05-10T11:00:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.894 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "exclude_perf_counters": { 2024-05-10T11:00:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "exclude_perf_counters", 2024-05-10T11:00:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.895 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-10T11:00:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-10T11:00:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.896 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.897 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.897 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.897 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.897 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.897 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.897 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.897 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.897 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.897 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.898 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.899 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.900 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_stats_pools": { 2024-05-10T11:00:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_stats_pools", 2024-05-10T11:00:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.901 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-10T11:00:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-10T11:00:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300", 2024-05-10T11:00:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.902 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "scrape_interval": { 2024-05-10T11:00:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "scrape_interval", 2024-05-10T11:00:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "15.0", 2024-05-10T11:00:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.903 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "server_addr": { 2024-05-10T11:00:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_addr", 2024-05-10T11:00:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "::", 2024-05-10T11:00:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-10T11:00:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "server_port": { 2024-05-10T11:00:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_port", 2024-05-10T11:00:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "9283", 2024-05-10T11:00:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-10T11:00:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.905 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "stale_cache_strategy": { 2024-05-10T11:00:40.906 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "stale_cache_strategy", 2024-05-10T11:00:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "log", 2024-05-10T11:00:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_behaviour": { 2024-05-10T11:00:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_behaviour", 2024-05-10T11:00:40.907 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "default", 2024-05-10T11:00:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "default", 2024-05-10T11:00:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "error" 2024-05-10T11:00:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.908 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_error_status_code": { 2024-05-10T11:00:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_error_status_code", 2024-05-10T11:00:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "500", 2024-05-10T11:00:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "400", 2024-05-10T11:00:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "599", 2024-05-10T11:00:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_support", 2024-05-10T11:00:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.910 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.911 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.912 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.913 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.913 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.913 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.913 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.913 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.913 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.913 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.913 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.913 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.913 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.913 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.913 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.913 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.913 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.913 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.914 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.914 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.914 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.914 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.914 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.914 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.914 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.914 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.914 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.914 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.914 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.914 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.914 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.914 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.915 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.915 INFO:teuthology.orchestra.run.smithi107.stdout: "max_concurrent_snap_create": { 2024-05-10T11:00:40.915 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_concurrent_snap_create", 2024-05-10T11:00:40.915 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.915 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.915 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.915 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:40.915 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.915 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.915 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.915 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.915 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.915 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.915 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "mirror_snapshot_schedule": { 2024-05-10T11:00:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mirror_snapshot_schedule", 2024-05-10T11:00:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "trash_purge_schedule": { 2024-05-10T11:00:40.917 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "trash_purge_schedule", 2024-05-10T11:00:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "restful", 2024-05-10T11:00:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "enable_auth": { 2024-05-10T11:00:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enable_auth", 2024-05-10T11:00:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.919 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: "key_file": { 2024-05-10T11:00:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "key_file", 2024-05-10T11:00:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.920 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.921 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.922 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.923 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.924 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "server_addr": { 2024-05-10T11:00:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_addr", 2024-05-10T11:00:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "server_port": { 2024-05-10T11:00:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_port", 2024-05-10T11:00:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.927 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rgw", 2024-05-10T11:00:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.929 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.930 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.931 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.933 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.934 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rook", 2024-05-10T11:00:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.935 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.936 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.937 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.938 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.939 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.940 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "storage_class": { 2024-05-10T11:00:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "storage_class", 2024-05-10T11:00:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "local", 2024-05-10T11:00:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.941 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-10T11:00:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "selftest", 2024-05-10T11:00:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.942 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.943 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.944 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.945 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.946 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "roption1": { 2024-05-10T11:00:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "roption1", 2024-05-10T11:00:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.947 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "roption2": { 2024-05-10T11:00:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "roption2", 2024-05-10T11:00:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "xyz", 2024-05-10T11:00:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption1": { 2024-05-10T11:00:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption1", 2024-05-10T11:00:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.949 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption2": { 2024-05-10T11:00:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption2", 2024-05-10T11:00:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.950 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption3": { 2024-05-10T11:00:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption3", 2024-05-10T11:00:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.951 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption4": { 2024-05-10T11:00:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption4", 2024-05-10T11:00:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.952 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption5": { 2024-05-10T11:00:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption5", 2024-05-10T11:00:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.953 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption6": { 2024-05-10T11:00:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption6", 2024-05-10T11:00:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.954 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption7": { 2024-05-10T11:00:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption7", 2024-05-10T11:00:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2024-05-10T11:00:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "42", 2024-05-10T11:00:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.956 INFO:teuthology.orchestra.run.smithi107.stdout: "testkey": { 2024-05-10T11:00:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "testkey", 2024-05-10T11:00:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "testlkey": { 2024-05-10T11:00:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "testlkey", 2024-05-10T11:00:40.957 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "testnewline": { 2024-05-10T11:00:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "testnewline", 2024-05-10T11:00:40.958 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.959 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smb", 2024-05-10T11:00:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.960 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.961 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.962 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.963 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "update_orchestration": { 2024-05-10T11:00:40.965 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "update_orchestration", 2024-05-10T11:00:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-10T11:00:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "snap_schedule", 2024-05-10T11:00:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: "allow_m_granularity": { 2024-05-10T11:00:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "allow_m_granularity", 2024-05-10T11:00:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.967 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "allow minute scheduled snapshots", 2024-05-10T11:00:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "dump_on_update": { 2024-05-10T11:00:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "dump_on_update", 2024-05-10T11:00:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.968 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "dump database to debug log on update", 2024-05-10T11:00:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.969 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.970 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.971 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.973 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "stats", 2024-05-10T11:00:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.975 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.976 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.977 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.978 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.979 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.980 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "status", 2024-05-10T11:00:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.981 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.982 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.983 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.984 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.985 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.985 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.985 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.985 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.985 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.985 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.985 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.985 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.985 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.985 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.985 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.986 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.986 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.986 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.986 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.986 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.986 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.986 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.986 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:40.986 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.986 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "telegraf", 2024-05-10T11:00:40.987 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "address": { 2024-05-10T11:00:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "address", 2024-05-10T11:00:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-10T11:00:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.988 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2024-05-10T11:00:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2024-05-10T11:00:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "15", 2024-05-10T11:00:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.989 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.990 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.990 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.990 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.990 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:40.990 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:40.990 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.990 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.990 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.990 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.991 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.992 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.992 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.992 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.992 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.992 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.992 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:40.992 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:40.992 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.992 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.993 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.993 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.993 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.993 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.993 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.993 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.993 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.993 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.993 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.994 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:40.994 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:40.994 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:40.994 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.994 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.994 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:40.994 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.994 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.994 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:40.995 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:40.995 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:40.995 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:40.995 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:40.995 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:40.995 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:40.995 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:40.995 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.995 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.996 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.996 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.996 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:40.996 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:40.997 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:40.997 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:40.997 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:40.997 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:40.997 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:40.998 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:40.998 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:40.998 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:40.998 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:40.998 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:40.998 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:40.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:40.999 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:40.999 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:40.999 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:40.999 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.000 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.000 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.000 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.000 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.000 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.001 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.001 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.001 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.001 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.001 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.001 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.002 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "telemetry", 2024-05-10T11:00:41.002 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.002 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.003 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.003 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_basic": { 2024-05-10T11:00:41.003 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_basic", 2024-05-10T11:00:41.003 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.003 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.003 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.004 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.004 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.004 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.004 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.004 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-10T11:00:41.004 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.004 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_crash": { 2024-05-10T11:00:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_crash", 2024-05-10T11:00:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.005 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-10T11:00:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_device": { 2024-05-10T11:00:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_device", 2024-05-10T11:00:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.006 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-10T11:00:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_ident": { 2024-05-10T11:00:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_ident", 2024-05-10T11:00:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.007 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-10T11:00:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_perf": { 2024-05-10T11:00:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_perf", 2024-05-10T11:00:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.008 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-10T11:00:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: "contact": { 2024-05-10T11:00:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "contact", 2024-05-10T11:00:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.009 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: "description": { 2024-05-10T11:00:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "description", 2024-05-10T11:00:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.010 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.011 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.011 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.011 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.011 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.011 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.011 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.011 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.011 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.011 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.011 INFO:teuthology.orchestra.run.smithi107.stdout: "device_url": { 2024-05-10T11:00:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "device_url", 2024-05-10T11:00:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-10T11:00:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": { 2024-05-10T11:00:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enabled", 2024-05-10T11:00:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.013 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.014 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2024-05-10T11:00:41.014 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2024-05-10T11:00:41.014 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.014 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.014 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.014 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "24", 2024-05-10T11:00:41.014 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "8", 2024-05-10T11:00:41.014 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.014 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.014 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.014 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: "last_opt_revision": { 2024-05-10T11:00:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "last_opt_revision", 2024-05-10T11:00:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "1", 2024-05-10T11:00:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.015 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: "leaderboard": { 2024-05-10T11:00:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "leaderboard", 2024-05-10T11:00:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.016 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: "leaderboard_description": { 2024-05-10T11:00:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "leaderboard_description", 2024-05-10T11:00:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.017 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.018 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.018 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.018 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.018 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.018 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.018 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.018 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.018 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.018 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.018 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.018 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.019 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.020 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.021 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.022 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.022 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.022 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.022 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.022 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.022 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.022 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.022 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.022 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.022 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.022 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.022 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.023 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: "organization": { 2024-05-10T11:00:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "organization", 2024-05-10T11:00:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.024 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "proxy": { 2024-05-10T11:00:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "proxy", 2024-05-10T11:00:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.025 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.026 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.026 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.026 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.026 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.026 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.026 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.026 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.026 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.026 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: "url": { 2024-05-10T11:00:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "url", 2024-05-10T11:00:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.027 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-10T11:00:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "test_orchestrator", 2024-05-10T11:00:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.029 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.030 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.030 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.030 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.030 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.030 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.030 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.030 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.030 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.030 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.030 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.030 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.031 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.032 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.033 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.034 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.035 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.036 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.036 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.036 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.036 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.036 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.036 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "volumes", 2024-05-10T11:00:41.036 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.036 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.036 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.036 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.037 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.038 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.039 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.041 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: "max_concurrent_clones": { 2024-05-10T11:00:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_concurrent_clones", 2024-05-10T11:00:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.042 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "4", 2024-05-10T11:00:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-10T11:00:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.043 INFO:teuthology.orchestra.run.smithi107.stdout: "periodic_async_work": { 2024-05-10T11:00:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "periodic_async_work", 2024-05-10T11:00:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Periodically check for async work", 2024-05-10T11:00:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.044 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "snapshot_clone_delay": { 2024-05-10T11:00:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "snapshot_clone_delay", 2024-05-10T11:00:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-10T11:00:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.045 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: "snapshot_clone_no_wait": { 2024-05-10T11:00:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "snapshot_clone_no_wait", 2024-05-10T11:00:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.046 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-10T11:00:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.047 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix", 2024-05-10T11:00:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.048 INFO:teuthology.orchestra.run.smithi107.stdout: "discovery_interval": { 2024-05-10T11:00:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "discovery_interval", 2024-05-10T11:00:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2024-05-10T11:00:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "100", 2024-05-10T11:00:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.049 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: "identifier": { 2024-05-10T11:00:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "identifier", 2024-05-10T11:00:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.050 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2024-05-10T11:00:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2024-05-10T11:00:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2024-05-10T11:00:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.051 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.052 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.053 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.054 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.055 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.056 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.056 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.056 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.056 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.056 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.056 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.056 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.056 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.056 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.056 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.056 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.057 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.058 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.058 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.058 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.058 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.058 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.058 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.058 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.058 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.058 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.058 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: "zabbix_host": { 2024-05-10T11:00:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix_host", 2024-05-10T11:00:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.059 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.060 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.060 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.060 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.060 INFO:teuthology.orchestra.run.smithi107.stdout: "zabbix_port": { 2024-05-10T11:00:41.060 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix_port", 2024-05-10T11:00:41.060 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.060 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.060 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.060 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10051", 2024-05-10T11:00:41.060 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.060 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: "zabbix_sender": { 2024-05-10T11:00:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix_sender", 2024-05-10T11:00:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.061 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-10T11:00:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-10T11:00:41.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.063 INFO:teuthology.orchestra.run.smithi107.stdout: "gid": 24116, 2024-05-10T11:00:41.063 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "y", 2024-05-10T11:00:41.063 INFO:teuthology.orchestra.run.smithi107.stdout: "mgr_features": 4540701547738038271, 2024-05-10T11:00:41.063 INFO:teuthology.orchestra.run.smithi107.stdout: "available_modules": [ 2024-05-10T11:00:41.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.063 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "alerts", 2024-05-10T11:00:41.063 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.063 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.063 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.063 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2024-05-10T11:00:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2024-05-10T11:00:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2024-05-10T11:00:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How frequently to reexamine health status", 2024-05-10T11:00:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.065 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.066 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.067 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.068 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.068 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.068 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.068 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.068 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.068 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.068 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.068 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.068 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.068 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.068 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.069 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.069 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.069 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.069 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.069 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.069 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.069 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.069 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.069 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.069 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.069 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_destination": { 2024-05-10T11:00:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_destination", 2024-05-10T11:00:41.070 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Email address to send alerts to", 2024-05-10T11:00:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_from_name": { 2024-05-10T11:00:41.071 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_from_name", 2024-05-10T11:00:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "Ceph", 2024-05-10T11:00:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Email From: name", 2024-05-10T11:00:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.072 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_host": { 2024-05-10T11:00:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_host", 2024-05-10T11:00:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SMTP server", 2024-05-10T11:00:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_password": { 2024-05-10T11:00:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_password", 2024-05-10T11:00:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Password to authenticate with", 2024-05-10T11:00:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_port": { 2024-05-10T11:00:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_port", 2024-05-10T11:00:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "465", 2024-05-10T11:00:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.075 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SMTP port", 2024-05-10T11:00:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_sender": { 2024-05-10T11:00:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_sender", 2024-05-10T11:00:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.076 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SMTP envelope sender", 2024-05-10T11:00:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_ssl": { 2024-05-10T11:00:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_ssl", 2024-05-10T11:00:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.077 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-10T11:00:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_user": { 2024-05-10T11:00:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_user", 2024-05-10T11:00:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.078 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "User to authenticate as", 2024-05-10T11:00:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.079 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.080 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "balancer", 2024-05-10T11:00:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: "active": { 2024-05-10T11:00:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "active", 2024-05-10T11:00:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.081 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "automatically balance PGs across cluster", 2024-05-10T11:00:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "begin_time": { 2024-05-10T11:00:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "begin_time", 2024-05-10T11:00:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.082 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0000", 2024-05-10T11:00:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "beginning time of day to automatically balance", 2024-05-10T11:00:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-10T11:00:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: "begin_weekday": { 2024-05-10T11:00:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "begin_weekday", 2024-05-10T11:00:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2024-05-10T11:00:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.083 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.084 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.084 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "0", 2024-05-10T11:00:41.084 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "6", 2024-05-10T11:00:41.084 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.084 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-10T11:00:41.084 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-10T11:00:41.084 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.084 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.084 INFO:teuthology.orchestra.run.smithi107.stdout: "crush_compat_max_iterations": { 2024-05-10T11:00:41.084 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crush_compat_max_iterations", 2024-05-10T11:00:41.084 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2024-05-10T11:00:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "25", 2024-05-10T11:00:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2024-05-10T11:00:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "250", 2024-05-10T11:00:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-10T11:00:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: "crush_compat_metrics": { 2024-05-10T11:00:41.085 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crush_compat_metrics", 2024-05-10T11:00:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "pgs,objects,bytes", 2024-05-10T11:00:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-10T11:00:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-10T11:00:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "crush_compat_step": { 2024-05-10T11:00:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crush_compat_step", 2024-05-10T11:00:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0.5", 2024-05-10T11:00:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "0.001", 2024-05-10T11:00:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "0.999", 2024-05-10T11:00:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "aggressiveness of optimization", 2024-05-10T11:00:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-10T11:00:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.087 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: "end_time": { 2024-05-10T11:00:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_time", 2024-05-10T11:00:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "2359", 2024-05-10T11:00:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "ending time of day to automatically balance", 2024-05-10T11:00:41.088 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-10T11:00:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "end_weekday": { 2024-05-10T11:00:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_weekday", 2024-05-10T11:00:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2024-05-10T11:00:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "0", 2024-05-10T11:00:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "6", 2024-05-10T11:00:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.089 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-10T11:00:41.090 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-10T11:00:41.090 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.090 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.090 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.090 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.090 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.090 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.090 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.090 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.090 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.090 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.091 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.092 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.092 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.092 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.092 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.092 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.092 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.092 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.092 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.092 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.092 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.092 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.093 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.094 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.095 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.095 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.095 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.095 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.095 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.095 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.095 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.095 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.095 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.095 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.095 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.095 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: "min_score": { 2024-05-10T11:00:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "min_score", 2024-05-10T11:00:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-10T11:00:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.096 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.097 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.097 INFO:teuthology.orchestra.run.smithi107.stdout: "mode": { 2024-05-10T11:00:41.097 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mode", 2024-05-10T11:00:41.097 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.097 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.097 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.097 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "upmap", 2024-05-10T11:00:41.097 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.097 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.097 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.097 INFO:teuthology.orchestra.run.smithi107.stdout: "crush-compat", 2024-05-10T11:00:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: "none", 2024-05-10T11:00:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: "read", 2024-05-10T11:00:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap", 2024-05-10T11:00:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap-read" 2024-05-10T11:00:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Balancer mode", 2024-05-10T11:00:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: "pool_ids": { 2024-05-10T11:00:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pool_ids", 2024-05-10T11:00:41.098 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-10T11:00:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.099 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2024-05-10T11:00:41.100 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2024-05-10T11:00:41.100 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.100 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.100 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.100 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2024-05-10T11:00:41.100 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.100 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.100 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.100 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-10T11:00:41.100 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.100 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.100 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.101 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.102 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.102 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap_max_deviation": { 2024-05-10T11:00:41.102 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "upmap_max_deviation", 2024-05-10T11:00:41.102 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.102 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.102 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.102 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2024-05-10T11:00:41.105 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2024-05-10T11:00:41.105 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.106 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.106 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-10T11:00:41.106 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-10T11:00:41.106 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.106 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.106 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap_max_optimizations": { 2024-05-10T11:00:41.106 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "upmap_max_optimizations", 2024-05-10T11:00:41.106 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2024-05-10T11:00:41.106 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.106 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-10T11:00:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cephadm", 2024-05-10T11:00:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.107 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "agent_down_multiplier": { 2024-05-10T11:00:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "agent_down_multiplier", 2024-05-10T11:00:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "3.0", 2024-05-10T11:00:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-10T11:00:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "agent_refresh_rate": { 2024-05-10T11:00:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "agent_refresh_rate", 2024-05-10T11:00:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "20", 2024-05-10T11:00:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-10T11:00:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "agent_starting_port": { 2024-05-10T11:00:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "agent_starting_port", 2024-05-10T11:00:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "4721", 2024-05-10T11:00:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-10T11:00:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "allow_ptrace": { 2024-05-10T11:00:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "allow_ptrace", 2024-05-10T11:00:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-10T11:00:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-10T11:00:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "autotune_interval": { 2024-05-10T11:00:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "autotune_interval", 2024-05-10T11:00:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2024-05-10T11:00:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-10T11:00:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "autotune_memory_target_ratio": { 2024-05-10T11:00:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "autotune_memory_target_ratio", 2024-05-10T11:00:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0.7", 2024-05-10T11:00:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-10T11:00:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "cephadm_log_destination": { 2024-05-10T11:00:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cephadm_log_destination", 2024-05-10T11:00:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "file", 2024-05-10T11:00:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "file,syslog", 2024-05-10T11:00:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "syslog" 2024-05-10T11:00:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-10T11:00:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "cgroups_split": { 2024-05-10T11:00:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cgroups_split", 2024-05-10T11:00:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-10T11:00:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "config_checks_enabled": { 2024-05-10T11:00:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "config_checks_enabled", 2024-05-10T11:00:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-10T11:00:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "config_dashboard": { 2024-05-10T11:00:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "config_dashboard", 2024-05-10T11:00:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-10T11:00:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_alertmanager": { 2024-05-10T11:00:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_alertmanager", 2024-05-10T11:00:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-10T11:00:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2024-05-10T11:00:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_base": { 2024-05-10T11:00:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_base", 2024-05-10T11:00:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-10T11:00:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Container image name, without the tag", 2024-05-10T11:00:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_elasticsearch": { 2024-05-10T11:00:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_elasticsearch", 2024-05-10T11:00:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-10T11:00:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "elasticsearch container image", 2024-05-10T11:00:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_grafana": { 2024-05-10T11:00:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_grafana", 2024-05-10T11:00:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-10T11:00:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2024-05-10T11:00:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_haproxy": { 2024-05-10T11:00:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_haproxy", 2024-05-10T11:00:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-10T11:00:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "HAproxy container image", 2024-05-10T11:00:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_jaeger_agent": { 2024-05-10T11:00:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_jaeger_agent", 2024-05-10T11:00:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-10T11:00:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Jaeger agent container image", 2024-05-10T11:00:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_jaeger_collector": { 2024-05-10T11:00:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_jaeger_collector", 2024-05-10T11:00:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-10T11:00:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Jaeger collector container image", 2024-05-10T11:00:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_jaeger_query": { 2024-05-10T11:00:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_jaeger_query", 2024-05-10T11:00:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-10T11:00:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Jaeger query container image", 2024-05-10T11:00:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_keepalived": { 2024-05-10T11:00:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_keepalived", 2024-05-10T11:00:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-10T11:00:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Keepalived container image", 2024-05-10T11:00:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_loki": { 2024-05-10T11:00:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_loki", 2024-05-10T11:00:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-10T11:00:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Loki container image", 2024-05-10T11:00:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_node_exporter": { 2024-05-10T11:00:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_node_exporter", 2024-05-10T11:00:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-10T11:00:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2024-05-10T11:00:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_nvmeof": { 2024-05-10T11:00:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_nvmeof", 2024-05-10T11:00:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-10T11:00:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Nvme-of container image", 2024-05-10T11:00:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_prometheus": { 2024-05-10T11:00:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_prometheus", 2024-05-10T11:00:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-10T11:00:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2024-05-10T11:00:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_promtail": { 2024-05-10T11:00:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_promtail", 2024-05-10T11:00:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-10T11:00:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Promtail container image", 2024-05-10T11:00:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_samba": { 2024-05-10T11:00:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_samba", 2024-05-10T11:00:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-10T11:00:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Samba/SMB container image", 2024-05-10T11:00:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_snmp_gateway": { 2024-05-10T11:00:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_snmp_gateway", 2024-05-10T11:00:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-10T11:00:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SNMP Gateway container image", 2024-05-10T11:00:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "container_init": { 2024-05-10T11:00:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_init", 2024-05-10T11:00:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Run podman/docker with `--init`", 2024-05-10T11:00:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "daemon_cache_timeout": { 2024-05-10T11:00:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "daemon_cache_timeout", 2024-05-10T11:00:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2024-05-10T11:00:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-10T11:00:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "default_cephadm_command_timeout": { 2024-05-10T11:00:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "default_cephadm_command_timeout", 2024-05-10T11:00:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "900", 2024-05-10T11:00:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-10T11:00:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "default_registry": { 2024-05-10T11:00:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "default_registry", 2024-05-10T11:00:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io", 2024-05-10T11:00:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-10T11:00:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "device_cache_timeout": { 2024-05-10T11:00:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "device_cache_timeout", 2024-05-10T11:00:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "1800", 2024-05-10T11:00:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache device inventory", 2024-05-10T11:00:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "device_enhanced_scan": { 2024-05-10T11:00:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "device_enhanced_scan", 2024-05-10T11:00:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-10T11:00:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "facts_cache_timeout": { 2024-05-10T11:00:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "facts_cache_timeout", 2024-05-10T11:00:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2024-05-10T11:00:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache host facts data", 2024-05-10T11:00:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "grafana_dashboards_path": { 2024-05-10T11:00:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "grafana_dashboards_path", 2024-05-10T11:00:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-10T11:00:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-10T11:00:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "host_check_interval": { 2024-05-10T11:00:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "host_check_interval", 2024-05-10T11:00:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2024-05-10T11:00:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to perform a host check", 2024-05-10T11:00:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "hw_monitoring": { 2024-05-10T11:00:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "hw_monitoring", 2024-05-10T11:00:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-10T11:00:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "inventory_list_all": { 2024-05-10T11:00:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "inventory_list_all", 2024-05-10T11:00:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-10T11:00:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "log_refresh_metadata": { 2024-05-10T11:00:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_refresh_metadata", 2024-05-10T11:00:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-10T11:00:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-10T11:00:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-10T11:00:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-10T11:00:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-10T11:00:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-10T11:00:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-10T11:00:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "*", 2024-05-10T11:00:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-10T11:00:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "max_count_per_host": { 2024-05-10T11:00:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_count_per_host", 2024-05-10T11:00:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "max number of daemons per service per host", 2024-05-10T11:00:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "max_osd_draining_count": { 2024-05-10T11:00:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_osd_draining_count", 2024-05-10T11:00:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-10T11:00:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "migration_current": { 2024-05-10T11:00:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "migration_current", 2024-05-10T11:00:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "internal - do not modify", 2024-05-10T11:00:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "mode": { 2024-05-10T11:00:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mode", 2024-05-10T11:00:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "root", 2024-05-10T11:00:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "cephadm-package", 2024-05-10T11:00:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "root" 2024-05-10T11:00:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "mode for remote execution of cephadm", 2024-05-10T11:00:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "oob_default_addr": { 2024-05-10T11:00:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "oob_default_addr", 2024-05-10T11:00:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "169.254.1.1", 2024-05-10T11:00:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-10T11:00:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "prometheus_alerts_path": { 2024-05-10T11:00:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prometheus_alerts_path", 2024-05-10T11:00:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-10T11:00:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-10T11:00:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_insecure": { 2024-05-10T11:00:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_insecure", 2024-05-10T11:00:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-10T11:00:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_password": { 2024-05-10T11:00:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_password", 2024-05-10T11:00:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-10T11:00:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_url": { 2024-05-10T11:00:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_url", 2024-05-10T11:00:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-10T11:00:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_username": { 2024-05-10T11:00:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_username", 2024-05-10T11:00:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-10T11:00:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "secure_monitoring_stack": { 2024-05-10T11:00:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "secure_monitoring_stack", 2024-05-10T11:00:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-10T11:00:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "service_discovery_port": { 2024-05-10T11:00:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "service_discovery_port", 2024-05-10T11:00:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8765", 2024-05-10T11:00:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "cephadm service discovery port", 2024-05-10T11:00:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "ssh_config_file": { 2024-05-10T11:00:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssh_config_file", 2024-05-10T11:00:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-10T11:00:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "use_agent": { 2024-05-10T11:00:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_agent", 2024-05-10T11:00:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-10T11:00:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "use_repo_digest": { 2024-05-10T11:00:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_repo_digest", 2024-05-10T11:00:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-10T11:00:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_on_failed_host_check": { 2024-05-10T11:00:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_on_failed_host_check", 2024-05-10T11:00:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise a health warning if the host check fails", 2024-05-10T11:00:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_on_stray_daemons": { 2024-05-10T11:00:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_on_stray_daemons", 2024-05-10T11:00:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-10T11:00:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_on_stray_hosts": { 2024-05-10T11:00:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_on_stray_hosts", 2024-05-10T11:00:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-10T11:00:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crash", 2024-05-10T11:00:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "retain_interval": { 2024-05-10T11:00:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retain_interval", 2024-05-10T11:00:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "31536000", 2024-05-10T11:00:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-10T11:00:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_recent_interval": { 2024-05-10T11:00:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_recent_interval", 2024-05-10T11:00:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "1209600", 2024-05-10T11:00:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-10T11:00:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "dashboard", 2024-05-10T11:00:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-10T11:00:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-10T11:00:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "ALERTMANAGER_API_HOST": { 2024-05-10T11:00:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-10T11:00:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-10T11:00:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-10T11:00:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "AUDIT_API_ENABLED": { 2024-05-10T11:00:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "AUDIT_API_ENABLED", 2024-05-10T11:00:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-10T11:00:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-10T11:00:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "ENABLE_BROWSABLE_API": { 2024-05-10T11:00:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-10T11:00:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-10T11:00:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-10T11:00:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-10T11:00:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-10T11:00:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-10T11:00:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-10T11:00:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-10T11:00:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-10T11:00:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-10T11:00:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-10T11:00:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-10T11:00:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-10T11:00:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.188 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-10T11:00:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-10T11:00:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-10T11:00:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-10T11:00:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_PASSWORD": { 2024-05-10T11:00:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-10T11:00:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2024-05-10T11:00:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-10T11:00:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-10T11:00:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_URL": { 2024-05-10T11:00:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_URL", 2024-05-10T11:00:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_USERNAME": { 2024-05-10T11:00:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-10T11:00:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2024-05-10T11:00:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-10T11:00:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-10T11:00:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-10T11:00:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-10T11:00:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-10T11:00:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-10T11:00:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-10T11:00:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-10T11:00:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-10T11:00:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-10T11:00:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "[]", 2024-05-10T11:00:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "MULTICLUSTER_CONFIG": { 2024-05-10T11:00:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-10T11:00:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "{}", 2024-05-10T11:00:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "PROMETHEUS_API_HOST": { 2024-05-10T11:00:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-10T11:00:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-10T11:00:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-10T11:00:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-10T11:00:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-10T11:00:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-10T11:00:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-10T11:00:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-10T11:00:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-10T11:00:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-10T11:00:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-10T11:00:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-10T11:00:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-10T11:00:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.206 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-10T11:00:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-10T11:00:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.207 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-10T11:00:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-10T11:00:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.208 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_ENABLED": { 2024-05-10T11:00:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-10T11:00:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.209 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-10T11:00:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-10T11:00:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-10T11:00:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.210 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-10T11:00:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-10T11:00:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.211 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-10T11:00:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-10T11:00:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8", 2024-05-10T11:00:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.212 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-10T11:00:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-10T11:00:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "45", 2024-05-10T11:00:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_ACCESS_KEY": { 2024-05-10T11:00:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-10T11:00:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.214 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-10T11:00:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-10T11:00:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2024-05-10T11:00:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_SECRET_KEY": { 2024-05-10T11:00:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-10T11:00:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.216 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_SSL_VERIFY": { 2024-05-10T11:00:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-10T11:00:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "UNSAFE_TLS_v1_2": { 2024-05-10T11:00:41.217 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-10T11:00:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-10T11:00:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-10T11:00:41.218 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-10T11:00:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-10T11:00:41.219 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-10T11:00:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-10T11:00:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.220 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2024-05-10T11:00:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "cross_origin_url": { 2024-05-10T11:00:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cross_origin_url", 2024-05-10T11:00:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.221 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "crt_file": { 2024-05-10T11:00:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crt_file", 2024-05-10T11:00:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.222 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "debug": { 2024-05-10T11:00:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "debug", 2024-05-10T11:00:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.223 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Enable/disable debug options", 2024-05-10T11:00:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "jwt_token_ttl": { 2024-05-10T11:00:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "jwt_token_ttl", 2024-05-10T11:00:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "28800", 2024-05-10T11:00:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.224 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "key_file": { 2024-05-10T11:00:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "key_file", 2024-05-10T11:00:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.225 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.226 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.227 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.228 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.229 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.230 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "motd": { 2024-05-10T11:00:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "motd", 2024-05-10T11:00:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "The message of the day", 2024-05-10T11:00:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: "redirect_resolve_ip_addr": { 2024-05-10T11:00:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "redirect_resolve_ip_addr", 2024-05-10T11:00:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "server_addr": { 2024-05-10T11:00:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_addr", 2024-05-10T11:00:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "::", 2024-05-10T11:00:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.233 INFO:teuthology.orchestra.run.smithi107.stdout: "server_port": { 2024-05-10T11:00:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_port", 2024-05-10T11:00:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8080", 2024-05-10T11:00:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.234 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "ssl": { 2024-05-10T11:00:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssl", 2024-05-10T11:00:41.235 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: "ssl_server_port": { 2024-05-10T11:00:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssl_server_port", 2024-05-10T11:00:41.236 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8443", 2024-05-10T11:00:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_behaviour": { 2024-05-10T11:00:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_behaviour", 2024-05-10T11:00:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.237 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "redirect", 2024-05-10T11:00:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: "redirect" 2024-05-10T11:00:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_error_status_code": { 2024-05-10T11:00:41.238 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_error_status_code", 2024-05-10T11:00:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "500", 2024-05-10T11:00:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "400", 2024-05-10T11:00:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "599", 2024-05-10T11:00:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "url_prefix": { 2024-05-10T11:00:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "url_prefix", 2024-05-10T11:00:41.239 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", 2024-05-10T11:00:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "enable_monitoring": { 2024-05-10T11:00:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enable_monitoring", 2024-05-10T11:00:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.241 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "monitor device health metrics", 2024-05-10T11:00:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.242 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.243 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.244 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.245 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.246 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "mark_out_threshold": { 2024-05-10T11:00:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mark_out_threshold", 2024-05-10T11:00:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "2419200", 2024-05-10T11:00:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-10T11:00:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "pool_name": { 2024-05-10T11:00:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pool_name", 2024-05-10T11:00:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "device_health_metrics", 2024-05-10T11:00:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-10T11:00:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "retention_period": { 2024-05-10T11:00:41.248 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retention_period", 2024-05-10T11:00:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "15552000", 2024-05-10T11:00:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how long to retain device health metrics", 2024-05-10T11:00:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "scrape_frequency": { 2024-05-10T11:00:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "scrape_frequency", 2024-05-10T11:00:41.249 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "86400", 2024-05-10T11:00:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-10T11:00:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "self_heal": { 2024-05-10T11:00:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "self_heal", 2024-05-10T11:00:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.250 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-10T11:00:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2024-05-10T11:00:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2024-05-10T11:00:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.251 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2024-05-10T11:00:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to wake up and check device health", 2024-05-10T11:00:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.252 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_threshold": { 2024-05-10T11:00:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_threshold", 2024-05-10T11:00:41.253 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "7257600", 2024-05-10T11:00:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-10T11:00:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "diskprediction_local", 2024-05-10T11:00:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.255 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.256 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.257 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.258 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "predict_interval": { 2024-05-10T11:00:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "predict_interval", 2024-05-10T11:00:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "86400", 2024-05-10T11:00:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "predictor_model": { 2024-05-10T11:00:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "predictor_model", 2024-05-10T11:00:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "prophetstor", 2024-05-10T11:00:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2024-05-10T11:00:41.261 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2024-05-10T11:00:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2024-05-10T11:00:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.262 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.263 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "influx", 2024-05-10T11:00:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": false, 2024-05-10T11:00:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "influxdb python module not found", 2024-05-10T11:00:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "batch_size": { 2024-05-10T11:00:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "batch_size", 2024-05-10T11:00:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5000", 2024-05-10T11:00:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-10T11:00:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.264 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "database": { 2024-05-10T11:00:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "database", 2024-05-10T11:00:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "ceph", 2024-05-10T11:00:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-10T11:00:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.265 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "hostname": { 2024-05-10T11:00:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "hostname", 2024-05-10T11:00:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server hostname", 2024-05-10T11:00:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.266 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2024-05-10T11:00:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2024-05-10T11:00:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "30", 2024-05-10T11:00:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "5", 2024-05-10T11:00:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-10T11:00:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.267 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.268 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.269 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.270 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.271 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "password": { 2024-05-10T11:00:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "password", 2024-05-10T11:00:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.272 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "password of InfluxDB server user", 2024-05-10T11:00:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "port": { 2024-05-10T11:00:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "port", 2024-05-10T11:00:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.273 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8086", 2024-05-10T11:00:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server port", 2024-05-10T11:00:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.274 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "ssl": { 2024-05-10T11:00:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssl", 2024-05-10T11:00:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "false", 2024-05-10T11:00:41.275 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-10T11:00:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "threads": { 2024-05-10T11:00:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "threads", 2024-05-10T11:00:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2024-05-10T11:00:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2024-05-10T11:00:41.276 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "32", 2024-05-10T11:00:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-10T11:00:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "username": { 2024-05-10T11:00:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "username", 2024-05-10T11:00:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.277 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "username of InfluxDB server user", 2024-05-10T11:00:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: "verify_ssl": { 2024-05-10T11:00:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "verify_ssl", 2024-05-10T11:00:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "true", 2024-05-10T11:00:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.278 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-10T11:00:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "insights", 2024-05-10T11:00:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.279 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.280 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.281 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.282 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.283 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.284 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "iostat", 2024-05-10T11:00:41.285 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.286 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.287 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.288 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.289 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.290 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.291 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "k8sevents", 2024-05-10T11:00:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_event_retention_days": { 2024-05-10T11:00:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ceph_event_retention_days", 2024-05-10T11:00:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "7", 2024-05-10T11:00:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-10T11:00:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.292 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "config_check_secs": { 2024-05-10T11:00:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "config_check_secs", 2024-05-10T11:00:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "10", 2024-05-10T11:00:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-10T11:00:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.293 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.294 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.295 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.296 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.297 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.298 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "localpool", 2024-05-10T11:00:41.299 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "failure_domain": { 2024-05-10T11:00:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "failure_domain", 2024-05-10T11:00:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "host", 2024-05-10T11:00:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "failure domain for any created local pool", 2024-05-10T11:00:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-10T11:00:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.301 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.302 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.303 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.304 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: "min_size": { 2024-05-10T11:00:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "min_size", 2024-05-10T11:00:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.305 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "default min_size for any created local pool", 2024-05-10T11:00:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-10T11:00:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "num_rep": { 2024-05-10T11:00:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "num_rep", 2024-05-10T11:00:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.306 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "3", 2024-05-10T11:00:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "default replica count for any created local pool", 2024-05-10T11:00:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "pg_num": { 2024-05-10T11:00:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pg_num", 2024-05-10T11:00:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.307 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "128", 2024-05-10T11:00:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "default pg_num for any created local pool", 2024-05-10T11:00:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "prefix": { 2024-05-10T11:00:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prefix", 2024-05-10T11:00:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.308 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "name prefix for any created local pool", 2024-05-10T11:00:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.309 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "subtree": { 2024-05-10T11:00:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "subtree", 2024-05-10T11:00:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "rack", 2024-05-10T11:00:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.310 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.311 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-10T11:00:41.311 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-10T11:00:41.311 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.311 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.311 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.311 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.311 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mds_autoscaler", 2024-05-10T11:00:41.311 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.314 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.315 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.316 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.317 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.318 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mirroring", 2024-05-10T11:00:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.320 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.321 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.322 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.323 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.324 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.325 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "nfs", 2024-05-10T11:00:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.326 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.327 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.328 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.329 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.330 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.331 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "orchestrator", 2024-05-10T11:00:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: "fail_fs": { 2024-05-10T11:00:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "fail_fs", 2024-05-10T11:00:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.332 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-10T11:00:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.333 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.334 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.335 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.336 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.337 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "orchestrator": { 2024-05-10T11:00:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "orchestrator", 2024-05-10T11:00:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "cephadm", 2024-05-10T11:00:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "rook", 2024-05-10T11:00:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: "test_orchestrator" 2024-05-10T11:00:41.338 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Orchestrator backend", 2024-05-10T11:00:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.339 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "osd_perf_query", 2024-05-10T11:00:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.340 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.341 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.343 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.344 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.345 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "osd_support", 2024-05-10T11:00:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.346 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.347 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.348 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.349 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.350 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.351 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pg_autoscaler", 2024-05-10T11:00:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.352 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.353 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.354 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.355 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.356 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2024-05-10T11:00:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2024-05-10T11:00:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2024-05-10T11:00:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.357 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.358 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "threshold": { 2024-05-10T11:00:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "threshold", 2024-05-10T11:00:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "3.0", 2024-05-10T11:00:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1.0", 2024-05-10T11:00:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "scaling threshold", 2024-05-10T11:00:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-10T11:00:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "progress", 2024-05-10T11:00:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: "allow_pg_recovery_event": { 2024-05-10T11:00:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "allow_pg_recovery_event", 2024-05-10T11:00:41.360 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-10T11:00:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": { 2024-05-10T11:00:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enabled", 2024-05-10T11:00:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.361 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.362 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.363 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.364 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.365 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.366 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: "max_completed_events": { 2024-05-10T11:00:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_completed_events", 2024-05-10T11:00:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "50", 2024-05-10T11:00:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.367 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "number of past completed events to remember", 2024-05-10T11:00:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2024-05-10T11:00:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2024-05-10T11:00:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2024-05-10T11:00:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.368 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how long the module is going to sleep", 2024-05-10T11:00:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.369 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prometheus", 2024-05-10T11:00:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "cache": { 2024-05-10T11:00:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cache", 2024-05-10T11:00:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.370 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "exclude_perf_counters": { 2024-05-10T11:00:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "exclude_perf_counters", 2024-05-10T11:00:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.371 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-10T11:00:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-10T11:00:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.372 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.373 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.374 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.375 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.376 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_stats_pools": { 2024-05-10T11:00:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_stats_pools", 2024-05-10T11:00:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.377 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-10T11:00:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-10T11:00:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.378 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300", 2024-05-10T11:00:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "scrape_interval": { 2024-05-10T11:00:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "scrape_interval", 2024-05-10T11:00:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "15.0", 2024-05-10T11:00:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.379 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "server_addr": { 2024-05-10T11:00:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_addr", 2024-05-10T11:00:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "::", 2024-05-10T11:00:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.380 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-10T11:00:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: "server_port": { 2024-05-10T11:00:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_port", 2024-05-10T11:00:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "9283", 2024-05-10T11:00:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.381 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-10T11:00:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.382 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "stale_cache_strategy": { 2024-05-10T11:00:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "stale_cache_strategy", 2024-05-10T11:00:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "log", 2024-05-10T11:00:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.383 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_behaviour": { 2024-05-10T11:00:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_behaviour", 2024-05-10T11:00:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "default", 2024-05-10T11:00:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "default", 2024-05-10T11:00:41.384 INFO:teuthology.orchestra.run.smithi107.stdout: "error" 2024-05-10T11:00:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_error_status_code": { 2024-05-10T11:00:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_error_status_code", 2024-05-10T11:00:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "500", 2024-05-10T11:00:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "400", 2024-05-10T11:00:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "599", 2024-05-10T11:00:41.385 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_support", 2024-05-10T11:00:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.386 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.387 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.388 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.389 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.390 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "max_concurrent_snap_create": { 2024-05-10T11:00:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_concurrent_snap_create", 2024-05-10T11:00:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.391 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "mirror_snapshot_schedule": { 2024-05-10T11:00:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mirror_snapshot_schedule", 2024-05-10T11:00:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.392 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.393 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "trash_purge_schedule": { 2024-05-10T11:00:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "trash_purge_schedule", 2024-05-10T11:00:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.394 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "restful", 2024-05-10T11:00:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.395 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "enable_auth": { 2024-05-10T11:00:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enable_auth", 2024-05-10T11:00:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "key_file": { 2024-05-10T11:00:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "key_file", 2024-05-10T11:00:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.398 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.399 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.400 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.401 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "server_addr": { 2024-05-10T11:00:41.402 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_addr", 2024-05-10T11:00:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "server_port": { 2024-05-10T11:00:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_port", 2024-05-10T11:00:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.403 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.404 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rgw", 2024-05-10T11:00:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.405 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.406 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.407 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.408 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.409 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.410 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.411 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rook", 2024-05-10T11:00:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.412 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.413 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.414 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.416 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "storage_class": { 2024-05-10T11:00:41.417 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "storage_class", 2024-05-10T11:00:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "local", 2024-05-10T11:00:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-10T11:00:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "selftest", 2024-05-10T11:00:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.419 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.420 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.421 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.422 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.423 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "roption1": { 2024-05-10T11:00:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "roption1", 2024-05-10T11:00:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.424 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "roption2": { 2024-05-10T11:00:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "roption2", 2024-05-10T11:00:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "xyz", 2024-05-10T11:00:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.425 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption1": { 2024-05-10T11:00:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption1", 2024-05-10T11:00:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.426 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption2": { 2024-05-10T11:00:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption2", 2024-05-10T11:00:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption3": { 2024-05-10T11:00:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption3", 2024-05-10T11:00:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption4": { 2024-05-10T11:00:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption4", 2024-05-10T11:00:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.429 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption5": { 2024-05-10T11:00:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption5", 2024-05-10T11:00:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption6": { 2024-05-10T11:00:41.430 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption6", 2024-05-10T11:00:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption7": { 2024-05-10T11:00:41.431 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption7", 2024-05-10T11:00:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2024-05-10T11:00:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "42", 2024-05-10T11:00:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.432 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "testkey": { 2024-05-10T11:00:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "testkey", 2024-05-10T11:00:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.433 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "testlkey": { 2024-05-10T11:00:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "testlkey", 2024-05-10T11:00:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.434 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "testnewline": { 2024-05-10T11:00:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "testnewline", 2024-05-10T11:00:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.435 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smb", 2024-05-10T11:00:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.436 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.437 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.438 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.439 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "update_orchestration": { 2024-05-10T11:00:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "update_orchestration", 2024-05-10T11:00:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-10T11:00:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.443 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "snap_schedule", 2024-05-10T11:00:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "allow_m_granularity": { 2024-05-10T11:00:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "allow_m_granularity", 2024-05-10T11:00:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.444 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "allow minute scheduled snapshots", 2024-05-10T11:00:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "dump_on_update": { 2024-05-10T11:00:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "dump_on_update", 2024-05-10T11:00:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.445 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "dump database to debug log on update", 2024-05-10T11:00:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.446 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.447 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.448 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.449 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.450 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.451 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "stats", 2024-05-10T11:00:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.452 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.453 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.454 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.455 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.456 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.457 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "status", 2024-05-10T11:00:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.458 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.459 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.460 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.461 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.462 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.463 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "telegraf", 2024-05-10T11:00:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.464 INFO:teuthology.orchestra.run.smithi107.stdout: "address": { 2024-05-10T11:00:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "address", 2024-05-10T11:00:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-10T11:00:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2024-05-10T11:00:41.465 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2024-05-10T11:00:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "15", 2024-05-10T11:00:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.466 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.467 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.468 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.469 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.470 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.471 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "telemetry", 2024-05-10T11:00:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_basic": { 2024-05-10T11:00:41.472 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_basic", 2024-05-10T11:00:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-10T11:00:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_crash": { 2024-05-10T11:00:41.473 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_crash", 2024-05-10T11:00:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-10T11:00:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_device": { 2024-05-10T11:00:41.474 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_device", 2024-05-10T11:00:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-10T11:00:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_ident": { 2024-05-10T11:00:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_ident", 2024-05-10T11:00:41.475 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-10T11:00:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_perf": { 2024-05-10T11:00:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_perf", 2024-05-10T11:00:41.476 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-10T11:00:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "contact": { 2024-05-10T11:00:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "contact", 2024-05-10T11:00:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.477 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "description": { 2024-05-10T11:00:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "description", 2024-05-10T11:00:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.478 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "device_url": { 2024-05-10T11:00:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "device_url", 2024-05-10T11:00:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.479 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-10T11:00:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": { 2024-05-10T11:00:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enabled", 2024-05-10T11:00:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.480 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2024-05-10T11:00:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2024-05-10T11:00:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.481 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "24", 2024-05-10T11:00:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "8", 2024-05-10T11:00:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "last_opt_revision": { 2024-05-10T11:00:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "last_opt_revision", 2024-05-10T11:00:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "1", 2024-05-10T11:00:41.482 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "leaderboard": { 2024-05-10T11:00:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "leaderboard", 2024-05-10T11:00:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.483 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "leaderboard_description": { 2024-05-10T11:00:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "leaderboard_description", 2024-05-10T11:00:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.484 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.485 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.486 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.487 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.488 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.489 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "organization": { 2024-05-10T11:00:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "organization", 2024-05-10T11:00:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.490 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "proxy": { 2024-05-10T11:00:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "proxy", 2024-05-10T11:00:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.491 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "url": { 2024-05-10T11:00:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "url", 2024-05-10T11:00:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-10T11:00:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.493 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "test_orchestrator", 2024-05-10T11:00:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.494 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.495 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.496 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.497 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.498 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.499 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "volumes", 2024-05-10T11:00:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.500 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.501 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.502 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.503 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.504 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "max_concurrent_clones": { 2024-05-10T11:00:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_concurrent_clones", 2024-05-10T11:00:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.505 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "4", 2024-05-10T11:00:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-10T11:00:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "periodic_async_work": { 2024-05-10T11:00:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "periodic_async_work", 2024-05-10T11:00:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.506 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Periodically check for async work", 2024-05-10T11:00:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "snapshot_clone_delay": { 2024-05-10T11:00:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "snapshot_clone_delay", 2024-05-10T11:00:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.507 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-10T11:00:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "snapshot_clone_no_wait": { 2024-05-10T11:00:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "snapshot_clone_no_wait", 2024-05-10T11:00:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.508 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-10T11:00:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.509 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix", 2024-05-10T11:00:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.510 INFO:teuthology.orchestra.run.smithi107.stdout: "discovery_interval": { 2024-05-10T11:00:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "discovery_interval", 2024-05-10T11:00:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2024-05-10T11:00:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "100", 2024-05-10T11:00:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "identifier": { 2024-05-10T11:00:41.511 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "identifier", 2024-05-10T11:00:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2024-05-10T11:00:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2024-05-10T11:00:41.512 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2024-05-10T11:00:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.513 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.514 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.515 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.515 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.515 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.515 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.515 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.515 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.515 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.515 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.515 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.515 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.518 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.518 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.518 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.518 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.518 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.518 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.518 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.518 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.518 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.519 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.521 INFO:teuthology.orchestra.run.smithi107.stdout: "zabbix_host": { 2024-05-10T11:00:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix_host", 2024-05-10T11:00:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "zabbix_port": { 2024-05-10T11:00:41.522 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix_port", 2024-05-10T11:00:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10051", 2024-05-10T11:00:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "zabbix_sender": { 2024-05-10T11:00:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix_sender", 2024-05-10T11:00:41.523 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-10T11:00:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-10T11:00:41.524 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: "modules": [ 2024-05-10T11:00:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: "cephadm", 2024-05-10T11:00:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: "dashboard", 2024-05-10T11:00:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: "iostat", 2024-05-10T11:00:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: "nfs", 2024-05-10T11:00:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: "restful" 2024-05-10T11:00:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: "available_modules": [ 2024-05-10T11:00:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "alerts", 2024-05-10T11:00:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.525 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2024-05-10T11:00:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2024-05-10T11:00:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2024-05-10T11:00:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How frequently to reexamine health status", 2024-05-10T11:00:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.526 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.527 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.528 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.529 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.530 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_destination": { 2024-05-10T11:00:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_destination", 2024-05-10T11:00:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.531 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Email address to send alerts to", 2024-05-10T11:00:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_from_name": { 2024-05-10T11:00:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_from_name", 2024-05-10T11:00:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "Ceph", 2024-05-10T11:00:41.532 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Email From: name", 2024-05-10T11:00:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_host": { 2024-05-10T11:00:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_host", 2024-05-10T11:00:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.533 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SMTP server", 2024-05-10T11:00:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_password": { 2024-05-10T11:00:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_password", 2024-05-10T11:00:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.534 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Password to authenticate with", 2024-05-10T11:00:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_port": { 2024-05-10T11:00:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_port", 2024-05-10T11:00:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "465", 2024-05-10T11:00:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.535 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SMTP port", 2024-05-10T11:00:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_sender": { 2024-05-10T11:00:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_sender", 2024-05-10T11:00:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SMTP envelope sender", 2024-05-10T11:00:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_ssl": { 2024-05-10T11:00:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_ssl", 2024-05-10T11:00:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.537 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-10T11:00:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "smtp_user": { 2024-05-10T11:00:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smtp_user", 2024-05-10T11:00:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.538 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "User to authenticate as", 2024-05-10T11:00:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.539 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "balancer", 2024-05-10T11:00:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: "active": { 2024-05-10T11:00:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "active", 2024-05-10T11:00:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.540 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "automatically balance PGs across cluster", 2024-05-10T11:00:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "begin_time": { 2024-05-10T11:00:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "begin_time", 2024-05-10T11:00:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.541 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0000", 2024-05-10T11:00:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "beginning time of day to automatically balance", 2024-05-10T11:00:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-10T11:00:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "begin_weekday": { 2024-05-10T11:00:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "begin_weekday", 2024-05-10T11:00:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2024-05-10T11:00:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.542 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "0", 2024-05-10T11:00:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "6", 2024-05-10T11:00:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-10T11:00:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-10T11:00:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "crush_compat_max_iterations": { 2024-05-10T11:00:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crush_compat_max_iterations", 2024-05-10T11:00:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2024-05-10T11:00:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "25", 2024-05-10T11:00:41.543 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2024-05-10T11:00:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "250", 2024-05-10T11:00:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-10T11:00:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "crush_compat_metrics": { 2024-05-10T11:00:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crush_compat_metrics", 2024-05-10T11:00:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "pgs,objects,bytes", 2024-05-10T11:00:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.544 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-10T11:00:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-10T11:00:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "crush_compat_step": { 2024-05-10T11:00:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crush_compat_step", 2024-05-10T11:00:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0.5", 2024-05-10T11:00:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "0.001", 2024-05-10T11:00:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "0.999", 2024-05-10T11:00:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.545 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "aggressiveness of optimization", 2024-05-10T11:00:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-10T11:00:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "end_time": { 2024-05-10T11:00:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_time", 2024-05-10T11:00:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "2359", 2024-05-10T11:00:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "ending time of day to automatically balance", 2024-05-10T11:00:41.546 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-10T11:00:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "end_weekday": { 2024-05-10T11:00:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "end_weekday", 2024-05-10T11:00:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2024-05-10T11:00:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "0", 2024-05-10T11:00:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "6", 2024-05-10T11:00:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-10T11:00:41.547 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-10T11:00:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.548 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.549 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.550 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.551 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "min_score": { 2024-05-10T11:00:41.552 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "min_score", 2024-05-10T11:00:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-10T11:00:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "mode": { 2024-05-10T11:00:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mode", 2024-05-10T11:00:41.553 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "upmap", 2024-05-10T11:00:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "crush-compat", 2024-05-10T11:00:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "none", 2024-05-10T11:00:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "read", 2024-05-10T11:00:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap", 2024-05-10T11:00:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap-read" 2024-05-10T11:00:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Balancer mode", 2024-05-10T11:00:41.554 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "pool_ids": { 2024-05-10T11:00:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pool_ids", 2024-05-10T11:00:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-10T11:00:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.555 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2024-05-10T11:00:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2024-05-10T11:00:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2024-05-10T11:00:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-10T11:00:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.556 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap_max_deviation": { 2024-05-10T11:00:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "upmap_max_deviation", 2024-05-10T11:00:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2024-05-10T11:00:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2024-05-10T11:00:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-10T11:00:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-10T11:00:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "upmap_max_optimizations": { 2024-05-10T11:00:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "upmap_max_optimizations", 2024-05-10T11:00:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2024-05-10T11:00:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-10T11:00:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.559 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cephadm", 2024-05-10T11:00:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: "agent_down_multiplier": { 2024-05-10T11:00:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "agent_down_multiplier", 2024-05-10T11:00:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "3.0", 2024-05-10T11:00:41.560 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-10T11:00:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "agent_refresh_rate": { 2024-05-10T11:00:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "agent_refresh_rate", 2024-05-10T11:00:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "20", 2024-05-10T11:00:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.561 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-10T11:00:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "agent_starting_port": { 2024-05-10T11:00:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "agent_starting_port", 2024-05-10T11:00:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "4721", 2024-05-10T11:00:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.562 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-10T11:00:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "allow_ptrace": { 2024-05-10T11:00:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "allow_ptrace", 2024-05-10T11:00:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.563 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-10T11:00:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-10T11:00:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: "autotune_interval": { 2024-05-10T11:00:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "autotune_interval", 2024-05-10T11:00:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2024-05-10T11:00:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.564 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-10T11:00:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "autotune_memory_target_ratio": { 2024-05-10T11:00:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "autotune_memory_target_ratio", 2024-05-10T11:00:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0.7", 2024-05-10T11:00:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-10T11:00:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "cephadm_log_destination": { 2024-05-10T11:00:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cephadm_log_destination", 2024-05-10T11:00:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.566 INFO:teuthology.orchestra.run.smithi107.stdout: "file", 2024-05-10T11:00:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: "file,syslog", 2024-05-10T11:00:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: "syslog" 2024-05-10T11:00:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-10T11:00:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: "cgroups_split": { 2024-05-10T11:00:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cgroups_split", 2024-05-10T11:00:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.567 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-10T11:00:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "config_checks_enabled": { 2024-05-10T11:00:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "config_checks_enabled", 2024-05-10T11:00:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.568 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-10T11:00:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "config_dashboard": { 2024-05-10T11:00:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "config_dashboard", 2024-05-10T11:00:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.569 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-10T11:00:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_alertmanager": { 2024-05-10T11:00:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_alertmanager", 2024-05-10T11:00:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-10T11:00:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.570 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2024-05-10T11:00:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_base": { 2024-05-10T11:00:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_base", 2024-05-10T11:00:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-10T11:00:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.571 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Container image name, without the tag", 2024-05-10T11:00:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_elasticsearch": { 2024-05-10T11:00:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_elasticsearch", 2024-05-10T11:00:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-10T11:00:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "elasticsearch container image", 2024-05-10T11:00:41.572 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_grafana": { 2024-05-10T11:00:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_grafana", 2024-05-10T11:00:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-10T11:00:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2024-05-10T11:00:41.573 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_haproxy": { 2024-05-10T11:00:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_haproxy", 2024-05-10T11:00:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-10T11:00:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "HAproxy container image", 2024-05-10T11:00:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.574 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_jaeger_agent": { 2024-05-10T11:00:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_jaeger_agent", 2024-05-10T11:00:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-10T11:00:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Jaeger agent container image", 2024-05-10T11:00:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.575 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_jaeger_collector": { 2024-05-10T11:00:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_jaeger_collector", 2024-05-10T11:00:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-10T11:00:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Jaeger collector container image", 2024-05-10T11:00:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.576 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_jaeger_query": { 2024-05-10T11:00:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_jaeger_query", 2024-05-10T11:00:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-10T11:00:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Jaeger query container image", 2024-05-10T11:00:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_keepalived": { 2024-05-10T11:00:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_keepalived", 2024-05-10T11:00:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-10T11:00:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Keepalived container image", 2024-05-10T11:00:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.578 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_loki": { 2024-05-10T11:00:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_loki", 2024-05-10T11:00:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-10T11:00:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Loki container image", 2024-05-10T11:00:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.579 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_node_exporter": { 2024-05-10T11:00:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_node_exporter", 2024-05-10T11:00:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-10T11:00:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2024-05-10T11:00:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_nvmeof": { 2024-05-10T11:00:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_nvmeof", 2024-05-10T11:00:41.580 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-10T11:00:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Nvme-of container image", 2024-05-10T11:00:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_prometheus": { 2024-05-10T11:00:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_prometheus", 2024-05-10T11:00:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.581 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-10T11:00:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Prometheus container image", 2024-05-10T11:00:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_promtail": { 2024-05-10T11:00:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_promtail", 2024-05-10T11:00:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.582 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-10T11:00:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Promtail container image", 2024-05-10T11:00:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_samba": { 2024-05-10T11:00:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_samba", 2024-05-10T11:00:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.583 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-10T11:00:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Samba/SMB container image", 2024-05-10T11:00:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: "container_image_snmp_gateway": { 2024-05-10T11:00:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_image_snmp_gateway", 2024-05-10T11:00:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-10T11:00:41.584 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "SNMP Gateway container image", 2024-05-10T11:00:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "container_init": { 2024-05-10T11:00:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "container_init", 2024-05-10T11:00:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.585 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Run podman/docker with `--init`", 2024-05-10T11:00:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "daemon_cache_timeout": { 2024-05-10T11:00:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "daemon_cache_timeout", 2024-05-10T11:00:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2024-05-10T11:00:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.586 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-10T11:00:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "default_cephadm_command_timeout": { 2024-05-10T11:00:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "default_cephadm_command_timeout", 2024-05-10T11:00:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "900", 2024-05-10T11:00:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-10T11:00:41.587 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "default_registry": { 2024-05-10T11:00:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "default_registry", 2024-05-10T11:00:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "docker.io", 2024-05-10T11:00:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-10T11:00:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.588 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "device_cache_timeout": { 2024-05-10T11:00:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "device_cache_timeout", 2024-05-10T11:00:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "1800", 2024-05-10T11:00:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache device inventory", 2024-05-10T11:00:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: "device_enhanced_scan": { 2024-05-10T11:00:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "device_enhanced_scan", 2024-05-10T11:00:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-10T11:00:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "facts_cache_timeout": { 2024-05-10T11:00:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "facts_cache_timeout", 2024-05-10T11:00:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2024-05-10T11:00:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "seconds to cache host facts data", 2024-05-10T11:00:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.591 INFO:teuthology.orchestra.run.smithi107.stdout: "grafana_dashboards_path": { 2024-05-10T11:00:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "grafana_dashboards_path", 2024-05-10T11:00:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-10T11:00:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-10T11:00:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "host_check_interval": { 2024-05-10T11:00:41.592 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "host_check_interval", 2024-05-10T11:00:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2024-05-10T11:00:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to perform a host check", 2024-05-10T11:00:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "hw_monitoring": { 2024-05-10T11:00:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "hw_monitoring", 2024-05-10T11:00:41.593 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-10T11:00:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "inventory_list_all": { 2024-05-10T11:00:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "inventory_list_all", 2024-05-10T11:00:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.594 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-10T11:00:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.595 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.596 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: "log_refresh_metadata": { 2024-05-10T11:00:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_refresh_metadata", 2024-05-10T11:00:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-10T11:00:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-10T11:00:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.598 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.599 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.600 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-10T11:00:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-10T11:00:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-10T11:00:41.601 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-10T11:00:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-10T11:00:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "*", 2024-05-10T11:00:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-10T11:00:41.602 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "max_count_per_host": { 2024-05-10T11:00:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_count_per_host", 2024-05-10T11:00:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "max number of daemons per service per host", 2024-05-10T11:00:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.603 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.604 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.604 INFO:teuthology.orchestra.run.smithi107.stdout: "max_osd_draining_count": { 2024-05-10T11:00:41.604 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_osd_draining_count", 2024-05-10T11:00:41.604 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.604 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.604 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.604 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:41.604 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.604 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.604 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-10T11:00:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "migration_current": { 2024-05-10T11:00:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "migration_current", 2024-05-10T11:00:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.605 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "internal - do not modify", 2024-05-10T11:00:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "mode": { 2024-05-10T11:00:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mode", 2024-05-10T11:00:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "root", 2024-05-10T11:00:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.606 INFO:teuthology.orchestra.run.smithi107.stdout: "cephadm-package", 2024-05-10T11:00:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: "root" 2024-05-10T11:00:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "mode for remote execution of cephadm", 2024-05-10T11:00:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: "oob_default_addr": { 2024-05-10T11:00:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "oob_default_addr", 2024-05-10T11:00:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "169.254.1.1", 2024-05-10T11:00:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.607 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-10T11:00:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "prometheus_alerts_path": { 2024-05-10T11:00:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prometheus_alerts_path", 2024-05-10T11:00:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-10T11:00:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.608 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-10T11:00:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_insecure": { 2024-05-10T11:00:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_insecure", 2024-05-10T11:00:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.609 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-10T11:00:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_password": { 2024-05-10T11:00:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_password", 2024-05-10T11:00:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-10T11:00:41.610 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_url": { 2024-05-10T11:00:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_url", 2024-05-10T11:00:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-10T11:00:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.611 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "registry_username": { 2024-05-10T11:00:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "registry_username", 2024-05-10T11:00:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-10T11:00:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "secure_monitoring_stack": { 2024-05-10T11:00:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "secure_monitoring_stack", 2024-05-10T11:00:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-10T11:00:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "service_discovery_port": { 2024-05-10T11:00:41.613 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "service_discovery_port", 2024-05-10T11:00:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8765", 2024-05-10T11:00:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "cephadm service discovery port", 2024-05-10T11:00:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.614 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "ssh_config_file": { 2024-05-10T11:00:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssh_config_file", 2024-05-10T11:00:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.615 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-10T11:00:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "use_agent": { 2024-05-10T11:00:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_agent", 2024-05-10T11:00:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.616 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-10T11:00:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "use_repo_digest": { 2024-05-10T11:00:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "use_repo_digest", 2024-05-10T11:00:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.617 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-10T11:00:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_on_failed_host_check": { 2024-05-10T11:00:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_on_failed_host_check", 2024-05-10T11:00:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.618 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise a health warning if the host check fails", 2024-05-10T11:00:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_on_stray_daemons": { 2024-05-10T11:00:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_on_stray_daemons", 2024-05-10T11:00:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-10T11:00:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_on_stray_hosts": { 2024-05-10T11:00:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_on_stray_hosts", 2024-05-10T11:00:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-10T11:00:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crash", 2024-05-10T11:00:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "retain_interval": { 2024-05-10T11:00:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retain_interval", 2024-05-10T11:00:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "31536000", 2024-05-10T11:00:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-10T11:00:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_recent_interval": { 2024-05-10T11:00:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_recent_interval", 2024-05-10T11:00:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "1209600", 2024-05-10T11:00:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-10T11:00:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "dashboard", 2024-05-10T11:00:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-10T11:00:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-10T11:00:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "ALERTMANAGER_API_HOST": { 2024-05-10T11:00:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-10T11:00:41.630 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-10T11:00:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-10T11:00:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.631 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "AUDIT_API_ENABLED": { 2024-05-10T11:00:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "AUDIT_API_ENABLED", 2024-05-10T11:00:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.632 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-10T11:00:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-10T11:00:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.633 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "ENABLE_BROWSABLE_API": { 2024-05-10T11:00:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-10T11:00:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.634 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-10T11:00:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-10T11:00:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.635 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-10T11:00:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-10T11:00:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.636 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-10T11:00:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-10T11:00:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.637 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-10T11:00:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-10T11:00:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.638 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-10T11:00:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-10T11:00:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.639 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-10T11:00:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-10T11:00:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.640 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-10T11:00:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-10T11:00:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.641 INFO:teuthology.orchestra.run.smithi107.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-10T11:00:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-10T11:00:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_PASSWORD": { 2024-05-10T11:00:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-10T11:00:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2024-05-10T11:00:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-10T11:00:41.643 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-10T11:00:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_URL": { 2024-05-10T11:00:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_URL", 2024-05-10T11:00:41.644 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_API_USERNAME": { 2024-05-10T11:00:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-10T11:00:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.645 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2024-05-10T11:00:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-10T11:00:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-10T11:00:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.646 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-10T11:00:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-10T11:00:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.647 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-10T11:00:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-10T11:00:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.648 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-10T11:00:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-10T11:00:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.649 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-10T11:00:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-10T11:00:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.650 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "[]", 2024-05-10T11:00:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: "MULTICLUSTER_CONFIG": { 2024-05-10T11:00:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-10T11:00:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.651 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "{}", 2024-05-10T11:00:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "PROMETHEUS_API_HOST": { 2024-05-10T11:00:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-10T11:00:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.652 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-10T11:00:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-10T11:00:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.653 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-10T11:00:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-10T11:00:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.654 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-10T11:00:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-10T11:00:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.655 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-10T11:00:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-10T11:00:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.656 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-10T11:00:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-10T11:00:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.657 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-10T11:00:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-10T11:00:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.658 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-10T11:00:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-10T11:00:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.659 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-10T11:00:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-10T11:00:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_ENABLED": { 2024-05-10T11:00:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-10T11:00:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.661 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-10T11:00:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-10T11:00:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-10T11:00:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-10T11:00:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-10T11:00:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.663 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-10T11:00:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-10T11:00:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8", 2024-05-10T11:00:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.664 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-10T11:00:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-10T11:00:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "45", 2024-05-10T11:00:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_ACCESS_KEY": { 2024-05-10T11:00:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-10T11:00:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.666 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-10T11:00:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-10T11:00:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "admin", 2024-05-10T11:00:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_SECRET_KEY": { 2024-05-10T11:00:41.667 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-10T11:00:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "RGW_API_SSL_VERIFY": { 2024-05-10T11:00:41.668 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-10T11:00:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "UNSAFE_TLS_v1_2": { 2024-05-10T11:00:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-10T11:00:41.669 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-10T11:00:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-10T11:00:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.670 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-10T11:00:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-10T11:00:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.671 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-10T11:00:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-10T11:00:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.672 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2024-05-10T11:00:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "cross_origin_url": { 2024-05-10T11:00:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cross_origin_url", 2024-05-10T11:00:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.673 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "crt_file": { 2024-05-10T11:00:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "crt_file", 2024-05-10T11:00:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.674 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "debug": { 2024-05-10T11:00:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "debug", 2024-05-10T11:00:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.675 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Enable/disable debug options", 2024-05-10T11:00:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "jwt_token_ttl": { 2024-05-10T11:00:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "jwt_token_ttl", 2024-05-10T11:00:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "28800", 2024-05-10T11:00:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.676 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "key_file": { 2024-05-10T11:00:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "key_file", 2024-05-10T11:00:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.677 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.678 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.680 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "motd": { 2024-05-10T11:00:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "motd", 2024-05-10T11:00:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "The message of the day", 2024-05-10T11:00:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.683 INFO:teuthology.orchestra.run.smithi107.stdout: "redirect_resolve_ip_addr": { 2024-05-10T11:00:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "redirect_resolve_ip_addr", 2024-05-10T11:00:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "server_addr": { 2024-05-10T11:00:41.684 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_addr", 2024-05-10T11:00:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "::", 2024-05-10T11:00:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "server_port": { 2024-05-10T11:00:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_port", 2024-05-10T11:00:41.685 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8080", 2024-05-10T11:00:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.686 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "ssl": { 2024-05-10T11:00:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssl", 2024-05-10T11:00:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.687 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "ssl_server_port": { 2024-05-10T11:00:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssl_server_port", 2024-05-10T11:00:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.688 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8443", 2024-05-10T11:00:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_behaviour": { 2024-05-10T11:00:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_behaviour", 2024-05-10T11:00:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "redirect", 2024-05-10T11:00:41.689 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: "redirect" 2024-05-10T11:00:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_error_status_code": { 2024-05-10T11:00:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_error_status_code", 2024-05-10T11:00:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.690 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "500", 2024-05-10T11:00:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "400", 2024-05-10T11:00:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "599", 2024-05-10T11:00:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "url_prefix": { 2024-05-10T11:00:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "url_prefix", 2024-05-10T11:00:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.691 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", 2024-05-10T11:00:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.692 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "enable_monitoring": { 2024-05-10T11:00:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enable_monitoring", 2024-05-10T11:00:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "monitor device health metrics", 2024-05-10T11:00:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.693 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.694 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.695 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.696 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.697 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: "mark_out_threshold": { 2024-05-10T11:00:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mark_out_threshold", 2024-05-10T11:00:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.698 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "2419200", 2024-05-10T11:00:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-10T11:00:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "pool_name": { 2024-05-10T11:00:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pool_name", 2024-05-10T11:00:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.699 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "device_health_metrics", 2024-05-10T11:00:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-10T11:00:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "retention_period": { 2024-05-10T11:00:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "retention_period", 2024-05-10T11:00:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "15552000", 2024-05-10T11:00:41.700 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how long to retain device health metrics", 2024-05-10T11:00:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "scrape_frequency": { 2024-05-10T11:00:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "scrape_frequency", 2024-05-10T11:00:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "86400", 2024-05-10T11:00:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.701 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-10T11:00:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "self_heal": { 2024-05-10T11:00:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "self_heal", 2024-05-10T11:00:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.702 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-10T11:00:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2024-05-10T11:00:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2024-05-10T11:00:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2024-05-10T11:00:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.703 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how frequently to wake up and check device health", 2024-05-10T11:00:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.704 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "warn_threshold": { 2024-05-10T11:00:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "warn_threshold", 2024-05-10T11:00:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "7257600", 2024-05-10T11:00:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-10T11:00:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.705 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "diskprediction_local", 2024-05-10T11:00:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.706 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.708 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.709 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.710 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "predict_interval": { 2024-05-10T11:00:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "predict_interval", 2024-05-10T11:00:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "86400", 2024-05-10T11:00:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.711 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "predictor_model": { 2024-05-10T11:00:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "predictor_model", 2024-05-10T11:00:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "prophetstor", 2024-05-10T11:00:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.712 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2024-05-10T11:00:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2024-05-10T11:00:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "600", 2024-05-10T11:00:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.713 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.714 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "influx", 2024-05-10T11:00:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": false, 2024-05-10T11:00:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "influxdb python module not found", 2024-05-10T11:00:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: "batch_size": { 2024-05-10T11:00:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "batch_size", 2024-05-10T11:00:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.715 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5000", 2024-05-10T11:00:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-10T11:00:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "database": { 2024-05-10T11:00:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "database", 2024-05-10T11:00:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "ceph", 2024-05-10T11:00:41.716 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-10T11:00:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "hostname": { 2024-05-10T11:00:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "hostname", 2024-05-10T11:00:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.717 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server hostname", 2024-05-10T11:00:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2024-05-10T11:00:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2024-05-10T11:00:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "30", 2024-05-10T11:00:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "5", 2024-05-10T11:00:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.718 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-10T11:00:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.719 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.720 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.721 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.722 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "password": { 2024-05-10T11:00:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "password", 2024-05-10T11:00:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "password of InfluxDB server user", 2024-05-10T11:00:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "port": { 2024-05-10T11:00:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "port", 2024-05-10T11:00:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "8086", 2024-05-10T11:00:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "InfluxDB server port", 2024-05-10T11:00:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.726 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: "ssl": { 2024-05-10T11:00:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ssl", 2024-05-10T11:00:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "false", 2024-05-10T11:00:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-10T11:00:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.727 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "threads": { 2024-05-10T11:00:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "threads", 2024-05-10T11:00:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2024-05-10T11:00:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2024-05-10T11:00:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "32", 2024-05-10T11:00:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-10T11:00:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.728 INFO:teuthology.orchestra.run.smithi107.stdout: "username": { 2024-05-10T11:00:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "username", 2024-05-10T11:00:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "username of InfluxDB server user", 2024-05-10T11:00:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "verify_ssl": { 2024-05-10T11:00:41.729 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "verify_ssl", 2024-05-10T11:00:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "true", 2024-05-10T11:00:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-10T11:00:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "insights", 2024-05-10T11:00:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.731 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.732 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.733 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.734 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.735 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.736 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "iostat", 2024-05-10T11:00:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.737 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.739 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.740 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.741 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.742 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "k8sevents", 2024-05-10T11:00:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_event_retention_days": { 2024-05-10T11:00:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "ceph_event_retention_days", 2024-05-10T11:00:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.743 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "7", 2024-05-10T11:00:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-10T11:00:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: "config_check_secs": { 2024-05-10T11:00:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "config_check_secs", 2024-05-10T11:00:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.744 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "10", 2024-05-10T11:00:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-10T11:00:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.745 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.746 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.747 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.748 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.749 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.750 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "localpool", 2024-05-10T11:00:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.751 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "failure_domain": { 2024-05-10T11:00:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "failure_domain", 2024-05-10T11:00:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "host", 2024-05-10T11:00:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "failure domain for any created local pool", 2024-05-10T11:00:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-10T11:00:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.753 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.754 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.755 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.756 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "min_size": { 2024-05-10T11:00:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "min_size", 2024-05-10T11:00:41.757 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "default min_size for any created local pool", 2024-05-10T11:00:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-10T11:00:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "num_rep": { 2024-05-10T11:00:41.758 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "num_rep", 2024-05-10T11:00:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "3", 2024-05-10T11:00:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "default replica count for any created local pool", 2024-05-10T11:00:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: "pg_num": { 2024-05-10T11:00:41.759 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pg_num", 2024-05-10T11:00:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "128", 2024-05-10T11:00:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "default pg_num for any created local pool", 2024-05-10T11:00:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "prefix": { 2024-05-10T11:00:41.760 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prefix", 2024-05-10T11:00:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "name prefix for any created local pool", 2024-05-10T11:00:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.761 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: "subtree": { 2024-05-10T11:00:41.762 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "subtree", 2024-05-10T11:00:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "rack", 2024-05-10T11:00:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-10T11:00:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-10T11:00:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mds_autoscaler", 2024-05-10T11:00:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.764 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.765 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.767 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.768 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.769 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mirroring", 2024-05-10T11:00:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.770 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.771 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.772 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.773 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.774 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.775 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "nfs", 2024-05-10T11:00:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.776 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.777 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.778 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.779 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.780 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.781 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "orchestrator", 2024-05-10T11:00:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.782 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "fail_fs": { 2024-05-10T11:00:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "fail_fs", 2024-05-10T11:00:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-10T11:00:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.783 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.784 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.785 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.786 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.787 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "orchestrator": { 2024-05-10T11:00:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "orchestrator", 2024-05-10T11:00:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.788 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: "cephadm", 2024-05-10T11:00:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: "rook", 2024-05-10T11:00:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: "test_orchestrator" 2024-05-10T11:00:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Orchestrator backend", 2024-05-10T11:00:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.789 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "osd_perf_query", 2024-05-10T11:00:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.791 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.792 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.793 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.794 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.795 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.796 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "osd_support", 2024-05-10T11:00:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.797 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.799 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.800 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.801 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.802 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "pg_autoscaler", 2024-05-10T11:00:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.803 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.804 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.806 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.807 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2024-05-10T11:00:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2024-05-10T11:00:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2024-05-10T11:00:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.808 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.809 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "threshold": { 2024-05-10T11:00:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "threshold", 2024-05-10T11:00:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "3.0", 2024-05-10T11:00:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1.0", 2024-05-10T11:00:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.810 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "scaling threshold", 2024-05-10T11:00:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-10T11:00:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "progress", 2024-05-10T11:00:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: "allow_pg_recovery_event": { 2024-05-10T11:00:41.811 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "allow_pg_recovery_event", 2024-05-10T11:00:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-10T11:00:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": { 2024-05-10T11:00:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enabled", 2024-05-10T11:00:41.812 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.813 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.814 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.815 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.816 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.817 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "max_completed_events": { 2024-05-10T11:00:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_completed_events", 2024-05-10T11:00:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "50", 2024-05-10T11:00:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.818 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "number of past completed events to remember", 2024-05-10T11:00:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "sleep_interval": { 2024-05-10T11:00:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sleep_interval", 2024-05-10T11:00:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "5", 2024-05-10T11:00:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.819 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "how long the module is going to sleep", 2024-05-10T11:00:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.820 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "prometheus", 2024-05-10T11:00:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: "cache": { 2024-05-10T11:00:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "cache", 2024-05-10T11:00:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.821 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "exclude_perf_counters": { 2024-05-10T11:00:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "exclude_perf_counters", 2024-05-10T11:00:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.822 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-10T11:00:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-10T11:00:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.823 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.825 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.826 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.827 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_stats_pools": { 2024-05-10T11:00:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_stats_pools", 2024-05-10T11:00:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.828 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-10T11:00:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-10T11:00:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "300", 2024-05-10T11:00:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.829 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "scrape_interval": { 2024-05-10T11:00:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "scrape_interval", 2024-05-10T11:00:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "15.0", 2024-05-10T11:00:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.830 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "server_addr": { 2024-05-10T11:00:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_addr", 2024-05-10T11:00:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "::", 2024-05-10T11:00:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-10T11:00:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.831 INFO:teuthology.orchestra.run.smithi107.stdout: "server_port": { 2024-05-10T11:00:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_port", 2024-05-10T11:00:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "9283", 2024-05-10T11:00:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-10T11:00:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.832 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "stale_cache_strategy": { 2024-05-10T11:00:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "stale_cache_strategy", 2024-05-10T11:00:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.833 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "log", 2024-05-10T11:00:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_behaviour": { 2024-05-10T11:00:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_behaviour", 2024-05-10T11:00:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.834 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "default", 2024-05-10T11:00:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "default", 2024-05-10T11:00:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "error" 2024-05-10T11:00:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "standby_error_status_code": { 2024-05-10T11:00:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "standby_error_status_code", 2024-05-10T11:00:41.835 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "500", 2024-05-10T11:00:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "400", 2024-05-10T11:00:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "599", 2024-05-10T11:00:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.836 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_support", 2024-05-10T11:00:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.837 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.838 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.839 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.840 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "max_concurrent_snap_create": { 2024-05-10T11:00:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_concurrent_snap_create", 2024-05-10T11:00:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10", 2024-05-10T11:00:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: "mirror_snapshot_schedule": { 2024-05-10T11:00:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "mirror_snapshot_schedule", 2024-05-10T11:00:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.843 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "trash_purge_schedule": { 2024-05-10T11:00:41.844 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "trash_purge_schedule", 2024-05-10T11:00:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "restful", 2024-05-10T11:00:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "enable_auth": { 2024-05-10T11:00:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enable_auth", 2024-05-10T11:00:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.846 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "key_file": { 2024-05-10T11:00:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "key_file", 2024-05-10T11:00:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.847 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.848 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.849 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.850 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.851 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "server_addr": { 2024-05-10T11:00:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_addr", 2024-05-10T11:00:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.852 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "server_port": { 2024-05-10T11:00:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "server_port", 2024-05-10T11:00:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.853 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.854 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rgw", 2024-05-10T11:00:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.855 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.856 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.857 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.858 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.859 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.860 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rook", 2024-05-10T11:00:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.861 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.862 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.863 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.864 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.865 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.866 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "storage_class": { 2024-05-10T11:00:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "storage_class", 2024-05-10T11:00:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.867 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "local", 2024-05-10T11:00:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-10T11:00:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "selftest", 2024-05-10T11:00:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.868 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.869 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.869 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.869 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.869 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.869 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.869 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.869 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.869 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.869 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.869 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.869 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.869 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.870 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.870 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.870 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.870 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.870 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.870 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.870 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.870 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.870 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.870 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.872 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.873 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: "roption1": { 2024-05-10T11:00:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "roption1", 2024-05-10T11:00:41.874 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "roption2": { 2024-05-10T11:00:41.875 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "roption2", 2024-05-10T11:00:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "xyz", 2024-05-10T11:00:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.876 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption1": { 2024-05-10T11:00:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption1", 2024-05-10T11:00:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption2": { 2024-05-10T11:00:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption2", 2024-05-10T11:00:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.878 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption3": { 2024-05-10T11:00:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption3", 2024-05-10T11:00:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "float", 2024-05-10T11:00:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.879 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption4": { 2024-05-10T11:00:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption4", 2024-05-10T11:00:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.880 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption5": { 2024-05-10T11:00:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption5", 2024-05-10T11:00:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.881 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.882 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.882 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.882 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.882 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.882 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.882 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption6": { 2024-05-10T11:00:41.882 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption6", 2024-05-10T11:00:41.882 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.882 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.882 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.882 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: "rwoption7": { 2024-05-10T11:00:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rwoption7", 2024-05-10T11:00:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.883 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "1", 2024-05-10T11:00:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "42", 2024-05-10T11:00:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.884 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.885 INFO:teuthology.orchestra.run.smithi107.stdout: "testkey": { 2024-05-10T11:00:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "testkey", 2024-05-10T11:00:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.886 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: "testlkey": { 2024-05-10T11:00:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "testlkey", 2024-05-10T11:00:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.887 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: "testnewline": { 2024-05-10T11:00:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "testnewline", 2024-05-10T11:00:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.888 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "smb", 2024-05-10T11:00:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.889 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.890 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.891 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.892 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.892 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.892 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.892 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.892 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.892 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.892 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.892 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.892 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.892 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.892 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.893 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.894 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.894 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.894 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.894 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.894 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.894 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.894 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.894 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.894 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.894 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.894 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.895 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: "update_orchestration": { 2024-05-10T11:00:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "update_orchestration", 2024-05-10T11:00:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.896 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-10T11:00:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.897 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "snap_schedule", 2024-05-10T11:00:41.898 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.898 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.898 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.898 INFO:teuthology.orchestra.run.smithi107.stdout: "allow_m_granularity": { 2024-05-10T11:00:41.898 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "allow_m_granularity", 2024-05-10T11:00:41.898 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.898 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.898 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.898 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.898 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.898 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.898 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "allow minute scheduled snapshots", 2024-05-10T11:00:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "dump_on_update": { 2024-05-10T11:00:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "dump_on_update", 2024-05-10T11:00:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.899 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "dump database to debug log on update", 2024-05-10T11:00:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.900 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.901 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.902 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.903 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.904 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.905 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.906 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "stats", 2024-05-10T11:00:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.907 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.908 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.909 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.910 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.910 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.910 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.910 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.910 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.910 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.910 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.910 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.910 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.910 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.910 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.911 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.912 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.913 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.914 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.914 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.914 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.914 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "status", 2024-05-10T11:00:41.914 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.914 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.914 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.914 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.914 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.914 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.915 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.916 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.917 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.918 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.919 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.920 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "telegraf", 2024-05-10T11:00:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.921 INFO:teuthology.orchestra.run.smithi107.stdout: "address": { 2024-05-10T11:00:41.922 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "address", 2024-05-10T11:00:41.922 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.922 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.922 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.922 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-10T11:00:41.922 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.922 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.926 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.926 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.926 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.926 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.926 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.926 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2024-05-10T11:00:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2024-05-10T11:00:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "15", 2024-05-10T11:00:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.928 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.929 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.930 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.931 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.932 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.932 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.932 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.932 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.932 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.932 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.932 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.932 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.932 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.932 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.932 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.933 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.934 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.934 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.934 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.934 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.934 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.934 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.934 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.934 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.934 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "telemetry", 2024-05-10T11:00:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_basic": { 2024-05-10T11:00:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_basic", 2024-05-10T11:00:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.935 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-10T11:00:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_crash": { 2024-05-10T11:00:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_crash", 2024-05-10T11:00:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.936 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-10T11:00:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_device": { 2024-05-10T11:00:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_device", 2024-05-10T11:00:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.937 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.938 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.938 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.938 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.938 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-10T11:00:41.938 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.938 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.938 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.938 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_ident": { 2024-05-10T11:00:41.938 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_ident", 2024-05-10T11:00:41.938 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-10T11:00:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.939 INFO:teuthology.orchestra.run.smithi107.stdout: "channel_perf": { 2024-05-10T11:00:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "channel_perf", 2024-05-10T11:00:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-10T11:00:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "contact": { 2024-05-10T11:00:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "contact", 2024-05-10T11:00:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.941 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.942 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.942 INFO:teuthology.orchestra.run.smithi107.stdout: "description": { 2024-05-10T11:00:41.942 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "description", 2024-05-10T11:00:41.942 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.942 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.942 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.942 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.942 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.942 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.942 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.942 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: "device_url": { 2024-05-10T11:00:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "device_url", 2024-05-10T11:00:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-10T11:00:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.943 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "enabled": { 2024-05-10T11:00:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "enabled", 2024-05-10T11:00:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.944 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.945 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.945 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.945 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.945 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.945 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.945 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2024-05-10T11:00:41.945 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2024-05-10T11:00:41.945 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.945 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.945 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.945 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "24", 2024-05-10T11:00:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "8", 2024-05-10T11:00:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "last_opt_revision": { 2024-05-10T11:00:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "last_opt_revision", 2024-05-10T11:00:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.946 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "1", 2024-05-10T11:00:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: "leaderboard": { 2024-05-10T11:00:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "leaderboard", 2024-05-10T11:00:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.947 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.948 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.948 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.948 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.948 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.948 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.948 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.948 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.948 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.948 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.948 INFO:teuthology.orchestra.run.smithi107.stdout: "leaderboard_description": { 2024-05-10T11:00:41.948 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "leaderboard_description", 2024-05-10T11:00:41.949 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.949 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.949 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.949 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.949 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.949 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.949 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.949 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.949 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.950 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.950 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.950 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.950 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.950 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "organization": { 2024-05-10T11:00:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "organization", 2024-05-10T11:00:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "proxy": { 2024-05-10T11:00:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "proxy", 2024-05-10T11:00:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "url": { 2024-05-10T11:00:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "url", 2024-05-10T11:00:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-10T11:00:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "test_orchestrator", 2024-05-10T11:00:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "volumes", 2024-05-10T11:00:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "max_concurrent_clones": { 2024-05-10T11:00:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "max_concurrent_clones", 2024-05-10T11:00:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "4", 2024-05-10T11:00:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-10T11:00:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "periodic_async_work": { 2024-05-10T11:00:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "periodic_async_work", 2024-05-10T11:00:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Periodically check for async work", 2024-05-10T11:00:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "snapshot_clone_delay": { 2024-05-10T11:00:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "snapshot_clone_delay", 2024-05-10T11:00:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-10T11:00:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: "snapshot_clone_no_wait": { 2024-05-10T11:00:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "snapshot_clone_no_wait", 2024-05-10T11:00:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "True", 2024-05-10T11:00:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-10T11:00:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix", 2024-05-10T11:00:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: "can_run": true, 2024-05-10T11:00:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: "error_string": "", 2024-05-10T11:00:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "module_options": { 2024-05-10T11:00:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "discovery_interval": { 2024-05-10T11:00:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "discovery_interval", 2024-05-10T11:00:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "uint", 2024-05-10T11:00:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "100", 2024-05-10T11:00:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "identifier": { 2024-05-10T11:00:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "identifier", 2024-05-10T11:00:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: "interval": { 2024-05-10T11:00:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "interval", 2024-05-10T11:00:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "secs", 2024-05-10T11:00:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "60", 2024-05-10T11:00:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "log_level": { 2024-05-10T11:00:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_level", 2024-05-10T11:00:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster": { 2024-05-10T11:00:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster", 2024-05-10T11:00:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_cluster_level": { 2024-05-10T11:00:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_cluster_level", 2024-05-10T11:00:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "info", 2024-05-10T11:00:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [ 2024-05-10T11:00:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "", 2024-05-10T11:00:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "critical", 2024-05-10T11:00:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "debug", 2024-05-10T11:00:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "error", 2024-05-10T11:00:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "info", 2024-05-10T11:00:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "warning" 2024-05-10T11:00:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "log_to_file": { 2024-05-10T11:00:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "log_to_file", 2024-05-10T11:00:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "bool", 2024-05-10T11:00:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "False", 2024-05-10T11:00:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: "sqlite3_killpoint": { 2024-05-10T11:00:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "sqlite3_killpoint", 2024-05-10T11:00:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "dev", 2024-05-10T11:00:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 1, 2024-05-10T11:00:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "0", 2024-05-10T11:00:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "zabbix_host": { 2024-05-10T11:00:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix_host", 2024-05-10T11:00:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "", 2024-05-10T11:00:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "zabbix_port": { 2024-05-10T11:00:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix_port", 2024-05-10T11:00:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "int", 2024-05-10T11:00:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "10051", 2024-05-10T11:00:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "zabbix_sender": { 2024-05-10T11:00:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "zabbix_sender", 2024-05-10T11:00:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "str", 2024-05-10T11:00:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "level": "advanced", 2024-05-10T11:00:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: "flags": 0, 2024-05-10T11:00:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-10T11:00:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: "min": "", 2024-05-10T11:00:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: "max": "", 2024-05-10T11:00:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: "enum_allowed": [], 2024-05-10T11:00:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: "desc": "", 2024-05-10T11:00:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: "long_desc": "", 2024-05-10T11:00:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: "tags": [], 2024-05-10T11:00:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: "see_also": [] 2024-05-10T11:00:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "services": { 2024-05-10T11:00:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "dashboard": "https://172.21.15.107:8443/" 2024-05-10T11:00:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "always_on_modules": { 2024-05-10T11:00:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "octopus": [ 2024-05-10T11:00:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "balancer", 2024-05-10T11:00:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "crash", 2024-05-10T11:00:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "devicehealth", 2024-05-10T11:00:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "orchestrator", 2024-05-10T11:00:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "pg_autoscaler", 2024-05-10T11:00:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "progress", 2024-05-10T11:00:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_support", 2024-05-10T11:00:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "status", 2024-05-10T11:00:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "telemetry", 2024-05-10T11:00:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "volumes" 2024-05-10T11:00:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "pacific": [ 2024-05-10T11:00:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "balancer", 2024-05-10T11:00:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "crash", 2024-05-10T11:00:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "devicehealth", 2024-05-10T11:00:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "orchestrator", 2024-05-10T11:00:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "pg_autoscaler", 2024-05-10T11:00:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "progress", 2024-05-10T11:00:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_support", 2024-05-10T11:00:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "status", 2024-05-10T11:00:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "telemetry", 2024-05-10T11:00:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "volumes" 2024-05-10T11:00:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "quincy": [ 2024-05-10T11:00:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "balancer", 2024-05-10T11:00:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "crash", 2024-05-10T11:00:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "devicehealth", 2024-05-10T11:00:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "orchestrator", 2024-05-10T11:00:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "pg_autoscaler", 2024-05-10T11:00:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "progress", 2024-05-10T11:00:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_support", 2024-05-10T11:00:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: "status", 2024-05-10T11:00:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: "telemetry", 2024-05-10T11:00:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: "volumes" 2024-05-10T11:00:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: "reef": [ 2024-05-10T11:00:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: "balancer", 2024-05-10T11:00:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: "crash", 2024-05-10T11:00:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: "devicehealth", 2024-05-10T11:00:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: "orchestrator", 2024-05-10T11:00:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: "pg_autoscaler", 2024-05-10T11:00:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: "progress", 2024-05-10T11:00:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_support", 2024-05-10T11:00:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "status", 2024-05-10T11:00:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "telemetry", 2024-05-10T11:00:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "volumes" 2024-05-10T11:00:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-10T11:00:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "squid": [ 2024-05-10T11:00:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "balancer", 2024-05-10T11:00:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "crash", 2024-05-10T11:00:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "devicehealth", 2024-05-10T11:00:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "orchestrator", 2024-05-10T11:00:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "pg_autoscaler", 2024-05-10T11:00:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: "progress", 2024-05-10T11:00:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: "rbd_support", 2024-05-10T11:00:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: "status", 2024-05-10T11:00:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: "telemetry", 2024-05-10T11:00:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: "volumes" 2024-05-10T11:00:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-10T11:00:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: "last_failure_osd_epoch": 3, 2024-05-10T11:00:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: "active_clients": [ 2024-05-10T11:00:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "devicehealth", 2024-05-10T11:00:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ 2024-05-10T11:00:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v2", 2024-05-10T11:00:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:0", 2024-05-10T11:00:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 352827006 2024-05-10T11:00:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-10T11:00:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "libcephsqlite", 2024-05-10T11:00:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ 2024-05-10T11:00:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v2", 2024-05-10T11:00:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:0", 2024-05-10T11:00:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 1206403814 2024-05-10T11:00:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-10T11:00:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "rbd_support", 2024-05-10T11:00:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ 2024-05-10T11:00:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v2", 2024-05-10T11:00:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:0", 2024-05-10T11:00:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 1174205013 2024-05-10T11:00:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-10T11:00:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: "name": "volumes", 2024-05-10T11:00:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: "addrvec": [ 2024-05-10T11:00:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-10T11:00:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: "type": "v2", 2024-05-10T11:00:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: "addr": "172.21.15.107:0", 2024-05-10T11:00:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: "nonce": 343213747 2024-05-10T11:00:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:42.008 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-10T11:00:42.008 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:42.008 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-10T11:00:42.008 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T11:00:42.010 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:40 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/737455197' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T11:00:42.010 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:40 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1241001008' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T11:00:42.010 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:40 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/4119429198' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T11:00:42.010 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:41 smithi184 ceph-mon[34585]: pgmap v538: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 434 op/s 2024-05-10T11:00:42.010 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:41 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/2448134954' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-10T11:00:42.010 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:40 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/737455197' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T11:00:42.010 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:40 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1241001008' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T11:00:42.011 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:40 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/4119429198' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T11:00:42.011 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:41 smithi196 ceph-mon[34872]: pgmap v538: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 434 op/s 2024-05-10T11:00:42.011 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:41 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/2448134954' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-10T11:00:42.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.587+0000 7f8d39625640 1 -- 172.21.15.107:0/2448134954 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8d200b27f0 msgr2=0x7f8d200b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:42.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.587+0000 7f8d39625640 1 --2- 172.21.15.107:0/2448134954 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8d200b27f0 0x7f8d200b4cb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8d24031440 tx=0x7f8d24031510 comp rx=0 tx=0).stop 2024-05-10T11:00:42.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.587+0000 7f8d39625640 1 -- 172.21.15.107:0/2448134954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d34101930 msgr2=0x7f8d341058c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:00:42.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.587+0000 7f8d39625640 1 --2- 172.21.15.107:0/2448134954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d34101930 0x7f8d341058c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00d950 tx=0x7f8d1c00de10 comp rx=0 tx=0).stop 2024-05-10T11:00:42.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.587+0000 7f8d39625640 1 -- 172.21.15.107:0/2448134954 shutdown_connections 2024-05-10T11:00:42.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.587+0000 7f8d39625640 1 --2- 172.21.15.107:0/2448134954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8d341034e0 0x7f8d34104440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:42.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.587+0000 7f8d39625640 1 --2- 172.21.15.107:0/2448134954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d34102b20 0x7f8d34103f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:42.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.587+0000 7f8d39625640 1 --2- 172.21.15.107:0/2448134954 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8d200b27f0 0x7f8d200b4cb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:42.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.587+0000 7f8d39625640 1 --2- 172.21.15.107:0/2448134954 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8d34101930 0x7f8d341058c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:00:42.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.587+0000 7f8d39625640 1 -- 172.21.15.107:0/2448134954 >> 172.21.15.107:0/2448134954 conn(0x7f8d340fcea0 msgr2=0x7f8d340fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:00:42.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.587+0000 7f8d39625640 1 -- 172.21.15.107:0/2448134954 shutdown_connections 2024-05-10T11:00:42.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:00:40.587+0000 7f8d39625640 1 -- 172.21.15.107:0/2448134954 wait complete. 2024-05-10T11:00:42.020 DEBUG:tasks.check_counter:Getting stats from a 2024-05-10T11:00:42.020 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph daemon mds.a perf dump 2024-05-10T11:00:42.021 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:40 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/737455197' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-10T11:00:42.021 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:40 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1241001008' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-10T11:00:42.021 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:40 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/4119429198' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-10T11:00:42.021 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:41 smithi107 ceph-mon[30373]: pgmap v538: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 434 op/s 2024-05-10T11:00:42.021 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:41 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2448134954' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-10T11:00:42.277 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T11:00:43.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:43 smithi196 ceph-mon[34872]: pgmap v539: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 714 KiB/s wr, 276 op/s 2024-05-10T11:00:43.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:43 smithi184 ceph-mon[34585]: pgmap v539: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 714 KiB/s wr, 276 op/s 2024-05-10T11:00:43.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:43 smithi107 ceph-mon[30373]: pgmap v539: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 714 KiB/s wr, 276 op/s 2024-05-10T11:00:44.533 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T11:00:44.533 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T11:00:44.533 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 1023, 2024-05-10T11:00:44.533 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 1023, 2024-05-10T11:00:44.533 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 2689189, 2024-05-10T11:00:44.533 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 324491, 2024-05-10T11:00:44.533 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 6, 2024-05-10T11:00:44.533 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 2, 2024-05-10T11:00:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.089293868, 2024-05-10T11:00:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.028097714, 2024-05-10T11:00:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.025615451, 2024-05-10T11:00:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.027279999, 2024-05-10T11:00:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:00:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 1022, 2024-05-10T11:00:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.032627322, 2024-05-10T11:00:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000031924 2024-05-10T11:00:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:00:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.534 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-05-10T11:00:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 448 2024-05-10T11:00:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T11:00:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 482, 2024-05-10T11:00:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 466, 2024-05-10T11:00:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 961470, 2024-05-10T11:00:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 188974, 2024-05-10T11:00:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 4, 2024-05-10T11:00:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 3, 2024-05-10T11:00:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.055951622, 2024-05-10T11:00:44.535 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.017422634, 2024-05-10T11:00:44.536 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.025973966, 2024-05-10T11:00:44.536 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.014747839, 2024-05-10T11:00:44.536 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:00:44.536 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 465, 2024-05-10T11:00:44.536 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.020562336, 2024-05-10T11:00:44.536 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000044220 2024-05-10T11:00:44.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.536 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:00:44.536 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.536 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.536 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.537 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 883328, 2024-05-10T11:00:44.537 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 88736 2024-05-10T11:00:44.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.537 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T11:00:44.537 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 2, 2024-05-10T11:00:44.537 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 110, 2024-05-10T11:00:44.537 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 428, 2024-05-10T11:00:44.537 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 267374, 2024-05-10T11:00:44.537 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 4, 2024-05-10T11:00:44.537 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 3, 2024-05-10T11:00:44.538 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.008823847, 2024-05-10T11:00:44.538 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.005847121, 2024-05-10T11:00:44.538 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.001969278, 2024-05-10T11:00:44.538 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.000015657, 2024-05-10T11:00:44.538 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:00:44.538 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 108, 2024-05-10T11:00:44.538 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.006057227, 2024-05-10T11:00:44.538 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000056085 2024-05-10T11:00:44.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.538 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:00:44.539 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.539 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.539 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.539 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-10T11:00:44.539 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 267056 2024-05-10T11:00:44.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.539 INFO:teuthology.orchestra.run.smithi107.stdout: "cct": { 2024-05-10T11:00:44.539 INFO:teuthology.orchestra.run.smithi107.stdout: "total_workers": 1, 2024-05-10T11:00:44.539 INFO:teuthology.orchestra.run.smithi107.stdout: "unhealthy_workers": 0 2024-05-10T11:00:44.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.540 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-MDSRank": { 2024-05-10T11:00:44.540 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2024-05-10T11:00:44.540 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2024-05-10T11:00:44.540 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 2253, 2024-05-10T11:00:44.540 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.056949558, 2024-05-10T11:00:44.540 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000025277 2024-05-10T11:00:44.540 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:44.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.540 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-PurgeQueue": { 2024-05-10T11:00:44.540 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2024-05-10T11:00:44.540 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2024-05-10T11:00:44.541 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.541 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.541 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.541 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:44.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.541 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-05-10T11:00:44.541 INFO:teuthology.orchestra.run.smithi107.stdout: "request": 0, 2024-05-10T11:00:44.541 INFO:teuthology.orchestra.run.smithi107.stdout: "reply": 0, 2024-05-10T11:00:44.541 INFO:teuthology.orchestra.run.smithi107.stdout: "reply_latency": { 2024-05-10T11:00:44.541 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.541 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.542 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.542 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_reply": 0, 2024-05-10T11:00:44.542 INFO:teuthology.orchestra.run.smithi107.stdout: "forward": 0, 2024-05-10T11:00:44.542 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_complete": 0, 2024-05-10T11:00:44.542 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_keys": 0, 2024-05-10T11:00:44.542 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_commit": 0, 2024-05-10T11:00:44.542 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_split": 0, 2024-05-10T11:00:44.542 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_merge": 0, 2024-05-10T11:00:44.543 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes": 340, 2024-05-10T11:00:44.543 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_top": 0, 2024-05-10T11:00:44.543 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_bottom": 340, 2024-05-10T11:00:44.543 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pin_tail": 0, 2024-05-10T11:00:44.543 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pinned": 340, 2024-05-10T11:00:44.543 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_expired": 0, 2024-05-10T11:00:44.543 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_with_caps": 0, 2024-05-10T11:00:44.543 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": 0, 2024-05-10T11:00:44.543 INFO:teuthology.orchestra.run.smithi107.stdout: "subtrees": 1, 2024-05-10T11:00:44.543 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse": 0, 2024-05-10T11:00:44.543 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_hit": 0, 2024-05-10T11:00:44.543 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_forward": 0, 2024-05-10T11:00:44.543 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_discover": 0, 2024-05-10T11:00:44.544 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_dir_fetch": 0, 2024-05-10T11:00:44.544 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_remote_ino": 0, 2024-05-10T11:00:44.544 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_lock": 0, 2024-05-10T11:00:44.544 INFO:teuthology.orchestra.run.smithi107.stdout: "load_cent": 0, 2024-05-10T11:00:44.544 INFO:teuthology.orchestra.run.smithi107.stdout: "q": 0, 2024-05-10T11:00:44.544 INFO:teuthology.orchestra.run.smithi107.stdout: "exported": 0, 2024-05-10T11:00:44.544 INFO:teuthology.orchestra.run.smithi107.stdout: "exported_inodes": 0, 2024-05-10T11:00:44.544 INFO:teuthology.orchestra.run.smithi107.stdout: "imported": 0, 2024-05-10T11:00:44.544 INFO:teuthology.orchestra.run.smithi107.stdout: "imported_inodes": 0, 2024-05-10T11:00:44.544 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_dir_fetch": 0, 2024-05-10T11:00:44.544 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_backtrace_fetch": 0, 2024-05-10T11:00:44.544 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_peer_discover": 0, 2024-05-10T11:00:44.544 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rfiles": 0, 2024-05-10T11:00:44.544 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rbytes": 0, 2024-05-10T11:00:44.545 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rsnaps": 0, 2024-05-10T11:00:44.545 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_fetch": 0, 2024-05-10T11:00:44.545 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_set_tag": 0, 2024-05-10T11:00:44.545 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T11:00:44.545 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_inotable_repaired": 0, 2024-05-10T11:00:44.545 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_inodes": 0, 2024-05-10T11:00:44.545 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_base_inodes": 0, 2024-05-10T11:00:44.545 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dirfrag_rstats": 0, 2024-05-10T11:00:44.545 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_file_inodes": 0, 2024-05-10T11:00:44.545 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 0, 2024-05-10T11:00:44.545 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 0, 2024-05-10T11:00:44.545 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 0, 2024-05-10T11:00:44.545 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T11:00:44.546 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T11:00:44.546 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T11:00:44.546 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps": 0, 2024-05-10T11:00:44.546 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps_dirty": 0, 2024-05-10T11:00:44.546 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_cap_release": 0, 2024-05-10T11:00:44.546 INFO:teuthology.orchestra.run.smithi107.stdout: "process_request_cap_release": 0 2024-05-10T11:00:44.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.546 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_cache": { 2024-05-10T11:00:44.546 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update": 0, 2024-05-10T11:00:44.546 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update_receipt": 0, 2024-05-10T11:00:44.546 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_try_discover": 0, 2024-05-10T11:00:44.546 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_send_discover": 0, 2024-05-10T11:00:44.547 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_handle_discover": 0, 2024-05-10T11:00:44.547 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays": 0, 2024-05-10T11:00:44.547 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_delayed": 0, 2024-05-10T11:00:44.547 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_enqueuing": 0, 2024-05-10T11:00:44.547 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_created": 0, 2024-05-10T11:00:44.547 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_enqueued": 0, 2024-05-10T11:00:44.547 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_reintegrated": 0, 2024-05-10T11:00:44.547 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_migrated": 0, 2024-05-10T11:00:44.547 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_processing": 0, 2024-05-10T11:00:44.547 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_enqueued": 0, 2024-05-10T11:00:44.547 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_prioritized": 0, 2024-05-10T11:00:44.547 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_started": 0, 2024-05-10T11:00:44.547 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_completed": 0, 2024-05-10T11:00:44.548 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_quiesce_path": 0, 2024-05-10T11:00:44.548 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_quiesce_inode": 0, 2024-05-10T11:00:44.548 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_enqueue_scrub": 0, 2024-05-10T11:00:44.548 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_exportdir": 0, 2024-05-10T11:00:44.548 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_flush": 0, 2024-05-10T11:00:44.548 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragmentdir": 0, 2024-05-10T11:00:44.548 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragstats": 0, 2024-05-10T11:00:44.548 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_inodestats": 0 2024-05-10T11:00:44.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.548 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_log": { 2024-05-10T11:00:44.548 INFO:teuthology.orchestra.run.smithi107.stdout: "evlrg": 0, 2024-05-10T11:00:44.548 INFO:teuthology.orchestra.run.smithi107.stdout: "evadd": 0, 2024-05-10T11:00:44.548 INFO:teuthology.orchestra.run.smithi107.stdout: "evex": 0, 2024-05-10T11:00:44.549 INFO:teuthology.orchestra.run.smithi107.stdout: "evtrm": 0, 2024-05-10T11:00:44.549 INFO:teuthology.orchestra.run.smithi107.stdout: "ev": 1526, 2024-05-10T11:00:44.549 INFO:teuthology.orchestra.run.smithi107.stdout: "evexg": 0, 2024-05-10T11:00:44.549 INFO:teuthology.orchestra.run.smithi107.stdout: "evexd": 0, 2024-05-10T11:00:44.549 INFO:teuthology.orchestra.run.smithi107.stdout: "segadd": 0, 2024-05-10T11:00:44.549 INFO:teuthology.orchestra.run.smithi107.stdout: "segex": 0, 2024-05-10T11:00:44.549 INFO:teuthology.orchestra.run.smithi107.stdout: "segtrm": 0, 2024-05-10T11:00:44.549 INFO:teuthology.orchestra.run.smithi107.stdout: "seg": 3, 2024-05-10T11:00:44.549 INFO:teuthology.orchestra.run.smithi107.stdout: "segmjr": 2, 2024-05-10T11:00:44.549 INFO:teuthology.orchestra.run.smithi107.stdout: "segexg": 0, 2024-05-10T11:00:44.549 INFO:teuthology.orchestra.run.smithi107.stdout: "segexd": 0, 2024-05-10T11:00:44.549 INFO:teuthology.orchestra.run.smithi107.stdout: "expos": 4194304, 2024-05-10T11:00:44.549 INFO:teuthology.orchestra.run.smithi107.stdout: "wrpos": 6577804, 2024-05-10T11:00:44.549 INFO:teuthology.orchestra.run.smithi107.stdout: "rdpos": 6576666, 2024-05-10T11:00:44.550 INFO:teuthology.orchestra.run.smithi107.stdout: "jlat": { 2024-05-10T11:00:44.550 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.550 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.550 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.550 INFO:teuthology.orchestra.run.smithi107.stdout: "replayed": 1526 2024-05-10T11:00:44.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.550 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_mem": { 2024-05-10T11:00:44.550 INFO:teuthology.orchestra.run.smithi107.stdout: "ino": 5, 2024-05-10T11:00:44.550 INFO:teuthology.orchestra.run.smithi107.stdout: "ino+": 399, 2024-05-10T11:00:44.550 INFO:teuthology.orchestra.run.smithi107.stdout: "ino-": 394, 2024-05-10T11:00:44.550 INFO:teuthology.orchestra.run.smithi107.stdout: "dir": 3, 2024-05-10T11:00:44.550 INFO:teuthology.orchestra.run.smithi107.stdout: "dir+": 80, 2024-05-10T11:00:44.550 INFO:teuthology.orchestra.run.smithi107.stdout: "dir-": 77, 2024-05-10T11:00:44.551 INFO:teuthology.orchestra.run.smithi107.stdout: "dn": 340, 2024-05-10T11:00:44.551 INFO:teuthology.orchestra.run.smithi107.stdout: "dn+": 605, 2024-05-10T11:00:44.551 INFO:teuthology.orchestra.run.smithi107.stdout: "dn-": 265, 2024-05-10T11:00:44.551 INFO:teuthology.orchestra.run.smithi107.stdout: "cap": 0, 2024-05-10T11:00:44.551 INFO:teuthology.orchestra.run.smithi107.stdout: "cap+": 0, 2024-05-10T11:00:44.551 INFO:teuthology.orchestra.run.smithi107.stdout: "cap-": 0, 2024-05-10T11:00:44.551 INFO:teuthology.orchestra.run.smithi107.stdout: "rss": 52072, 2024-05-10T11:00:44.551 INFO:teuthology.orchestra.run.smithi107.stdout: "heap": 215416 2024-05-10T11:00:44.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.551 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_server": { 2024-05-10T11:00:44.551 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_client_request": 0, 2024-05-10T11:00:44.551 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_server_request": 0, 2024-05-10T11:00:44.551 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_request": 0, 2024-05-10T11:00:44.551 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_session": 0, 2024-05-10T11:00:44.551 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_peer_request": 0, 2024-05-10T11:00:44.552 INFO:teuthology.orchestra.run.smithi107.stdout: "req_create_latency": { 2024-05-10T11:00:44.552 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.552 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.552 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.552 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getattr_latency": { 2024-05-10T11:00:44.552 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.552 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.552 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.552 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getfilelock_latency": { 2024-05-10T11:00:44.552 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.552 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.552 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.553 INFO:teuthology.orchestra.run.smithi107.stdout: "req_link_latency": { 2024-05-10T11:00:44.553 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.553 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.553 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.553 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { 2024-05-10T11:00:44.553 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.553 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.553 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.553 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookuphash_latency": { 2024-05-10T11:00:44.553 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.553 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.553 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.554 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupino_latency": { 2024-05-10T11:00:44.554 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.554 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.554 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.554 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupname_latency": { 2024-05-10T11:00:44.554 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.554 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.554 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.554 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupparent_latency": { 2024-05-10T11:00:44.554 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.555 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.555 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.555 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupsnap_latency": { 2024-05-10T11:00:44.555 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.555 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.555 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.555 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lssnap_latency": { 2024-05-10T11:00:44.555 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.555 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.555 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.555 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mkdir_latency": { 2024-05-10T11:00:44.556 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.556 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.556 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.556 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mknod_latency": { 2024-05-10T11:00:44.556 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.556 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.556 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.557 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mksnap_latency": { 2024-05-10T11:00:44.557 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.557 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.557 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.557 INFO:teuthology.orchestra.run.smithi107.stdout: "req_open_latency": { 2024-05-10T11:00:44.557 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.557 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.557 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.557 INFO:teuthology.orchestra.run.smithi107.stdout: "req_readdir_latency": { 2024-05-10T11:00:44.557 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.558 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.558 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.558 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rename_latency": { 2024-05-10T11:00:44.558 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.558 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.558 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.558 INFO:teuthology.orchestra.run.smithi107.stdout: "req_renamesnap_latency": { 2024-05-10T11:00:44.558 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.558 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.558 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.558 INFO:teuthology.orchestra.run.smithi107.stdout: "req_snapdiff_latency": { 2024-05-10T11:00:44.559 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.559 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.559 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.559 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmdir_latency": { 2024-05-10T11:00:44.559 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.559 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.559 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.559 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmsnap_latency": { 2024-05-10T11:00:44.559 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.559 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.560 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.560 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmxattr_latency": { 2024-05-10T11:00:44.560 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.560 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.560 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.560 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setattr_latency": { 2024-05-10T11:00:44.560 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.560 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.560 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.560 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setdirlayout_latency": { 2024-05-10T11:00:44.560 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.561 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.561 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.561 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { 2024-05-10T11:00:44.561 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.561 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.561 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.561 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setlayout_latency": { 2024-05-10T11:00:44.561 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.561 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.561 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.561 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setxattr_latency": { 2024-05-10T11:00:44.562 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.562 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.562 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.562 INFO:teuthology.orchestra.run.smithi107.stdout: "req_symlink_latency": { 2024-05-10T11:00:44.562 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.562 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.562 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.562 INFO:teuthology.orchestra.run.smithi107.stdout: "req_unlink_latency": { 2024-05-10T11:00:44.562 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.562 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.562 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.563 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_revoke_eviction": 0, 2024-05-10T11:00:44.563 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_acquisition_throttle": 0, 2024-05-10T11:00:44.563 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getvxattr_latency": { 2024-05-10T11:00:44.563 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.563 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.563 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.563 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:44.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.563 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_sessions": { 2024-05-10T11:00:44.563 INFO:teuthology.orchestra.run.smithi107.stdout: "session_count": 1, 2024-05-10T11:00:44.564 INFO:teuthology.orchestra.run.smithi107.stdout: "session_add": 2, 2024-05-10T11:00:44.564 INFO:teuthology.orchestra.run.smithi107.stdout: "session_remove": 1, 2024-05-10T11:00:44.564 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_open": 1, 2024-05-10T11:00:44.564 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_stale": 0, 2024-05-10T11:00:44.564 INFO:teuthology.orchestra.run.smithi107.stdout: "total_load": 0, 2024-05-10T11:00:44.564 INFO:teuthology.orchestra.run.smithi107.stdout: "average_load": 0, 2024-05-10T11:00:44.564 INFO:teuthology.orchestra.run.smithi107.stdout: "avg_session_uptime": 1520, 2024-05-10T11:00:44.564 INFO:teuthology.orchestra.run.smithi107.stdout: "mdthresh_evicted": 0 2024-05-10T11:00:44.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.564 INFO:teuthology.orchestra.run.smithi107.stdout: "mempool": { 2024-05-10T11:00:44.564 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_bytes": 0, 2024-05-10T11:00:44.564 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_items": 0, 2024-05-10T11:00:44.564 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T11:00:44.564 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_items": 0, 2024-05-10T11:00:44.565 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T11:00:44.565 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_items": 0, 2024-05-10T11:00:44.565 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T11:00:44.565 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T11:00:44.565 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T11:00:44.565 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T11:00:44.565 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T11:00:44.565 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_items": 0, 2024-05-10T11:00:44.566 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T11:00:44.566 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T11:00:44.566 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_bytes": 0, 2024-05-10T11:00:44.566 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_items": 0, 2024-05-10T11:00:44.566 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_bytes": 0, 2024-05-10T11:00:44.566 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_items": 0, 2024-05-10T11:00:44.566 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T11:00:44.566 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T11:00:44.566 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T11:00:44.566 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T11:00:44.567 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T11:00:44.567 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_items": 0, 2024-05-10T11:00:44.567 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_bytes": 0, 2024-05-10T11:00:44.567 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_items": 0, 2024-05-10T11:00:44.567 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T11:00:44.567 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T11:00:44.567 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_bytes": 0, 2024-05-10T11:00:44.567 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_items": 0, 2024-05-10T11:00:44.567 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_bytes": 0, 2024-05-10T11:00:44.567 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_items": 0, 2024-05-10T11:00:44.568 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T11:00:44.568 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_items": 0, 2024-05-10T11:00:44.568 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T11:00:44.568 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_items": 0, 2024-05-10T11:00:44.568 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_bytes": 189400, 2024-05-10T11:00:44.568 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_items": 51, 2024-05-10T11:00:44.568 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_bytes": 0, 2024-05-10T11:00:44.569 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_items": 0, 2024-05-10T11:00:44.569 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_bytes": 0, 2024-05-10T11:00:44.569 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_items": 0, 2024-05-10T11:00:44.569 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_bytes": 0, 2024-05-10T11:00:44.569 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_items": 0, 2024-05-10T11:00:44.569 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_bytes": 0, 2024-05-10T11:00:44.569 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_items": 0, 2024-05-10T11:00:44.569 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_bytes": 7336, 2024-05-10T11:00:44.569 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_items": 154, 2024-05-10T11:00:44.569 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T11:00:44.570 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_items": 0, 2024-05-10T11:00:44.570 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_bytes": 0, 2024-05-10T11:00:44.570 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_items": 0, 2024-05-10T11:00:44.570 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_bytes": 254920, 2024-05-10T11:00:44.570 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_items": 1400, 2024-05-10T11:00:44.571 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_bytes": 0, 2024-05-10T11:00:44.571 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_items": 0, 2024-05-10T11:00:44.571 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, 2024-05-10T11:00:44.571 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 2024-05-10T11:00:44.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.571 INFO:teuthology.orchestra.run.smithi107.stdout: "objecter": { 2024-05-10T11:00:44.571 INFO:teuthology.orchestra.run.smithi107.stdout: "op_active": 0, 2024-05-10T11:00:44.571 INFO:teuthology.orchestra.run.smithi107.stdout: "op_laggy": 0, 2024-05-10T11:00:44.571 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send": 1335, 2024-05-10T11:00:44.571 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send_bytes": 21, 2024-05-10T11:00:44.571 INFO:teuthology.orchestra.run.smithi107.stdout: "op_resend": 3, 2024-05-10T11:00:44.572 INFO:teuthology.orchestra.run.smithi107.stdout: "op_reply": 1335, 2024-05-10T11:00:44.572 INFO:teuthology.orchestra.run.smithi107.stdout: "op_latency": { 2024-05-10T11:00:44.572 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 1335, 2024-05-10T11:00:44.572 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 1.069982816, 2024-05-10T11:00:44.572 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000801485 2024-05-10T11:00:44.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.572 INFO:teuthology.orchestra.run.smithi107.stdout: "op_inflight": 0, 2024-05-10T11:00:44.572 INFO:teuthology.orchestra.run.smithi107.stdout: "oplen_avg": { 2024-05-10T11:00:44.572 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 1335, 2024-05-10T11:00:44.572 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 1336 2024-05-10T11:00:44.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.572 INFO:teuthology.orchestra.run.smithi107.stdout: "op": 1335, 2024-05-10T11:00:44.573 INFO:teuthology.orchestra.run.smithi107.stdout: "op_r": 1335, 2024-05-10T11:00:44.573 INFO:teuthology.orchestra.run.smithi107.stdout: "op_w": 0, 2024-05-10T11:00:44.573 INFO:teuthology.orchestra.run.smithi107.stdout: "op_rmw": 0, 2024-05-10T11:00:44.573 INFO:teuthology.orchestra.run.smithi107.stdout: "op_pg": 0, 2024-05-10T11:00:44.573 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_stat": 802, 2024-05-10T11:00:44.573 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_create": 0, 2024-05-10T11:00:44.573 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_read": 531, 2024-05-10T11:00:44.573 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_write": 0, 2024-05-10T11:00:44.573 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writefull": 0, 2024-05-10T11:00:44.573 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writesame": 0, 2024-05-10T11:00:44.573 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_append": 0, 2024-05-10T11:00:44.573 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_zero": 0, 2024-05-10T11:00:44.573 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_truncate": 0, 2024-05-10T11:00:44.574 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_delete": 0, 2024-05-10T11:00:44.574 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_mapext": 0, 2024-05-10T11:00:44.574 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_sparse_read": 0, 2024-05-10T11:00:44.574 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_clonerange": 0, 2024-05-10T11:00:44.574 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_getxattr": 1, 2024-05-10T11:00:44.574 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_setxattr": 0, 2024-05-10T11:00:44.574 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_cmpxattr": 0, 2024-05-10T11:00:44.574 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_rmxattr": 0, 2024-05-10T11:00:44.574 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_resetxattrs": 0, 2024-05-10T11:00:44.574 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_call": 0, 2024-05-10T11:00:44.574 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_watch": 0, 2024-05-10T11:00:44.574 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_notify": 0, 2024-05-10T11:00:44.575 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T11:00:44.575 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls": 0, 2024-05-10T11:00:44.575 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls_filter": 0, 2024-05-10T11:00:44.575 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_other": 0, 2024-05-10T11:00:44.575 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_active": 0, 2024-05-10T11:00:44.575 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_send": 0, 2024-05-10T11:00:44.575 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_resend": 0, 2024-05-10T11:00:44.575 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_ping": 0, 2024-05-10T11:00:44.575 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_active": 0, 2024-05-10T11:00:44.575 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_send": 0, 2024-05-10T11:00:44.575 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_resend": 0, 2024-05-10T11:00:44.575 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_active": 0, 2024-05-10T11:00:44.576 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_send": 0, 2024-05-10T11:00:44.576 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_resend": 0, 2024-05-10T11:00:44.576 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_active": 0, 2024-05-10T11:00:44.576 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_send": 0, 2024-05-10T11:00:44.576 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_resend": 0, 2024-05-10T11:00:44.576 INFO:teuthology.orchestra.run.smithi107.stdout: "command_active": 0, 2024-05-10T11:00:44.576 INFO:teuthology.orchestra.run.smithi107.stdout: "command_send": 0, 2024-05-10T11:00:44.576 INFO:teuthology.orchestra.run.smithi107.stdout: "command_resend": 0, 2024-05-10T11:00:44.576 INFO:teuthology.orchestra.run.smithi107.stdout: "map_epoch": 82, 2024-05-10T11:00:44.576 INFO:teuthology.orchestra.run.smithi107.stdout: "map_full": 0, 2024-05-10T11:00:44.577 INFO:teuthology.orchestra.run.smithi107.stdout: "map_inc": 2, 2024-05-10T11:00:44.577 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_sessions": 5, 2024-05-10T11:00:44.577 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_open": 5, 2024-05-10T11:00:44.577 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_close": 0, 2024-05-10T11:00:44.577 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_laggy": 0, 2024-05-10T11:00:44.577 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_wr": 0, 2024-05-10T11:00:44.577 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_rd": 2, 2024-05-10T11:00:44.577 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_del": 0 2024-05-10T11:00:44.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.577 INFO:teuthology.orchestra.run.smithi107.stdout: "oft": { 2024-05-10T11:00:44.577 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_objs": 0, 2024-05-10T11:00:44.578 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_kv_pairs": 0, 2024-05-10T11:00:44.578 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_updates": 0, 2024-05-10T11:00:44.578 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_removes": 0 2024-05-10T11:00:44.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.578 INFO:teuthology.orchestra.run.smithi107.stdout: "osd-slow-ops": { 2024-05-10T11:00:44.578 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_ops_count": 0 2024-05-10T11:00:44.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.578 INFO:teuthology.orchestra.run.smithi107.stdout: "purge_queue": { 2024-05-10T11:00:44.578 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops": 0, 2024-05-10T11:00:44.578 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops_high_water": 0, 2024-05-10T11:00:44.579 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing": 0, 2024-05-10T11:00:44.579 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_high_water": 0, 2024-05-10T11:00:44.579 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executed_ops": 0, 2024-05-10T11:00:44.579 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executed": 0, 2024-05-10T11:00:44.579 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_item_in_journal": 0 2024-05-10T11:00:44.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.579 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T11:00:44.579 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-05-10T11:00:44.579 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2024-05-10T11:00:44.579 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-05-10T11:00:44.579 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 1503, 2024-05-10T11:00:44.579 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 3504232, 2024-05-10T11:00:44.579 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-05-10T11:00:44.579 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 1503, 2024-05-10T11:00:44.579 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-05-10T11:00:44.580 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-05-10T11:00:44.580 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 1503, 2024-05-10T11:00:44.580 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 3504232, 2024-05-10T11:00:44.580 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-05-10T11:00:44.580 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.580 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.580 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.580 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:44.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.580 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_bytes": { 2024-05-10T11:00:44.580 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-05-10T11:00:44.580 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2024-05-10T11:00:44.580 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-05-10T11:00:44.580 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-05-10T11:00:44.581 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-05-10T11:00:44.581 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-05-10T11:00:44.581 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-05-10T11:00:44.581 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 1335, 2024-05-10T11:00:44.581 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 2383505, 2024-05-10T11:00:44.581 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 1335, 2024-05-10T11:00:44.581 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 2383505, 2024-05-10T11:00:44.581 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-05-10T11:00:44.581 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.581 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.581 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.581 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:44.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.581 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_ops": { 2024-05-10T11:00:44.581 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-05-10T11:00:44.582 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 1024, 2024-05-10T11:00:44.582 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-05-10T11:00:44.582 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-05-10T11:00:44.582 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-05-10T11:00:44.582 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-05-10T11:00:44.582 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-05-10T11:00:44.582 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 1335, 2024-05-10T11:00:44.582 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 1335, 2024-05-10T11:00:44.582 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 1335, 2024-05-10T11:00:44.582 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 1335, 2024-05-10T11:00:44.582 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-05-10T11:00:44.582 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.582 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.582 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.583 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:44.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.583 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle": { 2024-05-10T11:00:44.583 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-05-10T11:00:44.583 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2024-05-10T11:00:44.583 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-05-10T11:00:44.583 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-05-10T11:00:44.583 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-05-10T11:00:44.583 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-05-10T11:00:44.583 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-05-10T11:00:44.583 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-05-10T11:00:44.583 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-05-10T11:00:44.583 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 0, 2024-05-10T11:00:44.584 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 0, 2024-05-10T11:00:44.584 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-05-10T11:00:44.584 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.584 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.584 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.584 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:44.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:44.584 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle-0x5651f1cbc6e0": { 2024-05-10T11:00:44.584 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-05-10T11:00:44.584 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2024-05-10T11:00:44.584 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-05-10T11:00:44.584 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-05-10T11:00:44.585 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-05-10T11:00:44.585 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-05-10T11:00:44.585 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-05-10T11:00:44.585 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-05-10T11:00:44.585 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-05-10T11:00:44.585 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 0, 2024-05-10T11:00:44.585 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 0, 2024-05-10T11:00:44.585 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-05-10T11:00:44.585 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:44.585 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:44.585 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:44.585 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:44.585 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:44.585 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T11:00:45.464 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-05-10T11:00:45.464 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-05-10T11:00:45.465 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-05-10T11:00:45.465 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-05-10T11:00:45.465 DEBUG:tasks.check_counter:Getting stats from d 2024-05-10T11:00:45.465 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph daemon mds.d perf dump 2024-05-10T11:00:45.721 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T11:00:45.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:45 smithi196 ceph-mon[34872]: pgmap v540: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 670 KiB/s wr, 163 op/s 2024-05-10T11:00:45.844 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:45 smithi107 ceph-mon[30373]: pgmap v540: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 670 KiB/s wr, 163 op/s 2024-05-10T11:00:45.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:45 smithi184 ceph-mon[34585]: pgmap v540: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 670 KiB/s wr, 163 op/s 2024-05-10T11:00:47.589 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T11:00:47.589 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T11:00:47.589 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 156, 2024-05-10T11:00:47.589 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 151, 2024-05-10T11:00:47.589 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 795024, 2024-05-10T11:00:47.589 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 91728, 2024-05-10T11:00:47.589 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 4, 2024-05-10T11:00:47.589 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 0, 2024-05-10T11:00:47.589 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.026125361, 2024-05-10T11:00:47.589 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.008863197, 2024-05-10T11:00:47.590 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.018150611, 2024-05-10T11:00:47.590 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.002652490, 2024-05-10T11:00:47.590 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:00:47.590 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 150, 2024-05-10T11:00:47.590 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.007059090, 2024-05-10T11:00:47.590 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000047060 2024-05-10T11:00:47.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:47.590 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:00:47.590 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:47.590 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:47.590 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:47.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:47.591 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 795024, 2024-05-10T11:00:47.591 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 91728 2024-05-10T11:00:47.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:47.591 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T11:00:47.591 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 1, 2024-05-10T11:00:47.591 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 114, 2024-05-10T11:00:47.591 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 160, 2024-05-10T11:00:47.591 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 98672, 2024-05-10T11:00:47.591 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 3, 2024-05-10T11:00:47.591 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 2, 2024-05-10T11:00:47.592 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.008876547, 2024-05-10T11:00:47.592 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.006621694, 2024-05-10T11:00:47.592 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.001114276, 2024-05-10T11:00:47.592 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-10T11:00:47.592 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:00:47.592 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 112, 2024-05-10T11:00:47.592 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.006266960, 2024-05-10T11:00:47.592 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000055955 2024-05-10T11:00:47.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:47.592 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:00:47.592 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:47.592 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:47.592 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:47.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:47.593 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-10T11:00:47.593 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 98672 2024-05-10T11:00:47.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:47.593 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T11:00:47.593 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 4, 2024-05-10T11:00:47.593 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 4, 2024-05-10T11:00:47.593 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 3040, 2024-05-10T11:00:47.593 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 448, 2024-05-10T11:00:47.593 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 2, 2024-05-10T11:00:47.594 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 1, 2024-05-10T11:00:47.594 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.000751996, 2024-05-10T11:00:47.594 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.000051477, 2024-05-10T11:00:47.594 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.000684130, 2024-05-10T11:00:47.594 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-10T11:00:47.594 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:00:47.594 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 3, 2024-05-10T11:00:47.594 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000805122, 2024-05-10T11:00:47.594 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000268374 2024-05-10T11:00:47.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:47.594 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:00:47.594 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:47.594 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:47.595 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:47.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:47.595 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-05-10T11:00:47.595 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 448 2024-05-10T11:00:47.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:47.595 INFO:teuthology.orchestra.run.smithi107.stdout: "cct": { 2024-05-10T11:00:47.595 INFO:teuthology.orchestra.run.smithi107.stdout: "total_workers": 0, 2024-05-10T11:00:47.595 INFO:teuthology.orchestra.run.smithi107.stdout: "unhealthy_workers": 0 2024-05-10T11:00:47.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:47.595 INFO:teuthology.orchestra.run.smithi107.stdout: "mempool": { 2024-05-10T11:00:47.596 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_bytes": 0, 2024-05-10T11:00:47.596 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_items": 0, 2024-05-10T11:00:47.596 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T11:00:47.596 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_items": 0, 2024-05-10T11:00:47.596 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T11:00:47.596 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_items": 0, 2024-05-10T11:00:47.596 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T11:00:47.596 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T11:00:47.596 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T11:00:47.596 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T11:00:47.596 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T11:00:47.596 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_items": 0, 2024-05-10T11:00:47.596 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T11:00:47.597 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T11:00:47.597 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_bytes": 0, 2024-05-10T11:00:47.597 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_items": 0, 2024-05-10T11:00:47.597 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_bytes": 0, 2024-05-10T11:00:47.597 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_items": 0, 2024-05-10T11:00:47.597 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T11:00:47.597 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T11:00:47.597 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T11:00:47.597 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T11:00:47.597 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T11:00:47.597 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_items": 0, 2024-05-10T11:00:47.598 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_bytes": 0, 2024-05-10T11:00:47.598 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_items": 0, 2024-05-10T11:00:47.598 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T11:00:47.598 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T11:00:47.598 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_bytes": 0, 2024-05-10T11:00:47.598 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_items": 0, 2024-05-10T11:00:47.598 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_bytes": 0, 2024-05-10T11:00:47.598 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_items": 0, 2024-05-10T11:00:47.598 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T11:00:47.599 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_items": 0, 2024-05-10T11:00:47.599 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T11:00:47.599 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_items": 0, 2024-05-10T11:00:47.599 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_bytes": 148984, 2024-05-10T11:00:47.599 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_items": 30, 2024-05-10T11:00:47.599 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_bytes": 0, 2024-05-10T11:00:47.599 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_items": 0, 2024-05-10T11:00:47.599 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_bytes": 0, 2024-05-10T11:00:47.599 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_items": 0, 2024-05-10T11:00:47.599 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_bytes": 0, 2024-05-10T11:00:47.599 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_items": 0, 2024-05-10T11:00:47.599 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_bytes": 0, 2024-05-10T11:00:47.600 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_items": 0, 2024-05-10T11:00:47.600 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_bytes": 0, 2024-05-10T11:00:47.600 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_items": 0, 2024-05-10T11:00:47.600 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T11:00:47.600 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_items": 0, 2024-05-10T11:00:47.600 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_bytes": 0, 2024-05-10T11:00:47.600 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_items": 0, 2024-05-10T11:00:47.600 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_bytes": 928, 2024-05-10T11:00:47.600 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_items": 2, 2024-05-10T11:00:47.600 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_bytes": 0, 2024-05-10T11:00:47.601 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_items": 0, 2024-05-10T11:00:47.601 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, 2024-05-10T11:00:47.601 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 2024-05-10T11:00:47.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:47.601 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T11:00:47.601 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-05-10T11:00:47.601 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2024-05-10T11:00:47.601 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-05-10T11:00:47.601 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 157, 2024-05-10T11:00:47.601 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 773005, 2024-05-10T11:00:47.601 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-05-10T11:00:47.601 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 157, 2024-05-10T11:00:47.601 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-05-10T11:00:47.602 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-05-10T11:00:47.602 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 157, 2024-05-10T11:00:47.602 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 773005, 2024-05-10T11:00:47.602 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-05-10T11:00:47.602 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:47.602 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:47.602 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:47.602 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:47.602 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:47.602 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T11:00:47.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:47 smithi196 ceph-mon[34872]: pgmap v541: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 318 KiB/s wr, 119 op/s 2024-05-10T11:00:47.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:47 smithi184 ceph-mon[34585]: pgmap v541: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 318 KiB/s wr, 119 op/s 2024-05-10T11:00:47.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:47 smithi107 ceph-mon[30373]: pgmap v541: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 318 KiB/s wr, 119 op/s 2024-05-10T11:00:48.734 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-05-10T11:00:48.734 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-05-10T11:00:48.734 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-05-10T11:00:48.734 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-05-10T11:00:48.734 DEBUG:tasks.check_counter:Getting stats from g 2024-05-10T11:00:48.734 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph daemon mds.g perf dump 2024-05-10T11:00:48.982 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T11:00:49.814 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:49 smithi196 ceph-mon[34872]: pgmap v542: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 33 op/s 2024-05-10T11:00:49.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:49 smithi184 ceph-mon[34585]: pgmap v542: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 33 op/s 2024-05-10T11:00:49.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:49 smithi107 ceph-mon[30373]: pgmap v542: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 33 op/s 2024-05-10T11:00:50.785 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T11:00:50.785 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T11:00:50.785 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 498, 2024-05-10T11:00:50.785 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 500, 2024-05-10T11:00:50.785 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 167273, 2024-05-10T11:00:50.785 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 158365, 2024-05-10T11:00:50.785 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 6, 2024-05-10T11:00:50.785 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 2, 2024-05-10T11:00:50.785 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.051927183, 2024-05-10T11:00:50.785 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.022025911, 2024-05-10T11:00:50.786 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.010744211, 2024-05-10T11:00:50.786 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.013551289, 2024-05-10T11:00:50.786 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:00:50.786 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 498, 2024-05-10T11:00:50.786 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.023634212, 2024-05-10T11:00:50.786 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000047458 2024-05-10T11:00:50.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.786 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:00:50.786 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.786 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.786 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.786 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-10T11:00:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 0 2024-05-10T11:00:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T11:00:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 871, 2024-05-10T11:00:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 979, 2024-05-10T11:00:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 2274093, 2024-05-10T11:00:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 544917, 2024-05-10T11:00:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 5, 2024-05-10T11:00:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 4, 2024-05-10T11:00:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.059977357, 2024-05-10T11:00:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.019930120, 2024-05-10T11:00:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.016366099, 2024-05-10T11:00:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.019064428, 2024-05-10T11:00:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:00:50.788 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 978, 2024-05-10T11:00:50.788 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.027710589, 2024-05-10T11:00:50.788 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000028333 2024-05-10T11:00:50.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.788 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:00:50.788 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.788 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.788 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.788 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-05-10T11:00:50.788 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 269472 2024-05-10T11:00:50.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.788 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T11:00:50.788 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 172, 2024-05-10T11:00:50.789 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 156, 2024-05-10T11:00:50.789 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 885220, 2024-05-10T11:00:50.789 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 90981, 2024-05-10T11:00:50.789 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 4, 2024-05-10T11:00:50.789 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 3, 2024-05-10T11:00:50.789 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.025207530, 2024-05-10T11:00:50.789 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.009035306, 2024-05-10T11:00:50.789 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.017243278, 2024-05-10T11:00:50.789 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.002675133, 2024-05-10T11:00:50.789 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:00:50.789 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 155, 2024-05-10T11:00:50.789 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.008770665, 2024-05-10T11:00:50.789 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000056584 2024-05-10T11:00:50.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.790 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:00:50.790 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.790 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.790 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.790 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 883872, 2024-05-10T11:00:50.790 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 90016 2024-05-10T11:00:50.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.790 INFO:teuthology.orchestra.run.smithi107.stdout: "cct": { 2024-05-10T11:00:50.790 INFO:teuthology.orchestra.run.smithi107.stdout: "total_workers": 1, 2024-05-10T11:00:50.791 INFO:teuthology.orchestra.run.smithi107.stdout: "unhealthy_workers": 0 2024-05-10T11:00:50.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.791 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-MDSRank": { 2024-05-10T11:00:50.791 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2024-05-10T11:00:50.791 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2024-05-10T11:00:50.791 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 2398, 2024-05-10T11:00:50.791 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.053878468, 2024-05-10T11:00:50.791 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000022468 2024-05-10T11:00:50.791 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:50.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.791 INFO:teuthology.orchestra.run.smithi107.stdout: "finisher-PurgeQueue": { 2024-05-10T11:00:50.791 INFO:teuthology.orchestra.run.smithi107.stdout: "queue_len": 0, 2024-05-10T11:00:50.792 INFO:teuthology.orchestra.run.smithi107.stdout: "complete_latency": { 2024-05-10T11:00:50.792 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.792 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.792 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.792 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:50.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.792 INFO:teuthology.orchestra.run.smithi107.stdout: "mds": { 2024-05-10T11:00:50.792 INFO:teuthology.orchestra.run.smithi107.stdout: "request": 0, 2024-05-10T11:00:50.792 INFO:teuthology.orchestra.run.smithi107.stdout: "reply": 0, 2024-05-10T11:00:50.792 INFO:teuthology.orchestra.run.smithi107.stdout: "reply_latency": { 2024-05-10T11:00:50.792 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.792 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.792 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_reply": 0, 2024-05-10T11:00:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: "forward": 0, 2024-05-10T11:00:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_complete": 0, 2024-05-10T11:00:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_fetch_keys": 0, 2024-05-10T11:00:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_commit": 0, 2024-05-10T11:00:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_split": 0, 2024-05-10T11:00:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_merge": 0, 2024-05-10T11:00:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes": 300, 2024-05-10T11:00:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_top": 0, 2024-05-10T11:00:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_bottom": 300, 2024-05-10T11:00:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pin_tail": 0, 2024-05-10T11:00:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_pinned": 300, 2024-05-10T11:00:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_expired": 0, 2024-05-10T11:00:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: "inodes_with_caps": 0, 2024-05-10T11:00:50.794 INFO:teuthology.orchestra.run.smithi107.stdout: "caps": 0, 2024-05-10T11:00:50.794 INFO:teuthology.orchestra.run.smithi107.stdout: "subtrees": 1, 2024-05-10T11:00:50.794 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse": 0, 2024-05-10T11:00:50.794 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_hit": 0, 2024-05-10T11:00:50.794 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_forward": 0, 2024-05-10T11:00:50.794 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_discover": 0, 2024-05-10T11:00:50.794 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_dir_fetch": 0, 2024-05-10T11:00:50.794 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_remote_ino": 0, 2024-05-10T11:00:50.794 INFO:teuthology.orchestra.run.smithi107.stdout: "traverse_lock": 0, 2024-05-10T11:00:50.794 INFO:teuthology.orchestra.run.smithi107.stdout: "load_cent": 0, 2024-05-10T11:00:50.794 INFO:teuthology.orchestra.run.smithi107.stdout: "q": 0, 2024-05-10T11:00:50.794 INFO:teuthology.orchestra.run.smithi107.stdout: "exported": 0, 2024-05-10T11:00:50.794 INFO:teuthology.orchestra.run.smithi107.stdout: "exported_inodes": 0, 2024-05-10T11:00:50.794 INFO:teuthology.orchestra.run.smithi107.stdout: "imported": 0, 2024-05-10T11:00:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: "imported_inodes": 0, 2024-05-10T11:00:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_dir_fetch": 0, 2024-05-10T11:00:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_backtrace_fetch": 0, 2024-05-10T11:00:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: "openino_peer_discover": 0, 2024-05-10T11:00:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rfiles": 0, 2024-05-10T11:00:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rbytes": 0, 2024-05-10T11:00:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: "root_rsnaps": 0, 2024-05-10T11:00:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_fetch": 0, 2024-05-10T11:00:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_set_tag": 0, 2024-05-10T11:00:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T11:00:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_inotable_repaired": 0, 2024-05-10T11:00:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_inodes": 0, 2024-05-10T11:00:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dir_base_inodes": 0, 2024-05-10T11:00:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_dirfrag_rstats": 0, 2024-05-10T11:00:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: "scrub_file_inodes": 0, 2024-05-10T11:00:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_inode_file_caps": 0, 2024-05-10T11:00:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_revoke": 0, 2024-05-10T11:00:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_grant": 0, 2024-05-10T11:00:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T11:00:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T11:00:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T11:00:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps": 0, 2024-05-10T11:00:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_caps_dirty": 0, 2024-05-10T11:00:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_cap_release": 0, 2024-05-10T11:00:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: "process_request_cap_release": 0 2024-05-10T11:00:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_cache": { 2024-05-10T11:00:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update": 0, 2024-05-10T11:00:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_update_receipt": 0, 2024-05-10T11:00:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_try_discover": 0, 2024-05-10T11:00:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_send_discover": 0, 2024-05-10T11:00:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: "dir_handle_discover": 0, 2024-05-10T11:00:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays": 0, 2024-05-10T11:00:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_delayed": 0, 2024-05-10T11:00:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: "num_strays_enqueuing": 0, 2024-05-10T11:00:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_created": 0, 2024-05-10T11:00:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_enqueued": 0, 2024-05-10T11:00:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_reintegrated": 0, 2024-05-10T11:00:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: "strays_migrated": 0, 2024-05-10T11:00:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_processing": 0, 2024-05-10T11:00:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_enqueued": 0, 2024-05-10T11:00:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: "num_recovering_prioritized": 0, 2024-05-10T11:00:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_started": 0, 2024-05-10T11:00:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: "recovery_completed": 0, 2024-05-10T11:00:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_quiesce_path": 0, 2024-05-10T11:00:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_quiesce_inode": 0, 2024-05-10T11:00:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_enqueue_scrub": 0, 2024-05-10T11:00:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_exportdir": 0, 2024-05-10T11:00:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_flush": 0, 2024-05-10T11:00:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragmentdir": 0, 2024-05-10T11:00:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_fragstats": 0, 2024-05-10T11:00:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: "ireq_inodestats": 0 2024-05-10T11:00:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_log": { 2024-05-10T11:00:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: "evlrg": 0, 2024-05-10T11:00:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: "evadd": 0, 2024-05-10T11:00:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: "evex": 0, 2024-05-10T11:00:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: "evtrm": 0, 2024-05-10T11:00:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: "ev": 1133, 2024-05-10T11:00:50.799 INFO:teuthology.orchestra.run.smithi107.stdout: "evexg": 0, 2024-05-10T11:00:50.799 INFO:teuthology.orchestra.run.smithi107.stdout: "evexd": 0, 2024-05-10T11:00:50.799 INFO:teuthology.orchestra.run.smithi107.stdout: "segadd": 0, 2024-05-10T11:00:50.799 INFO:teuthology.orchestra.run.smithi107.stdout: "segex": 0, 2024-05-10T11:00:50.799 INFO:teuthology.orchestra.run.smithi107.stdout: "segtrm": 0, 2024-05-10T11:00:50.800 INFO:teuthology.orchestra.run.smithi107.stdout: "seg": 3, 2024-05-10T11:00:50.800 INFO:teuthology.orchestra.run.smithi107.stdout: "segmjr": 2, 2024-05-10T11:00:50.800 INFO:teuthology.orchestra.run.smithi107.stdout: "segexg": 0, 2024-05-10T11:00:50.800 INFO:teuthology.orchestra.run.smithi107.stdout: "segexd": 0, 2024-05-10T11:00:50.800 INFO:teuthology.orchestra.run.smithi107.stdout: "expos": 4194304, 2024-05-10T11:00:50.800 INFO:teuthology.orchestra.run.smithi107.stdout: "wrpos": 6244145, 2024-05-10T11:00:50.800 INFO:teuthology.orchestra.run.smithi107.stdout: "rdpos": 6243007, 2024-05-10T11:00:50.800 INFO:teuthology.orchestra.run.smithi107.stdout: "jlat": { 2024-05-10T11:00:50.800 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.801 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.801 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.801 INFO:teuthology.orchestra.run.smithi107.stdout: "replayed": 1133 2024-05-10T11:00:50.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.801 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_mem": { 2024-05-10T11:00:50.801 INFO:teuthology.orchestra.run.smithi107.stdout: "ino": 7, 2024-05-10T11:00:50.801 INFO:teuthology.orchestra.run.smithi107.stdout: "ino+": 341, 2024-05-10T11:00:50.801 INFO:teuthology.orchestra.run.smithi107.stdout: "ino-": 334, 2024-05-10T11:00:50.801 INFO:teuthology.orchestra.run.smithi107.stdout: "dir": 5, 2024-05-10T11:00:50.801 INFO:teuthology.orchestra.run.smithi107.stdout: "dir+": 100, 2024-05-10T11:00:50.801 INFO:teuthology.orchestra.run.smithi107.stdout: "dir-": 95, 2024-05-10T11:00:50.801 INFO:teuthology.orchestra.run.smithi107.stdout: "dn": 300, 2024-05-10T11:00:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: "dn+": 537, 2024-05-10T11:00:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: "dn-": 237, 2024-05-10T11:00:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: "cap": 0, 2024-05-10T11:00:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: "cap+": 0, 2024-05-10T11:00:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: "cap-": 0, 2024-05-10T11:00:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: "rss": 51388, 2024-05-10T11:00:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: "heap": 215416 2024-05-10T11:00:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_server": { 2024-05-10T11:00:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_client_request": 0, 2024-05-10T11:00:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: "dispatch_server_request": 0, 2024-05-10T11:00:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_request": 0, 2024-05-10T11:00:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_client_session": 0, 2024-05-10T11:00:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: "handle_peer_request": 0, 2024-05-10T11:00:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: "req_create_latency": { 2024-05-10T11:00:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getattr_latency": { 2024-05-10T11:00:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.804 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getfilelock_latency": { 2024-05-10T11:00:50.804 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.804 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.804 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.804 INFO:teuthology.orchestra.run.smithi107.stdout: "req_link_latency": { 2024-05-10T11:00:50.804 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.804 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.804 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.804 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookup_latency": { 2024-05-10T11:00:50.804 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.804 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.805 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.805 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookuphash_latency": { 2024-05-10T11:00:50.805 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.805 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.805 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.805 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupino_latency": { 2024-05-10T11:00:50.805 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.805 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.805 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.805 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupname_latency": { 2024-05-10T11:00:50.806 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.806 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.806 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.806 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupparent_latency": { 2024-05-10T11:00:50.806 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.806 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.806 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.806 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lookupsnap_latency": { 2024-05-10T11:00:50.806 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.806 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.806 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.807 INFO:teuthology.orchestra.run.smithi107.stdout: "req_lssnap_latency": { 2024-05-10T11:00:50.807 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.807 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.807 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.807 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mkdir_latency": { 2024-05-10T11:00:50.807 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.808 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.808 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.808 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mknod_latency": { 2024-05-10T11:00:50.808 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.809 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.809 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.809 INFO:teuthology.orchestra.run.smithi107.stdout: "req_mksnap_latency": { 2024-05-10T11:00:50.809 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.809 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.809 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.809 INFO:teuthology.orchestra.run.smithi107.stdout: "req_open_latency": { 2024-05-10T11:00:50.809 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.809 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.810 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.810 INFO:teuthology.orchestra.run.smithi107.stdout: "req_readdir_latency": { 2024-05-10T11:00:50.810 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.810 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.810 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.810 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rename_latency": { 2024-05-10T11:00:50.810 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.810 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.811 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.811 INFO:teuthology.orchestra.run.smithi107.stdout: "req_renamesnap_latency": { 2024-05-10T11:00:50.811 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.811 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.811 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.811 INFO:teuthology.orchestra.run.smithi107.stdout: "req_snapdiff_latency": { 2024-05-10T11:00:50.811 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.811 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.812 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.812 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmdir_latency": { 2024-05-10T11:00:50.812 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.812 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.812 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.812 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmsnap_latency": { 2024-05-10T11:00:50.813 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.813 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.813 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.813 INFO:teuthology.orchestra.run.smithi107.stdout: "req_rmxattr_latency": { 2024-05-10T11:00:50.813 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.813 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.814 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.814 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setattr_latency": { 2024-05-10T11:00:50.814 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.814 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.814 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.814 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setdirlayout_latency": { 2024-05-10T11:00:50.814 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.815 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.815 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.815 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setfilelock_latency": { 2024-05-10T11:00:50.815 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.815 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.815 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.815 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setlayout_latency": { 2024-05-10T11:00:50.815 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.816 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.816 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.816 INFO:teuthology.orchestra.run.smithi107.stdout: "req_setxattr_latency": { 2024-05-10T11:00:50.816 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.816 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.816 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.817 INFO:teuthology.orchestra.run.smithi107.stdout: "req_symlink_latency": { 2024-05-10T11:00:50.817 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.817 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.817 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.817 INFO:teuthology.orchestra.run.smithi107.stdout: "req_unlink_latency": { 2024-05-10T11:00:50.817 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.818 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.818 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.818 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_revoke_eviction": 0, 2024-05-10T11:00:50.818 INFO:teuthology.orchestra.run.smithi107.stdout: "cap_acquisition_throttle": 0, 2024-05-10T11:00:50.818 INFO:teuthology.orchestra.run.smithi107.stdout: "req_getvxattr_latency": { 2024-05-10T11:00:50.818 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.818 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.819 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.819 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:50.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.819 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_sessions": { 2024-05-10T11:00:50.819 INFO:teuthology.orchestra.run.smithi107.stdout: "session_count": 1, 2024-05-10T11:00:50.819 INFO:teuthology.orchestra.run.smithi107.stdout: "session_add": 2, 2024-05-10T11:00:50.819 INFO:teuthology.orchestra.run.smithi107.stdout: "session_remove": 1, 2024-05-10T11:00:50.819 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_open": 1, 2024-05-10T11:00:50.819 INFO:teuthology.orchestra.run.smithi107.stdout: "sessions_stale": 0, 2024-05-10T11:00:50.819 INFO:teuthology.orchestra.run.smithi107.stdout: "total_load": 0, 2024-05-10T11:00:50.820 INFO:teuthology.orchestra.run.smithi107.stdout: "average_load": 0, 2024-05-10T11:00:50.820 INFO:teuthology.orchestra.run.smithi107.stdout: "avg_session_uptime": 1526, 2024-05-10T11:00:50.820 INFO:teuthology.orchestra.run.smithi107.stdout: "mdthresh_evicted": 0 2024-05-10T11:00:50.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.820 INFO:teuthology.orchestra.run.smithi107.stdout: "mempool": { 2024-05-10T11:00:50.820 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_bytes": 0, 2024-05-10T11:00:50.820 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_items": 0, 2024-05-10T11:00:50.820 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T11:00:50.821 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_items": 0, 2024-05-10T11:00:50.821 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T11:00:50.821 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_items": 0, 2024-05-10T11:00:50.821 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T11:00:50.821 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T11:00:50.821 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T11:00:50.821 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T11:00:50.822 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T11:00:50.822 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_items": 0, 2024-05-10T11:00:50.822 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T11:00:50.822 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T11:00:50.822 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_bytes": 0, 2024-05-10T11:00:50.823 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_items": 0, 2024-05-10T11:00:50.823 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_bytes": 0, 2024-05-10T11:00:50.823 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_items": 0, 2024-05-10T11:00:50.823 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T11:00:50.823 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T11:00:50.823 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T11:00:50.824 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T11:00:50.824 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T11:00:50.825 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_items": 0, 2024-05-10T11:00:50.825 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_bytes": 0, 2024-05-10T11:00:50.825 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_items": 0, 2024-05-10T11:00:50.825 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T11:00:50.825 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T11:00:50.826 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_bytes": 0, 2024-05-10T11:00:50.826 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_items": 0, 2024-05-10T11:00:50.826 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_bytes": 0, 2024-05-10T11:00:50.826 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_items": 0, 2024-05-10T11:00:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T11:00:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_items": 0, 2024-05-10T11:00:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T11:00:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_items": 0, 2024-05-10T11:00:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_bytes": 197493, 2024-05-10T11:00:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_items": 56, 2024-05-10T11:00:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_bytes": 0, 2024-05-10T11:00:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_items": 0, 2024-05-10T11:00:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_bytes": 0, 2024-05-10T11:00:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_items": 0, 2024-05-10T11:00:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_bytes": 0, 2024-05-10T11:00:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_items": 0, 2024-05-10T11:00:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_bytes": 0, 2024-05-10T11:00:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_items": 0, 2024-05-10T11:00:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_bytes": 7336, 2024-05-10T11:00:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_items": 154, 2024-05-10T11:00:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T11:00:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_items": 0, 2024-05-10T11:00:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_bytes": 0, 2024-05-10T11:00:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_items": 0, 2024-05-10T11:00:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_bytes": 234503, 2024-05-10T11:00:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_items": 1617, 2024-05-10T11:00:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_bytes": 0, 2024-05-10T11:00:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_items": 0, 2024-05-10T11:00:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, 2024-05-10T11:00:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 2024-05-10T11:00:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "objecter": { 2024-05-10T11:00:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "op_active": 0, 2024-05-10T11:00:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "op_laggy": 0, 2024-05-10T11:00:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send": 1367, 2024-05-10T11:00:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "op_send_bytes": 21, 2024-05-10T11:00:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "op_resend": 3, 2024-05-10T11:00:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "op_reply": 1367, 2024-05-10T11:00:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "op_latency": { 2024-05-10T11:00:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 1367, 2024-05-10T11:00:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.732988228, 2024-05-10T11:00:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000536202 2024-05-10T11:00:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "op_inflight": 0, 2024-05-10T11:00:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "oplen_avg": { 2024-05-10T11:00:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 1367, 2024-05-10T11:00:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 1368 2024-05-10T11:00:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "op": 1367, 2024-05-10T11:00:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "op_r": 1367, 2024-05-10T11:00:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "op_w": 0, 2024-05-10T11:00:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "op_rmw": 0, 2024-05-10T11:00:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "op_pg": 0, 2024-05-10T11:00:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_stat": 816, 2024-05-10T11:00:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_create": 0, 2024-05-10T11:00:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_read": 549, 2024-05-10T11:00:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_write": 0, 2024-05-10T11:00:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writefull": 0, 2024-05-10T11:00:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_writesame": 0, 2024-05-10T11:00:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_append": 0, 2024-05-10T11:00:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_zero": 0, 2024-05-10T11:00:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_truncate": 0, 2024-05-10T11:00:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_delete": 0, 2024-05-10T11:00:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_mapext": 0, 2024-05-10T11:00:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_sparse_read": 0, 2024-05-10T11:00:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_clonerange": 0, 2024-05-10T11:00:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_getxattr": 1, 2024-05-10T11:00:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_setxattr": 0, 2024-05-10T11:00:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_cmpxattr": 0, 2024-05-10T11:00:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_rmxattr": 0, 2024-05-10T11:00:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_resetxattrs": 0, 2024-05-10T11:00:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_call": 0, 2024-05-10T11:00:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_watch": 0, 2024-05-10T11:00:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_notify": 0, 2024-05-10T11:00:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T11:00:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls": 0, 2024-05-10T11:00:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_pgls_filter": 0, 2024-05-10T11:00:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "osdop_other": 0, 2024-05-10T11:00:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_active": 0, 2024-05-10T11:00:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_send": 0, 2024-05-10T11:00:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_resend": 0, 2024-05-10T11:00:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "linger_ping": 0, 2024-05-10T11:00:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_active": 0, 2024-05-10T11:00:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_send": 0, 2024-05-10T11:00:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "poolop_resend": 0, 2024-05-10T11:00:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_active": 0, 2024-05-10T11:00:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_send": 0, 2024-05-10T11:00:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "poolstat_resend": 0, 2024-05-10T11:00:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_active": 0, 2024-05-10T11:00:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_send": 0, 2024-05-10T11:00:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "statfs_resend": 0, 2024-05-10T11:00:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "command_active": 0, 2024-05-10T11:00:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "command_send": 0, 2024-05-10T11:00:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "command_resend": 0, 2024-05-10T11:00:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "map_epoch": 82, 2024-05-10T11:00:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "map_full": 0, 2024-05-10T11:00:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "map_inc": 2, 2024-05-10T11:00:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_sessions": 6, 2024-05-10T11:00:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_open": 6, 2024-05-10T11:00:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_session_close": 0, 2024-05-10T11:00:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_laggy": 0, 2024-05-10T11:00:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_wr": 0, 2024-05-10T11:00:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_rd": 2, 2024-05-10T11:00:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_del": 0 2024-05-10T11:00:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "oft": { 2024-05-10T11:00:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_objs": 0, 2024-05-10T11:00:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_kv_pairs": 0, 2024-05-10T11:00:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_updates": 0, 2024-05-10T11:00:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "omap_total_removes": 0 2024-05-10T11:00:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "osd-slow-ops": { 2024-05-10T11:00:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "slow_ops_count": 0 2024-05-10T11:00:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "purge_queue": { 2024-05-10T11:00:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops": 0, 2024-05-10T11:00:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_ops_high_water": 0, 2024-05-10T11:00:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing": 0, 2024-05-10T11:00:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executing_high_water": 0, 2024-05-10T11:00:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executed_ops": 0, 2024-05-10T11:00:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_executed": 0, 2024-05-10T11:00:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "pq_item_in_journal": 0 2024-05-10T11:00:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T11:00:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-05-10T11:00:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2024-05-10T11:00:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-05-10T11:00:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 1537, 2024-05-10T11:00:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 3176567, 2024-05-10T11:00:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-05-10T11:00:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 1537, 2024-05-10T11:00:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-05-10T11:00:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-05-10T11:00:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 1537, 2024-05-10T11:00:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 3176567, 2024-05-10T11:00:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-05-10T11:00:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_bytes": { 2024-05-10T11:00:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-05-10T11:00:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2024-05-10T11:00:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-05-10T11:00:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-05-10T11:00:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-05-10T11:00:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-05-10T11:00:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-05-10T11:00:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 1367, 2024-05-10T11:00:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 2049846, 2024-05-10T11:00:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 1367, 2024-05-10T11:00:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 2049846, 2024-05-10T11:00:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-05-10T11:00:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-objecter_ops": { 2024-05-10T11:00:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-05-10T11:00:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 1024, 2024-05-10T11:00:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-05-10T11:00:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-05-10T11:00:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-05-10T11:00:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-05-10T11:00:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-05-10T11:00:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 1367, 2024-05-10T11:00:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 1367, 2024-05-10T11:00:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 1367, 2024-05-10T11:00:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 1367, 2024-05-10T11:00:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-05-10T11:00:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle": { 2024-05-10T11:00:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-05-10T11:00:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2024-05-10T11:00:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-05-10T11:00:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-05-10T11:00:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-05-10T11:00:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-05-10T11:00:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-05-10T11:00:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-05-10T11:00:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-05-10T11:00:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 0, 2024-05-10T11:00:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 0, 2024-05-10T11:00:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-05-10T11:00:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-write_buf_throttle-0x55ad46ff06e0": { 2024-05-10T11:00:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-05-10T11:00:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 3758096384, 2024-05-10T11:00:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-05-10T11:00:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 0, 2024-05-10T11:00:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 0, 2024-05-10T11:00:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-05-10T11:00:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 0, 2024-05-10T11:00:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-05-10T11:00:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-05-10T11:00:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 0, 2024-05-10T11:00:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 0, 2024-05-10T11:00:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-05-10T11:00:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:50.841 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:50.841 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T11:00:51.637 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-05-10T11:00:51.638 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-05-10T11:00:51.638 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-05-10T11:00:51.638 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-05-10T11:00:51.638 DEBUG:tasks.check_counter:Getting stats from j 2024-05-10T11:00:51.638 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph daemon mds.j perf dump 2024-05-10T11:00:51.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:51 smithi196 ceph-mon[34872]: pgmap v543: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-05-10T11:00:51.881 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T11:00:51.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:51 smithi184 ceph-mon[34585]: pgmap v543: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-05-10T11:00:51.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:51 smithi107 ceph-mon[30373]: pgmap v543: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-05-10T11:00:53.566 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-10T11:00:53.566 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T11:00:53.566 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 0, 2024-05-10T11:00:53.566 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 2, 2024-05-10T11:00:53.567 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 0, 2024-05-10T11:00:53.567 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 0, 2024-05-10T11:00:53.567 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 4, 2024-05-10T11:00:53.567 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 0, 2024-05-10T11:00:53.567 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.001080654, 2024-05-10T11:00:53.567 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.000000000, 2024-05-10T11:00:53.567 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.000262291, 2024-05-10T11:00:53.567 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-10T11:00:53.567 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:00:53.567 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:53.567 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:53.567 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:53.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:53.568 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:00:53.568 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:53.568 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:53.568 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:53.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:53.568 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-10T11:00:53.568 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 0 2024-05-10T11:00:53.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:53.568 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T11:00:53.568 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 158, 2024-05-10T11:00:53.568 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 153, 2024-05-10T11:00:53.568 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 795568, 2024-05-10T11:00:53.568 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 93008, 2024-05-10T11:00:53.568 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 2, 2024-05-10T11:00:53.569 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 1, 2024-05-10T11:00:53.569 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.028089714, 2024-05-10T11:00:53.569 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.009520493, 2024-05-10T11:00:53.569 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.019778519, 2024-05-10T11:00:53.569 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.002718994, 2024-05-10T11:00:53.569 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:00:53.569 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 152, 2024-05-10T11:00:53.569 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.007202222, 2024-05-10T11:00:53.569 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000047383 2024-05-10T11:00:53.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:53.569 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:00:53.569 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:53.569 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:53.569 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:53.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:53.570 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 795568, 2024-05-10T11:00:53.570 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 93008 2024-05-10T11:00:53.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:53.570 INFO:teuthology.orchestra.run.smithi107.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T11:00:53.570 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_messages": 5, 2024-05-10T11:00:53.570 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages": 117, 2024-05-10T11:00:53.570 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_bytes": 3200, 2024-05-10T11:00:53.570 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_bytes": 99296, 2024-05-10T11:00:53.570 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_created_connections": 3, 2024-05-10T11:00:53.570 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_active_connections": 2, 2024-05-10T11:00:53.570 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_total_time": 0.008855494, 2024-05-10T11:00:53.570 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_send_time": 0.006363476, 2024-05-10T11:00:53.570 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_recv_time": 0.001428507, 2024-05-10T11:00:53.571 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-10T11:00:53.571 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:00:53.571 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 116, 2024-05-10T11:00:53.571 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.006704229, 2024-05-10T11:00:53.571 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000057795 2024-05-10T11:00:53.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:53.571 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:00:53.571 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:53.571 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:53.571 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:53.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:53.571 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-05-10T11:00:53.571 INFO:teuthology.orchestra.run.smithi107.stdout: "msgr_send_encrypted_bytes": 99296 2024-05-10T11:00:53.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:53.572 INFO:teuthology.orchestra.run.smithi107.stdout: "cct": { 2024-05-10T11:00:53.572 INFO:teuthology.orchestra.run.smithi107.stdout: "total_workers": 0, 2024-05-10T11:00:53.572 INFO:teuthology.orchestra.run.smithi107.stdout: "unhealthy_workers": 0 2024-05-10T11:00:53.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:53.572 INFO:teuthology.orchestra.run.smithi107.stdout: "mempool": { 2024-05-10T11:00:53.572 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_bytes": 0, 2024-05-10T11:00:53.572 INFO:teuthology.orchestra.run.smithi107.stdout: "bloom_filter_items": 0, 2024-05-10T11:00:53.572 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T11:00:53.572 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_alloc_items": 0, 2024-05-10T11:00:53.572 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T11:00:53.572 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_data_items": 0, 2024-05-10T11:00:53.572 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T11:00:53.572 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T11:00:53.572 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T11:00:53.572 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T11:00:53.573 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T11:00:53.573 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_other_items": 0, 2024-05-10T11:00:53.573 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T11:00:53.573 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T11:00:53.573 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_bytes": 0, 2024-05-10T11:00:53.573 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_extent_items": 0, 2024-05-10T11:00:53.573 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_bytes": 0, 2024-05-10T11:00:53.573 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_blob_items": 0, 2024-05-10T11:00:53.573 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T11:00:53.573 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T11:00:53.573 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T11:00:53.573 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T11:00:53.573 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T11:00:53.573 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_fsck_items": 0, 2024-05-10T11:00:53.573 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_bytes": 0, 2024-05-10T11:00:53.573 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_txc_items": 0, 2024-05-10T11:00:53.574 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T11:00:53.574 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T11:00:53.574 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_bytes": 0, 2024-05-10T11:00:53.574 INFO:teuthology.orchestra.run.smithi107.stdout: "bluestore_writing_items": 0, 2024-05-10T11:00:53.574 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_bytes": 0, 2024-05-10T11:00:53.574 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_items": 0, 2024-05-10T11:00:53.574 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T11:00:53.574 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_reader_items": 0, 2024-05-10T11:00:53.574 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T11:00:53.574 INFO:teuthology.orchestra.run.smithi107.stdout: "bluefs_file_writer_items": 0, 2024-05-10T11:00:53.574 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_bytes": 148984, 2024-05-10T11:00:53.574 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_anon_items": 30, 2024-05-10T11:00:53.574 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_bytes": 0, 2024-05-10T11:00:53.574 INFO:teuthology.orchestra.run.smithi107.stdout: "buffer_meta_items": 0, 2024-05-10T11:00:53.575 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_bytes": 0, 2024-05-10T11:00:53.575 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_items": 0, 2024-05-10T11:00:53.575 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_bytes": 0, 2024-05-10T11:00:53.575 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_mapbl_items": 0, 2024-05-10T11:00:53.575 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_bytes": 0, 2024-05-10T11:00:53.575 INFO:teuthology.orchestra.run.smithi107.stdout: "osd_pglog_items": 0, 2024-05-10T11:00:53.575 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_bytes": 0, 2024-05-10T11:00:53.575 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_items": 0, 2024-05-10T11:00:53.575 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T11:00:53.575 INFO:teuthology.orchestra.run.smithi107.stdout: "osdmap_mapping_items": 0, 2024-05-10T11:00:53.575 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_bytes": 0, 2024-05-10T11:00:53.575 INFO:teuthology.orchestra.run.smithi107.stdout: "pgmap_items": 0, 2024-05-10T11:00:53.575 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_bytes": 928, 2024-05-10T11:00:53.575 INFO:teuthology.orchestra.run.smithi107.stdout: "mds_co_items": 2, 2024-05-10T11:00:53.576 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_bytes": 0, 2024-05-10T11:00:53.576 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_1_items": 0, 2024-05-10T11:00:53.576 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_bytes": 0, 2024-05-10T11:00:53.576 INFO:teuthology.orchestra.run.smithi107.stdout: "unittest_2_items": 0 2024-05-10T11:00:53.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-10T11:00:53.576 INFO:teuthology.orchestra.run.smithi107.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T11:00:53.576 INFO:teuthology.orchestra.run.smithi107.stdout: "val": 0, 2024-05-10T11:00:53.576 INFO:teuthology.orchestra.run.smithi107.stdout: "max": 104857600, 2024-05-10T11:00:53.576 INFO:teuthology.orchestra.run.smithi107.stdout: "get_started": 0, 2024-05-10T11:00:53.576 INFO:teuthology.orchestra.run.smithi107.stdout: "get": 159, 2024-05-10T11:00:53.576 INFO:teuthology.orchestra.run.smithi107.stdout: "get_sum": 773265, 2024-05-10T11:00:53.576 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_fail": 0, 2024-05-10T11:00:53.576 INFO:teuthology.orchestra.run.smithi107.stdout: "get_or_fail_success": 159, 2024-05-10T11:00:53.576 INFO:teuthology.orchestra.run.smithi107.stdout: "take": 0, 2024-05-10T11:00:53.576 INFO:teuthology.orchestra.run.smithi107.stdout: "take_sum": 0, 2024-05-10T11:00:53.577 INFO:teuthology.orchestra.run.smithi107.stdout: "put": 159, 2024-05-10T11:00:53.577 INFO:teuthology.orchestra.run.smithi107.stdout: "put_sum": 773265, 2024-05-10T11:00:53.577 INFO:teuthology.orchestra.run.smithi107.stdout: "wait": { 2024-05-10T11:00:53.577 INFO:teuthology.orchestra.run.smithi107.stdout: "avgcount": 0, 2024-05-10T11:00:53.577 INFO:teuthology.orchestra.run.smithi107.stdout: "sum": 0.000000000, 2024-05-10T11:00:53.577 INFO:teuthology.orchestra.run.smithi107.stdout: "avgtime": 0.000000000 2024-05-10T11:00:53.577 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:53.577 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-10T11:00:53.577 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-10T11:00:53.577 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:53 smithi107 ceph-mon[30373]: pgmap v544: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T11:00:53.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:53 smithi196 ceph-mon[34872]: pgmap v544: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T11:00:53.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:53 smithi184 ceph-mon[34585]: pgmap v544: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T11:00:54.349 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-05-10T11:00:54.349 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-05-10T11:00:54.349 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-05-10T11:00:54.349 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-05-10T11:00:54.350 DEBUG:tasks.check_counter:Getting stats from b 2024-05-10T11:00:54.350 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph daemon mds.b perf dump 2024-05-10T11:00:54.599 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T11:00:55.770 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:55 smithi184 ceph-mon[34585]: pgmap v545: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-05-10T11:00:55.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:55 smithi196 ceph-mon[34872]: pgmap v545: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-05-10T11:00:55.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:55 smithi107 ceph-mon[30373]: pgmap v545: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-05-10T11:00:56.523 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-05-10T11:00:56.524 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T11:00:56.524 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 34675, 2024-05-10T11:00:56.524 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 56629, 2024-05-10T11:00:56.524 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 11311075, 2024-05-10T11:00:56.524 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 44337534, 2024-05-10T11:00:56.524 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 32, 2024-05-10T11:00:56.524 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 3, 2024-05-10T11:00:56.524 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 2.066476092, 2024-05-10T11:00:56.524 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.916854621, 2024-05-10T11:00:56.524 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 1.659704583, 2024-05-10T11:00:56.524 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.139119409, 2024-05-10T11:00:56.524 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:00:56.525 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 56627, 2024-05-10T11:00:56.525 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 4.245021702, 2024-05-10T11:00:56.525 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000074964 2024-05-10T11:00:56.525 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.525 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:00:56.525 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 77742, 2024-05-10T11:00:56.525 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.011730932, 2024-05-10T11:00:56.525 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000150 2024-05-10T11:00:56.525 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.525 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 57696, 2024-05-10T11:00:56.525 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 29856 2024-05-10T11:00:56.525 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.525 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T11:00:56.525 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 8587, 2024-05-10T11:00:56.526 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 11961, 2024-05-10T11:00:56.526 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 2589287, 2024-05-10T11:00:56.526 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 21345551, 2024-05-10T11:00:56.526 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 10, 2024-05-10T11:00:56.526 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 6, 2024-05-10T11:00:56.526 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.738280862, 2024-05-10T11:00:56.526 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.349500795, 2024-05-10T11:00:56.526 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.256634617, 2024-05-10T11:00:56.526 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.135156237, 2024-05-10T11:00:56.526 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:00:56.526 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 11959, 2024-05-10T11:00:56.526 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 4.017196925, 2024-05-10T11:00:56.526 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000335914 2024-05-10T11:00:56.527 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.527 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:00:56.527 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 10669, 2024-05-10T11:00:56.527 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.002065575, 2024-05-10T11:00:56.527 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000193 2024-05-10T11:00:56.527 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.527 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-10T11:00:56.527 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 275360 2024-05-10T11:00:56.527 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.527 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T11:00:56.527 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 10345, 2024-05-10T11:00:56.527 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 16856, 2024-05-10T11:00:56.527 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 3298138, 2024-05-10T11:00:56.528 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 19968155, 2024-05-10T11:00:56.528 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 42, 2024-05-10T11:00:56.528 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 5, 2024-05-10T11:00:56.528 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.879797623, 2024-05-10T11:00:56.528 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.407887245, 2024-05-10T11:00:56.528 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.392680381, 2024-05-10T11:00:56.528 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.109499509, 2024-05-10T11:00:56.528 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:00:56.528 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 16856, 2024-05-10T11:00:56.528 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 2.845681180, 2024-05-10T11:00:56.528 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000168823 2024-05-10T11:00:56.528 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.528 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:00:56.529 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 21554, 2024-05-10T11:00:56.529 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.003728670, 2024-05-10T11:00:56.529 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000172 2024-05-10T11:00:56.529 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.529 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 948576, 2024-05-10T11:00:56.529 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 97152 2024-05-10T11:00:56.529 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.529 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2024-05-10T11:00:56.529 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 1, 2024-05-10T11:00:56.529 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2024-05-10T11:00:56.529 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.529 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-MDSRank": { 2024-05-10T11:00:56.529 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-05-10T11:00:56.529 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-05-10T11:00:56.530 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1738, 2024-05-10T11:00:56.530 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 12.913701995, 2024-05-10T11:00:56.530 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.007430208 2024-05-10T11:00:56.530 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:00:56.530 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.530 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-PurgeQueue": { 2024-05-10T11:00:56.530 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-05-10T11:00:56.530 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-05-10T11:00:56.530 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 6687, 2024-05-10T11:00:56.530 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 1.389508924, 2024-05-10T11:00:56.530 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000207792 2024-05-10T11:00:56.530 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:00:56.530 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.530 INFO:teuthology.orchestra.run.smithi184.stdout: "mds": { 2024-05-10T11:00:56.531 INFO:teuthology.orchestra.run.smithi184.stdout: "request": 11171, 2024-05-10T11:00:56.531 INFO:teuthology.orchestra.run.smithi184.stdout: "reply": 11104, 2024-05-10T11:00:56.531 INFO:teuthology.orchestra.run.smithi184.stdout: "reply_latency": { 2024-05-10T11:00:56.531 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 11104, 2024-05-10T11:00:56.531 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 145.121803297, 2024-05-10T11:00:56.531 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.013069326 2024-05-10T11:00:56.531 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.531 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_reply": 0, 2024-05-10T11:00:56.531 INFO:teuthology.orchestra.run.smithi184.stdout: "forward": 67, 2024-05-10T11:00:56.531 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_complete": 1, 2024-05-10T11:00:56.531 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_keys": 0, 2024-05-10T11:00:56.531 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_commit": 591, 2024-05-10T11:00:56.531 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_split": 8, 2024-05-10T11:00:56.532 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_merge": 1, 2024-05-10T11:00:56.532 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes": 253, 2024-05-10T11:00:56.532 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_top": 56, 2024-05-10T11:00:56.532 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_bottom": 186, 2024-05-10T11:00:56.532 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pin_tail": 11, 2024-05-10T11:00:56.532 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pinned": 172, 2024-05-10T11:00:56.532 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_expired": 3345, 2024-05-10T11:00:56.532 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_with_caps": 1, 2024-05-10T11:00:56.532 INFO:teuthology.orchestra.run.smithi184.stdout: "caps": 1, 2024-05-10T11:00:56.532 INFO:teuthology.orchestra.run.smithi184.stdout: "subtrees": 7, 2024-05-10T11:00:56.532 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse": 12335, 2024-05-10T11:00:56.532 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_hit": 11557, 2024-05-10T11:00:56.532 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_forward": 36, 2024-05-10T11:00:56.532 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_discover": 174, 2024-05-10T11:00:56.533 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_dir_fetch": 0, 2024-05-10T11:00:56.533 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_remote_ino": 0, 2024-05-10T11:00:56.533 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_lock": 0, 2024-05-10T11:00:56.533 INFO:teuthology.orchestra.run.smithi184.stdout: "load_cent": 0, 2024-05-10T11:00:56.533 INFO:teuthology.orchestra.run.smithi184.stdout: "q": 0, 2024-05-10T11:00:56.533 INFO:teuthology.orchestra.run.smithi184.stdout: "exported": 152, 2024-05-10T11:00:56.533 INFO:teuthology.orchestra.run.smithi184.stdout: "exported_inodes": 2859, 2024-05-10T11:00:56.533 INFO:teuthology.orchestra.run.smithi184.stdout: "imported": 36, 2024-05-10T11:00:56.533 INFO:teuthology.orchestra.run.smithi184.stdout: "imported_inodes": 235, 2024-05-10T11:00:56.533 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_dir_fetch": 0, 2024-05-10T11:00:56.533 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_backtrace_fetch": 0, 2024-05-10T11:00:56.533 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_peer_discover": 0, 2024-05-10T11:00:56.533 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rfiles": 269, 2024-05-10T11:00:56.533 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rbytes": 2580817, 2024-05-10T11:00:56.533 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rsnaps": 0, 2024-05-10T11:00:56.533 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_fetch": 0, 2024-05-10T11:00:56.534 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_set_tag": 0, 2024-05-10T11:00:56.534 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T11:00:56.534 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_inotable_repaired": 0, 2024-05-10T11:00:56.534 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_inodes": 0, 2024-05-10T11:00:56.534 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_base_inodes": 0, 2024-05-10T11:00:56.534 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dirfrag_rstats": 0, 2024-05-10T11:00:56.534 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_file_inodes": 0, 2024-05-10T11:00:56.534 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_inode_file_caps": 58, 2024-05-10T11:00:56.534 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_revoke": 1279, 2024-05-10T11:00:56.534 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_grant": 10731, 2024-05-10T11:00:56.534 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T11:00:56.534 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T11:00:56.534 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T11:00:56.534 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps": 7040, 2024-05-10T11:00:56.535 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps_dirty": 5906, 2024-05-10T11:00:56.535 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_cap_release": 43, 2024-05-10T11:00:56.535 INFO:teuthology.orchestra.run.smithi184.stdout: "process_request_cap_release": 4903 2024-05-10T11:00:56.535 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.535 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_cache": { 2024-05-10T11:00:56.535 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update": 1327, 2024-05-10T11:00:56.535 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update_receipt": 660, 2024-05-10T11:00:56.535 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_try_discover": 416, 2024-05-10T11:00:56.535 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_send_discover": 464, 2024-05-10T11:00:56.535 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_handle_discover": 2809, 2024-05-10T11:00:56.535 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays": 23, 2024-05-10T11:00:56.535 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_delayed": 0, 2024-05-10T11:00:56.535 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_enqueuing": 0, 2024-05-10T11:00:56.535 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_created": 3839, 2024-05-10T11:00:56.535 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_enqueued": 3816, 2024-05-10T11:00:56.536 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_reintegrated": 0, 2024-05-10T11:00:56.536 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_migrated": 0, 2024-05-10T11:00:56.536 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_processing": 0, 2024-05-10T11:00:56.536 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_enqueued": 0, 2024-05-10T11:00:56.536 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_prioritized": 0, 2024-05-10T11:00:56.536 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_started": 0, 2024-05-10T11:00:56.536 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_completed": 0, 2024-05-10T11:00:56.536 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_path": 3, 2024-05-10T11:00:56.536 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_inode": 507, 2024-05-10T11:00:56.536 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_enqueue_scrub": 0, 2024-05-10T11:00:56.536 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_exportdir": 152, 2024-05-10T11:00:56.536 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_flush": 0, 2024-05-10T11:00:56.536 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragmentdir": 9, 2024-05-10T11:00:56.536 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragstats": 0, 2024-05-10T11:00:56.537 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_inodestats": 0 2024-05-10T11:00:56.537 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.537 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_log": { 2024-05-10T11:00:56.537 INFO:teuthology.orchestra.run.smithi184.stdout: "evlrg": 0, 2024-05-10T11:00:56.537 INFO:teuthology.orchestra.run.smithi184.stdout: "evadd": 22439, 2024-05-10T11:00:56.537 INFO:teuthology.orchestra.run.smithi184.stdout: "evex": 17616, 2024-05-10T11:00:56.537 INFO:teuthology.orchestra.run.smithi184.stdout: "evtrm": 17616, 2024-05-10T11:00:56.537 INFO:teuthology.orchestra.run.smithi184.stdout: "ev": 4823, 2024-05-10T11:00:56.537 INFO:teuthology.orchestra.run.smithi184.stdout: "evexg": 0, 2024-05-10T11:00:56.537 INFO:teuthology.orchestra.run.smithi184.stdout: "evexd": 9942, 2024-05-10T11:00:56.537 INFO:teuthology.orchestra.run.smithi184.stdout: "segadd": 43, 2024-05-10T11:00:56.537 INFO:teuthology.orchestra.run.smithi184.stdout: "segex": 36, 2024-05-10T11:00:56.537 INFO:teuthology.orchestra.run.smithi184.stdout: "segtrm": 36, 2024-05-10T11:00:56.537 INFO:teuthology.orchestra.run.smithi184.stdout: "seg": 7, 2024-05-10T11:00:56.537 INFO:teuthology.orchestra.run.smithi184.stdout: "segmjr": 1, 2024-05-10T11:00:56.538 INFO:teuthology.orchestra.run.smithi184.stdout: "segexg": 0, 2024-05-10T11:00:56.538 INFO:teuthology.orchestra.run.smithi184.stdout: "segexd": 13, 2024-05-10T11:00:56.538 INFO:teuthology.orchestra.run.smithi184.stdout: "expos": 40719719, 2024-05-10T11:00:56.538 INFO:teuthology.orchestra.run.smithi184.stdout: "wrpos": 49638336, 2024-05-10T11:00:56.538 INFO:teuthology.orchestra.run.smithi184.stdout: "rdpos": 0, 2024-05-10T11:00:56.538 INFO:teuthology.orchestra.run.smithi184.stdout: "jlat": { 2024-05-10T11:00:56.538 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1334, 2024-05-10T11:00:56.538 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 72.700340262, 2024-05-10T11:00:56.538 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.054498006 2024-05-10T11:00:56.538 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.538 INFO:teuthology.orchestra.run.smithi184.stdout: "replayed": 0 2024-05-10T11:00:56.538 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.538 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_mem": { 2024-05-10T11:00:56.539 INFO:teuthology.orchestra.run.smithi184.stdout: "ino": 56, 2024-05-10T11:00:56.539 INFO:teuthology.orchestra.run.smithi184.stdout: "ino+": 6917, 2024-05-10T11:00:56.539 INFO:teuthology.orchestra.run.smithi184.stdout: "ino-": 6861, 2024-05-10T11:00:56.539 INFO:teuthology.orchestra.run.smithi184.stdout: "dir": 73, 2024-05-10T11:00:56.539 INFO:teuthology.orchestra.run.smithi184.stdout: "dir+": 867, 2024-05-10T11:00:56.539 INFO:teuthology.orchestra.run.smithi184.stdout: "dir-": 794, 2024-05-10T11:00:56.539 INFO:teuthology.orchestra.run.smithi184.stdout: "dn": 253, 2024-05-10T11:00:56.539 INFO:teuthology.orchestra.run.smithi184.stdout: "dn+": 11235, 2024-05-10T11:00:56.539 INFO:teuthology.orchestra.run.smithi184.stdout: "dn-": 10982, 2024-05-10T11:00:56.539 INFO:teuthology.orchestra.run.smithi184.stdout: "cap": 1, 2024-05-10T11:00:56.539 INFO:teuthology.orchestra.run.smithi184.stdout: "cap+": 6727, 2024-05-10T11:00:56.539 INFO:teuthology.orchestra.run.smithi184.stdout: "cap-": 6726, 2024-05-10T11:00:56.539 INFO:teuthology.orchestra.run.smithi184.stdout: "rss": 97756, 2024-05-10T11:00:56.539 INFO:teuthology.orchestra.run.smithi184.stdout: "heap": 231800 2024-05-10T11:00:56.539 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.540 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_server": { 2024-05-10T11:00:56.540 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_client_request": 13419, 2024-05-10T11:00:56.540 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_server_request": 1113, 2024-05-10T11:00:56.540 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_request": 11171, 2024-05-10T11:00:56.540 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_session": 160, 2024-05-10T11:00:56.540 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_peer_request": 2630, 2024-05-10T11:00:56.540 INFO:teuthology.orchestra.run.smithi184.stdout: "req_create_latency": { 2024-05-10T11:00:56.540 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 6192, 2024-05-10T11:00:56.540 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 102.107905971, 2024-05-10T11:00:56.540 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.016490294 2024-05-10T11:00:56.540 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.540 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getattr_latency": { 2024-05-10T11:00:56.540 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 43, 2024-05-10T11:00:56.540 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.056306671, 2024-05-10T11:00:56.540 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001309457 2024-05-10T11:00:56.541 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.541 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getfilelock_latency": { 2024-05-10T11:00:56.541 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.541 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.541 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.541 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.541 INFO:teuthology.orchestra.run.smithi184.stdout: "req_link_latency": { 2024-05-10T11:00:56.541 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.541 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.541 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.541 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.541 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookup_latency": { 2024-05-10T11:00:56.541 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 165, 2024-05-10T11:00:56.542 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 4.279202610, 2024-05-10T11:00:56.542 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.025934561 2024-05-10T11:00:56.542 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.542 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookuphash_latency": { 2024-05-10T11:00:56.542 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.542 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.542 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.542 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.542 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupino_latency": { 2024-05-10T11:00:56.542 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.542 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.542 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.542 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.542 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupname_latency": { 2024-05-10T11:00:56.542 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.543 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.543 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.543 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.543 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupparent_latency": { 2024-05-10T11:00:56.543 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.543 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.543 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.543 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.543 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupsnap_latency": { 2024-05-10T11:00:56.543 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.543 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.543 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.544 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.544 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lssnap_latency": { 2024-05-10T11:00:56.544 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.544 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.544 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.544 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.545 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mkdir_latency": { 2024-05-10T11:00:56.545 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 515, 2024-05-10T11:00:56.545 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 26.612004699, 2024-05-10T11:00:56.545 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.051673795 2024-05-10T11:00:56.545 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.545 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mknod_latency": { 2024-05-10T11:00:56.545 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.545 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.545 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.545 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.545 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mksnap_latency": { 2024-05-10T11:00:56.545 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.545 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.545 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.545 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.546 INFO:teuthology.orchestra.run.smithi184.stdout: "req_open_latency": { 2024-05-10T11:00:56.546 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1, 2024-05-10T11:00:56.546 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000265578, 2024-05-10T11:00:56.546 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000265578 2024-05-10T11:00:56.546 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.546 INFO:teuthology.orchestra.run.smithi184.stdout: "req_readdir_latency": { 2024-05-10T11:00:56.546 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 336, 2024-05-10T11:00:56.546 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.345071092, 2024-05-10T11:00:56.546 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001026997 2024-05-10T11:00:56.546 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.546 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rename_latency": { 2024-05-10T11:00:56.546 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2, 2024-05-10T11:00:56.546 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.003269703, 2024-05-10T11:00:56.547 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001634851 2024-05-10T11:00:56.547 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.547 INFO:teuthology.orchestra.run.smithi184.stdout: "req_renamesnap_latency": { 2024-05-10T11:00:56.547 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.547 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.547 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.547 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.547 INFO:teuthology.orchestra.run.smithi184.stdout: "req_snapdiff_latency": { 2024-05-10T11:00:56.547 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.547 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.547 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.547 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.547 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmdir_latency": { 2024-05-10T11:00:56.547 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 310, 2024-05-10T11:00:56.548 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 6.200902890, 2024-05-10T11:00:56.548 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.020002912 2024-05-10T11:00:56.548 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.548 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmsnap_latency": { 2024-05-10T11:00:56.548 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.548 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.548 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.548 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.548 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmxattr_latency": { 2024-05-10T11:00:56.548 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.548 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.548 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.548 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.548 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setattr_latency": { 2024-05-10T11:00:56.549 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 3, 2024-05-10T11:00:56.549 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.011809582, 2024-05-10T11:00:56.549 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.003936527 2024-05-10T11:00:56.549 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.549 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setdirlayout_latency": { 2024-05-10T11:00:56.549 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.549 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.549 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.549 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.549 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setfilelock_latency": { 2024-05-10T11:00:56.549 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.549 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.549 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.549 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.549 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setlayout_latency": { 2024-05-10T11:00:56.550 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.550 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.550 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.550 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.550 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setxattr_latency": { 2024-05-10T11:00:56.550 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 8, 2024-05-10T11:00:56.550 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.020901157, 2024-05-10T11:00:56.550 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.002612644 2024-05-10T11:00:56.550 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.550 INFO:teuthology.orchestra.run.smithi184.stdout: "req_symlink_latency": { 2024-05-10T11:00:56.550 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.550 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.550 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.551 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.551 INFO:teuthology.orchestra.run.smithi184.stdout: "req_unlink_latency": { 2024-05-10T11:00:56.551 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 3529, 2024-05-10T11:00:56.551 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 5.484163344, 2024-05-10T11:00:56.551 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001554027 2024-05-10T11:00:56.551 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.551 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_revoke_eviction": 0, 2024-05-10T11:00:56.551 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_acquisition_throttle": 0, 2024-05-10T11:00:56.551 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getvxattr_latency": { 2024-05-10T11:00:56.551 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.551 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.551 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.551 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:00:56.551 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.551 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_sessions": { 2024-05-10T11:00:56.552 INFO:teuthology.orchestra.run.smithi184.stdout: "session_count": 1, 2024-05-10T11:00:56.552 INFO:teuthology.orchestra.run.smithi184.stdout: "session_add": 3, 2024-05-10T11:00:56.552 INFO:teuthology.orchestra.run.smithi184.stdout: "session_remove": 2, 2024-05-10T11:00:56.552 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_open": 1, 2024-05-10T11:00:56.552 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_stale": 0, 2024-05-10T11:00:56.552 INFO:teuthology.orchestra.run.smithi184.stdout: "total_load": 8084, 2024-05-10T11:00:56.552 INFO:teuthology.orchestra.run.smithi184.stdout: "average_load": 8084, 2024-05-10T11:00:56.552 INFO:teuthology.orchestra.run.smithi184.stdout: "avg_session_uptime": 322, 2024-05-10T11:00:56.552 INFO:teuthology.orchestra.run.smithi184.stdout: "mdthresh_evicted": 0 2024-05-10T11:00:56.552 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.552 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2024-05-10T11:00:56.552 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 360, 2024-05-10T11:00:56.552 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 360, 2024-05-10T11:00:56.552 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T11:00:56.553 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2024-05-10T11:00:56.553 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T11:00:56.553 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2024-05-10T11:00:56.553 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T11:00:56.553 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T11:00:56.553 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T11:00:56.553 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T11:00:56.553 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T11:00:56.553 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2024-05-10T11:00:56.553 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T11:00:56.553 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T11:00:56.553 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2024-05-10T11:00:56.553 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2024-05-10T11:00:56.553 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2024-05-10T11:00:56.553 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2024-05-10T11:00:56.554 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T11:00:56.554 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T11:00:56.554 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T11:00:56.554 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T11:00:56.554 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T11:00:56.554 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2024-05-10T11:00:56.554 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2024-05-10T11:00:56.554 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2024-05-10T11:00:56.554 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T11:00:56.554 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T11:00:56.554 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2024-05-10T11:00:56.554 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2024-05-10T11:00:56.554 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2024-05-10T11:00:56.555 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2024-05-10T11:00:56.555 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T11:00:56.555 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2024-05-10T11:00:56.555 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T11:00:56.555 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2024-05-10T11:00:56.555 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 311554, 2024-05-10T11:00:56.555 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 129, 2024-05-10T11:00:56.555 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 88, 2024-05-10T11:00:56.555 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 1, 2024-05-10T11:00:56.555 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2024-05-10T11:00:56.555 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2024-05-10T11:00:56.555 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2024-05-10T11:00:56.555 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2024-05-10T11:00:56.555 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2024-05-10T11:00:56.556 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2024-05-10T11:00:56.556 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 7336, 2024-05-10T11:00:56.556 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 154, 2024-05-10T11:00:56.556 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T11:00:56.556 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2024-05-10T11:00:56.556 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2024-05-10T11:00:56.556 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2024-05-10T11:00:56.556 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 427458, 2024-05-10T11:00:56.556 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 6557, 2024-05-10T11:00:56.556 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2024-05-10T11:00:56.556 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2024-05-10T11:00:56.556 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2024-05-10T11:00:56.556 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2024-05-10T11:00:56.556 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.556 INFO:teuthology.orchestra.run.smithi184.stdout: "objecter": { 2024-05-10T11:00:56.557 INFO:teuthology.orchestra.run.smithi184.stdout: "op_active": 0, 2024-05-10T11:00:56.557 INFO:teuthology.orchestra.run.smithi184.stdout: "op_laggy": 0, 2024-05-10T11:00:56.557 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send": 11260, 2024-05-10T11:00:56.557 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send_bytes": 52971095, 2024-05-10T11:00:56.557 INFO:teuthology.orchestra.run.smithi184.stdout: "op_resend": 31, 2024-05-10T11:00:56.557 INFO:teuthology.orchestra.run.smithi184.stdout: "op_reply": 11260, 2024-05-10T11:00:56.557 INFO:teuthology.orchestra.run.smithi184.stdout: "op_latency": { 2024-05-10T11:00:56.557 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 11260, 2024-05-10T11:00:56.557 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 706.431498298, 2024-05-10T11:00:56.557 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.062738143 2024-05-10T11:00:56.557 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.557 INFO:teuthology.orchestra.run.smithi184.stdout: "op_inflight": 0, 2024-05-10T11:00:56.557 INFO:teuthology.orchestra.run.smithi184.stdout: "oplen_avg": { 2024-05-10T11:00:56.557 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 11260, 2024-05-10T11:00:56.558 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 21120 2024-05-10T11:00:56.558 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.558 INFO:teuthology.orchestra.run.smithi184.stdout: "op": 11260, 2024-05-10T11:00:56.558 INFO:teuthology.orchestra.run.smithi184.stdout: "op_r": 114, 2024-05-10T11:00:56.558 INFO:teuthology.orchestra.run.smithi184.stdout: "op_w": 11146, 2024-05-10T11:00:56.558 INFO:teuthology.orchestra.run.smithi184.stdout: "op_rmw": 0, 2024-05-10T11:00:56.558 INFO:teuthology.orchestra.run.smithi184.stdout: "op_pg": 0, 2024-05-10T11:00:56.558 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_stat": 211, 2024-05-10T11:00:56.558 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_create": 4466, 2024-05-10T11:00:56.558 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_read": 113, 2024-05-10T11:00:56.558 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_write": 1447, 2024-05-10T11:00:56.558 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writefull": 109, 2024-05-10T11:00:56.558 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writesame": 0, 2024-05-10T11:00:56.558 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_append": 0, 2024-05-10T11:00:56.559 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_zero": 0, 2024-05-10T11:00:56.559 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_truncate": 8, 2024-05-10T11:00:56.559 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_delete": 4412, 2024-05-10T11:00:56.559 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_mapext": 0, 2024-05-10T11:00:56.559 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_sparse_read": 0, 2024-05-10T11:00:56.559 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_clonerange": 0, 2024-05-10T11:00:56.559 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_getxattr": 1, 2024-05-10T11:00:56.559 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_setxattr": 8932, 2024-05-10T11:00:56.559 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_cmpxattr": 0, 2024-05-10T11:00:56.559 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_rmxattr": 0, 2024-05-10T11:00:56.559 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_resetxattrs": 0, 2024-05-10T11:00:56.559 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_call": 0, 2024-05-10T11:00:56.559 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_watch": 0, 2024-05-10T11:00:56.559 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_notify": 0, 2024-05-10T11:00:56.559 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T11:00:56.560 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls": 0, 2024-05-10T11:00:56.560 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls_filter": 0, 2024-05-10T11:00:56.560 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_other": 0, 2024-05-10T11:00:56.560 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_active": 0, 2024-05-10T11:00:56.560 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_send": 0, 2024-05-10T11:00:56.560 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_resend": 0, 2024-05-10T11:00:56.560 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_ping": 0, 2024-05-10T11:00:56.560 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_active": 0, 2024-05-10T11:00:56.560 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_send": 0, 2024-05-10T11:00:56.560 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_resend": 0, 2024-05-10T11:00:56.560 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_active": 0, 2024-05-10T11:00:56.560 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_send": 0, 2024-05-10T11:00:56.560 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_resend": 0, 2024-05-10T11:00:56.560 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_active": 0, 2024-05-10T11:00:56.561 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_send": 0, 2024-05-10T11:00:56.561 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_resend": 0, 2024-05-10T11:00:56.561 INFO:teuthology.orchestra.run.smithi184.stdout: "command_active": 0, 2024-05-10T11:00:56.561 INFO:teuthology.orchestra.run.smithi184.stdout: "command_send": 0, 2024-05-10T11:00:56.561 INFO:teuthology.orchestra.run.smithi184.stdout: "command_resend": 0, 2024-05-10T11:00:56.561 INFO:teuthology.orchestra.run.smithi184.stdout: "map_epoch": 82, 2024-05-10T11:00:56.561 INFO:teuthology.orchestra.run.smithi184.stdout: "map_full": 0, 2024-05-10T11:00:56.561 INFO:teuthology.orchestra.run.smithi184.stdout: "map_inc": 2, 2024-05-10T11:00:56.561 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_sessions": 12, 2024-05-10T11:00:56.561 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_open": 12, 2024-05-10T11:00:56.561 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_close": 0, 2024-05-10T11:00:56.561 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_laggy": 0, 2024-05-10T11:00:56.561 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_wr": 1349, 2024-05-10T11:00:56.561 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_rd": 2, 2024-05-10T11:00:56.562 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_del": 70 2024-05-10T11:00:56.562 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.562 INFO:teuthology.orchestra.run.smithi184.stdout: "oft": { 2024-05-10T11:00:56.562 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_objs": 1, 2024-05-10T11:00:56.562 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_kv_pairs": 0, 2024-05-10T11:00:56.562 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_updates": 0, 2024-05-10T11:00:56.562 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_removes": 0 2024-05-10T11:00:56.562 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.562 INFO:teuthology.orchestra.run.smithi184.stdout: "osd-slow-ops": { 2024-05-10T11:00:56.562 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_ops_count": 581 2024-05-10T11:00:56.562 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.562 INFO:teuthology.orchestra.run.smithi184.stdout: "purge_queue": { 2024-05-10T11:00:56.562 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops": 0, 2024-05-10T11:00:56.562 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops_high_water": 20, 2024-05-10T11:00:56.563 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing": 0, 2024-05-10T11:00:56.563 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_high_water": 6, 2024-05-10T11:00:56.563 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed_ops": 3878, 2024-05-10T11:00:56.563 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed": 3816, 2024-05-10T11:00:56.563 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_item_in_journal": 0 2024-05-10T11:00:56.563 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.563 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T11:00:56.563 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:00:56.563 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-05-10T11:00:56.563 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:00:56.563 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 53603, 2024-05-10T11:00:56.563 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 12351053, 2024-05-10T11:00:56.563 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:00:56.563 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 53603, 2024-05-10T11:00:56.563 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-05-10T11:00:56.564 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-05-10T11:00:56.564 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 53603, 2024-05-10T11:00:56.564 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 12351053, 2024-05-10T11:00:56.564 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:00:56.564 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.564 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.564 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.564 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:00:56.564 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.564 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_bytes": { 2024-05-10T11:00:56.564 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:00:56.564 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-05-10T11:00:56.564 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:00:56.564 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-05-10T11:00:56.565 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-05-10T11:00:56.565 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:00:56.565 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-05-10T11:00:56.565 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 11260, 2024-05-10T11:00:56.565 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 53356527, 2024-05-10T11:00:56.565 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 11260, 2024-05-10T11:00:56.565 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 53356527, 2024-05-10T11:00:56.565 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:00:56.565 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.565 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.565 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.565 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:00:56.565 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.565 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_ops": { 2024-05-10T11:00:56.565 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:00:56.566 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 1024, 2024-05-10T11:00:56.566 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:00:56.566 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-05-10T11:00:56.566 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-05-10T11:00:56.566 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:00:56.566 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-05-10T11:00:56.566 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 11260, 2024-05-10T11:00:56.566 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 11260, 2024-05-10T11:00:56.566 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 11260, 2024-05-10T11:00:56.566 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 11260, 2024-05-10T11:00:56.566 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:00:56.566 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.566 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.566 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.567 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:00:56.567 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.567 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle": { 2024-05-10T11:00:56.567 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:00:56.567 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-05-10T11:00:56.567 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:00:56.567 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 3816, 2024-05-10T11:00:56.567 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 385448, 2024-05-10T11:00:56.567 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:00:56.567 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 3816, 2024-05-10T11:00:56.567 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-05-10T11:00:56.567 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-05-10T11:00:56.567 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 113, 2024-05-10T11:00:56.567 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 385448, 2024-05-10T11:00:56.568 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:00:56.568 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.568 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.568 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.568 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:00:56.568 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:00:56.568 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle-0x564c1b232500": { 2024-05-10T11:00:56.568 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:00:56.568 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-05-10T11:00:56.568 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:00:56.568 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 22439, 2024-05-10T11:00:56.568 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 45444032, 2024-05-10T11:00:56.568 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:00:56.568 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 22439, 2024-05-10T11:00:56.569 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-05-10T11:00:56.569 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-05-10T11:00:56.569 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 1334, 2024-05-10T11:00:56.569 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 45444032, 2024-05-10T11:00:56.569 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:00:56.569 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:00:56.569 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:00:56.569 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:00:56.569 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:00:56.569 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:00:56.569 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-05-10T11:00:57.369 INFO:tasks.check_counter:Daemon mds.b mds.exported=152 2024-05-10T11:00:57.369 INFO:tasks.check_counter:Daemon mds.b mds.imported=36 2024-05-10T11:00:57.370 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=1327 2024-05-10T11:00:57.370 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=660 2024-05-10T11:00:57.370 DEBUG:tasks.check_counter:Getting stats from e 2024-05-10T11:00:57.370 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph daemon mds.e perf dump 2024-05-10T11:00:57.624 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T11:00:57.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:57 smithi184 ceph-mon[34585]: pgmap v546: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T11:00:57.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:57 smithi196 ceph-mon[34872]: pgmap v546: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T11:00:57.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:57 smithi107 ceph-mon[30373]: pgmap v546: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-10T11:00:59.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:00:59 smithi196 ceph-mon[34872]: pgmap v547: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-05-10T11:00:59.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:00:59 smithi184 ceph-mon[34585]: pgmap v547: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-05-10T11:00:59.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:00:59 smithi107 ceph-mon[30373]: pgmap v547: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-05-10T11:01:01.252 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-05-10T11:01:01.252 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T11:01:01.252 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 7693, 2024-05-10T11:01:01.252 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 4394, 2024-05-10T11:01:01.252 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 3180047, 2024-05-10T11:01:01.252 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 3150110, 2024-05-10T11:01:01.252 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 10, 2024-05-10T11:01:01.252 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 4, 2024-05-10T11:01:01.252 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.388928756, 2024-05-10T11:01:01.252 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.172452705, 2024-05-10T11:01:01.253 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.267692813, 2024-05-10T11:01:01.253 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.012804164, 2024-05-10T11:01:01.253 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:01.253 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 4396, 2024-05-10T11:01:01.253 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.102910754, 2024-05-10T11:01:01.253 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000023410 2024-05-10T11:01:01.253 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.253 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:01.253 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 11291, 2024-05-10T11:01:01.253 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.001604811, 2024-05-10T11:01:01.253 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000142 2024-05-10T11:01:01.253 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.253 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-05-10T11:01:01.253 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 448 2024-05-10T11:01:01.254 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.254 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T11:01:01.254 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 7308, 2024-05-10T11:01:01.254 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 4105, 2024-05-10T11:01:01.254 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 2970135, 2024-05-10T11:01:01.254 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 1119321, 2024-05-10T11:01:01.254 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 11, 2024-05-10T11:01:01.254 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 7, 2024-05-10T11:01:01.254 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.300327714, 2024-05-10T11:01:01.254 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.115810784, 2024-05-10T11:01:01.254 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.246875118, 2024-05-10T11:01:01.254 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.003650077, 2024-05-10T11:01:01.254 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:01.255 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 4103, 2024-05-10T11:01:01.255 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.083676196, 2024-05-10T11:01:01.255 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000020393 2024-05-10T11:01:01.255 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.255 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:01.255 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 10909, 2024-05-10T11:01:01.255 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.001491918, 2024-05-10T11:01:01.255 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000136 2024-05-10T11:01:01.255 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.255 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-10T11:01:01.255 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 273136 2024-05-10T11:01:01.255 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.255 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T11:01:01.255 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 1690, 2024-05-10T11:01:01.256 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 2888, 2024-05-10T11:01:01.256 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 1425779, 2024-05-10T11:01:01.256 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 1447819, 2024-05-10T11:01:01.256 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 13, 2024-05-10T11:01:01.256 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 7, 2024-05-10T11:01:01.256 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.124214780, 2024-05-10T11:01:01.256 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.049072331, 2024-05-10T11:01:01.256 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.087734508, 2024-05-10T11:01:01.256 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.006617556, 2024-05-10T11:01:01.256 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:01.256 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2884, 2024-05-10T11:01:01.256 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.120484851, 2024-05-10T11:01:01.256 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000041776 2024-05-10T11:01:01.256 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.257 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:01.257 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 3563, 2024-05-10T11:01:01.257 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000529762, 2024-05-10T11:01:01.257 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000148 2024-05-10T11:01:01.257 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.257 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 904560, 2024-05-10T11:01:01.257 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 104352 2024-05-10T11:01:01.257 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.257 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2024-05-10T11:01:01.257 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 1, 2024-05-10T11:01:01.257 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2024-05-10T11:01:01.257 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.257 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-MDSRank": { 2024-05-10T11:01:01.257 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-05-10T11:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-05-10T11:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 285, 2024-05-10T11:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.369619876, 2024-05-10T11:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001296911 2024-05-10T11:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-PurgeQueue": { 2024-05-10T11:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-05-10T11:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-05-10T11:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 728, 2024-05-10T11:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.038450196, 2024-05-10T11:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000052816 2024-05-10T11:01:01.258 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "mds": { 2024-05-10T11:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "request": 674, 2024-05-10T11:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "reply": 661, 2024-05-10T11:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "reply_latency": { 2024-05-10T11:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 661, 2024-05-10T11:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.872891541, 2024-05-10T11:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001320562 2024-05-10T11:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_reply": 0, 2024-05-10T11:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "forward": 13, 2024-05-10T11:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_complete": 0, 2024-05-10T11:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_keys": 0, 2024-05-10T11:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_commit": 11, 2024-05-10T11:01:01.259 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_split": 0, 2024-05-10T11:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_merge": 0, 2024-05-10T11:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes": 31, 2024-05-10T11:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_top": 11, 2024-05-10T11:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_bottom": 10, 2024-05-10T11:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pin_tail": 10, 2024-05-10T11:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pinned": 13, 2024-05-10T11:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_expired": 1231, 2024-05-10T11:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_with_caps": 0, 2024-05-10T11:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "caps": 0, 2024-05-10T11:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "subtrees": 6, 2024-05-10T11:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse": 2819, 2024-05-10T11:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_hit": 1610, 2024-05-10T11:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_forward": 12, 2024-05-10T11:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_discover": 785, 2024-05-10T11:01:01.260 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_dir_fetch": 0, 2024-05-10T11:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_remote_ino": 0, 2024-05-10T11:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_lock": 0, 2024-05-10T11:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "load_cent": 0, 2024-05-10T11:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "q": 0, 2024-05-10T11:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "exported": 11, 2024-05-10T11:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "exported_inodes": 10, 2024-05-10T11:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "imported": 11, 2024-05-10T11:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "imported_inodes": 207, 2024-05-10T11:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_dir_fetch": 0, 2024-05-10T11:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_backtrace_fetch": 0, 2024-05-10T11:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_peer_discover": 0, 2024-05-10T11:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rfiles": 4, 2024-05-10T11:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rbytes": 234, 2024-05-10T11:01:01.261 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rsnaps": 0, 2024-05-10T11:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_fetch": 0, 2024-05-10T11:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_set_tag": 0, 2024-05-10T11:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T11:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_inotable_repaired": 0, 2024-05-10T11:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_inodes": 0, 2024-05-10T11:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_base_inodes": 0, 2024-05-10T11:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dirfrag_rstats": 0, 2024-05-10T11:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_file_inodes": 0, 2024-05-10T11:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_inode_file_caps": 0, 2024-05-10T11:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_revoke": 35, 2024-05-10T11:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_grant": 501, 2024-05-10T11:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T11:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T11:01:01.262 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T11:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps": 360, 2024-05-10T11:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps_dirty": 336, 2024-05-10T11:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_cap_release": 13, 2024-05-10T11:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "process_request_cap_release": 625 2024-05-10T11:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_cache": { 2024-05-10T11:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update": 89, 2024-05-10T11:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update_receipt": 2199, 2024-05-10T11:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_try_discover": 1482, 2024-05-10T11:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_send_discover": 1408, 2024-05-10T11:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_handle_discover": 111, 2024-05-10T11:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays": 0, 2024-05-10T11:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_delayed": 0, 2024-05-10T11:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_enqueuing": 0, 2024-05-10T11:01:01.263 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_created": 338, 2024-05-10T11:01:01.264 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_enqueued": 338, 2024-05-10T11:01:01.264 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_reintegrated": 0, 2024-05-10T11:01:01.264 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_migrated": 0, 2024-05-10T11:01:01.264 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_processing": 0, 2024-05-10T11:01:01.264 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_enqueued": 0, 2024-05-10T11:01:01.264 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_prioritized": 0, 2024-05-10T11:01:01.264 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_started": 0, 2024-05-10T11:01:01.264 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_completed": 0, 2024-05-10T11:01:01.264 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_path": 3, 2024-05-10T11:01:01.264 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_inode": 17, 2024-05-10T11:01:01.264 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_enqueue_scrub": 0, 2024-05-10T11:01:01.264 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_exportdir": 11, 2024-05-10T11:01:01.264 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_flush": 0, 2024-05-10T11:01:01.264 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragmentdir": 0, 2024-05-10T11:01:01.264 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragstats": 0, 2024-05-10T11:01:01.265 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_inodestats": 0 2024-05-10T11:01:01.265 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.265 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_log": { 2024-05-10T11:01:01.265 INFO:teuthology.orchestra.run.smithi184.stdout: "evlrg": 0, 2024-05-10T11:01:01.265 INFO:teuthology.orchestra.run.smithi184.stdout: "evadd": 1526, 2024-05-10T11:01:01.265 INFO:teuthology.orchestra.run.smithi184.stdout: "evex": 0, 2024-05-10T11:01:01.265 INFO:teuthology.orchestra.run.smithi184.stdout: "evtrm": 0, 2024-05-10T11:01:01.265 INFO:teuthology.orchestra.run.smithi184.stdout: "ev": 1526, 2024-05-10T11:01:01.265 INFO:teuthology.orchestra.run.smithi184.stdout: "evexg": 0, 2024-05-10T11:01:01.265 INFO:teuthology.orchestra.run.smithi184.stdout: "evexd": 0, 2024-05-10T11:01:01.265 INFO:teuthology.orchestra.run.smithi184.stdout: "segadd": 3, 2024-05-10T11:01:01.265 INFO:teuthology.orchestra.run.smithi184.stdout: "segex": 0, 2024-05-10T11:01:01.265 INFO:teuthology.orchestra.run.smithi184.stdout: "segtrm": 0, 2024-05-10T11:01:01.265 INFO:teuthology.orchestra.run.smithi184.stdout: "seg": 3, 2024-05-10T11:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: "segmjr": 2, 2024-05-10T11:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: "segexg": 0, 2024-05-10T11:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: "segexd": 0, 2024-05-10T11:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: "expos": 4194304, 2024-05-10T11:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: "wrpos": 6577804, 2024-05-10T11:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: "rdpos": 0, 2024-05-10T11:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: "jlat": { 2024-05-10T11:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 98, 2024-05-10T11:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.245260683, 2024-05-10T11:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.002502660 2024-05-10T11:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: "replayed": 0 2024-05-10T11:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.266 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_mem": { 2024-05-10T11:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "ino": 38, 2024-05-10T11:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "ino+": 992, 2024-05-10T11:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "ino-": 954, 2024-05-10T11:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "dir": 37, 2024-05-10T11:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "dir+": 794, 2024-05-10T11:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "dir-": 757, 2024-05-10T11:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "dn": 31, 2024-05-10T11:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "dn+": 1797, 2024-05-10T11:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "dn-": 1766, 2024-05-10T11:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "cap": 0, 2024-05-10T11:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "cap+": 352, 2024-05-10T11:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "cap-": 352, 2024-05-10T11:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "rss": 63472, 2024-05-10T11:01:01.267 INFO:teuthology.orchestra.run.smithi184.stdout: "heap": 223608 2024-05-10T11:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_server": { 2024-05-10T11:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_client_request": 1135, 2024-05-10T11:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_server_request": 66, 2024-05-10T11:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_request": 674, 2024-05-10T11:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_session": 7, 2024-05-10T11:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_peer_request": 531, 2024-05-10T11:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "req_create_latency": { 2024-05-10T11:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 131, 2024-05-10T11:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.141709866, 2024-05-10T11:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001081754 2024-05-10T11:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getattr_latency": { 2024-05-10T11:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1, 2024-05-10T11:01:01.268 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.001645083, 2024-05-10T11:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001645083 2024-05-10T11:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getfilelock_latency": { 2024-05-10T11:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "req_link_latency": { 2024-05-10T11:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookup_latency": { 2024-05-10T11:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 165, 2024-05-10T11:01:01.269 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.048988627, 2024-05-10T11:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000296900 2024-05-10T11:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookuphash_latency": { 2024-05-10T11:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupino_latency": { 2024-05-10T11:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupname_latency": { 2024-05-10T11:01:01.270 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupparent_latency": { 2024-05-10T11:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupsnap_latency": { 2024-05-10T11:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lssnap_latency": { 2024-05-10T11:01:01.271 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mkdir_latency": { 2024-05-10T11:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.272 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mknod_latency": { 2024-05-10T11:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mksnap_latency": { 2024-05-10T11:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "req_open_latency": { 2024-05-10T11:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.273 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: "req_readdir_latency": { 2024-05-10T11:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 26, 2024-05-10T11:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.027067902, 2024-05-10T11:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001041073 2024-05-10T11:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rename_latency": { 2024-05-10T11:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: "req_renamesnap_latency": { 2024-05-10T11:01:01.274 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: "req_snapdiff_latency": { 2024-05-10T11:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmdir_latency": { 2024-05-10T11:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 5, 2024-05-10T11:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.098786373, 2024-05-10T11:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.019757274 2024-05-10T11:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.275 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmsnap_latency": { 2024-05-10T11:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmxattr_latency": { 2024-05-10T11:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setattr_latency": { 2024-05-10T11:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.276 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setdirlayout_latency": { 2024-05-10T11:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setfilelock_latency": { 2024-05-10T11:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setlayout_latency": { 2024-05-10T11:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.277 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setxattr_latency": { 2024-05-10T11:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "req_symlink_latency": { 2024-05-10T11:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "req_unlink_latency": { 2024-05-10T11:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 333, 2024-05-10T11:01:01.278 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.554693690, 2024-05-10T11:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001665746 2024-05-10T11:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_revoke_eviction": 0, 2024-05-10T11:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_acquisition_throttle": 0, 2024-05-10T11:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getvxattr_latency": { 2024-05-10T11:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_sessions": { 2024-05-10T11:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "session_count": 1, 2024-05-10T11:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "session_add": 2, 2024-05-10T11:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "session_remove": 1, 2024-05-10T11:01:01.279 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_open": 1, 2024-05-10T11:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_stale": 0, 2024-05-10T11:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "total_load": 451, 2024-05-10T11:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "average_load": 451, 2024-05-10T11:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "avg_session_uptime": 99, 2024-05-10T11:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "mdthresh_evicted": 0 2024-05-10T11:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2024-05-10T11:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 0, 2024-05-10T11:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 0, 2024-05-10T11:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T11:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2024-05-10T11:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T11:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2024-05-10T11:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T11:01:01.280 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T11:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T11:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T11:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T11:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2024-05-10T11:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T11:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T11:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2024-05-10T11:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2024-05-10T11:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2024-05-10T11:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2024-05-10T11:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T11:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T11:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T11:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T11:01:01.281 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T11:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2024-05-10T11:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2024-05-10T11:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2024-05-10T11:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T11:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T11:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2024-05-10T11:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2024-05-10T11:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2024-05-10T11:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2024-05-10T11:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T11:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2024-05-10T11:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T11:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2024-05-10T11:01:01.282 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 287335, 2024-05-10T11:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 101, 2024-05-10T11:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 0, 2024-05-10T11:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 0, 2024-05-10T11:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2024-05-10T11:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2024-05-10T11:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2024-05-10T11:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2024-05-10T11:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2024-05-10T11:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2024-05-10T11:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 7336, 2024-05-10T11:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 154, 2024-05-10T11:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T11:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2024-05-10T11:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2024-05-10T11:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2024-05-10T11:01:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 155373, 2024-05-10T11:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 586, 2024-05-10T11:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2024-05-10T11:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2024-05-10T11:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2024-05-10T11:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2024-05-10T11:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "objecter": { 2024-05-10T11:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "op_active": 0, 2024-05-10T11:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "op_laggy": 0, 2024-05-10T11:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send": 595, 2024-05-10T11:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send_bytes": 2468550, 2024-05-10T11:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "op_resend": 28, 2024-05-10T11:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "op_reply": 595, 2024-05-10T11:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "op_latency": { 2024-05-10T11:01:01.284 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 595, 2024-05-10T11:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 1.348972376, 2024-05-10T11:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.002267180 2024-05-10T11:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: "op_inflight": 0, 2024-05-10T11:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: "oplen_avg": { 2024-05-10T11:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 595, 2024-05-10T11:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 662 2024-05-10T11:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: "op": 595, 2024-05-10T11:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: "op_r": 31, 2024-05-10T11:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: "op_w": 564, 2024-05-10T11:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: "op_rmw": 0, 2024-05-10T11:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: "op_pg": 0, 2024-05-10T11:01:01.285 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_stat": 0, 2024-05-10T11:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_create": 10, 2024-05-10T11:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_read": 31, 2024-05-10T11:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_write": 129, 2024-05-10T11:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writefull": 29, 2024-05-10T11:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writesame": 0, 2024-05-10T11:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_append": 0, 2024-05-10T11:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_zero": 0, 2024-05-10T11:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_truncate": 0, 2024-05-10T11:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_delete": 350, 2024-05-10T11:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_mapext": 0, 2024-05-10T11:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_sparse_read": 0, 2024-05-10T11:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_clonerange": 0, 2024-05-10T11:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_getxattr": 0, 2024-05-10T11:01:01.286 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_setxattr": 20, 2024-05-10T11:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_cmpxattr": 0, 2024-05-10T11:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_rmxattr": 0, 2024-05-10T11:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_resetxattrs": 0, 2024-05-10T11:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_call": 0, 2024-05-10T11:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_watch": 0, 2024-05-10T11:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_notify": 0, 2024-05-10T11:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T11:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls": 0, 2024-05-10T11:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls_filter": 0, 2024-05-10T11:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_other": 0, 2024-05-10T11:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_active": 0, 2024-05-10T11:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_send": 0, 2024-05-10T11:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_resend": 0, 2024-05-10T11:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_ping": 0, 2024-05-10T11:01:01.287 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_active": 0, 2024-05-10T11:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_send": 0, 2024-05-10T11:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_resend": 0, 2024-05-10T11:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_active": 0, 2024-05-10T11:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_send": 0, 2024-05-10T11:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_resend": 0, 2024-05-10T11:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_active": 0, 2024-05-10T11:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_send": 0, 2024-05-10T11:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_resend": 0, 2024-05-10T11:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "command_active": 0, 2024-05-10T11:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "command_send": 0, 2024-05-10T11:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "command_resend": 0, 2024-05-10T11:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "map_epoch": 82, 2024-05-10T11:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "map_full": 0, 2024-05-10T11:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "map_inc": 2, 2024-05-10T11:01:01.288 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_sessions": 12, 2024-05-10T11:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_open": 12, 2024-05-10T11:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_close": 0, 2024-05-10T11:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_laggy": 0, 2024-05-10T11:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_wr": 71, 2024-05-10T11:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_rd": 0, 2024-05-10T11:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_del": 22 2024-05-10T11:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "oft": { 2024-05-10T11:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_objs": 1, 2024-05-10T11:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_kv_pairs": 0, 2024-05-10T11:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_updates": 0, 2024-05-10T11:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_removes": 0 2024-05-10T11:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "osd-slow-ops": { 2024-05-10T11:01:01.289 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_ops_count": 20 2024-05-10T11:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "purge_queue": { 2024-05-10T11:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops": 0, 2024-05-10T11:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops_high_water": 6, 2024-05-10T11:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing": 0, 2024-05-10T11:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_high_water": 6, 2024-05-10T11:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed_ops": 338, 2024-05-10T11:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed": 338, 2024-05-10T11:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_item_in_journal": 0 2024-05-10T11:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T11:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-05-10T11:01:01.290 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 16687, 2024-05-10T11:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 6060194, 2024-05-10T11:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 16687, 2024-05-10T11:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-05-10T11:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-05-10T11:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 16687, 2024-05-10T11:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 6060194, 2024-05-10T11:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_bytes": { 2024-05-10T11:01:01.291 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-05-10T11:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-05-10T11:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-05-10T11:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 595, 2024-05-10T11:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 2502688, 2024-05-10T11:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 595, 2024-05-10T11:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 2502688, 2024-05-10T11:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.292 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_ops": { 2024-05-10T11:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 1024, 2024-05-10T11:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-05-10T11:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-05-10T11:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 595, 2024-05-10T11:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 595, 2024-05-10T11:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 595, 2024-05-10T11:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 595, 2024-05-10T11:01:01.293 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle": { 2024-05-10T11:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-05-10T11:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 338, 2024-05-10T11:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 34138, 2024-05-10T11:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 338, 2024-05-10T11:01:01.294 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-05-10T11:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-05-10T11:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 31, 2024-05-10T11:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 34138, 2024-05-10T11:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle-0x55dc37938500": { 2024-05-10T11:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-05-10T11:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:01:01.295 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 1526, 2024-05-10T11:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 2383500, 2024-05-10T11:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 1526, 2024-05-10T11:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-05-10T11:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-05-10T11:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 98, 2024-05-10T11:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 2383500, 2024-05-10T11:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:01.296 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-05-10T11:01:01.795 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:01 smithi107 ceph-mon[30373]: pgmap v548: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-10T11:01:01.807 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:01 smithi184 ceph-mon[34585]: pgmap v548: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-10T11:01:01.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:01 smithi196 ceph-mon[34872]: pgmap v548: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-10T11:01:02.143 INFO:tasks.check_counter:Daemon mds.e mds.exported=11 2024-05-10T11:01:02.143 INFO:tasks.check_counter:Daemon mds.e mds.imported=11 2024-05-10T11:01:02.143 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=89 2024-05-10T11:01:02.143 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=2199 2024-05-10T11:01:02.143 DEBUG:tasks.check_counter:Getting stats from h 2024-05-10T11:01:02.143 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph daemon mds.h perf dump 2024-05-10T11:01:02.381 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T11:01:03.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:03 smithi196 ceph-mon[34872]: pgmap v549: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-10T11:01:03.823 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:03 smithi184 ceph-mon[34585]: pgmap v549: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-10T11:01:03.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:03 smithi107 ceph-mon[30373]: pgmap v549: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-10T11:01:04.094 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-05-10T11:01:04.094 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T11:01:04.094 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 1587, 2024-05-10T11:01:04.094 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 2491, 2024-05-10T11:01:04.094 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 1398846, 2024-05-10T11:01:04.094 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 2973130, 2024-05-10T11:01:04.094 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 15, 2024-05-10T11:01:04.094 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 6, 2024-05-10T11:01:04.094 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.125213919, 2024-05-10T11:01:04.095 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.051169332, 2024-05-10T11:01:04.095 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.076045443, 2024-05-10T11:01:04.095 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.008479100, 2024-05-10T11:01:04.095 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:04.095 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2488, 2024-05-10T11:01:04.095 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.065922726, 2024-05-10T11:01:04.095 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000026496 2024-05-10T11:01:04.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.095 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:04.095 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 3003, 2024-05-10T11:01:04.095 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000443607, 2024-05-10T11:01:04.095 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000147 2024-05-10T11:01:04.095 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.095 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 912032, 2024-05-10T11:01:04.096 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 100800 2024-05-10T11:01:04.096 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.096 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T11:01:04.096 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 7392, 2024-05-10T11:01:04.096 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 4115, 2024-05-10T11:01:04.096 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 3108720, 2024-05-10T11:01:04.096 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 1205633, 2024-05-10T11:01:04.096 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 9, 2024-05-10T11:01:04.096 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 6, 2024-05-10T11:01:04.096 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.360312901, 2024-05-10T11:01:04.096 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.161888992, 2024-05-10T11:01:04.096 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.256005344, 2024-05-10T11:01:04.096 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.005408834, 2024-05-10T11:01:04.096 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:04.096 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 4116, 2024-05-10T11:01:04.097 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.103754940, 2024-05-10T11:01:04.097 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000025207 2024-05-10T11:01:04.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.097 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:04.097 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 11011, 2024-05-10T11:01:04.097 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.001695804, 2024-05-10T11:01:04.097 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000154 2024-05-10T11:01:04.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.097 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-05-10T11:01:04.097 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 275024 2024-05-10T11:01:04.097 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.097 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T11:01:04.097 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 7373, 2024-05-10T11:01:04.097 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 4048, 2024-05-10T11:01:04.098 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 2955312, 2024-05-10T11:01:04.098 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 931915, 2024-05-10T11:01:04.098 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 10, 2024-05-10T11:01:04.098 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 6, 2024-05-10T11:01:04.098 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.299375818, 2024-05-10T11:01:04.098 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.113292917, 2024-05-10T11:01:04.098 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.247204264, 2024-05-10T11:01:04.098 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.004863798, 2024-05-10T11:01:04.098 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:04.098 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 4046, 2024-05-10T11:01:04.098 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.088861876, 2024-05-10T11:01:04.098 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000021962 2024-05-10T11:01:04.098 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.099 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:04.099 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 10934, 2024-05-10T11:01:04.099 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.001467712, 2024-05-10T11:01:04.099 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000134 2024-05-10T11:01:04.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.099 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-10T11:01:04.099 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 0 2024-05-10T11:01:04.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.099 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2024-05-10T11:01:04.099 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 1, 2024-05-10T11:01:04.099 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2024-05-10T11:01:04.099 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.099 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-MDSRank": { 2024-05-10T11:01:04.099 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-05-10T11:01:04.100 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-05-10T11:01:04.100 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 240, 2024-05-10T11:01:04.100 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.307054954, 2024-05-10T11:01:04.100 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001279395 2024-05-10T11:01:04.100 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:04.100 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.100 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-PurgeQueue": { 2024-05-10T11:01:04.100 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-05-10T11:01:04.100 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-05-10T11:01:04.100 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 558, 2024-05-10T11:01:04.100 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.028199092, 2024-05-10T11:01:04.100 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000050536 2024-05-10T11:01:04.100 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:04.100 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.100 INFO:teuthology.orchestra.run.smithi184.stdout: "mds": { 2024-05-10T11:01:04.101 INFO:teuthology.orchestra.run.smithi184.stdout: "request": 583, 2024-05-10T11:01:04.101 INFO:teuthology.orchestra.run.smithi184.stdout: "reply": 566, 2024-05-10T11:01:04.101 INFO:teuthology.orchestra.run.smithi184.stdout: "reply_latency": { 2024-05-10T11:01:04.101 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 566, 2024-05-10T11:01:04.101 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.851820315, 2024-05-10T11:01:04.101 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001504982 2024-05-10T11:01:04.101 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.101 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_reply": 0, 2024-05-10T11:01:04.101 INFO:teuthology.orchestra.run.smithi184.stdout: "forward": 17, 2024-05-10T11:01:04.101 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_complete": 0, 2024-05-10T11:01:04.101 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_keys": 0, 2024-05-10T11:01:04.101 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_commit": 11, 2024-05-10T11:01:04.101 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_split": 0, 2024-05-10T11:01:04.101 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_merge": 0, 2024-05-10T11:01:04.102 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes": 36, 2024-05-10T11:01:04.102 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_top": 14, 2024-05-10T11:01:04.102 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_bottom": 12, 2024-05-10T11:01:04.102 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pin_tail": 10, 2024-05-10T11:01:04.102 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pinned": 13, 2024-05-10T11:01:04.102 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_expired": 1229, 2024-05-10T11:01:04.102 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_with_caps": 1, 2024-05-10T11:01:04.102 INFO:teuthology.orchestra.run.smithi184.stdout: "caps": 1, 2024-05-10T11:01:04.102 INFO:teuthology.orchestra.run.smithi184.stdout: "subtrees": 6, 2024-05-10T11:01:04.102 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse": 2709, 2024-05-10T11:01:04.102 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_hit": 1512, 2024-05-10T11:01:04.102 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_forward": 16, 2024-05-10T11:01:04.102 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_discover": 785, 2024-05-10T11:01:04.102 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_dir_fetch": 0, 2024-05-10T11:01:04.103 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_remote_ino": 0, 2024-05-10T11:01:04.103 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_lock": 0, 2024-05-10T11:01:04.103 INFO:teuthology.orchestra.run.smithi184.stdout: "load_cent": 0, 2024-05-10T11:01:04.103 INFO:teuthology.orchestra.run.smithi184.stdout: "q": 0, 2024-05-10T11:01:04.103 INFO:teuthology.orchestra.run.smithi184.stdout: "exported": 10, 2024-05-10T11:01:04.103 INFO:teuthology.orchestra.run.smithi184.stdout: "exported_inodes": 2, 2024-05-10T11:01:04.103 INFO:teuthology.orchestra.run.smithi184.stdout: "imported": 10, 2024-05-10T11:01:04.103 INFO:teuthology.orchestra.run.smithi184.stdout: "imported_inodes": 184, 2024-05-10T11:01:04.103 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_dir_fetch": 0, 2024-05-10T11:01:04.103 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_backtrace_fetch": 0, 2024-05-10T11:01:04.103 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_peer_discover": 0, 2024-05-10T11:01:04.103 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rfiles": 4, 2024-05-10T11:01:04.103 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rbytes": 234, 2024-05-10T11:01:04.103 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rsnaps": 0, 2024-05-10T11:01:04.103 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_fetch": 0, 2024-05-10T11:01:04.104 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_set_tag": 0, 2024-05-10T11:01:04.104 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T11:01:04.104 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_inotable_repaired": 0, 2024-05-10T11:01:04.104 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_inodes": 0, 2024-05-10T11:01:04.104 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_base_inodes": 0, 2024-05-10T11:01:04.104 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dirfrag_rstats": 0, 2024-05-10T11:01:04.104 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_file_inodes": 0, 2024-05-10T11:01:04.104 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_inode_file_caps": 0, 2024-05-10T11:01:04.104 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_revoke": 24, 2024-05-10T11:01:04.104 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_grant": 400, 2024-05-10T11:01:04.104 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T11:01:04.104 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T11:01:04.104 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T11:01:04.104 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps": 265, 2024-05-10T11:01:04.105 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps_dirty": 250, 2024-05-10T11:01:04.105 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_cap_release": 12, 2024-05-10T11:01:04.105 INFO:teuthology.orchestra.run.smithi184.stdout: "process_request_cap_release": 559 2024-05-10T11:01:04.105 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.105 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_cache": { 2024-05-10T11:01:04.105 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update": 68, 2024-05-10T11:01:04.105 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update_receipt": 2194, 2024-05-10T11:01:04.105 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_try_discover": 1479, 2024-05-10T11:01:04.105 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_send_discover": 1415, 2024-05-10T11:01:04.105 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_handle_discover": 78, 2024-05-10T11:01:04.105 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays": 0, 2024-05-10T11:01:04.105 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_delayed": 0, 2024-05-10T11:01:04.105 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_enqueuing": 0, 2024-05-10T11:01:04.105 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_created": 282, 2024-05-10T11:01:04.105 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_enqueued": 282, 2024-05-10T11:01:04.106 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_reintegrated": 0, 2024-05-10T11:01:04.106 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_migrated": 0, 2024-05-10T11:01:04.106 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_processing": 0, 2024-05-10T11:01:04.106 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_enqueued": 0, 2024-05-10T11:01:04.106 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_prioritized": 0, 2024-05-10T11:01:04.106 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_started": 0, 2024-05-10T11:01:04.106 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_completed": 0, 2024-05-10T11:01:04.106 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_path": 3, 2024-05-10T11:01:04.106 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_inode": 17, 2024-05-10T11:01:04.106 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_enqueue_scrub": 0, 2024-05-10T11:01:04.106 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_exportdir": 10, 2024-05-10T11:01:04.106 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_flush": 0, 2024-05-10T11:01:04.106 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragmentdir": 0, 2024-05-10T11:01:04.106 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragstats": 0, 2024-05-10T11:01:04.107 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_inodestats": 0 2024-05-10T11:01:04.107 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.107 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_log": { 2024-05-10T11:01:04.107 INFO:teuthology.orchestra.run.smithi184.stdout: "evlrg": 0, 2024-05-10T11:01:04.107 INFO:teuthology.orchestra.run.smithi184.stdout: "evadd": 1108, 2024-05-10T11:01:04.107 INFO:teuthology.orchestra.run.smithi184.stdout: "evex": 0, 2024-05-10T11:01:04.107 INFO:teuthology.orchestra.run.smithi184.stdout: "evtrm": 0, 2024-05-10T11:01:04.107 INFO:teuthology.orchestra.run.smithi184.stdout: "ev": 1108, 2024-05-10T11:01:04.107 INFO:teuthology.orchestra.run.smithi184.stdout: "evexg": 0, 2024-05-10T11:01:04.107 INFO:teuthology.orchestra.run.smithi184.stdout: "evexd": 0, 2024-05-10T11:01:04.107 INFO:teuthology.orchestra.run.smithi184.stdout: "segadd": 3, 2024-05-10T11:01:04.107 INFO:teuthology.orchestra.run.smithi184.stdout: "segex": 0, 2024-05-10T11:01:04.107 INFO:teuthology.orchestra.run.smithi184.stdout: "segtrm": 0, 2024-05-10T11:01:04.107 INFO:teuthology.orchestra.run.smithi184.stdout: "seg": 3, 2024-05-10T11:01:04.107 INFO:teuthology.orchestra.run.smithi184.stdout: "segmjr": 2, 2024-05-10T11:01:04.108 INFO:teuthology.orchestra.run.smithi184.stdout: "segexg": 0, 2024-05-10T11:01:04.108 INFO:teuthology.orchestra.run.smithi184.stdout: "segexd": 0, 2024-05-10T11:01:04.108 INFO:teuthology.orchestra.run.smithi184.stdout: "expos": 4194304, 2024-05-10T11:01:04.108 INFO:teuthology.orchestra.run.smithi184.stdout: "wrpos": 5941802, 2024-05-10T11:01:04.108 INFO:teuthology.orchestra.run.smithi184.stdout: "rdpos": 0, 2024-05-10T11:01:04.108 INFO:teuthology.orchestra.run.smithi184.stdout: "jlat": { 2024-05-10T11:01:04.108 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 83, 2024-05-10T11:01:04.108 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.657095822, 2024-05-10T11:01:04.108 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.007916817 2024-05-10T11:01:04.108 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.108 INFO:teuthology.orchestra.run.smithi184.stdout: "replayed": 0 2024-05-10T11:01:04.108 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.108 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_mem": { 2024-05-10T11:01:04.108 INFO:teuthology.orchestra.run.smithi184.stdout: "ino": 43, 2024-05-10T11:01:04.109 INFO:teuthology.orchestra.run.smithi184.stdout: "ino+": 940, 2024-05-10T11:01:04.109 INFO:teuthology.orchestra.run.smithi184.stdout: "ino-": 897, 2024-05-10T11:01:04.109 INFO:teuthology.orchestra.run.smithi184.stdout: "dir": 42, 2024-05-10T11:01:04.109 INFO:teuthology.orchestra.run.smithi184.stdout: "dir+": 796, 2024-05-10T11:01:04.109 INFO:teuthology.orchestra.run.smithi184.stdout: "dir-": 754, 2024-05-10T11:01:04.109 INFO:teuthology.orchestra.run.smithi184.stdout: "dn": 36, 2024-05-10T11:01:04.109 INFO:teuthology.orchestra.run.smithi184.stdout: "dn+": 1729, 2024-05-10T11:01:04.109 INFO:teuthology.orchestra.run.smithi184.stdout: "dn-": 1693, 2024-05-10T11:01:04.109 INFO:teuthology.orchestra.run.smithi184.stdout: "cap": 1, 2024-05-10T11:01:04.109 INFO:teuthology.orchestra.run.smithi184.stdout: "cap+": 294, 2024-05-10T11:01:04.109 INFO:teuthology.orchestra.run.smithi184.stdout: "cap-": 293, 2024-05-10T11:01:04.109 INFO:teuthology.orchestra.run.smithi184.stdout: "rss": 58960, 2024-05-10T11:01:04.109 INFO:teuthology.orchestra.run.smithi184.stdout: "heap": 223608 2024-05-10T11:01:04.109 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.109 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_server": { 2024-05-10T11:01:04.110 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_client_request": 994, 2024-05-10T11:01:04.110 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_server_request": 66, 2024-05-10T11:01:04.110 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_request": 583, 2024-05-10T11:01:04.110 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_session": 9, 2024-05-10T11:01:04.110 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_peer_request": 519, 2024-05-10T11:01:04.110 INFO:teuthology.orchestra.run.smithi184.stdout: "req_create_latency": { 2024-05-10T11:01:04.110 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 98, 2024-05-10T11:01:04.110 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.130812864, 2024-05-10T11:01:04.110 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001334825 2024-05-10T11:01:04.110 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.110 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getattr_latency": { 2024-05-10T11:01:04.110 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1, 2024-05-10T11:01:04.110 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000191416, 2024-05-10T11:01:04.110 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000191416 2024-05-10T11:01:04.110 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.111 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getfilelock_latency": { 2024-05-10T11:01:04.111 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.111 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.111 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.111 INFO:teuthology.orchestra.run.smithi184.stdout: "req_link_latency": { 2024-05-10T11:01:04.111 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.111 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.111 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.111 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookup_latency": { 2024-05-10T11:01:04.111 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 166, 2024-05-10T11:01:04.111 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.054915948, 2024-05-10T11:01:04.111 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000330818 2024-05-10T11:01:04.111 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.112 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookuphash_latency": { 2024-05-10T11:01:04.112 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.112 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.112 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.112 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.112 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupino_latency": { 2024-05-10T11:01:04.112 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1, 2024-05-10T11:01:04.112 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000163775, 2024-05-10T11:01:04.112 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000163775 2024-05-10T11:01:04.112 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.112 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupname_latency": { 2024-05-10T11:01:04.112 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.112 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.112 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.113 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupparent_latency": { 2024-05-10T11:01:04.113 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.113 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.113 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.113 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupsnap_latency": { 2024-05-10T11:01:04.113 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.113 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.113 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.113 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.113 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lssnap_latency": { 2024-05-10T11:01:04.113 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.113 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.114 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.114 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mkdir_latency": { 2024-05-10T11:01:04.114 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.114 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.114 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.114 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.115 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mknod_latency": { 2024-05-10T11:01:04.115 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.115 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.115 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.115 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mksnap_latency": { 2024-05-10T11:01:04.115 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.115 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.115 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.115 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.115 INFO:teuthology.orchestra.run.smithi184.stdout: "req_open_latency": { 2024-05-10T11:01:04.115 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.115 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.115 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.116 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.116 INFO:teuthology.orchestra.run.smithi184.stdout: "req_readdir_latency": { 2024-05-10T11:01:04.116 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 18, 2024-05-10T11:01:04.116 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.014179367, 2024-05-10T11:01:04.116 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000787742 2024-05-10T11:01:04.116 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.116 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rename_latency": { 2024-05-10T11:01:04.116 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.116 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.116 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.116 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.116 INFO:teuthology.orchestra.run.smithi184.stdout: "req_renamesnap_latency": { 2024-05-10T11:01:04.116 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.116 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.116 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.117 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.117 INFO:teuthology.orchestra.run.smithi184.stdout: "req_snapdiff_latency": { 2024-05-10T11:01:04.117 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.117 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.117 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.117 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.117 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmdir_latency": { 2024-05-10T11:01:04.117 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2, 2024-05-10T11:01:04.117 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.025223045, 2024-05-10T11:01:04.117 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.012611522 2024-05-10T11:01:04.117 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.117 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmsnap_latency": { 2024-05-10T11:01:04.117 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.117 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.117 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.118 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmxattr_latency": { 2024-05-10T11:01:04.118 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.118 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.118 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.118 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setattr_latency": { 2024-05-10T11:01:04.118 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.118 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.118 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.118 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.118 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setdirlayout_latency": { 2024-05-10T11:01:04.118 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.118 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.119 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.119 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setfilelock_latency": { 2024-05-10T11:01:04.119 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.119 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.119 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.119 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setlayout_latency": { 2024-05-10T11:01:04.119 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.119 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.119 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.119 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.119 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setxattr_latency": { 2024-05-10T11:01:04.119 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.119 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.120 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.120 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.120 INFO:teuthology.orchestra.run.smithi184.stdout: "req_symlink_latency": { 2024-05-10T11:01:04.120 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.120 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.120 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.120 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.120 INFO:teuthology.orchestra.run.smithi184.stdout: "req_unlink_latency": { 2024-05-10T11:01:04.120 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 280, 2024-05-10T11:01:04.120 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.626333900, 2024-05-10T11:01:04.120 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.002236906 2024-05-10T11:01:04.120 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.120 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_revoke_eviction": 0, 2024-05-10T11:01:04.120 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_acquisition_throttle": 0, 2024-05-10T11:01:04.120 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getvxattr_latency": { 2024-05-10T11:01:04.121 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.121 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.121 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.121 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:04.121 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.121 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_sessions": { 2024-05-10T11:01:04.121 INFO:teuthology.orchestra.run.smithi184.stdout: "session_count": 1, 2024-05-10T11:01:04.121 INFO:teuthology.orchestra.run.smithi184.stdout: "session_add": 2, 2024-05-10T11:01:04.121 INFO:teuthology.orchestra.run.smithi184.stdout: "session_remove": 1, 2024-05-10T11:01:04.121 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_open": 1, 2024-05-10T11:01:04.121 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_stale": 0, 2024-05-10T11:01:04.121 INFO:teuthology.orchestra.run.smithi184.stdout: "total_load": 394, 2024-05-10T11:01:04.121 INFO:teuthology.orchestra.run.smithi184.stdout: "average_load": 394, 2024-05-10T11:01:04.121 INFO:teuthology.orchestra.run.smithi184.stdout: "avg_session_uptime": 333, 2024-05-10T11:01:04.121 INFO:teuthology.orchestra.run.smithi184.stdout: "mdthresh_evicted": 0 2024-05-10T11:01:04.122 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.122 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2024-05-10T11:01:04.122 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 0, 2024-05-10T11:01:04.122 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 0, 2024-05-10T11:01:04.122 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T11:01:04.122 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2024-05-10T11:01:04.122 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T11:01:04.122 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2024-05-10T11:01:04.122 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T11:01:04.122 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T11:01:04.122 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T11:01:04.122 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T11:01:04.122 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T11:01:04.122 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2024-05-10T11:01:04.123 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T11:01:04.123 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T11:01:04.123 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2024-05-10T11:01:04.123 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2024-05-10T11:01:04.123 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2024-05-10T11:01:04.123 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2024-05-10T11:01:04.123 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T11:01:04.123 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T11:01:04.123 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T11:01:04.123 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T11:01:04.123 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T11:01:04.123 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2024-05-10T11:01:04.123 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2024-05-10T11:01:04.123 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2024-05-10T11:01:04.123 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T11:01:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T11:01:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2024-05-10T11:01:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2024-05-10T11:01:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2024-05-10T11:01:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2024-05-10T11:01:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T11:01:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2024-05-10T11:01:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T11:01:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2024-05-10T11:01:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 295255, 2024-05-10T11:01:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 102, 2024-05-10T11:01:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 0, 2024-05-10T11:01:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 0, 2024-05-10T11:01:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2024-05-10T11:01:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2024-05-10T11:01:04.124 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2024-05-10T11:01:04.125 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2024-05-10T11:01:04.125 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2024-05-10T11:01:04.125 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2024-05-10T11:01:04.125 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 7336, 2024-05-10T11:01:04.125 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 154, 2024-05-10T11:01:04.125 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T11:01:04.125 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2024-05-10T11:01:04.125 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2024-05-10T11:01:04.125 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2024-05-10T11:01:04.125 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 176397, 2024-05-10T11:01:04.125 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 631, 2024-05-10T11:01:04.125 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2024-05-10T11:01:04.125 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2024-05-10T11:01:04.125 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2024-05-10T11:01:04.126 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2024-05-10T11:01:04.126 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.126 INFO:teuthology.orchestra.run.smithi184.stdout: "objecter": { 2024-05-10T11:01:04.126 INFO:teuthology.orchestra.run.smithi184.stdout: "op_active": 0, 2024-05-10T11:01:04.126 INFO:teuthology.orchestra.run.smithi184.stdout: "op_laggy": 0, 2024-05-10T11:01:04.126 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send": 506, 2024-05-10T11:01:04.126 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send_bytes": 1825180, 2024-05-10T11:01:04.126 INFO:teuthology.orchestra.run.smithi184.stdout: "op_resend": 32, 2024-05-10T11:01:04.126 INFO:teuthology.orchestra.run.smithi184.stdout: "op_reply": 506, 2024-05-10T11:01:04.126 INFO:teuthology.orchestra.run.smithi184.stdout: "op_latency": { 2024-05-10T11:01:04.126 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 506, 2024-05-10T11:01:04.126 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 1.790963314, 2024-05-10T11:01:04.126 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.003539453 2024-05-10T11:01:04.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.127 INFO:teuthology.orchestra.run.smithi184.stdout: "op_inflight": 0, 2024-05-10T11:01:04.127 INFO:teuthology.orchestra.run.smithi184.stdout: "oplen_avg": { 2024-05-10T11:01:04.127 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 506, 2024-05-10T11:01:04.127 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 567 2024-05-10T11:01:04.127 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.127 INFO:teuthology.orchestra.run.smithi184.stdout: "op": 506, 2024-05-10T11:01:04.127 INFO:teuthology.orchestra.run.smithi184.stdout: "op_r": 24, 2024-05-10T11:01:04.127 INFO:teuthology.orchestra.run.smithi184.stdout: "op_w": 482, 2024-05-10T11:01:04.127 INFO:teuthology.orchestra.run.smithi184.stdout: "op_rmw": 0, 2024-05-10T11:01:04.127 INFO:teuthology.orchestra.run.smithi184.stdout: "op_pg": 0, 2024-05-10T11:01:04.127 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_stat": 0, 2024-05-10T11:01:04.127 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_create": 10, 2024-05-10T11:01:04.127 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_read": 24, 2024-05-10T11:01:04.127 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_write": 107, 2024-05-10T11:01:04.128 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writefull": 26, 2024-05-10T11:01:04.128 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writesame": 0, 2024-05-10T11:01:04.128 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_append": 0, 2024-05-10T11:01:04.128 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_zero": 0, 2024-05-10T11:01:04.128 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_truncate": 0, 2024-05-10T11:01:04.128 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_delete": 294, 2024-05-10T11:01:04.128 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_mapext": 0, 2024-05-10T11:01:04.128 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_sparse_read": 0, 2024-05-10T11:01:04.128 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_clonerange": 0, 2024-05-10T11:01:04.128 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_getxattr": 0, 2024-05-10T11:01:04.128 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_setxattr": 20, 2024-05-10T11:01:04.128 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_cmpxattr": 0, 2024-05-10T11:01:04.128 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_rmxattr": 0, 2024-05-10T11:01:04.128 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_resetxattrs": 0, 2024-05-10T11:01:04.129 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_call": 0, 2024-05-10T11:01:04.129 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_watch": 0, 2024-05-10T11:01:04.129 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_notify": 0, 2024-05-10T11:01:04.129 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T11:01:04.129 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls": 0, 2024-05-10T11:01:04.129 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls_filter": 0, 2024-05-10T11:01:04.129 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_other": 0, 2024-05-10T11:01:04.129 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_active": 0, 2024-05-10T11:01:04.129 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_send": 0, 2024-05-10T11:01:04.129 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_resend": 0, 2024-05-10T11:01:04.129 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_ping": 0, 2024-05-10T11:01:04.129 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_active": 0, 2024-05-10T11:01:04.129 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_send": 0, 2024-05-10T11:01:04.129 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_resend": 0, 2024-05-10T11:01:04.129 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_active": 0, 2024-05-10T11:01:04.130 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_send": 0, 2024-05-10T11:01:04.130 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_resend": 0, 2024-05-10T11:01:04.130 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_active": 0, 2024-05-10T11:01:04.130 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_send": 0, 2024-05-10T11:01:04.130 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_resend": 0, 2024-05-10T11:01:04.130 INFO:teuthology.orchestra.run.smithi184.stdout: "command_active": 0, 2024-05-10T11:01:04.130 INFO:teuthology.orchestra.run.smithi184.stdout: "command_send": 0, 2024-05-10T11:01:04.130 INFO:teuthology.orchestra.run.smithi184.stdout: "command_resend": 0, 2024-05-10T11:01:04.130 INFO:teuthology.orchestra.run.smithi184.stdout: "map_epoch": 82, 2024-05-10T11:01:04.130 INFO:teuthology.orchestra.run.smithi184.stdout: "map_full": 0, 2024-05-10T11:01:04.130 INFO:teuthology.orchestra.run.smithi184.stdout: "map_inc": 2, 2024-05-10T11:01:04.130 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_sessions": 12, 2024-05-10T11:01:04.130 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_open": 12, 2024-05-10T11:01:04.130 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_close": 0, 2024-05-10T11:01:04.131 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_laggy": 0, 2024-05-10T11:01:04.131 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_wr": 67, 2024-05-10T11:01:04.131 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_rd": 0, 2024-05-10T11:01:04.131 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_del": 19 2024-05-10T11:01:04.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.131 INFO:teuthology.orchestra.run.smithi184.stdout: "oft": { 2024-05-10T11:01:04.131 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_objs": 1, 2024-05-10T11:01:04.131 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_kv_pairs": 0, 2024-05-10T11:01:04.131 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_updates": 0, 2024-05-10T11:01:04.131 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_removes": 0 2024-05-10T11:01:04.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.131 INFO:teuthology.orchestra.run.smithi184.stdout: "osd-slow-ops": { 2024-05-10T11:01:04.131 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_ops_count": 20 2024-05-10T11:01:04.131 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.131 INFO:teuthology.orchestra.run.smithi184.stdout: "purge_queue": { 2024-05-10T11:01:04.132 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops": 0, 2024-05-10T11:01:04.132 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops_high_water": 6, 2024-05-10T11:01:04.132 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing": 0, 2024-05-10T11:01:04.132 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_high_water": 6, 2024-05-10T11:01:04.132 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed_ops": 282, 2024-05-10T11:01:04.132 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed": 282, 2024-05-10T11:01:04.132 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_item_in_journal": 0 2024-05-10T11:01:04.132 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.132 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T11:01:04.132 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:01:04.132 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-05-10T11:01:04.132 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:01:04.132 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 16348, 2024-05-10T11:01:04.132 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 5977601, 2024-05-10T11:01:04.132 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:04.132 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 16348, 2024-05-10T11:01:04.133 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-05-10T11:01:04.133 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-05-10T11:01:04.133 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 16348, 2024-05-10T11:01:04.133 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 5977601, 2024-05-10T11:01:04.133 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:01:04.133 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.133 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.133 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.133 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:04.133 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.133 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_bytes": { 2024-05-10T11:01:04.133 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:01:04.133 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-05-10T11:01:04.133 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:01:04.133 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-05-10T11:01:04.134 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-05-10T11:01:04.134 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:04.134 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:04.134 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 506, 2024-05-10T11:01:04.134 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 1853662, 2024-05-10T11:01:04.134 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 506, 2024-05-10T11:01:04.134 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 1853662, 2024-05-10T11:01:04.134 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:01:04.134 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.134 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.134 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.134 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:04.134 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.135 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_ops": { 2024-05-10T11:01:04.135 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:01:04.135 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 1024, 2024-05-10T11:01:04.135 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:01:04.135 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-05-10T11:01:04.135 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-05-10T11:01:04.135 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:04.135 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:04.135 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 506, 2024-05-10T11:01:04.135 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 506, 2024-05-10T11:01:04.135 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 506, 2024-05-10T11:01:04.135 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 506, 2024-05-10T11:01:04.135 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:01:04.135 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.135 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.136 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.136 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:04.136 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.136 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle": { 2024-05-10T11:01:04.136 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:01:04.136 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-05-10T11:01:04.136 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:01:04.136 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 282, 2024-05-10T11:01:04.136 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 28482, 2024-05-10T11:01:04.136 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:04.136 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 282, 2024-05-10T11:01:04.136 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-05-10T11:01:04.136 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-05-10T11:01:04.136 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 24, 2024-05-10T11:01:04.136 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 28482, 2024-05-10T11:01:04.137 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:01:04.137 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.137 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.137 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.137 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:04.137 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:04.137 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle-0x55b132c8e500": { 2024-05-10T11:01:04.137 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:01:04.137 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-05-10T11:01:04.137 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:01:04.137 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 1108, 2024-05-10T11:01:04.137 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 1747498, 2024-05-10T11:01:04.137 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:04.137 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 1108, 2024-05-10T11:01:04.138 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-05-10T11:01:04.138 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-05-10T11:01:04.138 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 83, 2024-05-10T11:01:04.138 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 1747498, 2024-05-10T11:01:04.138 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:01:04.138 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:04.138 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:04.138 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:04.138 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:04.138 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:04.138 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-05-10T11:01:04.892 INFO:tasks.check_counter:Daemon mds.h mds.exported=10 2024-05-10T11:01:04.892 INFO:tasks.check_counter:Daemon mds.h mds.imported=10 2024-05-10T11:01:04.892 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=68 2024-05-10T11:01:04.892 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=2194 2024-05-10T11:01:04.892 DEBUG:tasks.check_counter:Getting stats from k 2024-05-10T11:01:04.893 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph daemon mds.k perf dump 2024-05-10T11:01:05.130 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.b/config 2024-05-10T11:01:05.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:05 smithi196 ceph-mon[34872]: pgmap v550: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-05-10T11:01:05.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:05 smithi184 ceph-mon[34585]: pgmap v550: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-05-10T11:01:05.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:05 smithi107 ceph-mon[30373]: pgmap v550: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-05-10T11:01:06.977 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-05-10T11:01:06.977 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T11:01:06.977 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 1482, 2024-05-10T11:01:06.977 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 1484, 2024-05-10T11:01:06.977 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 2167071, 2024-05-10T11:01:06.977 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 471283, 2024-05-10T11:01:06.977 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 6, 2024-05-10T11:01:06.977 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 2, 2024-05-10T11:01:06.977 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.113784872, 2024-05-10T11:01:06.977 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.037582781, 2024-05-10T11:01:06.977 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.028562909, 2024-05-10T11:01:06.977 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.038018373, 2024-05-10T11:01:06.978 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:06.978 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1482, 2024-05-10T11:01:06.978 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.045613963, 2024-05-10T11:01:06.978 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000030778 2024-05-10T11:01:06.978 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.978 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:06.978 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:06.978 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:06.978 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:06.978 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.978 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-10T11:01:06.978 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 0 2024-05-10T11:01:06.978 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.979 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T11:01:06.979 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 187, 2024-05-10T11:01:06.979 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 169, 2024-05-10T11:01:06.979 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 891356, 2024-05-10T11:01:06.979 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 98538, 2024-05-10T11:01:06.979 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 3, 2024-05-10T11:01:06.979 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 2, 2024-05-10T11:01:06.979 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.031322103, 2024-05-10T11:01:06.981 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.009956189, 2024-05-10T11:01:06.981 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.022289116, 2024-05-10T11:01:06.981 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.003824045, 2024-05-10T11:01:06.981 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:06.981 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 169, 2024-05-10T11:01:06.981 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.009212501, 2024-05-10T11:01:06.981 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000054511 2024-05-10T11:01:06.981 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.981 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:06.981 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:06.981 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:06.982 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:06.982 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 890800, 2024-05-10T11:01:06.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 97840 2024-05-10T11:01:06.982 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.982 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T11:01:06.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 2, 2024-05-10T11:01:06.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 120, 2024-05-10T11:01:06.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 428, 2024-05-10T11:01:06.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 275598, 2024-05-10T11:01:06.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 4, 2024-05-10T11:01:06.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 3, 2024-05-10T11:01:06.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.007324374, 2024-05-10T11:01:06.982 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.004856236, 2024-05-10T11:01:06.983 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.001143674, 2024-05-10T11:01:06.983 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.000014129, 2024-05-10T11:01:06.983 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:06.983 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 118, 2024-05-10T11:01:06.983 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.008352675, 2024-05-10T11:01:06.983 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000070785 2024-05-10T11:01:06.983 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.983 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:06.983 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:06.983 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:06.983 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:06.983 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.983 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-10T11:01:06.983 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 275280 2024-05-10T11:01:06.983 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.984 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2024-05-10T11:01:06.984 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 1, 2024-05-10T11:01:06.984 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2024-05-10T11:01:06.984 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.984 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-MDSRank": { 2024-05-10T11:01:06.984 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-05-10T11:01:06.984 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-05-10T11:01:06.984 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2541, 2024-05-10T11:01:06.984 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.059741376, 2024-05-10T11:01:06.984 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000023510 2024-05-10T11:01:06.984 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:06.984 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.984 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-PurgeQueue": { 2024-05-10T11:01:06.984 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-05-10T11:01:06.985 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-05-10T11:01:06.985 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:06.985 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:06.985 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:06.985 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:06.985 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.985 INFO:teuthology.orchestra.run.smithi184.stdout: "mds": { 2024-05-10T11:01:06.985 INFO:teuthology.orchestra.run.smithi184.stdout: "request": 0, 2024-05-10T11:01:06.985 INFO:teuthology.orchestra.run.smithi184.stdout: "reply": 0, 2024-05-10T11:01:06.985 INFO:teuthology.orchestra.run.smithi184.stdout: "reply_latency": { 2024-05-10T11:01:06.985 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:06.985 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:06.985 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:06.985 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.985 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_reply": 0, 2024-05-10T11:01:06.986 INFO:teuthology.orchestra.run.smithi184.stdout: "forward": 0, 2024-05-10T11:01:06.986 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_complete": 0, 2024-05-10T11:01:06.986 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_keys": 0, 2024-05-10T11:01:06.986 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_commit": 0, 2024-05-10T11:01:06.986 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_split": 0, 2024-05-10T11:01:06.986 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_merge": 0, 2024-05-10T11:01:06.986 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes": 284, 2024-05-10T11:01:06.986 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_top": 0, 2024-05-10T11:01:06.986 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_bottom": 284, 2024-05-10T11:01:06.986 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pin_tail": 0, 2024-05-10T11:01:06.986 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pinned": 284, 2024-05-10T11:01:06.986 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_expired": 0, 2024-05-10T11:01:06.986 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_with_caps": 0, 2024-05-10T11:01:06.986 INFO:teuthology.orchestra.run.smithi184.stdout: "caps": 0, 2024-05-10T11:01:06.987 INFO:teuthology.orchestra.run.smithi184.stdout: "subtrees": 1, 2024-05-10T11:01:06.987 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse": 0, 2024-05-10T11:01:06.987 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_hit": 0, 2024-05-10T11:01:06.987 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_forward": 0, 2024-05-10T11:01:06.987 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_discover": 0, 2024-05-10T11:01:06.987 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_dir_fetch": 0, 2024-05-10T11:01:06.987 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_remote_ino": 0, 2024-05-10T11:01:06.987 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_lock": 0, 2024-05-10T11:01:06.987 INFO:teuthology.orchestra.run.smithi184.stdout: "load_cent": 0, 2024-05-10T11:01:06.987 INFO:teuthology.orchestra.run.smithi184.stdout: "q": 0, 2024-05-10T11:01:06.987 INFO:teuthology.orchestra.run.smithi184.stdout: "exported": 0, 2024-05-10T11:01:06.987 INFO:teuthology.orchestra.run.smithi184.stdout: "exported_inodes": 0, 2024-05-10T11:01:06.987 INFO:teuthology.orchestra.run.smithi184.stdout: "imported": 0, 2024-05-10T11:01:06.987 INFO:teuthology.orchestra.run.smithi184.stdout: "imported_inodes": 0, 2024-05-10T11:01:06.987 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_dir_fetch": 0, 2024-05-10T11:01:06.987 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_backtrace_fetch": 0, 2024-05-10T11:01:06.988 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_peer_discover": 0, 2024-05-10T11:01:06.988 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rfiles": 0, 2024-05-10T11:01:06.988 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rbytes": 0, 2024-05-10T11:01:06.988 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rsnaps": 0, 2024-05-10T11:01:06.988 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_fetch": 0, 2024-05-10T11:01:06.988 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_set_tag": 0, 2024-05-10T11:01:06.988 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T11:01:06.988 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_inotable_repaired": 0, 2024-05-10T11:01:06.988 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_inodes": 0, 2024-05-10T11:01:06.988 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_base_inodes": 0, 2024-05-10T11:01:06.988 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dirfrag_rstats": 0, 2024-05-10T11:01:06.988 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_file_inodes": 0, 2024-05-10T11:01:06.988 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_inode_file_caps": 0, 2024-05-10T11:01:06.988 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_revoke": 0, 2024-05-10T11:01:06.988 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_grant": 0, 2024-05-10T11:01:06.989 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T11:01:06.989 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T11:01:06.989 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T11:01:06.989 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps": 0, 2024-05-10T11:01:06.989 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps_dirty": 0, 2024-05-10T11:01:06.989 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_cap_release": 0, 2024-05-10T11:01:06.989 INFO:teuthology.orchestra.run.smithi184.stdout: "process_request_cap_release": 0 2024-05-10T11:01:06.989 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.989 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_cache": { 2024-05-10T11:01:06.989 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update": 0, 2024-05-10T11:01:06.989 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update_receipt": 0, 2024-05-10T11:01:06.989 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_try_discover": 0, 2024-05-10T11:01:06.989 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_send_discover": 0, 2024-05-10T11:01:06.989 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_handle_discover": 0, 2024-05-10T11:01:06.989 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays": 0, 2024-05-10T11:01:06.990 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_delayed": 0, 2024-05-10T11:01:06.990 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_enqueuing": 0, 2024-05-10T11:01:06.990 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_created": 0, 2024-05-10T11:01:06.990 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_enqueued": 0, 2024-05-10T11:01:06.990 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_reintegrated": 0, 2024-05-10T11:01:06.990 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_migrated": 0, 2024-05-10T11:01:06.990 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_processing": 0, 2024-05-10T11:01:06.990 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_enqueued": 0, 2024-05-10T11:01:06.990 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_prioritized": 0, 2024-05-10T11:01:06.990 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_started": 0, 2024-05-10T11:01:06.990 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_completed": 0, 2024-05-10T11:01:06.990 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_path": 0, 2024-05-10T11:01:06.990 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_inode": 0, 2024-05-10T11:01:06.991 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_enqueue_scrub": 0, 2024-05-10T11:01:06.991 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_exportdir": 0, 2024-05-10T11:01:06.991 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_flush": 0, 2024-05-10T11:01:06.991 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragmentdir": 0, 2024-05-10T11:01:06.991 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragstats": 0, 2024-05-10T11:01:06.991 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_inodestats": 0 2024-05-10T11:01:06.991 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.991 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_log": { 2024-05-10T11:01:06.991 INFO:teuthology.orchestra.run.smithi184.stdout: "evlrg": 0, 2024-05-10T11:01:06.991 INFO:teuthology.orchestra.run.smithi184.stdout: "evadd": 0, 2024-05-10T11:01:06.991 INFO:teuthology.orchestra.run.smithi184.stdout: "evex": 0, 2024-05-10T11:01:06.991 INFO:teuthology.orchestra.run.smithi184.stdout: "evtrm": 0, 2024-05-10T11:01:06.991 INFO:teuthology.orchestra.run.smithi184.stdout: "ev": 1108, 2024-05-10T11:01:06.991 INFO:teuthology.orchestra.run.smithi184.stdout: "evexg": 0, 2024-05-10T11:01:06.992 INFO:teuthology.orchestra.run.smithi184.stdout: "evexd": 0, 2024-05-10T11:01:06.992 INFO:teuthology.orchestra.run.smithi184.stdout: "segadd": 0, 2024-05-10T11:01:06.992 INFO:teuthology.orchestra.run.smithi184.stdout: "segex": 0, 2024-05-10T11:01:06.992 INFO:teuthology.orchestra.run.smithi184.stdout: "segtrm": 0, 2024-05-10T11:01:06.992 INFO:teuthology.orchestra.run.smithi184.stdout: "seg": 3, 2024-05-10T11:01:06.992 INFO:teuthology.orchestra.run.smithi184.stdout: "segmjr": 2, 2024-05-10T11:01:06.992 INFO:teuthology.orchestra.run.smithi184.stdout: "segexg": 0, 2024-05-10T11:01:06.992 INFO:teuthology.orchestra.run.smithi184.stdout: "segexd": 0, 2024-05-10T11:01:06.992 INFO:teuthology.orchestra.run.smithi184.stdout: "expos": 4194304, 2024-05-10T11:01:06.992 INFO:teuthology.orchestra.run.smithi184.stdout: "wrpos": 5941802, 2024-05-10T11:01:06.992 INFO:teuthology.orchestra.run.smithi184.stdout: "rdpos": 5940664, 2024-05-10T11:01:06.992 INFO:teuthology.orchestra.run.smithi184.stdout: "jlat": { 2024-05-10T11:01:06.992 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:06.992 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:06.993 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:06.993 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.993 INFO:teuthology.orchestra.run.smithi184.stdout: "replayed": 1108 2024-05-10T11:01:06.993 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.993 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_mem": { 2024-05-10T11:01:06.993 INFO:teuthology.orchestra.run.smithi184.stdout: "ino": 5, 2024-05-10T11:01:06.993 INFO:teuthology.orchestra.run.smithi184.stdout: "ino+": 340, 2024-05-10T11:01:06.993 INFO:teuthology.orchestra.run.smithi184.stdout: "ino-": 335, 2024-05-10T11:01:06.993 INFO:teuthology.orchestra.run.smithi184.stdout: "dir": 3, 2024-05-10T11:01:06.993 INFO:teuthology.orchestra.run.smithi184.stdout: "dir+": 72, 2024-05-10T11:01:06.993 INFO:teuthology.orchestra.run.smithi184.stdout: "dir-": 69, 2024-05-10T11:01:06.993 INFO:teuthology.orchestra.run.smithi184.stdout: "dn": 284, 2024-05-10T11:01:06.993 INFO:teuthology.orchestra.run.smithi184.stdout: "dn+": 523, 2024-05-10T11:01:06.994 INFO:teuthology.orchestra.run.smithi184.stdout: "dn-": 239, 2024-05-10T11:01:06.994 INFO:teuthology.orchestra.run.smithi184.stdout: "cap": 0, 2024-05-10T11:01:06.994 INFO:teuthology.orchestra.run.smithi184.stdout: "cap+": 0, 2024-05-10T11:01:06.994 INFO:teuthology.orchestra.run.smithi184.stdout: "cap-": 0, 2024-05-10T11:01:06.994 INFO:teuthology.orchestra.run.smithi184.stdout: "rss": 51724, 2024-05-10T11:01:06.994 INFO:teuthology.orchestra.run.smithi184.stdout: "heap": 215416 2024-05-10T11:01:06.994 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.994 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_server": { 2024-05-10T11:01:06.994 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_client_request": 0, 2024-05-10T11:01:06.994 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_server_request": 0, 2024-05-10T11:01:06.994 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_request": 0, 2024-05-10T11:01:06.994 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_session": 0, 2024-05-10T11:01:06.994 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_peer_request": 0, 2024-05-10T11:01:06.994 INFO:teuthology.orchestra.run.smithi184.stdout: "req_create_latency": { 2024-05-10T11:01:06.995 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:06.995 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:06.995 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:06.995 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.995 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getattr_latency": { 2024-05-10T11:01:06.995 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:06.995 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:06.995 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:06.995 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.995 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getfilelock_latency": { 2024-05-10T11:01:06.995 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:06.995 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:06.995 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:06.995 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.996 INFO:teuthology.orchestra.run.smithi184.stdout: "req_link_latency": { 2024-05-10T11:01:06.996 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:06.996 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:06.996 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:06.996 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.996 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookup_latency": { 2024-05-10T11:01:06.996 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:06.996 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:06.996 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:06.996 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.996 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookuphash_latency": { 2024-05-10T11:01:06.996 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:06.996 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:06.996 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:06.996 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.997 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupino_latency": { 2024-05-10T11:01:06.997 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:06.997 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:06.997 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:06.997 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.997 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupname_latency": { 2024-05-10T11:01:06.997 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:06.997 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:06.997 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:06.997 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.997 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupparent_latency": { 2024-05-10T11:01:06.997 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:06.997 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:06.998 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:06.998 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.998 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupsnap_latency": { 2024-05-10T11:01:06.998 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:06.998 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:06.998 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:06.998 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.998 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lssnap_latency": { 2024-05-10T11:01:06.998 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:06.999 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:06.999 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:06.999 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.999 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mkdir_latency": { 2024-05-10T11:01:06.999 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:06.999 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:06.999 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:06.999 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:06.999 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mknod_latency": { 2024-05-10T11:01:07.000 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.000 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.000 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.000 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.000 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mksnap_latency": { 2024-05-10T11:01:07.000 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.000 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.000 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.000 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.001 INFO:teuthology.orchestra.run.smithi184.stdout: "req_open_latency": { 2024-05-10T11:01:07.001 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.001 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.001 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.001 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.001 INFO:teuthology.orchestra.run.smithi184.stdout: "req_readdir_latency": { 2024-05-10T11:01:07.001 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.001 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.001 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.001 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.001 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rename_latency": { 2024-05-10T11:01:07.002 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.002 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.002 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.002 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.002 INFO:teuthology.orchestra.run.smithi184.stdout: "req_renamesnap_latency": { 2024-05-10T11:01:07.002 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.002 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.003 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.003 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.003 INFO:teuthology.orchestra.run.smithi184.stdout: "req_snapdiff_latency": { 2024-05-10T11:01:07.003 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.003 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.003 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.003 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.003 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmdir_latency": { 2024-05-10T11:01:07.003 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.003 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.003 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.003 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.004 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmsnap_latency": { 2024-05-10T11:01:07.004 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.004 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.004 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.004 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.004 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmxattr_latency": { 2024-05-10T11:01:07.004 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.004 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.005 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.005 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.005 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setattr_latency": { 2024-05-10T11:01:07.005 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.005 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.005 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.005 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.005 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setdirlayout_latency": { 2024-05-10T11:01:07.005 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.005 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.005 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.006 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.006 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setfilelock_latency": { 2024-05-10T11:01:07.006 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.006 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.006 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.006 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.006 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setlayout_latency": { 2024-05-10T11:01:07.007 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.007 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.007 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.007 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.007 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setxattr_latency": { 2024-05-10T11:01:07.007 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.007 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.007 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.007 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.008 INFO:teuthology.orchestra.run.smithi184.stdout: "req_symlink_latency": { 2024-05-10T11:01:07.008 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.008 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.008 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.008 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.008 INFO:teuthology.orchestra.run.smithi184.stdout: "req_unlink_latency": { 2024-05-10T11:01:07.008 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.008 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.008 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.009 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.009 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_revoke_eviction": 0, 2024-05-10T11:01:07.009 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_acquisition_throttle": 0, 2024-05-10T11:01:07.009 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getvxattr_latency": { 2024-05-10T11:01:07.009 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.009 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.009 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.010 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:07.010 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.010 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_sessions": { 2024-05-10T11:01:07.010 INFO:teuthology.orchestra.run.smithi184.stdout: "session_count": 1, 2024-05-10T11:01:07.010 INFO:teuthology.orchestra.run.smithi184.stdout: "session_add": 2, 2024-05-10T11:01:07.010 INFO:teuthology.orchestra.run.smithi184.stdout: "session_remove": 1, 2024-05-10T11:01:07.010 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_open": 1, 2024-05-10T11:01:07.010 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_stale": 0, 2024-05-10T11:01:07.011 INFO:teuthology.orchestra.run.smithi184.stdout: "total_load": 0, 2024-05-10T11:01:07.011 INFO:teuthology.orchestra.run.smithi184.stdout: "average_load": 0, 2024-05-10T11:01:07.011 INFO:teuthology.orchestra.run.smithi184.stdout: "avg_session_uptime": 1815, 2024-05-10T11:01:07.011 INFO:teuthology.orchestra.run.smithi184.stdout: "mdthresh_evicted": 0 2024-05-10T11:01:07.011 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.011 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2024-05-10T11:01:07.011 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 0, 2024-05-10T11:01:07.011 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 0, 2024-05-10T11:01:07.011 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T11:01:07.011 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2024-05-10T11:01:07.011 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T11:01:07.011 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2024-05-10T11:01:07.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T11:01:07.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T11:01:07.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T11:01:07.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T11:01:07.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T11:01:07.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2024-05-10T11:01:07.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T11:01:07.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T11:01:07.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2024-05-10T11:01:07.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2024-05-10T11:01:07.012 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2024-05-10T11:01:07.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2024-05-10T11:01:07.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T11:01:07.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T11:01:07.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T11:01:07.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T11:01:07.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T11:01:07.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2024-05-10T11:01:07.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2024-05-10T11:01:07.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2024-05-10T11:01:07.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T11:01:07.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T11:01:07.013 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2024-05-10T11:01:07.014 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2024-05-10T11:01:07.014 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2024-05-10T11:01:07.014 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2024-05-10T11:01:07.014 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T11:01:07.014 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2024-05-10T11:01:07.014 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T11:01:07.014 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2024-05-10T11:01:07.014 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 181343, 2024-05-10T11:01:07.014 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 47, 2024-05-10T11:01:07.014 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 0, 2024-05-10T11:01:07.014 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 0, 2024-05-10T11:01:07.014 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2024-05-10T11:01:07.015 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2024-05-10T11:01:07.015 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2024-05-10T11:01:07.015 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2024-05-10T11:01:07.015 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2024-05-10T11:01:07.015 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2024-05-10T11:01:07.015 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 7336, 2024-05-10T11:01:07.015 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 154, 2024-05-10T11:01:07.015 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T11:01:07.015 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2024-05-10T11:01:07.015 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2024-05-10T11:01:07.015 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2024-05-10T11:01:07.015 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 215496, 2024-05-10T11:01:07.016 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 1176, 2024-05-10T11:01:07.016 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2024-05-10T11:01:07.016 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2024-05-10T11:01:07.016 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2024-05-10T11:01:07.016 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2024-05-10T11:01:07.016 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.016 INFO:teuthology.orchestra.run.smithi184.stdout: "objecter": { 2024-05-10T11:01:07.016 INFO:teuthology.orchestra.run.smithi184.stdout: "op_active": 0, 2024-05-10T11:01:07.016 INFO:teuthology.orchestra.run.smithi184.stdout: "op_laggy": 0, 2024-05-10T11:01:07.016 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send": 1485, 2024-05-10T11:01:07.016 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send_bytes": 21, 2024-05-10T11:01:07.016 INFO:teuthology.orchestra.run.smithi184.stdout: "op_resend": 3, 2024-05-10T11:01:07.017 INFO:teuthology.orchestra.run.smithi184.stdout: "op_reply": 1485, 2024-05-10T11:01:07.017 INFO:teuthology.orchestra.run.smithi184.stdout: "op_latency": { 2024-05-10T11:01:07.017 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1485, 2024-05-10T11:01:07.017 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.822983279, 2024-05-10T11:01:07.017 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000554197 2024-05-10T11:01:07.017 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.017 INFO:teuthology.orchestra.run.smithi184.stdout: "op_inflight": 0, 2024-05-10T11:01:07.017 INFO:teuthology.orchestra.run.smithi184.stdout: "oplen_avg": { 2024-05-10T11:01:07.017 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1485, 2024-05-10T11:01:07.017 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 1486 2024-05-10T11:01:07.017 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.017 INFO:teuthology.orchestra.run.smithi184.stdout: "op": 1485, 2024-05-10T11:01:07.018 INFO:teuthology.orchestra.run.smithi184.stdout: "op_r": 1485, 2024-05-10T11:01:07.018 INFO:teuthology.orchestra.run.smithi184.stdout: "op_w": 0, 2024-05-10T11:01:07.018 INFO:teuthology.orchestra.run.smithi184.stdout: "op_rmw": 0, 2024-05-10T11:01:07.018 INFO:teuthology.orchestra.run.smithi184.stdout: "op_pg": 0, 2024-05-10T11:01:07.018 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_stat": 932, 2024-05-10T11:01:07.018 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_create": 0, 2024-05-10T11:01:07.018 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_read": 551, 2024-05-10T11:01:07.018 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_write": 0, 2024-05-10T11:01:07.018 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writefull": 0, 2024-05-10T11:01:07.018 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writesame": 0, 2024-05-10T11:01:07.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_append": 0, 2024-05-10T11:01:07.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_zero": 0, 2024-05-10T11:01:07.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_truncate": 0, 2024-05-10T11:01:07.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_delete": 0, 2024-05-10T11:01:07.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_mapext": 0, 2024-05-10T11:01:07.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_sparse_read": 0, 2024-05-10T11:01:07.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_clonerange": 0, 2024-05-10T11:01:07.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_getxattr": 1, 2024-05-10T11:01:07.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_setxattr": 0, 2024-05-10T11:01:07.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_cmpxattr": 0, 2024-05-10T11:01:07.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_rmxattr": 0, 2024-05-10T11:01:07.019 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_resetxattrs": 0, 2024-05-10T11:01:07.020 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_call": 0, 2024-05-10T11:01:07.020 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_watch": 0, 2024-05-10T11:01:07.020 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_notify": 0, 2024-05-10T11:01:07.020 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T11:01:07.020 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls": 0, 2024-05-10T11:01:07.020 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls_filter": 0, 2024-05-10T11:01:07.020 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_other": 0, 2024-05-10T11:01:07.020 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_active": 0, 2024-05-10T11:01:07.020 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_send": 0, 2024-05-10T11:01:07.020 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_resend": 0, 2024-05-10T11:01:07.020 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_ping": 0, 2024-05-10T11:01:07.020 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_active": 0, 2024-05-10T11:01:07.021 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_send": 0, 2024-05-10T11:01:07.021 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_resend": 0, 2024-05-10T11:01:07.021 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_active": 0, 2024-05-10T11:01:07.021 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_send": 0, 2024-05-10T11:01:07.021 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_resend": 0, 2024-05-10T11:01:07.021 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_active": 0, 2024-05-10T11:01:07.021 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_send": 0, 2024-05-10T11:01:07.021 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_resend": 0, 2024-05-10T11:01:07.021 INFO:teuthology.orchestra.run.smithi184.stdout: "command_active": 0, 2024-05-10T11:01:07.021 INFO:teuthology.orchestra.run.smithi184.stdout: "command_send": 0, 2024-05-10T11:01:07.021 INFO:teuthology.orchestra.run.smithi184.stdout: "command_resend": 0, 2024-05-10T11:01:07.021 INFO:teuthology.orchestra.run.smithi184.stdout: "map_epoch": 82, 2024-05-10T11:01:07.022 INFO:teuthology.orchestra.run.smithi184.stdout: "map_full": 0, 2024-05-10T11:01:07.022 INFO:teuthology.orchestra.run.smithi184.stdout: "map_inc": 2, 2024-05-10T11:01:07.022 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_sessions": 4, 2024-05-10T11:01:07.022 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_open": 4, 2024-05-10T11:01:07.022 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_close": 0, 2024-05-10T11:01:07.022 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_laggy": 0, 2024-05-10T11:01:07.022 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_wr": 0, 2024-05-10T11:01:07.022 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_rd": 2, 2024-05-10T11:01:07.022 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_del": 0 2024-05-10T11:01:07.022 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.022 INFO:teuthology.orchestra.run.smithi184.stdout: "oft": { 2024-05-10T11:01:07.022 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_objs": 0, 2024-05-10T11:01:07.023 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_kv_pairs": 0, 2024-05-10T11:01:07.023 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_updates": 0, 2024-05-10T11:01:07.023 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_removes": 0 2024-05-10T11:01:07.023 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.023 INFO:teuthology.orchestra.run.smithi184.stdout: "osd-slow-ops": { 2024-05-10T11:01:07.023 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_ops_count": 0 2024-05-10T11:01:07.023 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.023 INFO:teuthology.orchestra.run.smithi184.stdout: "purge_queue": { 2024-05-10T11:01:07.023 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops": 0, 2024-05-10T11:01:07.023 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops_high_water": 0, 2024-05-10T11:01:07.023 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing": 0, 2024-05-10T11:01:07.023 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_high_water": 0, 2024-05-10T11:01:07.023 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed_ops": 0, 2024-05-10T11:01:07.024 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed": 0, 2024-05-10T11:01:07.024 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_item_in_journal": 0 2024-05-10T11:01:07.024 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.024 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T11:01:07.024 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:01:07.024 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-05-10T11:01:07.024 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:01:07.024 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 1667, 2024-05-10T11:01:07.024 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 2896525, 2024-05-10T11:01:07.024 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:07.024 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 1667, 2024-05-10T11:01:07.024 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-05-10T11:01:07.025 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-05-10T11:01:07.025 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 1667, 2024-05-10T11:01:07.025 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 2896525, 2024-05-10T11:01:07.025 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:01:07.025 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.025 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.025 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.025 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:07.025 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.025 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_bytes": { 2024-05-10T11:01:07.025 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:01:07.025 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-05-10T11:01:07.025 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:01:07.026 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-05-10T11:01:07.026 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-05-10T11:01:07.026 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:07.026 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:07.026 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 1485, 2024-05-10T11:01:07.026 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 1747503, 2024-05-10T11:01:07.026 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 1485, 2024-05-10T11:01:07.026 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 1747503, 2024-05-10T11:01:07.026 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:01:07.026 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.026 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.027 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.027 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:07.027 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.027 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_ops": { 2024-05-10T11:01:07.027 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:01:07.027 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 1024, 2024-05-10T11:01:07.027 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:01:07.027 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-05-10T11:01:07.027 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-05-10T11:01:07.027 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:07.027 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:07.027 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 1485, 2024-05-10T11:01:07.027 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 1485, 2024-05-10T11:01:07.028 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 1485, 2024-05-10T11:01:07.028 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 1485, 2024-05-10T11:01:07.028 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:01:07.028 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.028 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.028 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.028 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:07.028 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.028 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle": { 2024-05-10T11:01:07.028 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:01:07.028 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-05-10T11:01:07.028 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:01:07.029 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-05-10T11:01:07.029 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-05-10T11:01:07.029 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:07.029 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:07.029 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-05-10T11:01:07.029 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-05-10T11:01:07.029 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 0, 2024-05-10T11:01:07.029 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 0, 2024-05-10T11:01:07.029 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:01:07.029 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.029 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.029 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.030 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:07.030 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-05-10T11:01:07.030 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle-0x5570b6fb46e0": { 2024-05-10T11:01:07.030 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-05-10T11:01:07.030 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-05-10T11:01:07.030 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-05-10T11:01:07.030 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-05-10T11:01:07.030 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-05-10T11:01:07.030 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:07.030 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:07.030 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-05-10T11:01:07.030 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-05-10T11:01:07.030 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 0, 2024-05-10T11:01:07.031 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 0, 2024-05-10T11:01:07.031 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-05-10T11:01:07.031 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-05-10T11:01:07.031 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-05-10T11:01:07.031 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-05-10T11:01:07.031 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:07.031 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-05-10T11:01:07.031 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-05-10T11:01:07.795 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-05-10T11:01:07.795 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-05-10T11:01:07.795 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-05-10T11:01:07.795 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-05-10T11:01:07.795 DEBUG:tasks.check_counter:Getting stats from c 2024-05-10T11:01:07.795 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph daemon mds.c perf dump 2024-05-10T11:01:07.812 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:07 smithi196 ceph-mon[34872]: pgmap v551: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-10T11:01:07.888 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:07 smithi184 ceph-mon[34585]: pgmap v551: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-10T11:01:07.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:07 smithi107 ceph-mon[30373]: pgmap v551: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-10T11:01:08.050 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T11:01:09.791 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:09 smithi196 ceph-mon[34872]: pgmap v552: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T11:01:09.791 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-05-10T11:01:09.792 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T11:01:09.792 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 1563, 2024-05-10T11:01:09.792 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 2524, 2024-05-10T11:01:09.792 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 1378037, 2024-05-10T11:01:09.792 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 3175230, 2024-05-10T11:01:09.792 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 15, 2024-05-10T11:01:09.792 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 6, 2024-05-10T11:01:09.792 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.125798966, 2024-05-10T11:01:09.792 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.049578060, 2024-05-10T11:01:09.792 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.074199782, 2024-05-10T11:01:09.792 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.011368349, 2024-05-10T11:01:09.792 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:09.792 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 2520, 2024-05-10T11:01:09.792 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.066409546, 2024-05-10T11:01:09.793 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000026352 2024-05-10T11:01:09.793 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.793 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:09.793 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 2809, 2024-05-10T11:01:09.793 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000461261, 2024-05-10T11:01:09.793 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000164 2024-05-10T11:01:09.793 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.793 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 898736, 2024-05-10T11:01:09.793 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 101008 2024-05-10T11:01:09.793 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.793 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T11:01:09.793 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 7605, 2024-05-10T11:01:09.793 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 4469, 2024-05-10T11:01:09.793 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 3217748, 2024-05-10T11:01:09.794 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 1298006, 2024-05-10T11:01:09.794 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 9, 2024-05-10T11:01:09.794 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 6, 2024-05-10T11:01:09.794 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.310043109, 2024-05-10T11:01:09.794 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.122262317, 2024-05-10T11:01:09.794 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.242899051, 2024-05-10T11:01:09.794 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.005586897, 2024-05-10T11:01:09.794 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:09.794 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 4471, 2024-05-10T11:01:09.794 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.098504119, 2024-05-10T11:01:09.794 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000022031 2024-05-10T11:01:09.794 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.794 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:09.795 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 11605, 2024-05-10T11:01:09.795 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.001416527, 2024-05-10T11:01:09.795 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000122 2024-05-10T11:01:09.795 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.795 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-10T11:01:09.795 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 274752 2024-05-10T11:01:09.795 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.795 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T11:01:09.795 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 7244, 2024-05-10T11:01:09.795 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 3752, 2024-05-10T11:01:09.795 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 2842022, 2024-05-10T11:01:09.795 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 849660, 2024-05-10T11:01:09.795 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 10, 2024-05-10T11:01:09.795 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 6, 2024-05-10T11:01:09.795 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.293125598, 2024-05-10T11:01:09.796 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.128095681, 2024-05-10T11:01:09.796 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.218348227, 2024-05-10T11:01:09.796 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.004585694, 2024-05-10T11:01:09.796 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:09.796 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 3750, 2024-05-10T11:01:09.796 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.075985827, 2024-05-10T11:01:09.796 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000020262 2024-05-10T11:01:09.796 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.796 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:09.796 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 10555, 2024-05-10T11:01:09.796 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.001231486, 2024-05-10T11:01:09.796 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000116 2024-05-10T11:01:09.796 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.797 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-10T11:01:09.797 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 0 2024-05-10T11:01:09.797 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.797 INFO:teuthology.orchestra.run.smithi196.stdout: "cct": { 2024-05-10T11:01:09.797 INFO:teuthology.orchestra.run.smithi196.stdout: "total_workers": 1, 2024-05-10T11:01:09.797 INFO:teuthology.orchestra.run.smithi196.stdout: "unhealthy_workers": 0 2024-05-10T11:01:09.797 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.797 INFO:teuthology.orchestra.run.smithi196.stdout: "finisher-MDSRank": { 2024-05-10T11:01:09.797 INFO:teuthology.orchestra.run.smithi196.stdout: "queue_len": 0, 2024-05-10T11:01:09.797 INFO:teuthology.orchestra.run.smithi196.stdout: "complete_latency": { 2024-05-10T11:01:09.797 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 383, 2024-05-10T11:01:09.797 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.369542552, 2024-05-10T11:01:09.797 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000964863 2024-05-10T11:01:09.797 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:09.798 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.798 INFO:teuthology.orchestra.run.smithi196.stdout: "finisher-PurgeQueue": { 2024-05-10T11:01:09.798 INFO:teuthology.orchestra.run.smithi196.stdout: "queue_len": 0, 2024-05-10T11:01:09.798 INFO:teuthology.orchestra.run.smithi196.stdout: "complete_latency": { 2024-05-10T11:01:09.798 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 577, 2024-05-10T11:01:09.798 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.027401587, 2024-05-10T11:01:09.798 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000047489 2024-05-10T11:01:09.798 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:09.798 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.798 INFO:teuthology.orchestra.run.smithi196.stdout: "mds": { 2024-05-10T11:01:09.798 INFO:teuthology.orchestra.run.smithi196.stdout: "request": 491, 2024-05-10T11:01:09.798 INFO:teuthology.orchestra.run.smithi196.stdout: "reply": 490, 2024-05-10T11:01:09.798 INFO:teuthology.orchestra.run.smithi196.stdout: "reply_latency": { 2024-05-10T11:01:09.798 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 490, 2024-05-10T11:01:09.799 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.659896656, 2024-05-10T11:01:09.799 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.001346727 2024-05-10T11:01:09.799 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.799 INFO:teuthology.orchestra.run.smithi196.stdout: "slow_reply": 0, 2024-05-10T11:01:09.799 INFO:teuthology.orchestra.run.smithi196.stdout: "forward": 1, 2024-05-10T11:01:09.799 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_fetch_complete": 0, 2024-05-10T11:01:09.799 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_fetch_keys": 0, 2024-05-10T11:01:09.799 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_commit": 11, 2024-05-10T11:01:09.799 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_split": 0, 2024-05-10T11:01:09.799 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_merge": 0, 2024-05-10T11:01:09.799 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes": 41, 2024-05-10T11:01:09.799 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_top": 17, 2024-05-10T11:01:09.799 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_bottom": 12, 2024-05-10T11:01:09.799 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_pin_tail": 12, 2024-05-10T11:01:09.800 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_pinned": 15, 2024-05-10T11:01:09.800 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_expired": 1221, 2024-05-10T11:01:09.800 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_with_caps": 0, 2024-05-10T11:01:09.800 INFO:teuthology.orchestra.run.smithi196.stdout: "caps": 0, 2024-05-10T11:01:09.800 INFO:teuthology.orchestra.run.smithi196.stdout: "subtrees": 6, 2024-05-10T11:01:09.800 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse": 2370, 2024-05-10T11:01:09.800 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_hit": 1365, 2024-05-10T11:01:09.800 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_forward": 1, 2024-05-10T11:01:09.800 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_discover": 765, 2024-05-10T11:01:09.800 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_dir_fetch": 0, 2024-05-10T11:01:09.800 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_remote_ino": 0, 2024-05-10T11:01:09.800 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_lock": 0, 2024-05-10T11:01:09.800 INFO:teuthology.orchestra.run.smithi196.stdout: "load_cent": 0, 2024-05-10T11:01:09.800 INFO:teuthology.orchestra.run.smithi196.stdout: "q": 0, 2024-05-10T11:01:09.800 INFO:teuthology.orchestra.run.smithi196.stdout: "exported": 19, 2024-05-10T11:01:09.801 INFO:teuthology.orchestra.run.smithi196.stdout: "exported_inodes": 4, 2024-05-10T11:01:09.801 INFO:teuthology.orchestra.run.smithi196.stdout: "imported": 19, 2024-05-10T11:01:09.801 INFO:teuthology.orchestra.run.smithi196.stdout: "imported_inodes": 190, 2024-05-10T11:01:09.801 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_dir_fetch": 0, 2024-05-10T11:01:09.801 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_backtrace_fetch": 0, 2024-05-10T11:01:09.801 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_peer_discover": 0, 2024-05-10T11:01:09.801 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rfiles": 4, 2024-05-10T11:01:09.801 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rbytes": 234, 2024-05-10T11:01:09.801 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rsnaps": 0, 2024-05-10T11:01:09.801 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_backtrace_fetch": 0, 2024-05-10T11:01:09.801 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_set_tag": 0, 2024-05-10T11:01:09.801 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T11:01:09.801 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_inotable_repaired": 0, 2024-05-10T11:01:09.801 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dir_inodes": 0, 2024-05-10T11:01:09.801 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dir_base_inodes": 0, 2024-05-10T11:01:09.802 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dirfrag_rstats": 0, 2024-05-10T11:01:09.802 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_file_inodes": 0, 2024-05-10T11:01:09.802 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_inode_file_caps": 0, 2024-05-10T11:01:09.802 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_revoke": 48, 2024-05-10T11:01:09.802 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_grant": 379, 2024-05-10T11:01:09.802 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T11:01:09.802 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T11:01:09.802 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T11:01:09.802 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_caps": 287, 2024-05-10T11:01:09.802 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_caps_dirty": 256, 2024-05-10T11:01:09.802 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_cap_release": 16, 2024-05-10T11:01:09.802 INFO:teuthology.orchestra.run.smithi196.stdout: "process_request_cap_release": 439 2024-05-10T11:01:09.802 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.802 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_cache": { 2024-05-10T11:01:09.802 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_update": 141, 2024-05-10T11:01:09.803 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_update_receipt": 2121, 2024-05-10T11:01:09.803 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_try_discover": 1429, 2024-05-10T11:01:09.803 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_send_discover": 1360, 2024-05-10T11:01:09.803 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_handle_discover": 169, 2024-05-10T11:01:09.803 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays": 2, 2024-05-10T11:01:09.803 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays_delayed": 0, 2024-05-10T11:01:09.803 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays_enqueuing": 0, 2024-05-10T11:01:09.803 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_created": 262, 2024-05-10T11:01:09.803 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_enqueued": 260, 2024-05-10T11:01:09.803 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_reintegrated": 0, 2024-05-10T11:01:09.803 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_migrated": 0, 2024-05-10T11:01:09.803 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_processing": 0, 2024-05-10T11:01:09.803 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_enqueued": 0, 2024-05-10T11:01:09.803 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_prioritized": 0, 2024-05-10T11:01:09.804 INFO:teuthology.orchestra.run.smithi196.stdout: "recovery_started": 0, 2024-05-10T11:01:09.804 INFO:teuthology.orchestra.run.smithi196.stdout: "recovery_completed": 0, 2024-05-10T11:01:09.804 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_quiesce_path": 3, 2024-05-10T11:01:09.804 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_quiesce_inode": 17, 2024-05-10T11:01:09.804 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_enqueue_scrub": 0, 2024-05-10T11:01:09.804 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_exportdir": 19, 2024-05-10T11:01:09.804 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_flush": 0, 2024-05-10T11:01:09.804 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_fragmentdir": 0, 2024-05-10T11:01:09.804 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_fragstats": 0, 2024-05-10T11:01:09.804 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_inodestats": 0 2024-05-10T11:01:09.804 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.804 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_log": { 2024-05-10T11:01:09.804 INFO:teuthology.orchestra.run.smithi196.stdout: "evlrg": 0, 2024-05-10T11:01:09.804 INFO:teuthology.orchestra.run.smithi196.stdout: "evadd": 1133, 2024-05-10T11:01:09.804 INFO:teuthology.orchestra.run.smithi196.stdout: "evex": 0, 2024-05-10T11:01:09.804 INFO:teuthology.orchestra.run.smithi196.stdout: "evtrm": 0, 2024-05-10T11:01:09.805 INFO:teuthology.orchestra.run.smithi196.stdout: "ev": 1133, 2024-05-10T11:01:09.805 INFO:teuthology.orchestra.run.smithi196.stdout: "evexg": 0, 2024-05-10T11:01:09.805 INFO:teuthology.orchestra.run.smithi196.stdout: "evexd": 0, 2024-05-10T11:01:09.805 INFO:teuthology.orchestra.run.smithi196.stdout: "segadd": 3, 2024-05-10T11:01:09.805 INFO:teuthology.orchestra.run.smithi196.stdout: "segex": 0, 2024-05-10T11:01:09.805 INFO:teuthology.orchestra.run.smithi196.stdout: "segtrm": 0, 2024-05-10T11:01:09.805 INFO:teuthology.orchestra.run.smithi196.stdout: "seg": 3, 2024-05-10T11:01:09.805 INFO:teuthology.orchestra.run.smithi196.stdout: "segmjr": 2, 2024-05-10T11:01:09.805 INFO:teuthology.orchestra.run.smithi196.stdout: "segexg": 0, 2024-05-10T11:01:09.805 INFO:teuthology.orchestra.run.smithi196.stdout: "segexd": 0, 2024-05-10T11:01:09.805 INFO:teuthology.orchestra.run.smithi196.stdout: "expos": 4194304, 2024-05-10T11:01:09.805 INFO:teuthology.orchestra.run.smithi196.stdout: "wrpos": 6244145, 2024-05-10T11:01:09.805 INFO:teuthology.orchestra.run.smithi196.stdout: "rdpos": 0, 2024-05-10T11:01:09.805 INFO:teuthology.orchestra.run.smithi196.stdout: "jlat": { 2024-05-10T11:01:09.806 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 144, 2024-05-10T11:01:09.806 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.663260741, 2024-05-10T11:01:09.806 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.004605977 2024-05-10T11:01:09.806 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.806 INFO:teuthology.orchestra.run.smithi196.stdout: "replayed": 0 2024-05-10T11:01:09.806 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.806 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_mem": { 2024-05-10T11:01:09.806 INFO:teuthology.orchestra.run.smithi196.stdout: "ino": 45, 2024-05-10T11:01:09.806 INFO:teuthology.orchestra.run.smithi196.stdout: "ino+": 916, 2024-05-10T11:01:09.806 INFO:teuthology.orchestra.run.smithi196.stdout: "ino-": 871, 2024-05-10T11:01:09.807 INFO:teuthology.orchestra.run.smithi196.stdout: "dir": 44, 2024-05-10T11:01:09.807 INFO:teuthology.orchestra.run.smithi196.stdout: "dir+": 785, 2024-05-10T11:01:09.807 INFO:teuthology.orchestra.run.smithi196.stdout: "dir-": 741, 2024-05-10T11:01:09.807 INFO:teuthology.orchestra.run.smithi196.stdout: "dn": 41, 2024-05-10T11:01:09.807 INFO:teuthology.orchestra.run.smithi196.stdout: "dn+": 1705, 2024-05-10T11:01:09.807 INFO:teuthology.orchestra.run.smithi196.stdout: "dn-": 1664, 2024-05-10T11:01:09.807 INFO:teuthology.orchestra.run.smithi196.stdout: "cap": 0, 2024-05-10T11:01:09.807 INFO:teuthology.orchestra.run.smithi196.stdout: "cap+": 281, 2024-05-10T11:01:09.807 INFO:teuthology.orchestra.run.smithi196.stdout: "cap-": 281, 2024-05-10T11:01:09.807 INFO:teuthology.orchestra.run.smithi196.stdout: "rss": 60076, 2024-05-10T11:01:09.807 INFO:teuthology.orchestra.run.smithi196.stdout: "heap": 223608 2024-05-10T11:01:09.807 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.807 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_server": { 2024-05-10T11:01:09.807 INFO:teuthology.orchestra.run.smithi196.stdout: "dispatch_client_request": 780, 2024-05-10T11:01:09.807 INFO:teuthology.orchestra.run.smithi196.stdout: "dispatch_server_request": 66, 2024-05-10T11:01:09.808 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_request": 491, 2024-05-10T11:01:09.808 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_session": 6, 2024-05-10T11:01:09.808 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_peer_request": 346, 2024-05-10T11:01:09.808 INFO:teuthology.orchestra.run.smithi196.stdout: "req_create_latency": { 2024-05-10T11:01:09.808 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 72, 2024-05-10T11:01:09.808 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.073477017, 2024-05-10T11:01:09.808 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.001020514 2024-05-10T11:01:09.808 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.808 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getattr_latency": { 2024-05-10T11:01:09.808 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.808 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.808 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.808 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.808 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getfilelock_latency": { 2024-05-10T11:01:09.809 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.809 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.809 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.809 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.809 INFO:teuthology.orchestra.run.smithi196.stdout: "req_link_latency": { 2024-05-10T11:01:09.809 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.809 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.809 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.809 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.809 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookup_latency": { 2024-05-10T11:01:09.809 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 117, 2024-05-10T11:01:09.809 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.035374403, 2024-05-10T11:01:09.809 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000302345 2024-05-10T11:01:09.809 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.809 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookuphash_latency": { 2024-05-10T11:01:09.810 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.810 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.810 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.810 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.810 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupino_latency": { 2024-05-10T11:01:09.810 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.810 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.810 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.810 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.810 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupname_latency": { 2024-05-10T11:01:09.810 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.810 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.810 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.810 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.810 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupparent_latency": { 2024-05-10T11:01:09.811 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.811 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.811 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.811 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.811 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupsnap_latency": { 2024-05-10T11:01:09.811 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.811 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.811 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.811 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.811 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lssnap_latency": { 2024-05-10T11:01:09.811 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.811 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.812 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.812 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.812 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mkdir_latency": { 2024-05-10T11:01:09.812 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.812 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.813 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.813 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.813 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mknod_latency": { 2024-05-10T11:01:09.813 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.813 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.813 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.813 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.813 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mksnap_latency": { 2024-05-10T11:01:09.813 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.813 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.813 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.813 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.813 INFO:teuthology.orchestra.run.smithi196.stdout: "req_open_latency": { 2024-05-10T11:01:09.813 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.814 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.814 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.814 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.814 INFO:teuthology.orchestra.run.smithi196.stdout: "req_readdir_latency": { 2024-05-10T11:01:09.814 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 39, 2024-05-10T11:01:09.814 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.037607418, 2024-05-10T11:01:09.814 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000964292 2024-05-10T11:01:09.814 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.814 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rename_latency": { 2024-05-10T11:01:09.814 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.814 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.814 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.814 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.815 INFO:teuthology.orchestra.run.smithi196.stdout: "req_renamesnap_latency": { 2024-05-10T11:01:09.815 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.815 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.815 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.815 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.815 INFO:teuthology.orchestra.run.smithi196.stdout: "req_snapdiff_latency": { 2024-05-10T11:01:09.815 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.815 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.815 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.815 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.815 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmdir_latency": { 2024-05-10T11:01:09.815 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 6, 2024-05-10T11:01:09.815 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.098836129, 2024-05-10T11:01:09.815 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.016472688 2024-05-10T11:01:09.816 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.816 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmsnap_latency": { 2024-05-10T11:01:09.816 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.816 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.816 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.816 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.816 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmxattr_latency": { 2024-05-10T11:01:09.816 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.816 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.816 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.816 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.816 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setattr_latency": { 2024-05-10T11:01:09.816 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.816 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.816 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.817 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.817 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setdirlayout_latency": { 2024-05-10T11:01:09.817 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.817 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.817 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.817 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.817 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setfilelock_latency": { 2024-05-10T11:01:09.817 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.817 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.817 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.817 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.817 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setlayout_latency": { 2024-05-10T11:01:09.817 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.817 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.817 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.818 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.818 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setxattr_latency": { 2024-05-10T11:01:09.818 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.818 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.818 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.818 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.818 INFO:teuthology.orchestra.run.smithi196.stdout: "req_symlink_latency": { 2024-05-10T11:01:09.818 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.818 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.818 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.818 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.819 INFO:teuthology.orchestra.run.smithi196.stdout: "req_unlink_latency": { 2024-05-10T11:01:09.819 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 256, 2024-05-10T11:01:09.819 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.414601689, 2024-05-10T11:01:09.819 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.001619537 2024-05-10T11:01:09.819 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.819 INFO:teuthology.orchestra.run.smithi196.stdout: "cap_revoke_eviction": 0, 2024-05-10T11:01:09.819 INFO:teuthology.orchestra.run.smithi196.stdout: "cap_acquisition_throttle": 0, 2024-05-10T11:01:09.819 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getvxattr_latency": { 2024-05-10T11:01:09.819 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.819 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.819 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.819 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:09.819 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.819 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_sessions": { 2024-05-10T11:01:09.820 INFO:teuthology.orchestra.run.smithi196.stdout: "session_count": 1, 2024-05-10T11:01:09.820 INFO:teuthology.orchestra.run.smithi196.stdout: "session_add": 2, 2024-05-10T11:01:09.820 INFO:teuthology.orchestra.run.smithi196.stdout: "session_remove": 1, 2024-05-10T11:01:09.820 INFO:teuthology.orchestra.run.smithi196.stdout: "sessions_open": 1, 2024-05-10T11:01:09.820 INFO:teuthology.orchestra.run.smithi196.stdout: "sessions_stale": 0, 2024-05-10T11:01:09.820 INFO:teuthology.orchestra.run.smithi196.stdout: "total_load": 364, 2024-05-10T11:01:09.820 INFO:teuthology.orchestra.run.smithi196.stdout: "average_load": 364, 2024-05-10T11:01:09.820 INFO:teuthology.orchestra.run.smithi196.stdout: "avg_session_uptime": 1810, 2024-05-10T11:01:09.820 INFO:teuthology.orchestra.run.smithi196.stdout: "mdthresh_evicted": 0 2024-05-10T11:01:09.820 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.820 INFO:teuthology.orchestra.run.smithi196.stdout: "mempool": { 2024-05-10T11:01:09.820 INFO:teuthology.orchestra.run.smithi196.stdout: "bloom_filter_bytes": 0, 2024-05-10T11:01:09.820 INFO:teuthology.orchestra.run.smithi196.stdout: "bloom_filter_items": 0, 2024-05-10T11:01:09.820 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T11:01:09.820 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_alloc_items": 0, 2024-05-10T11:01:09.821 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T11:01:09.821 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_data_items": 0, 2024-05-10T11:01:09.821 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T11:01:09.821 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T11:01:09.821 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T11:01:09.821 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T11:01:09.821 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T11:01:09.821 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_other_items": 0, 2024-05-10T11:01:09.821 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T11:01:09.821 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T11:01:09.821 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_extent_bytes": 0, 2024-05-10T11:01:09.821 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_extent_items": 0, 2024-05-10T11:01:09.821 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_blob_bytes": 0, 2024-05-10T11:01:09.821 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_blob_items": 0, 2024-05-10T11:01:09.822 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T11:01:09.822 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T11:01:09.822 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T11:01:09.822 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T11:01:09.822 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T11:01:09.822 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_fsck_items": 0, 2024-05-10T11:01:09.822 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_txc_bytes": 0, 2024-05-10T11:01:09.822 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_txc_items": 0, 2024-05-10T11:01:09.822 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T11:01:09.822 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T11:01:09.822 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_bytes": 0, 2024-05-10T11:01:09.822 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_items": 0, 2024-05-10T11:01:09.822 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_bytes": 0, 2024-05-10T11:01:09.823 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_items": 0, 2024-05-10T11:01:09.823 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T11:01:09.823 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_reader_items": 0, 2024-05-10T11:01:09.823 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T11:01:09.823 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_writer_items": 0, 2024-05-10T11:01:09.823 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_anon_bytes": 287409, 2024-05-10T11:01:09.823 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_anon_items": 103, 2024-05-10T11:01:09.823 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_meta_bytes": 0, 2024-05-10T11:01:09.823 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_meta_items": 0, 2024-05-10T11:01:09.823 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_bytes": 0, 2024-05-10T11:01:09.824 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_items": 0, 2024-05-10T11:01:09.824 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_mapbl_bytes": 0, 2024-05-10T11:01:09.824 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_mapbl_items": 0, 2024-05-10T11:01:09.824 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_pglog_bytes": 0, 2024-05-10T11:01:09.824 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_pglog_items": 0, 2024-05-10T11:01:09.824 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_bytes": 7336, 2024-05-10T11:01:09.824 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_items": 154, 2024-05-10T11:01:09.824 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T11:01:09.824 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_mapping_items": 0, 2024-05-10T11:01:09.824 INFO:teuthology.orchestra.run.smithi196.stdout: "pgmap_bytes": 0, 2024-05-10T11:01:09.824 INFO:teuthology.orchestra.run.smithi196.stdout: "pgmap_items": 0, 2024-05-10T11:01:09.824 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_co_bytes": 187500, 2024-05-10T11:01:09.824 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_co_items": 1033, 2024-05-10T11:01:09.825 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_1_bytes": 0, 2024-05-10T11:01:09.825 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_1_items": 0, 2024-05-10T11:01:09.825 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_2_bytes": 0, 2024-05-10T11:01:09.825 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_2_items": 0 2024-05-10T11:01:09.825 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.825 INFO:teuthology.orchestra.run.smithi196.stdout: "objecter": { 2024-05-10T11:01:09.825 INFO:teuthology.orchestra.run.smithi196.stdout: "op_active": 0, 2024-05-10T11:01:09.825 INFO:teuthology.orchestra.run.smithi196.stdout: "op_laggy": 0, 2024-05-10T11:01:09.825 INFO:teuthology.orchestra.run.smithi196.stdout: "op_send": 572, 2024-05-10T11:01:09.825 INFO:teuthology.orchestra.run.smithi196.stdout: "op_send_bytes": 2133045, 2024-05-10T11:01:09.825 INFO:teuthology.orchestra.run.smithi196.stdout: "op_resend": 28, 2024-05-10T11:01:09.825 INFO:teuthology.orchestra.run.smithi196.stdout: "op_reply": 572, 2024-05-10T11:01:09.825 INFO:teuthology.orchestra.run.smithi196.stdout: "op_latency": { 2024-05-10T11:01:09.825 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 572, 2024-05-10T11:01:09.825 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 1.658964792, 2024-05-10T11:01:09.826 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.002900288 2024-05-10T11:01:09.826 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.826 INFO:teuthology.orchestra.run.smithi196.stdout: "op_inflight": 0, 2024-05-10T11:01:09.826 INFO:teuthology.orchestra.run.smithi196.stdout: "oplen_avg": { 2024-05-10T11:01:09.826 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 572, 2024-05-10T11:01:09.826 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 653 2024-05-10T11:01:09.826 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.826 INFO:teuthology.orchestra.run.smithi196.stdout: "op": 572, 2024-05-10T11:01:09.826 INFO:teuthology.orchestra.run.smithi196.stdout: "op_r": 31, 2024-05-10T11:01:09.826 INFO:teuthology.orchestra.run.smithi196.stdout: "op_w": 541, 2024-05-10T11:01:09.826 INFO:teuthology.orchestra.run.smithi196.stdout: "op_rmw": 0, 2024-05-10T11:01:09.826 INFO:teuthology.orchestra.run.smithi196.stdout: "op_pg": 0, 2024-05-10T11:01:09.826 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_stat": 0, 2024-05-10T11:01:09.826 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_create": 10, 2024-05-10T11:01:09.826 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_read": 31, 2024-05-10T11:01:09.827 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_write": 175, 2024-05-10T11:01:09.827 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_writefull": 30, 2024-05-10T11:01:09.827 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_writesame": 0, 2024-05-10T11:01:09.827 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_append": 0, 2024-05-10T11:01:09.827 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_zero": 0, 2024-05-10T11:01:09.827 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_truncate": 0, 2024-05-10T11:01:09.827 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_delete": 272, 2024-05-10T11:01:09.827 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_mapext": 0, 2024-05-10T11:01:09.827 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_sparse_read": 0, 2024-05-10T11:01:09.827 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_clonerange": 0, 2024-05-10T11:01:09.827 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_getxattr": 0, 2024-05-10T11:01:09.827 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_setxattr": 20, 2024-05-10T11:01:09.827 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_cmpxattr": 0, 2024-05-10T11:01:09.827 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_rmxattr": 0, 2024-05-10T11:01:09.828 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_resetxattrs": 0, 2024-05-10T11:01:09.828 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_call": 0, 2024-05-10T11:01:09.828 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_watch": 0, 2024-05-10T11:01:09.828 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_notify": 0, 2024-05-10T11:01:09.828 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T11:01:09.828 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_pgls": 0, 2024-05-10T11:01:09.828 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_pgls_filter": 0, 2024-05-10T11:01:09.828 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_other": 0, 2024-05-10T11:01:09.828 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_active": 0, 2024-05-10T11:01:09.828 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_send": 0, 2024-05-10T11:01:09.828 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_resend": 0, 2024-05-10T11:01:09.828 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_ping": 0, 2024-05-10T11:01:09.828 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_active": 0, 2024-05-10T11:01:09.828 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_send": 0, 2024-05-10T11:01:09.828 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_resend": 0, 2024-05-10T11:01:09.829 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_active": 0, 2024-05-10T11:01:09.829 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_send": 0, 2024-05-10T11:01:09.829 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_resend": 0, 2024-05-10T11:01:09.829 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_active": 0, 2024-05-10T11:01:09.829 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_send": 0, 2024-05-10T11:01:09.829 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_resend": 0, 2024-05-10T11:01:09.829 INFO:teuthology.orchestra.run.smithi196.stdout: "command_active": 0, 2024-05-10T11:01:09.829 INFO:teuthology.orchestra.run.smithi196.stdout: "command_send": 0, 2024-05-10T11:01:09.829 INFO:teuthology.orchestra.run.smithi196.stdout: "command_resend": 0, 2024-05-10T11:01:09.829 INFO:teuthology.orchestra.run.smithi196.stdout: "map_epoch": 82, 2024-05-10T11:01:09.829 INFO:teuthology.orchestra.run.smithi196.stdout: "map_full": 0, 2024-05-10T11:01:09.829 INFO:teuthology.orchestra.run.smithi196.stdout: "map_inc": 2, 2024-05-10T11:01:09.829 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_sessions": 12, 2024-05-10T11:01:09.829 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_session_open": 12, 2024-05-10T11:01:09.829 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_session_close": 0, 2024-05-10T11:01:09.830 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_laggy": 0, 2024-05-10T11:01:09.830 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_wr": 86, 2024-05-10T11:01:09.830 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_rd": 0, 2024-05-10T11:01:09.830 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_del": 29 2024-05-10T11:01:09.830 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.830 INFO:teuthology.orchestra.run.smithi196.stdout: "oft": { 2024-05-10T11:01:09.830 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_objs": 1, 2024-05-10T11:01:09.830 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_kv_pairs": 0, 2024-05-10T11:01:09.830 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_updates": 0, 2024-05-10T11:01:09.830 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_removes": 0 2024-05-10T11:01:09.830 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.830 INFO:teuthology.orchestra.run.smithi196.stdout: "osd-slow-ops": { 2024-05-10T11:01:09.830 INFO:teuthology.orchestra.run.smithi196.stdout: "slow_ops_count": 20 2024-05-10T11:01:09.830 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.831 INFO:teuthology.orchestra.run.smithi196.stdout: "purge_queue": { 2024-05-10T11:01:09.831 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_ops": 0, 2024-05-10T11:01:09.831 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_ops_high_water": 6, 2024-05-10T11:01:09.831 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing": 0, 2024-05-10T11:01:09.831 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_high_water": 6, 2024-05-10T11:01:09.831 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executed_ops": 260, 2024-05-10T11:01:09.831 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executed": 260, 2024-05-10T11:01:09.831 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_item_in_journal": 0 2024-05-10T11:01:09.831 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.831 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T11:01:09.831 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:09.831 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 104857600, 2024-05-10T11:01:09.831 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:09.831 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 16408, 2024-05-10T11:01:09.832 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 5947571, 2024-05-10T11:01:09.832 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:09.832 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 16408, 2024-05-10T11:01:09.832 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-05-10T11:01:09.832 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-05-10T11:01:09.832 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 16408, 2024-05-10T11:01:09.832 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 5947571, 2024-05-10T11:01:09.832 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:09.832 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.832 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.832 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.832 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:09.832 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.832 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-objecter_bytes": { 2024-05-10T11:01:09.833 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:09.833 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 104857600, 2024-05-10T11:01:09.833 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:09.833 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-05-10T11:01:09.833 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-05-10T11:01:09.833 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:09.833 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:09.833 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 572, 2024-05-10T11:01:09.833 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 2159305, 2024-05-10T11:01:09.833 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 572, 2024-05-10T11:01:09.833 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 2159305, 2024-05-10T11:01:09.833 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:09.833 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.834 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.834 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.834 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:09.834 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.834 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-objecter_ops": { 2024-05-10T11:01:09.834 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:09.834 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 1024, 2024-05-10T11:01:09.834 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:09.834 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-05-10T11:01:09.834 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-05-10T11:01:09.834 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:09.834 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:09.834 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 572, 2024-05-10T11:01:09.834 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 572, 2024-05-10T11:01:09.835 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 572, 2024-05-10T11:01:09.835 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 572, 2024-05-10T11:01:09.835 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:09.835 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.835 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.835 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.835 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:09.835 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.835 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-write_buf_throttle": { 2024-05-10T11:01:09.835 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:09.835 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 3758096384, 2024-05-10T11:01:09.835 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:09.835 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 260, 2024-05-10T11:01:09.835 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 26260, 2024-05-10T11:01:09.836 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:09.836 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 260, 2024-05-10T11:01:09.836 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-05-10T11:01:09.836 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-05-10T11:01:09.836 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 31, 2024-05-10T11:01:09.836 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 26260, 2024-05-10T11:01:09.836 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:09.836 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.836 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.836 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.836 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:09.836 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:09.836 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-write_buf_throttle-0x55b3214ec500": { 2024-05-10T11:01:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 3758096384, 2024-05-10T11:01:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 1133, 2024-05-10T11:01:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 2049841, 2024-05-10T11:01:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 1133, 2024-05-10T11:01:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-05-10T11:01:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-05-10T11:01:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 144, 2024-05-10T11:01:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 2049841, 2024-05-10T11:01:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:09.837 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:09.838 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:09.838 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:09.838 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:09.838 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:09.838 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-05-10T11:01:09.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:09 smithi184 ceph-mon[34585]: pgmap v552: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T11:01:09.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:09 smithi107 ceph-mon[30373]: pgmap v552: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T11:01:10.494 INFO:tasks.check_counter:Daemon mds.c mds.exported=19 2024-05-10T11:01:10.494 INFO:tasks.check_counter:Daemon mds.c mds.imported=19 2024-05-10T11:01:10.494 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=141 2024-05-10T11:01:10.494 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=2121 2024-05-10T11:01:10.494 DEBUG:tasks.check_counter:Getting stats from f 2024-05-10T11:01:10.494 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph daemon mds.f perf dump 2024-05-10T11:01:10.781 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:10 smithi196 ceph-mon[34872]: pgmap v553: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T11:01:10.788 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T11:01:10.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:10 smithi184 ceph-mon[34585]: pgmap v553: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T11:01:10.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:10 smithi107 ceph-mon[30373]: pgmap v553: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T11:01:12.363 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-05-10T11:01:12.363 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T11:01:12.363 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 1280, 2024-05-10T11:01:12.363 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 1262, 2024-05-10T11:01:12.363 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 17302314, 2024-05-10T11:01:12.363 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 445252, 2024-05-10T11:01:12.363 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 6, 2024-05-10T11:01:12.363 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 2, 2024-05-10T11:01:12.364 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.139687759, 2024-05-10T11:01:12.364 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.042505492, 2024-05-10T11:01:12.364 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.055941814, 2024-05-10T11:01:12.364 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.035896149, 2024-05-10T11:01:12.364 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:12.364 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 1262, 2024-05-10T11:01:12.364 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.049507943, 2024-05-10T11:01:12.364 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000039229 2024-05-10T11:01:12.364 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.364 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:12.364 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.364 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.364 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.364 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.365 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 890416, 2024-05-10T11:01:12.365 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 96720 2024-05-10T11:01:12.365 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.365 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T11:01:12.365 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 152, 2024-05-10T11:01:12.365 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 268, 2024-05-10T11:01:12.365 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 16817752, 2024-05-10T11:01:12.365 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 323012, 2024-05-10T11:01:12.365 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 5, 2024-05-10T11:01:12.365 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 4, 2024-05-10T11:01:12.365 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.023104482, 2024-05-10T11:01:12.365 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.007421582, 2024-05-10T11:01:12.365 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.011045043, 2024-05-10T11:01:12.365 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.002911288, 2024-05-10T11:01:12.365 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:12.366 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 266, 2024-05-10T11:01:12.366 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.011883026, 2024-05-10T11:01:12.366 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000044673 2024-05-10T11:01:12.366 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.366 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:12.366 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.366 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.366 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.366 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.366 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-10T11:01:12.366 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 274928 2024-05-10T11:01:12.366 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.366 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T11:01:12.367 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 452, 2024-05-10T11:01:12.367 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 454, 2024-05-10T11:01:12.367 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 12694754, 2024-05-10T11:01:12.367 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 143743, 2024-05-10T11:01:12.367 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 5, 2024-05-10T11:01:12.367 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 4, 2024-05-10T11:01:12.367 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.050840466, 2024-05-10T11:01:12.367 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.016251513, 2024-05-10T11:01:12.367 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.015906561, 2024-05-10T11:01:12.367 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.014475471, 2024-05-10T11:01:12.367 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:12.367 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 452, 2024-05-10T11:01:12.367 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.017876821, 2024-05-10T11:01:12.367 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000039550 2024-05-10T11:01:12.367 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.368 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:12.368 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.368 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.368 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.368 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.368 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-10T11:01:12.368 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 0 2024-05-10T11:01:12.368 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.368 INFO:teuthology.orchestra.run.smithi196.stdout: "cct": { 2024-05-10T11:01:12.368 INFO:teuthology.orchestra.run.smithi196.stdout: "total_workers": 1, 2024-05-10T11:01:12.368 INFO:teuthology.orchestra.run.smithi196.stdout: "unhealthy_workers": 0 2024-05-10T11:01:12.368 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.368 INFO:teuthology.orchestra.run.smithi196.stdout: "finisher-MDSRank": { 2024-05-10T11:01:12.368 INFO:teuthology.orchestra.run.smithi196.stdout: "queue_len": 0, 2024-05-10T11:01:12.369 INFO:teuthology.orchestra.run.smithi196.stdout: "complete_latency": { 2024-05-10T11:01:12.369 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 2766, 2024-05-10T11:01:12.369 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.116924088, 2024-05-10T11:01:12.369 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000042271 2024-05-10T11:01:12.369 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:12.369 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.369 INFO:teuthology.orchestra.run.smithi196.stdout: "finisher-PurgeQueue": { 2024-05-10T11:01:12.369 INFO:teuthology.orchestra.run.smithi196.stdout: "queue_len": 0, 2024-05-10T11:01:12.369 INFO:teuthology.orchestra.run.smithi196.stdout: "complete_latency": { 2024-05-10T11:01:12.369 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.369 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.369 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.369 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:12.369 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.370 INFO:teuthology.orchestra.run.smithi196.stdout: "mds": { 2024-05-10T11:01:12.370 INFO:teuthology.orchestra.run.smithi196.stdout: "request": 0, 2024-05-10T11:01:12.370 INFO:teuthology.orchestra.run.smithi196.stdout: "reply": 0, 2024-05-10T11:01:12.370 INFO:teuthology.orchestra.run.smithi196.stdout: "reply_latency": { 2024-05-10T11:01:12.370 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.370 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.370 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.370 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.370 INFO:teuthology.orchestra.run.smithi196.stdout: "slow_reply": 0, 2024-05-10T11:01:12.370 INFO:teuthology.orchestra.run.smithi196.stdout: "forward": 0, 2024-05-10T11:01:12.370 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_fetch_complete": 0, 2024-05-10T11:01:12.370 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_fetch_keys": 0, 2024-05-10T11:01:12.370 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_commit": 0, 2024-05-10T11:01:12.370 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_split": 0, 2024-05-10T11:01:12.371 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_merge": 0, 2024-05-10T11:01:12.371 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes": 4837, 2024-05-10T11:01:12.371 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_top": 1448, 2024-05-10T11:01:12.371 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_bottom": 3389, 2024-05-10T11:01:12.371 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_pin_tail": 0, 2024-05-10T11:01:12.371 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_pinned": 2768, 2024-05-10T11:01:12.371 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_expired": 0, 2024-05-10T11:01:12.371 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_with_caps": 0, 2024-05-10T11:01:12.371 INFO:teuthology.orchestra.run.smithi196.stdout: "caps": 0, 2024-05-10T11:01:12.371 INFO:teuthology.orchestra.run.smithi196.stdout: "subtrees": 2, 2024-05-10T11:01:12.371 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse": 0, 2024-05-10T11:01:12.371 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_hit": 0, 2024-05-10T11:01:12.371 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_forward": 0, 2024-05-10T11:01:12.371 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_discover": 0, 2024-05-10T11:01:12.371 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_dir_fetch": 0, 2024-05-10T11:01:12.372 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_remote_ino": 0, 2024-05-10T11:01:12.372 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_lock": 0, 2024-05-10T11:01:12.372 INFO:teuthology.orchestra.run.smithi196.stdout: "load_cent": 0, 2024-05-10T11:01:12.372 INFO:teuthology.orchestra.run.smithi196.stdout: "q": 0, 2024-05-10T11:01:12.372 INFO:teuthology.orchestra.run.smithi196.stdout: "exported": 0, 2024-05-10T11:01:12.372 INFO:teuthology.orchestra.run.smithi196.stdout: "exported_inodes": 0, 2024-05-10T11:01:12.372 INFO:teuthology.orchestra.run.smithi196.stdout: "imported": 0, 2024-05-10T11:01:12.372 INFO:teuthology.orchestra.run.smithi196.stdout: "imported_inodes": 0, 2024-05-10T11:01:12.372 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_dir_fetch": 0, 2024-05-10T11:01:12.372 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_backtrace_fetch": 0, 2024-05-10T11:01:12.372 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_peer_discover": 0, 2024-05-10T11:01:12.372 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rfiles": 4, 2024-05-10T11:01:12.372 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rbytes": 234, 2024-05-10T11:01:12.372 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rsnaps": 0, 2024-05-10T11:01:12.372 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_backtrace_fetch": 0, 2024-05-10T11:01:12.372 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_set_tag": 0, 2024-05-10T11:01:12.373 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T11:01:12.373 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_inotable_repaired": 0, 2024-05-10T11:01:12.373 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dir_inodes": 0, 2024-05-10T11:01:12.373 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dir_base_inodes": 0, 2024-05-10T11:01:12.373 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dirfrag_rstats": 0, 2024-05-10T11:01:12.373 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_file_inodes": 0, 2024-05-10T11:01:12.373 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_inode_file_caps": 0, 2024-05-10T11:01:12.373 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_revoke": 0, 2024-05-10T11:01:12.373 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_grant": 0, 2024-05-10T11:01:12.373 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T11:01:12.373 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T11:01:12.373 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T11:01:12.373 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_caps": 0, 2024-05-10T11:01:12.373 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_caps_dirty": 0, 2024-05-10T11:01:12.373 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_cap_release": 0, 2024-05-10T11:01:12.374 INFO:teuthology.orchestra.run.smithi196.stdout: "process_request_cap_release": 0 2024-05-10T11:01:12.374 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.374 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_cache": { 2024-05-10T11:01:12.374 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_update": 0, 2024-05-10T11:01:12.374 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_update_receipt": 0, 2024-05-10T11:01:12.374 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_try_discover": 0, 2024-05-10T11:01:12.374 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_send_discover": 0, 2024-05-10T11:01:12.374 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_handle_discover": 0, 2024-05-10T11:01:12.374 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays": 0, 2024-05-10T11:01:12.374 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays_delayed": 0, 2024-05-10T11:01:12.374 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays_enqueuing": 0, 2024-05-10T11:01:12.374 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_created": 0, 2024-05-10T11:01:12.374 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_enqueued": 0, 2024-05-10T11:01:12.374 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_reintegrated": 0, 2024-05-10T11:01:12.375 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_migrated": 0, 2024-05-10T11:01:12.375 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_processing": 0, 2024-05-10T11:01:12.375 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_enqueued": 0, 2024-05-10T11:01:12.375 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_prioritized": 0, 2024-05-10T11:01:12.375 INFO:teuthology.orchestra.run.smithi196.stdout: "recovery_started": 0, 2024-05-10T11:01:12.375 INFO:teuthology.orchestra.run.smithi196.stdout: "recovery_completed": 0, 2024-05-10T11:01:12.375 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_quiesce_path": 0, 2024-05-10T11:01:12.375 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_quiesce_inode": 0, 2024-05-10T11:01:12.375 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_enqueue_scrub": 0, 2024-05-10T11:01:12.375 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_exportdir": 0, 2024-05-10T11:01:12.375 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_flush": 0, 2024-05-10T11:01:12.375 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_fragmentdir": 0, 2024-05-10T11:01:12.375 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_fragstats": 0, 2024-05-10T11:01:12.375 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_inodestats": 0 2024-05-10T11:01:12.375 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.375 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_log": { 2024-05-10T11:01:12.376 INFO:teuthology.orchestra.run.smithi196.stdout: "evlrg": 0, 2024-05-10T11:01:12.376 INFO:teuthology.orchestra.run.smithi196.stdout: "evadd": 0, 2024-05-10T11:01:12.376 INFO:teuthology.orchestra.run.smithi196.stdout: "evex": 0, 2024-05-10T11:01:12.376 INFO:teuthology.orchestra.run.smithi196.stdout: "evtrm": 0, 2024-05-10T11:01:12.376 INFO:teuthology.orchestra.run.smithi196.stdout: "ev": 22439, 2024-05-10T11:01:12.376 INFO:teuthology.orchestra.run.smithi196.stdout: "evexg": 0, 2024-05-10T11:01:12.376 INFO:teuthology.orchestra.run.smithi196.stdout: "evexd": 0, 2024-05-10T11:01:12.376 INFO:teuthology.orchestra.run.smithi196.stdout: "segadd": 0, 2024-05-10T11:01:12.376 INFO:teuthology.orchestra.run.smithi196.stdout: "segex": 0, 2024-05-10T11:01:12.376 INFO:teuthology.orchestra.run.smithi196.stdout: "segtrm": 0, 2024-05-10T11:01:12.376 INFO:teuthology.orchestra.run.smithi196.stdout: "seg": 7, 2024-05-10T11:01:12.376 INFO:teuthology.orchestra.run.smithi196.stdout: "segmjr": 18, 2024-05-10T11:01:12.376 INFO:teuthology.orchestra.run.smithi196.stdout: "segexg": 0, 2024-05-10T11:01:12.376 INFO:teuthology.orchestra.run.smithi196.stdout: "segexd": 0, 2024-05-10T11:01:12.376 INFO:teuthology.orchestra.run.smithi196.stdout: "expos": 40719719, 2024-05-10T11:01:12.377 INFO:teuthology.orchestra.run.smithi196.stdout: "wrpos": 49638336, 2024-05-10T11:01:12.377 INFO:teuthology.orchestra.run.smithi196.stdout: "rdpos": 49636684, 2024-05-10T11:01:12.377 INFO:teuthology.orchestra.run.smithi196.stdout: "jlat": { 2024-05-10T11:01:12.377 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.377 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.377 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.377 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.377 INFO:teuthology.orchestra.run.smithi196.stdout: "replayed": 22439 2024-05-10T11:01:12.377 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.377 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_mem": { 2024-05-10T11:01:12.377 INFO:teuthology.orchestra.run.smithi196.stdout: "ino": 46, 2024-05-10T11:01:12.377 INFO:teuthology.orchestra.run.smithi196.stdout: "ino+": 6734, 2024-05-10T11:01:12.377 INFO:teuthology.orchestra.run.smithi196.stdout: "ino-": 6688, 2024-05-10T11:01:12.377 INFO:teuthology.orchestra.run.smithi196.stdout: "dir": 59, 2024-05-10T11:01:12.377 INFO:teuthology.orchestra.run.smithi196.stdout: "dir+": 613, 2024-05-10T11:01:12.378 INFO:teuthology.orchestra.run.smithi196.stdout: "dir-": 554, 2024-05-10T11:01:12.378 INFO:teuthology.orchestra.run.smithi196.stdout: "dn": 4837, 2024-05-10T11:01:12.378 INFO:teuthology.orchestra.run.smithi196.stdout: "dn+": 10759, 2024-05-10T11:01:12.378 INFO:teuthology.orchestra.run.smithi196.stdout: "dn-": 5922, 2024-05-10T11:01:12.378 INFO:teuthology.orchestra.run.smithi196.stdout: "cap": 0, 2024-05-10T11:01:12.378 INFO:teuthology.orchestra.run.smithi196.stdout: "cap+": 0, 2024-05-10T11:01:12.378 INFO:teuthology.orchestra.run.smithi196.stdout: "cap-": 0, 2024-05-10T11:01:12.378 INFO:teuthology.orchestra.run.smithi196.stdout: "rss": 59500, 2024-05-10T11:01:12.378 INFO:teuthology.orchestra.run.smithi196.stdout: "heap": 215416 2024-05-10T11:01:12.378 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.378 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_server": { 2024-05-10T11:01:12.378 INFO:teuthology.orchestra.run.smithi196.stdout: "dispatch_client_request": 0, 2024-05-10T11:01:12.378 INFO:teuthology.orchestra.run.smithi196.stdout: "dispatch_server_request": 0, 2024-05-10T11:01:12.378 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_request": 0, 2024-05-10T11:01:12.379 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_session": 0, 2024-05-10T11:01:12.379 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_peer_request": 0, 2024-05-10T11:01:12.379 INFO:teuthology.orchestra.run.smithi196.stdout: "req_create_latency": { 2024-05-10T11:01:12.379 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.379 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.379 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.379 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.379 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getattr_latency": { 2024-05-10T11:01:12.379 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.379 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.379 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.379 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.379 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getfilelock_latency": { 2024-05-10T11:01:12.379 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.379 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.380 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.380 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.380 INFO:teuthology.orchestra.run.smithi196.stdout: "req_link_latency": { 2024-05-10T11:01:12.380 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.380 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.380 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.380 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.380 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookup_latency": { 2024-05-10T11:01:12.380 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.380 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.380 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.380 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.380 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookuphash_latency": { 2024-05-10T11:01:12.380 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.380 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.381 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.381 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.381 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupino_latency": { 2024-05-10T11:01:12.381 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.381 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.381 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.381 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.381 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupname_latency": { 2024-05-10T11:01:12.381 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.381 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.381 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.381 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.381 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupparent_latency": { 2024-05-10T11:01:12.381 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.381 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.382 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.382 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.382 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupsnap_latency": { 2024-05-10T11:01:12.382 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.382 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.382 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.382 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.382 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lssnap_latency": { 2024-05-10T11:01:12.382 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.382 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.382 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.382 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.386 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mkdir_latency": { 2024-05-10T11:01:12.386 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.386 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.386 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.386 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.386 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mknod_latency": { 2024-05-10T11:01:12.386 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.386 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.386 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.386 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.386 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mksnap_latency": { 2024-05-10T11:01:12.386 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.386 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.387 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.387 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.387 INFO:teuthology.orchestra.run.smithi196.stdout: "req_open_latency": { 2024-05-10T11:01:12.387 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.387 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.387 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.387 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.387 INFO:teuthology.orchestra.run.smithi196.stdout: "req_readdir_latency": { 2024-05-10T11:01:12.387 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.387 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.387 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.387 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.387 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rename_latency": { 2024-05-10T11:01:12.387 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.388 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.388 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.388 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.388 INFO:teuthology.orchestra.run.smithi196.stdout: "req_renamesnap_latency": { 2024-05-10T11:01:12.388 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.388 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.388 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.388 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.388 INFO:teuthology.orchestra.run.smithi196.stdout: "req_snapdiff_latency": { 2024-05-10T11:01:12.388 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.388 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.388 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.388 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.388 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmdir_latency": { 2024-05-10T11:01:12.388 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.389 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.389 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.389 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.389 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmsnap_latency": { 2024-05-10T11:01:12.389 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.389 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.389 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.389 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.389 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmxattr_latency": { 2024-05-10T11:01:12.389 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.389 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.389 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.389 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.389 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setattr_latency": { 2024-05-10T11:01:12.390 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.390 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.390 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.390 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.390 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setdirlayout_latency": { 2024-05-10T11:01:12.390 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.390 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.390 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.390 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.390 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setfilelock_latency": { 2024-05-10T11:01:12.390 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.390 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.390 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.390 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.391 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setlayout_latency": { 2024-05-10T11:01:12.391 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.391 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.391 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.391 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.391 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setxattr_latency": { 2024-05-10T11:01:12.391 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.391 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.391 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.391 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.391 INFO:teuthology.orchestra.run.smithi196.stdout: "req_symlink_latency": { 2024-05-10T11:01:12.391 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.391 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.391 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.392 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.392 INFO:teuthology.orchestra.run.smithi196.stdout: "req_unlink_latency": { 2024-05-10T11:01:12.392 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.392 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.392 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.392 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.392 INFO:teuthology.orchestra.run.smithi196.stdout: "cap_revoke_eviction": 0, 2024-05-10T11:01:12.392 INFO:teuthology.orchestra.run.smithi196.stdout: "cap_acquisition_throttle": 0, 2024-05-10T11:01:12.392 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getvxattr_latency": { 2024-05-10T11:01:12.392 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.392 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.392 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.392 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:12.392 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.392 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_sessions": { 2024-05-10T11:01:12.393 INFO:teuthology.orchestra.run.smithi196.stdout: "session_count": 1, 2024-05-10T11:01:12.393 INFO:teuthology.orchestra.run.smithi196.stdout: "session_add": 3, 2024-05-10T11:01:12.393 INFO:teuthology.orchestra.run.smithi196.stdout: "session_remove": 2, 2024-05-10T11:01:12.393 INFO:teuthology.orchestra.run.smithi196.stdout: "sessions_open": 2, 2024-05-10T11:01:12.393 INFO:teuthology.orchestra.run.smithi196.stdout: "sessions_stale": 0, 2024-05-10T11:01:12.393 INFO:teuthology.orchestra.run.smithi196.stdout: "total_load": 0, 2024-05-10T11:01:12.393 INFO:teuthology.orchestra.run.smithi196.stdout: "average_load": 0, 2024-05-10T11:01:12.393 INFO:teuthology.orchestra.run.smithi196.stdout: "avg_session_uptime": 3294, 2024-05-10T11:01:12.393 INFO:teuthology.orchestra.run.smithi196.stdout: "mdthresh_evicted": 0 2024-05-10T11:01:12.393 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.393 INFO:teuthology.orchestra.run.smithi196.stdout: "mempool": { 2024-05-10T11:01:12.393 INFO:teuthology.orchestra.run.smithi196.stdout: "bloom_filter_bytes": 0, 2024-05-10T11:01:12.393 INFO:teuthology.orchestra.run.smithi196.stdout: "bloom_filter_items": 0, 2024-05-10T11:01:12.393 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T11:01:12.394 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_alloc_items": 0, 2024-05-10T11:01:12.394 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T11:01:12.394 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_data_items": 0, 2024-05-10T11:01:12.394 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T11:01:12.394 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T11:01:12.394 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T11:01:12.394 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T11:01:12.394 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T11:01:12.394 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_other_items": 0, 2024-05-10T11:01:12.394 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T11:01:12.394 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T11:01:12.394 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_extent_bytes": 0, 2024-05-10T11:01:12.394 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_extent_items": 0, 2024-05-10T11:01:12.394 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_blob_bytes": 0, 2024-05-10T11:01:12.395 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_blob_items": 0, 2024-05-10T11:01:12.395 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T11:01:12.395 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T11:01:12.395 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T11:01:12.395 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T11:01:12.395 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T11:01:12.395 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_fsck_items": 0, 2024-05-10T11:01:12.395 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_txc_bytes": 0, 2024-05-10T11:01:12.395 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_txc_items": 0, 2024-05-10T11:01:12.395 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T11:01:12.395 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T11:01:12.395 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_bytes": 0, 2024-05-10T11:01:12.395 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_items": 0, 2024-05-10T11:01:12.395 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_bytes": 0, 2024-05-10T11:01:12.396 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_items": 0, 2024-05-10T11:01:12.396 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T11:01:12.396 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_reader_items": 0, 2024-05-10T11:01:12.396 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T11:01:12.396 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_writer_items": 0, 2024-05-10T11:01:12.396 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_anon_bytes": 207156, 2024-05-10T11:01:12.396 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_anon_items": 83, 2024-05-10T11:01:12.396 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_meta_bytes": 0, 2024-05-10T11:01:12.396 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_meta_items": 0, 2024-05-10T11:01:12.396 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_bytes": 0, 2024-05-10T11:01:12.396 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_items": 0, 2024-05-10T11:01:12.396 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_mapbl_bytes": 0, 2024-05-10T11:01:12.396 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_mapbl_items": 0, 2024-05-10T11:01:12.396 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_pglog_bytes": 0, 2024-05-10T11:01:12.396 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_pglog_items": 0, 2024-05-10T11:01:12.397 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_bytes": 7336, 2024-05-10T11:01:12.397 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_items": 154, 2024-05-10T11:01:12.397 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T11:01:12.397 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_mapping_items": 0, 2024-05-10T11:01:12.397 INFO:teuthology.orchestra.run.smithi196.stdout: "pgmap_bytes": 0, 2024-05-10T11:01:12.397 INFO:teuthology.orchestra.run.smithi196.stdout: "pgmap_items": 0, 2024-05-10T11:01:12.397 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_co_bytes": 3595174, 2024-05-10T11:01:12.397 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_co_items": 26707, 2024-05-10T11:01:12.397 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_1_bytes": 0, 2024-05-10T11:01:12.397 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_1_items": 0, 2024-05-10T11:01:12.397 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_2_bytes": 0, 2024-05-10T11:01:12.397 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_2_items": 0 2024-05-10T11:01:12.397 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.397 INFO:teuthology.orchestra.run.smithi196.stdout: "objecter": { 2024-05-10T11:01:12.397 INFO:teuthology.orchestra.run.smithi196.stdout: "op_active": 0, 2024-05-10T11:01:12.398 INFO:teuthology.orchestra.run.smithi196.stdout: "op_laggy": 0, 2024-05-10T11:01:12.398 INFO:teuthology.orchestra.run.smithi196.stdout: "op_send": 1699, 2024-05-10T11:01:12.398 INFO:teuthology.orchestra.run.smithi196.stdout: "op_send_bytes": 26, 2024-05-10T11:01:12.398 INFO:teuthology.orchestra.run.smithi196.stdout: "op_resend": 4, 2024-05-10T11:01:12.398 INFO:teuthology.orchestra.run.smithi196.stdout: "op_reply": 1699, 2024-05-10T11:01:12.398 INFO:teuthology.orchestra.run.smithi196.stdout: "op_latency": { 2024-05-10T11:01:12.398 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 1699, 2024-05-10T11:01:12.398 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.918980548, 2024-05-10T11:01:12.398 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000540894 2024-05-10T11:01:12.398 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.398 INFO:teuthology.orchestra.run.smithi196.stdout: "op_inflight": 0, 2024-05-10T11:01:12.398 INFO:teuthology.orchestra.run.smithi196.stdout: "oplen_avg": { 2024-05-10T11:01:12.398 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 1699, 2024-05-10T11:01:12.398 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 1700 2024-05-10T11:01:12.399 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.399 INFO:teuthology.orchestra.run.smithi196.stdout: "op": 1699, 2024-05-10T11:01:12.399 INFO:teuthology.orchestra.run.smithi196.stdout: "op_r": 1699, 2024-05-10T11:01:12.399 INFO:teuthology.orchestra.run.smithi196.stdout: "op_w": 0, 2024-05-10T11:01:12.399 INFO:teuthology.orchestra.run.smithi196.stdout: "op_rmw": 0, 2024-05-10T11:01:12.399 INFO:teuthology.orchestra.run.smithi196.stdout: "op_pg": 0, 2024-05-10T11:01:12.399 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_stat": 1064, 2024-05-10T11:01:12.399 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_create": 0, 2024-05-10T11:01:12.399 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_read": 632, 2024-05-10T11:01:12.399 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_write": 0, 2024-05-10T11:01:12.399 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_writefull": 0, 2024-05-10T11:01:12.399 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_writesame": 0, 2024-05-10T11:01:12.399 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_append": 0, 2024-05-10T11:01:12.399 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_zero": 0, 2024-05-10T11:01:12.399 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_truncate": 0, 2024-05-10T11:01:12.400 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_delete": 0, 2024-05-10T11:01:12.400 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_mapext": 0, 2024-05-10T11:01:12.400 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_sparse_read": 0, 2024-05-10T11:01:12.400 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_clonerange": 0, 2024-05-10T11:01:12.400 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_getxattr": 2, 2024-05-10T11:01:12.400 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_setxattr": 0, 2024-05-10T11:01:12.400 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_cmpxattr": 0, 2024-05-10T11:01:12.400 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_rmxattr": 0, 2024-05-10T11:01:12.400 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_resetxattrs": 0, 2024-05-10T11:01:12.400 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_call": 0, 2024-05-10T11:01:12.400 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_watch": 0, 2024-05-10T11:01:12.400 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_notify": 0, 2024-05-10T11:01:12.400 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T11:01:12.400 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_pgls": 0, 2024-05-10T11:01:12.401 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_pgls_filter": 0, 2024-05-10T11:01:12.401 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_other": 0, 2024-05-10T11:01:12.401 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_active": 0, 2024-05-10T11:01:12.401 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_send": 0, 2024-05-10T11:01:12.401 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_resend": 0, 2024-05-10T11:01:12.401 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_ping": 0, 2024-05-10T11:01:12.401 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_active": 0, 2024-05-10T11:01:12.401 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_send": 0, 2024-05-10T11:01:12.401 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_resend": 0, 2024-05-10T11:01:12.401 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_active": 0, 2024-05-10T11:01:12.401 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_send": 0, 2024-05-10T11:01:12.401 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_resend": 0, 2024-05-10T11:01:12.401 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_active": 0, 2024-05-10T11:01:12.401 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_send": 0, 2024-05-10T11:01:12.401 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_resend": 0, 2024-05-10T11:01:12.402 INFO:teuthology.orchestra.run.smithi196.stdout: "command_active": 0, 2024-05-10T11:01:12.402 INFO:teuthology.orchestra.run.smithi196.stdout: "command_send": 0, 2024-05-10T11:01:12.402 INFO:teuthology.orchestra.run.smithi196.stdout: "command_resend": 0, 2024-05-10T11:01:12.402 INFO:teuthology.orchestra.run.smithi196.stdout: "map_epoch": 82, 2024-05-10T11:01:12.402 INFO:teuthology.orchestra.run.smithi196.stdout: "map_full": 0, 2024-05-10T11:01:12.402 INFO:teuthology.orchestra.run.smithi196.stdout: "map_inc": 2, 2024-05-10T11:01:12.402 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_sessions": 7, 2024-05-10T11:01:12.402 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_session_open": 7, 2024-05-10T11:01:12.402 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_session_close": 0, 2024-05-10T11:01:12.402 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_laggy": 0, 2024-05-10T11:01:12.402 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_wr": 0, 2024-05-10T11:01:12.402 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_rd": 2, 2024-05-10T11:01:12.402 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_del": 0 2024-05-10T11:01:12.402 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.403 INFO:teuthology.orchestra.run.smithi196.stdout: "oft": { 2024-05-10T11:01:12.403 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_objs": 0, 2024-05-10T11:01:12.403 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_kv_pairs": 0, 2024-05-10T11:01:12.403 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_updates": 0, 2024-05-10T11:01:12.403 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_removes": 0 2024-05-10T11:01:12.403 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.403 INFO:teuthology.orchestra.run.smithi196.stdout: "osd-slow-ops": { 2024-05-10T11:01:12.403 INFO:teuthology.orchestra.run.smithi196.stdout: "slow_ops_count": 0 2024-05-10T11:01:12.403 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.403 INFO:teuthology.orchestra.run.smithi196.stdout: "purge_queue": { 2024-05-10T11:01:12.403 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_ops": 0, 2024-05-10T11:01:12.403 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_ops_high_water": 0, 2024-05-10T11:01:12.403 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing": 0, 2024-05-10T11:01:12.403 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_high_water": 0, 2024-05-10T11:01:12.404 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executed_ops": 0, 2024-05-10T11:01:12.404 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executed": 0, 2024-05-10T11:01:12.404 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_item_in_journal": 0 2024-05-10T11:01:12.404 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.404 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T11:01:12.404 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:12.404 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 104857600, 2024-05-10T11:01:12.404 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:12.404 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 1880, 2024-05-10T11:01:12.404 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 46633378, 2024-05-10T11:01:12.404 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:12.404 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 1880, 2024-05-10T11:01:12.404 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-05-10T11:01:12.404 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-05-10T11:01:12.404 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 1880, 2024-05-10T11:01:12.405 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 46633378, 2024-05-10T11:01:12.405 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:12.405 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.405 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.405 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.405 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:12.405 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.405 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-objecter_bytes": { 2024-05-10T11:01:12.405 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:12.405 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 104857600, 2024-05-10T11:01:12.405 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:12.405 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-05-10T11:01:12.405 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-05-10T11:01:12.405 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:12.406 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:12.406 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 1699, 2024-05-10T11:01:12.406 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 45449056, 2024-05-10T11:01:12.406 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 1699, 2024-05-10T11:01:12.406 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 45449056, 2024-05-10T11:01:12.406 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:12.406 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.406 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.406 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.406 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:12.406 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.406 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-objecter_ops": { 2024-05-10T11:01:12.406 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:12.406 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 1024, 2024-05-10T11:01:12.407 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:12.407 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-05-10T11:01:12.407 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-05-10T11:01:12.407 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:12.407 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:12.407 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 1699, 2024-05-10T11:01:12.407 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 1699, 2024-05-10T11:01:12.407 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 1699, 2024-05-10T11:01:12.407 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 1699, 2024-05-10T11:01:12.407 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:12.407 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.407 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.407 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.407 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:12.407 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.408 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-write_buf_throttle": { 2024-05-10T11:01:12.408 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:12.408 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 3758096384, 2024-05-10T11:01:12.408 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:12.408 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-05-10T11:01:12.408 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-05-10T11:01:12.408 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:12.408 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:12.408 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-05-10T11:01:12.408 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-05-10T11:01:12.408 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 0, 2024-05-10T11:01:12.408 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 0, 2024-05-10T11:01:12.408 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:12.408 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.409 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.409 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.409 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:12.409 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:12.409 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-write_buf_throttle-0x5639d331a6e0": { 2024-05-10T11:01:12.409 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:12.409 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 3758096384, 2024-05-10T11:01:12.409 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:12.409 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-05-10T11:01:12.409 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-05-10T11:01:12.409 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:12.409 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:12.409 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-05-10T11:01:12.409 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-05-10T11:01:12.410 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 0, 2024-05-10T11:01:12.410 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 0, 2024-05-10T11:01:12.410 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:12.410 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:12.410 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:12.410 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:12.410 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:12.410 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:12.410 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-05-10T11:01:13.062 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:12 smithi196 ceph-mon[34872]: pgmap v554: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-10T11:01:13.138 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:12 smithi184 ceph-mon[34585]: pgmap v554: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-10T11:01:13.150 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-05-10T11:01:13.150 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-05-10T11:01:13.150 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-05-10T11:01:13.150 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-05-10T11:01:13.150 DEBUG:tasks.check_counter:Getting stats from i 2024-05-10T11:01:13.151 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph daemon mds.i perf dump 2024-05-10T11:01:13.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:12 smithi107 ceph-mon[30373]: pgmap v554: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-10T11:01:13.386 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T11:01:14.943 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:14 smithi196 ceph-mon[34872]: pgmap v555: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T11:01:14.978 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-05-10T11:01:14.979 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T11:01:14.979 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 27656, 2024-05-10T11:01:14.979 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 57781, 2024-05-10T11:01:14.979 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 8847707, 2024-05-10T11:01:14.979 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 46457528, 2024-05-10T11:01:14.979 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 15, 2024-05-10T11:01:14.979 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 8, 2024-05-10T11:01:14.979 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 1.678336658, 2024-05-10T11:01:14.979 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.795284871, 2024-05-10T11:01:14.979 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 1.654914540, 2024-05-10T11:01:14.979 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.067070605, 2024-05-10T11:01:14.979 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:14.979 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 57775, 2024-05-10T11:01:14.979 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 1.036877413, 2024-05-10T11:01:14.980 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000017946 2024-05-10T11:01:14.980 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.980 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:14.980 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 72248, 2024-05-10T11:01:14.980 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.009779075, 2024-05-10T11:01:14.980 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000135 2024-05-10T11:01:14.980 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.980 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-10T11:01:14.980 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 0 2024-05-10T11:01:14.980 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.980 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T11:01:14.980 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 7624, 2024-05-10T11:01:14.980 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 10920, 2024-05-10T11:01:14.980 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 2588884, 2024-05-10T11:01:14.981 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 32466270, 2024-05-10T11:01:14.981 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 10, 2024-05-10T11:01:14.981 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 9, 2024-05-10T11:01:14.981 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.643671154, 2024-05-10T11:01:14.981 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.306175396, 2024-05-10T11:01:14.981 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.234850838, 2024-05-10T11:01:14.981 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.100031318, 2024-05-10T11:01:14.981 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:14.981 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 10920, 2024-05-10T11:01:14.981 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.259614847, 2024-05-10T11:01:14.981 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000023774 2024-05-10T11:01:14.981 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.981 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:14.981 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 10831, 2024-05-10T11:01:14.981 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.001783982, 2024-05-10T11:01:14.982 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000164 2024-05-10T11:01:14.982 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.982 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 910336, 2024-05-10T11:01:14.982 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 101376 2024-05-10T11:01:14.982 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.982 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T11:01:14.982 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 18155, 2024-05-10T11:01:14.982 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 22451, 2024-05-10T11:01:14.982 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 8629111, 2024-05-10T11:01:14.982 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 11912146, 2024-05-10T11:01:14.982 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 8, 2024-05-10T11:01:14.982 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 5, 2024-05-10T11:01:14.982 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 1.007908753, 2024-05-10T11:01:14.982 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.433693240, 2024-05-10T11:01:14.983 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.593472295, 2024-05-10T11:01:14.983 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.063924790, 2024-05-10T11:01:14.983 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:14.983 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 22453, 2024-05-10T11:01:14.983 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.391847584, 2024-05-10T11:01:14.983 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000017451 2024-05-10T11:01:14.983 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.983 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:14.983 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 34627, 2024-05-10T11:01:14.983 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.005081259, 2024-05-10T11:01:14.983 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000146 2024-05-10T11:01:14.983 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.983 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-10T11:01:14.983 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 276368 2024-05-10T11:01:14.983 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.984 INFO:teuthology.orchestra.run.smithi196.stdout: "cct": { 2024-05-10T11:01:14.984 INFO:teuthology.orchestra.run.smithi196.stdout: "total_workers": 1, 2024-05-10T11:01:14.984 INFO:teuthology.orchestra.run.smithi196.stdout: "unhealthy_workers": 0 2024-05-10T11:01:14.984 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.984 INFO:teuthology.orchestra.run.smithi196.stdout: "finisher-MDSRank": { 2024-05-10T11:01:14.984 INFO:teuthology.orchestra.run.smithi196.stdout: "queue_len": 0, 2024-05-10T11:01:14.984 INFO:teuthology.orchestra.run.smithi196.stdout: "complete_latency": { 2024-05-10T11:01:14.984 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 1981, 2024-05-10T11:01:14.984 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 12.718321342, 2024-05-10T11:01:14.984 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.006420152 2024-05-10T11:01:14.984 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:14.984 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.984 INFO:teuthology.orchestra.run.smithi196.stdout: "finisher-PurgeQueue": { 2024-05-10T11:01:14.984 INFO:teuthology.orchestra.run.smithi196.stdout: "queue_len": 0, 2024-05-10T11:01:14.985 INFO:teuthology.orchestra.run.smithi196.stdout: "complete_latency": { 2024-05-10T11:01:14.985 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 12708, 2024-05-10T11:01:14.985 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 3.031790107, 2024-05-10T11:01:14.985 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000238573 2024-05-10T11:01:14.985 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:14.985 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.985 INFO:teuthology.orchestra.run.smithi196.stdout: "mds": { 2024-05-10T11:01:14.985 INFO:teuthology.orchestra.run.smithi196.stdout: "request": 12953, 2024-05-10T11:01:14.985 INFO:teuthology.orchestra.run.smithi196.stdout: "reply": 12922, 2024-05-10T11:01:14.985 INFO:teuthology.orchestra.run.smithi196.stdout: "reply_latency": { 2024-05-10T11:01:14.985 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 12922, 2024-05-10T11:01:14.985 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 27.672726059, 2024-05-10T11:01:14.985 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.002141520 2024-05-10T11:01:14.985 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.985 INFO:teuthology.orchestra.run.smithi196.stdout: "slow_reply": 0, 2024-05-10T11:01:14.986 INFO:teuthology.orchestra.run.smithi196.stdout: "forward": 31, 2024-05-10T11:01:14.986 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_fetch_complete": 0, 2024-05-10T11:01:14.986 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_fetch_keys": 0, 2024-05-10T11:01:14.986 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_commit": 46, 2024-05-10T11:01:14.986 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_split": 4, 2024-05-10T11:01:14.986 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_merge": 0, 2024-05-10T11:01:14.986 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes": 25, 2024-05-10T11:01:14.986 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_top": 8, 2024-05-10T11:01:14.986 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_bottom": 7, 2024-05-10T11:01:14.986 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_pin_tail": 10, 2024-05-10T11:01:14.986 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_pinned": 13, 2024-05-10T11:01:14.986 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_expired": 1144, 2024-05-10T11:01:14.986 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_with_caps": 1, 2024-05-10T11:01:14.986 INFO:teuthology.orchestra.run.smithi196.stdout: "caps": 1, 2024-05-10T11:01:14.987 INFO:teuthology.orchestra.run.smithi196.stdout: "subtrees": 4, 2024-05-10T11:01:14.987 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse": 15466, 2024-05-10T11:01:14.987 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_hit": 13660, 2024-05-10T11:01:14.987 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_forward": 6, 2024-05-10T11:01:14.987 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_discover": 607, 2024-05-10T11:01:14.987 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_dir_fetch": 0, 2024-05-10T11:01:14.987 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_remote_ino": 0, 2024-05-10T11:01:14.987 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_lock": 1, 2024-05-10T11:01:14.987 INFO:teuthology.orchestra.run.smithi196.stdout: "load_cent": 0, 2024-05-10T11:01:14.987 INFO:teuthology.orchestra.run.smithi196.stdout: "q": 0, 2024-05-10T11:01:14.987 INFO:teuthology.orchestra.run.smithi196.stdout: "exported": 25, 2024-05-10T11:01:14.987 INFO:teuthology.orchestra.run.smithi196.stdout: "exported_inodes": 409, 2024-05-10T11:01:14.987 INFO:teuthology.orchestra.run.smithi196.stdout: "imported": 141, 2024-05-10T11:01:14.987 INFO:teuthology.orchestra.run.smithi196.stdout: "imported_inodes": 2468, 2024-05-10T11:01:14.988 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_dir_fetch": 0, 2024-05-10T11:01:14.988 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_backtrace_fetch": 0, 2024-05-10T11:01:14.988 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_peer_discover": 0, 2024-05-10T11:01:14.988 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rfiles": 4, 2024-05-10T11:01:14.988 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rbytes": 234, 2024-05-10T11:01:14.988 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rsnaps": 0, 2024-05-10T11:01:14.988 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_backtrace_fetch": 0, 2024-05-10T11:01:14.988 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_set_tag": 0, 2024-05-10T11:01:14.988 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T11:01:14.988 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_inotable_repaired": 0, 2024-05-10T11:01:14.988 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dir_inodes": 0, 2024-05-10T11:01:14.988 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dir_base_inodes": 0, 2024-05-10T11:01:14.988 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dirfrag_rstats": 0, 2024-05-10T11:01:14.988 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_file_inodes": 0, 2024-05-10T11:01:14.988 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_inode_file_caps": 52, 2024-05-10T11:01:14.988 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_revoke": 1393, 2024-05-10T11:01:14.989 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_grant": 12733, 2024-05-10T11:01:14.989 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T11:01:14.989 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T11:01:14.989 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T11:01:14.989 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_caps": 7972, 2024-05-10T11:01:14.989 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_caps_dirty": 6727, 2024-05-10T11:01:14.989 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_cap_release": 83, 2024-05-10T11:01:14.989 INFO:teuthology.orchestra.run.smithi196.stdout: "process_request_cap_release": 8376 2024-05-10T11:01:14.989 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.989 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_cache": { 2024-05-10T11:01:14.989 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_update": 1112, 2024-05-10T11:01:14.989 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_update_receipt": 1213, 2024-05-10T11:01:14.989 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_try_discover": 844, 2024-05-10T11:01:14.989 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_send_discover": 844, 2024-05-10T11:01:14.989 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_handle_discover": 2324, 2024-05-10T11:01:14.990 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays": 0, 2024-05-10T11:01:14.990 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays_delayed": 0, 2024-05-10T11:01:14.990 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays_enqueuing": 0, 2024-05-10T11:01:14.990 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_created": 7040, 2024-05-10T11:01:14.990 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_enqueued": 7040, 2024-05-10T11:01:14.990 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_reintegrated": 0, 2024-05-10T11:01:14.990 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_migrated": 0, 2024-05-10T11:01:14.990 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_processing": 0, 2024-05-10T11:01:14.990 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_enqueued": 0, 2024-05-10T11:01:14.990 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_prioritized": 0, 2024-05-10T11:01:14.990 INFO:teuthology.orchestra.run.smithi196.stdout: "recovery_started": 0, 2024-05-10T11:01:14.990 INFO:teuthology.orchestra.run.smithi196.stdout: "recovery_completed": 0, 2024-05-10T11:01:14.990 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_quiesce_path": 3, 2024-05-10T11:01:14.990 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_quiesce_inode": 17, 2024-05-10T11:01:14.990 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_enqueue_scrub": 0, 2024-05-10T11:01:14.991 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_exportdir": 25, 2024-05-10T11:01:14.991 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_flush": 0, 2024-05-10T11:01:14.991 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_fragmentdir": 4, 2024-05-10T11:01:14.991 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_fragstats": 0, 2024-05-10T11:01:14.991 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_inodestats": 0 2024-05-10T11:01:14.991 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.991 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_log": { 2024-05-10T11:01:14.991 INFO:teuthology.orchestra.run.smithi196.stdout: "evlrg": 1, 2024-05-10T11:01:14.991 INFO:teuthology.orchestra.run.smithi196.stdout: "evadd": 30480, 2024-05-10T11:01:14.991 INFO:teuthology.orchestra.run.smithi196.stdout: "evex": 0, 2024-05-10T11:01:14.991 INFO:teuthology.orchestra.run.smithi196.stdout: "evtrm": 0, 2024-05-10T11:01:14.991 INFO:teuthology.orchestra.run.smithi196.stdout: "ev": 30480, 2024-05-10T11:01:14.991 INFO:teuthology.orchestra.run.smithi196.stdout: "evexg": 0, 2024-05-10T11:01:14.991 INFO:teuthology.orchestra.run.smithi196.stdout: "evexd": 0, 2024-05-10T11:01:14.991 INFO:teuthology.orchestra.run.smithi196.stdout: "segadd": 39, 2024-05-10T11:01:14.992 INFO:teuthology.orchestra.run.smithi196.stdout: "segex": 0, 2024-05-10T11:01:14.992 INFO:teuthology.orchestra.run.smithi196.stdout: "segtrm": 0, 2024-05-10T11:01:14.992 INFO:teuthology.orchestra.run.smithi196.stdout: "seg": 39, 2024-05-10T11:01:14.992 INFO:teuthology.orchestra.run.smithi196.stdout: "segmjr": 4, 2024-05-10T11:01:14.992 INFO:teuthology.orchestra.run.smithi196.stdout: "segexg": 0, 2024-05-10T11:01:14.992 INFO:teuthology.orchestra.run.smithi196.stdout: "segexd": 0, 2024-05-10T11:01:14.992 INFO:teuthology.orchestra.run.smithi196.stdout: "expos": 4194304, 2024-05-10T11:01:14.992 INFO:teuthology.orchestra.run.smithi196.stdout: "wrpos": 63773912, 2024-05-10T11:01:14.992 INFO:teuthology.orchestra.run.smithi196.stdout: "rdpos": 0, 2024-05-10T11:01:14.992 INFO:teuthology.orchestra.run.smithi196.stdout: "jlat": { 2024-05-10T11:01:14.992 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 1032, 2024-05-10T11:01:14.992 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 11.644885707, 2024-05-10T11:01:14.992 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.011283803 2024-05-10T11:01:14.992 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.992 INFO:teuthology.orchestra.run.smithi196.stdout: "replayed": 0 2024-05-10T11:01:14.993 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.993 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_mem": { 2024-05-10T11:01:14.993 INFO:teuthology.orchestra.run.smithi196.stdout: "ino": 31, 2024-05-10T11:01:14.993 INFO:teuthology.orchestra.run.smithi196.stdout: "ino+": 7577, 2024-05-10T11:01:14.993 INFO:teuthology.orchestra.run.smithi196.stdout: "ino-": 7546, 2024-05-10T11:01:14.993 INFO:teuthology.orchestra.run.smithi196.stdout: "dir": 29, 2024-05-10T11:01:14.993 INFO:teuthology.orchestra.run.smithi196.stdout: "dir+": 755, 2024-05-10T11:01:14.993 INFO:teuthology.orchestra.run.smithi196.stdout: "dir-": 726, 2024-05-10T11:01:14.993 INFO:teuthology.orchestra.run.smithi196.stdout: "dn": 25, 2024-05-10T11:01:14.993 INFO:teuthology.orchestra.run.smithi196.stdout: "dn+": 11567, 2024-05-10T11:01:14.993 INFO:teuthology.orchestra.run.smithi196.stdout: "dn-": 11542, 2024-05-10T11:01:14.993 INFO:teuthology.orchestra.run.smithi196.stdout: "cap": 1, 2024-05-10T11:01:14.993 INFO:teuthology.orchestra.run.smithi196.stdout: "cap+": 7239, 2024-05-10T11:01:14.993 INFO:teuthology.orchestra.run.smithi196.stdout: "cap-": 7238, 2024-05-10T11:01:14.993 INFO:teuthology.orchestra.run.smithi196.stdout: "rss": 87788, 2024-05-10T11:01:14.994 INFO:teuthology.orchestra.run.smithi196.stdout: "heap": 223608 2024-05-10T11:01:14.994 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.994 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_server": { 2024-05-10T11:01:14.994 INFO:teuthology.orchestra.run.smithi196.stdout: "dispatch_client_request": 15833, 2024-05-10T11:01:14.994 INFO:teuthology.orchestra.run.smithi196.stdout: "dispatch_server_request": 852, 2024-05-10T11:01:14.994 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_request": 12953, 2024-05-10T11:01:14.994 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_session": 17, 2024-05-10T11:01:14.994 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_peer_request": 2716, 2024-05-10T11:01:14.994 INFO:teuthology.orchestra.run.smithi196.stdout: "req_create_latency": { 2024-05-10T11:01:14.994 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 4655, 2024-05-10T11:01:14.994 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 4.501693731, 2024-05-10T11:01:14.994 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000967066 2024-05-10T11:01:14.994 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.994 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getattr_latency": { 2024-05-10T11:01:14.994 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 25, 2024-05-10T11:01:14.995 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.024535828, 2024-05-10T11:01:14.995 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000981433 2024-05-10T11:01:14.995 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.995 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getfilelock_latency": { 2024-05-10T11:01:14.995 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:14.995 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:14.995 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:14.995 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.995 INFO:teuthology.orchestra.run.smithi196.stdout: "req_link_latency": { 2024-05-10T11:01:14.995 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:14.995 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:14.995 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:14.995 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.995 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookup_latency": { 2024-05-10T11:01:14.995 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 438, 2024-05-10T11:01:14.996 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.642213262, 2024-05-10T11:01:14.996 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.001466240 2024-05-10T11:01:14.996 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.996 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookuphash_latency": { 2024-05-10T11:01:14.996 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:14.996 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:14.996 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:14.996 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.996 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupino_latency": { 2024-05-10T11:01:14.996 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 1, 2024-05-10T11:01:14.996 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000123119, 2024-05-10T11:01:14.996 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000123119 2024-05-10T11:01:14.996 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.996 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupname_latency": { 2024-05-10T11:01:14.996 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:14.996 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:14.997 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:14.997 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.997 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupparent_latency": { 2024-05-10T11:01:14.997 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:14.997 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:14.997 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:14.997 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.997 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupsnap_latency": { 2024-05-10T11:01:14.997 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:14.997 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:14.997 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:14.997 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.997 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lssnap_latency": { 2024-05-10T11:01:14.998 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:14.998 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:14.998 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:14.998 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.998 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mkdir_latency": { 2024-05-10T11:01:14.999 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 108, 2024-05-10T11:01:14.999 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.544984813, 2024-05-10T11:01:14.999 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.005046155 2024-05-10T11:01:14.999 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.999 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mknod_latency": { 2024-05-10T11:01:14.999 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:14.999 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:14.999 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:14.999 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.999 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mksnap_latency": { 2024-05-10T11:01:14.999 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:14.999 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:14.999 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:14.999 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:14.999 INFO:teuthology.orchestra.run.smithi196.stdout: "req_open_latency": { 2024-05-10T11:01:15.000 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:15.000 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:15.000 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:15.000 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.000 INFO:teuthology.orchestra.run.smithi196.stdout: "req_readdir_latency": { 2024-05-10T11:01:15.000 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 622, 2024-05-10T11:01:15.000 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 1.555014322, 2024-05-10T11:01:15.000 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.002500023 2024-05-10T11:01:15.000 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.000 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rename_latency": { 2024-05-10T11:01:15.000 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:15.000 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:15.000 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:15.000 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.000 INFO:teuthology.orchestra.run.smithi196.stdout: "req_renamesnap_latency": { 2024-05-10T11:01:15.001 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:15.001 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:15.001 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:15.001 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.001 INFO:teuthology.orchestra.run.smithi196.stdout: "req_snapdiff_latency": { 2024-05-10T11:01:15.001 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:15.001 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:15.001 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:15.001 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.001 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmdir_latency": { 2024-05-10T11:01:15.001 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 294, 2024-05-10T11:01:15.001 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 5.300184542, 2024-05-10T11:01:15.001 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.018027838 2024-05-10T11:01:15.001 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.001 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmsnap_latency": { 2024-05-10T11:01:15.002 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:15.002 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:15.002 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:15.002 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.002 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmxattr_latency": { 2024-05-10T11:01:15.002 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:15.002 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:15.002 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:15.002 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.002 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setattr_latency": { 2024-05-10T11:01:15.002 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 33, 2024-05-10T11:01:15.002 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 4.118999936, 2024-05-10T11:01:15.002 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.124818179 2024-05-10T11:01:15.002 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.003 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setdirlayout_latency": { 2024-05-10T11:01:15.003 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:15.003 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:15.003 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:15.003 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.003 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setfilelock_latency": { 2024-05-10T11:01:15.003 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:15.003 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:15.003 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:15.003 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.003 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setlayout_latency": { 2024-05-10T11:01:15.003 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:15.003 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:15.003 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:15.003 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.004 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setxattr_latency": { 2024-05-10T11:01:15.004 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:15.004 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:15.004 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:15.004 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.004 INFO:teuthology.orchestra.run.smithi196.stdout: "req_symlink_latency": { 2024-05-10T11:01:15.004 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:15.004 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:15.004 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:15.004 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.004 INFO:teuthology.orchestra.run.smithi196.stdout: "req_unlink_latency": { 2024-05-10T11:01:15.004 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 6746, 2024-05-10T11:01:15.004 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 10.984976506, 2024-05-10T11:01:15.004 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.001628368 2024-05-10T11:01:15.005 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.005 INFO:teuthology.orchestra.run.smithi196.stdout: "cap_revoke_eviction": 0, 2024-05-10T11:01:15.005 INFO:teuthology.orchestra.run.smithi196.stdout: "cap_acquisition_throttle": 0, 2024-05-10T11:01:15.005 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getvxattr_latency": { 2024-05-10T11:01:15.005 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:15.005 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:15.005 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:15.005 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:15.005 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.005 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_sessions": { 2024-05-10T11:01:15.005 INFO:teuthology.orchestra.run.smithi196.stdout: "session_count": 1, 2024-05-10T11:01:15.005 INFO:teuthology.orchestra.run.smithi196.stdout: "session_add": 1, 2024-05-10T11:01:15.006 INFO:teuthology.orchestra.run.smithi196.stdout: "session_remove": 0, 2024-05-10T11:01:15.006 INFO:teuthology.orchestra.run.smithi196.stdout: "sessions_open": 1, 2024-05-10T11:01:15.006 INFO:teuthology.orchestra.run.smithi196.stdout: "sessions_stale": 0, 2024-05-10T11:01:15.006 INFO:teuthology.orchestra.run.smithi196.stdout: "total_load": 7833, 2024-05-10T11:01:15.006 INFO:teuthology.orchestra.run.smithi196.stdout: "average_load": 7833, 2024-05-10T11:01:15.006 INFO:teuthology.orchestra.run.smithi196.stdout: "avg_session_uptime": 319, 2024-05-10T11:01:15.006 INFO:teuthology.orchestra.run.smithi196.stdout: "mdthresh_evicted": 0 2024-05-10T11:01:15.006 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.006 INFO:teuthology.orchestra.run.smithi196.stdout: "mempool": { 2024-05-10T11:01:15.006 INFO:teuthology.orchestra.run.smithi196.stdout: "bloom_filter_bytes": 0, 2024-05-10T11:01:15.006 INFO:teuthology.orchestra.run.smithi196.stdout: "bloom_filter_items": 0, 2024-05-10T11:01:15.006 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T11:01:15.006 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_alloc_items": 0, 2024-05-10T11:01:15.006 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T11:01:15.007 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_data_items": 0, 2024-05-10T11:01:15.007 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T11:01:15.007 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T11:01:15.007 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T11:01:15.007 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T11:01:15.007 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T11:01:15.007 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_other_items": 0, 2024-05-10T11:01:15.007 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T11:01:15.007 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T11:01:15.007 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_extent_bytes": 0, 2024-05-10T11:01:15.007 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_extent_items": 0, 2024-05-10T11:01:15.007 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_blob_bytes": 0, 2024-05-10T11:01:15.007 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_blob_items": 0, 2024-05-10T11:01:15.007 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T11:01:15.007 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T11:01:15.008 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T11:01:15.008 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T11:01:15.008 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T11:01:15.008 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_fsck_items": 0, 2024-05-10T11:01:15.008 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_txc_bytes": 0, 2024-05-10T11:01:15.008 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_txc_items": 0, 2024-05-10T11:01:15.008 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T11:01:15.008 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T11:01:15.008 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_bytes": 0, 2024-05-10T11:01:15.008 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_items": 0, 2024-05-10T11:01:15.008 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_bytes": 0, 2024-05-10T11:01:15.008 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_items": 0, 2024-05-10T11:01:15.008 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T11:01:15.008 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_reader_items": 0, 2024-05-10T11:01:15.009 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T11:01:15.009 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_writer_items": 0, 2024-05-10T11:01:15.009 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_anon_bytes": 295831, 2024-05-10T11:01:15.009 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_anon_items": 110, 2024-05-10T11:01:15.009 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_meta_bytes": 0, 2024-05-10T11:01:15.009 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_meta_items": 0, 2024-05-10T11:01:15.009 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_bytes": 0, 2024-05-10T11:01:15.009 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_items": 0, 2024-05-10T11:01:15.009 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_mapbl_bytes": 0, 2024-05-10T11:01:15.009 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_mapbl_items": 0, 2024-05-10T11:01:15.009 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_pglog_bytes": 0, 2024-05-10T11:01:15.009 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_pglog_items": 0, 2024-05-10T11:01:15.009 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_bytes": 7336, 2024-05-10T11:01:15.009 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_items": 154, 2024-05-10T11:01:15.009 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T11:01:15.009 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_mapping_items": 0, 2024-05-10T11:01:15.010 INFO:teuthology.orchestra.run.smithi196.stdout: "pgmap_bytes": 0, 2024-05-10T11:01:15.010 INFO:teuthology.orchestra.run.smithi196.stdout: "pgmap_items": 0, 2024-05-10T11:01:15.010 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_co_bytes": 129501, 2024-05-10T11:01:15.010 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_co_items": 665, 2024-05-10T11:01:15.010 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_1_bytes": 0, 2024-05-10T11:01:15.010 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_1_items": 0, 2024-05-10T11:01:15.010 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_2_bytes": 0, 2024-05-10T11:01:15.010 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_2_items": 0 2024-05-10T11:01:15.010 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.010 INFO:teuthology.orchestra.run.smithi196.stdout: "objecter": { 2024-05-10T11:01:15.010 INFO:teuthology.orchestra.run.smithi196.stdout: "op_active": 0, 2024-05-10T11:01:15.010 INFO:teuthology.orchestra.run.smithi196.stdout: "op_laggy": 0, 2024-05-10T11:01:15.010 INFO:teuthology.orchestra.run.smithi196.stdout: "op_send": 8697, 2024-05-10T11:01:15.010 INFO:teuthology.orchestra.run.smithi196.stdout: "op_send_bytes": 61752753, 2024-05-10T11:01:15.010 INFO:teuthology.orchestra.run.smithi196.stdout: "op_resend": 32, 2024-05-10T11:01:15.011 INFO:teuthology.orchestra.run.smithi196.stdout: "op_reply": 8697, 2024-05-10T11:01:15.011 INFO:teuthology.orchestra.run.smithi196.stdout: "op_latency": { 2024-05-10T11:01:15.011 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 8697, 2024-05-10T11:01:15.011 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 18.370609725, 2024-05-10T11:01:15.011 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.002112292 2024-05-10T11:01:15.011 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.011 INFO:teuthology.orchestra.run.smithi196.stdout: "op_inflight": 0, 2024-05-10T11:01:15.011 INFO:teuthology.orchestra.run.smithi196.stdout: "oplen_avg": { 2024-05-10T11:01:15.011 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 8697, 2024-05-10T11:01:15.011 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 8848 2024-05-10T11:01:15.011 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.011 INFO:teuthology.orchestra.run.smithi196.stdout: "op": 8697, 2024-05-10T11:01:15.011 INFO:teuthology.orchestra.run.smithi196.stdout: "op_r": 174, 2024-05-10T11:01:15.011 INFO:teuthology.orchestra.run.smithi196.stdout: "op_w": 8523, 2024-05-10T11:01:15.011 INFO:teuthology.orchestra.run.smithi196.stdout: "op_rmw": 0, 2024-05-10T11:01:15.012 INFO:teuthology.orchestra.run.smithi196.stdout: "op_pg": 0, 2024-05-10T11:01:15.012 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_stat": 0, 2024-05-10T11:01:15.012 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_create": 10, 2024-05-10T11:01:15.012 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_read": 174, 2024-05-10T11:01:15.012 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_write": 1206, 2024-05-10T11:01:15.012 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_writefull": 94, 2024-05-10T11:01:15.012 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_writesame": 0, 2024-05-10T11:01:15.012 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_append": 0, 2024-05-10T11:01:15.012 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_zero": 0, 2024-05-10T11:01:15.012 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_truncate": 4, 2024-05-10T11:01:15.012 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_delete": 7106, 2024-05-10T11:01:15.012 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_mapext": 0, 2024-05-10T11:01:15.012 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_sparse_read": 0, 2024-05-10T11:01:15.012 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_clonerange": 0, 2024-05-10T11:01:15.012 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_getxattr": 0, 2024-05-10T11:01:15.013 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_setxattr": 20, 2024-05-10T11:01:15.013 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_cmpxattr": 0, 2024-05-10T11:01:15.013 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_rmxattr": 0, 2024-05-10T11:01:15.013 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_resetxattrs": 0, 2024-05-10T11:01:15.013 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_call": 0, 2024-05-10T11:01:15.013 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_watch": 0, 2024-05-10T11:01:15.013 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_notify": 0, 2024-05-10T11:01:15.013 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T11:01:15.013 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_pgls": 0, 2024-05-10T11:01:15.013 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_pgls_filter": 0, 2024-05-10T11:01:15.013 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_other": 0, 2024-05-10T11:01:15.013 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_active": 0, 2024-05-10T11:01:15.013 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_send": 0, 2024-05-10T11:01:15.013 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_resend": 0, 2024-05-10T11:01:15.013 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_ping": 0, 2024-05-10T11:01:15.014 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_active": 0, 2024-05-10T11:01:15.014 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_send": 0, 2024-05-10T11:01:15.014 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_resend": 0, 2024-05-10T11:01:15.014 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_active": 0, 2024-05-10T11:01:15.014 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_send": 0, 2024-05-10T11:01:15.014 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_resend": 0, 2024-05-10T11:01:15.014 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_active": 0, 2024-05-10T11:01:15.014 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_send": 0, 2024-05-10T11:01:15.014 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_resend": 0, 2024-05-10T11:01:15.014 INFO:teuthology.orchestra.run.smithi196.stdout: "command_active": 0, 2024-05-10T11:01:15.014 INFO:teuthology.orchestra.run.smithi196.stdout: "command_send": 0, 2024-05-10T11:01:15.014 INFO:teuthology.orchestra.run.smithi196.stdout: "command_resend": 0, 2024-05-10T11:01:15.014 INFO:teuthology.orchestra.run.smithi196.stdout: "map_epoch": 82, 2024-05-10T11:01:15.014 INFO:teuthology.orchestra.run.smithi196.stdout: "map_full": 0, 2024-05-10T11:01:15.014 INFO:teuthology.orchestra.run.smithi196.stdout: "map_inc": 2, 2024-05-10T11:01:15.015 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_sessions": 12, 2024-05-10T11:01:15.015 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_session_open": 12, 2024-05-10T11:01:15.015 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_session_close": 0, 2024-05-10T11:01:15.015 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_laggy": 0, 2024-05-10T11:01:15.015 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_wr": 187, 2024-05-10T11:01:15.015 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_rd": 0, 2024-05-10T11:01:15.015 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_del": 47 2024-05-10T11:01:15.015 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.015 INFO:teuthology.orchestra.run.smithi196.stdout: "oft": { 2024-05-10T11:01:15.015 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_objs": 1, 2024-05-10T11:01:15.015 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_kv_pairs": 0, 2024-05-10T11:01:15.015 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_updates": 0, 2024-05-10T11:01:15.015 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_removes": 0 2024-05-10T11:01:15.015 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.015 INFO:teuthology.orchestra.run.smithi196.stdout: "osd-slow-ops": { 2024-05-10T11:01:15.016 INFO:teuthology.orchestra.run.smithi196.stdout: "slow_ops_count": 20 2024-05-10T11:01:15.016 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.016 INFO:teuthology.orchestra.run.smithi196.stdout: "purge_queue": { 2024-05-10T11:01:15.016 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_ops": 0, 2024-05-10T11:01:15.016 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_ops_high_water": 14, 2024-05-10T11:01:15.016 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing": 0, 2024-05-10T11:01:15.016 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_high_water": 6, 2024-05-10T11:01:15.016 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executed_ops": 7080, 2024-05-10T11:01:15.016 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executed": 7040, 2024-05-10T11:01:15.016 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_item_in_journal": 0 2024-05-10T11:01:15.016 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.016 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T11:01:15.016 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:15.016 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 104857600, 2024-05-10T11:01:15.016 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:15.017 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 53431, 2024-05-10T11:01:15.017 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 15243150, 2024-05-10T11:01:15.017 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:15.017 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 53431, 2024-05-10T11:01:15.017 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-05-10T11:01:15.017 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-05-10T11:01:15.017 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 53431, 2024-05-10T11:01:15.017 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 15243150, 2024-05-10T11:01:15.017 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:15.017 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:15.017 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:15.017 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:15.017 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:15.017 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.017 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-objecter_bytes": { 2024-05-10T11:01:15.018 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:15.018 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 104857600, 2024-05-10T11:01:15.018 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:15.018 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-05-10T11:01:15.018 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-05-10T11:01:15.018 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:15.018 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:15.018 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 8697, 2024-05-10T11:01:15.018 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 62463833, 2024-05-10T11:01:15.018 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 8697, 2024-05-10T11:01:15.018 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 62463833, 2024-05-10T11:01:15.018 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:15.018 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:15.018 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:15.018 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:15.019 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:15.019 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.019 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-objecter_ops": { 2024-05-10T11:01:15.019 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:15.019 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 1024, 2024-05-10T11:01:15.019 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:15.019 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-05-10T11:01:15.019 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-05-10T11:01:15.019 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:15.019 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:15.019 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 8697, 2024-05-10T11:01:15.019 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 8697, 2024-05-10T11:01:15.019 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 8697, 2024-05-10T11:01:15.019 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 8697, 2024-05-10T11:01:15.019 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:15.020 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:15.020 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:15.020 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:15.020 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:15.020 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.020 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-write_buf_throttle": { 2024-05-10T11:01:15.020 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:15.020 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 3758096384, 2024-05-10T11:01:15.020 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:15.020 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 7040, 2024-05-10T11:01:15.020 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 711080, 2024-05-10T11:01:15.020 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:15.020 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 7040, 2024-05-10T11:01:15.020 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-05-10T11:01:15.020 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-05-10T11:01:15.021 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 174, 2024-05-10T11:01:15.021 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 711080, 2024-05-10T11:01:15.021 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:15.021 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:15.021 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:15.021 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:15.021 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:15.021 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:15.021 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-write_buf_throttle-0x5638c65d2500": { 2024-05-10T11:01:15.021 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:15.021 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 3758096384, 2024-05-10T11:01:15.021 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:15.021 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 30480, 2024-05-10T11:01:15.021 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 59579608, 2024-05-10T11:01:15.021 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:15.022 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 30480, 2024-05-10T11:01:15.022 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-05-10T11:01:15.022 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-05-10T11:01:15.022 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 1032, 2024-05-10T11:01:15.022 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 59579608, 2024-05-10T11:01:15.022 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:15.022 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:15.022 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:15.022 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:15.022 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:15.022 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:15.022 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-05-10T11:01:15.138 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:14 smithi184 ceph-mon[34585]: pgmap v555: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T11:01:15.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:14 smithi107 ceph-mon[30373]: pgmap v555: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T11:01:15.702 INFO:tasks.check_counter:Daemon mds.i mds.exported=25 2024-05-10T11:01:15.702 INFO:tasks.check_counter:Daemon mds.i mds.imported=141 2024-05-10T11:01:15.702 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=1112 2024-05-10T11:01:15.702 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=1213 2024-05-10T11:01:15.702 DEBUG:tasks.check_counter:Getting stats from l 2024-05-10T11:01:15.703 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph daemon mds.l perf dump 2024-05-10T11:01:15.942 INFO:teuthology.orchestra.run.smithi196.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.c/config 2024-05-10T11:01:17.058 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:16 smithi196 ceph-mon[34872]: pgmap v556: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T11:01:17.138 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:16 smithi184 ceph-mon[34585]: pgmap v556: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T11:01:17.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:16 smithi107 ceph-mon[30373]: pgmap v556: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-10T11:01:17.571 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2024-05-10T11:01:17.571 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-0": { 2024-05-10T11:01:17.571 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 558, 2024-05-10T11:01:17.571 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 560, 2024-05-10T11:01:17.571 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 17786359, 2024-05-10T11:01:17.572 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 177508, 2024-05-10T11:01:17.572 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 7, 2024-05-10T11:01:17.572 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 3, 2024-05-10T11:01:17.572 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.058549353, 2024-05-10T11:01:17.572 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.016025827, 2024-05-10T11:01:17.572 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.022360162, 2024-05-10T11:01:17.572 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.014488319, 2024-05-10T11:01:17.572 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:17.572 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 558, 2024-05-10T11:01:17.572 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.021310013, 2024-05-10T11:01:17.572 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000038189 2024-05-10T11:01:17.572 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.572 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:17.572 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.572 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.573 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.573 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.573 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-10T11:01:17.573 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 0 2024-05-10T11:01:17.573 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.573 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-1": { 2024-05-10T11:01:17.573 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 313, 2024-05-10T11:01:17.573 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 433, 2024-05-10T11:01:17.573 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 29441334, 2024-05-10T11:01:17.573 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 376469, 2024-05-10T11:01:17.573 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 6, 2024-05-10T11:01:17.573 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 5, 2024-05-10T11:01:17.573 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.045105114, 2024-05-10T11:01:17.573 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.012754016, 2024-05-10T11:01:17.574 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.018500966, 2024-05-10T11:01:17.574 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.010073160, 2024-05-10T11:01:17.574 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:17.574 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 431, 2024-05-10T11:01:17.574 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.019515490, 2024-05-10T11:01:17.574 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000045279 2024-05-10T11:01:17.574 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.574 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:17.574 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.574 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.574 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.574 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.574 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-10T11:01:17.574 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 277248 2024-05-10T11:01:17.574 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.575 INFO:teuthology.orchestra.run.smithi196.stdout: "AsyncMessenger::Worker-2": { 2024-05-10T11:01:17.575 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_messages": 835, 2024-05-10T11:01:17.575 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages": 817, 2024-05-10T11:01:17.575 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_bytes": 13681713, 2024-05-10T11:01:17.575 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_bytes": 305506, 2024-05-10T11:01:17.575 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_created_connections": 4, 2024-05-10T11:01:17.575 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_active_connections": 3, 2024-05-10T11:01:17.575 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_total_time": 0.106746918, 2024-05-10T11:01:17.575 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_send_time": 0.031755061, 2024-05-10T11:01:17.575 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_recv_time": 0.046631296, 2024-05-10T11:01:17.575 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_running_fast_dispatch_time": 0.026656505, 2024-05-10T11:01:17.575 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_messages_queue_lat": { 2024-05-10T11:01:17.575 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 817, 2024-05-10T11:01:17.575 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.043413192, 2024-05-10T11:01:17.575 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000053137 2024-05-10T11:01:17.576 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.576 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_handle_ack_lat": { 2024-05-10T11:01:17.576 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.576 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.576 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.576 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.576 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_recv_encrypted_bytes": 891616, 2024-05-10T11:01:17.576 INFO:teuthology.orchestra.run.smithi196.stdout: "msgr_send_encrypted_bytes": 99760 2024-05-10T11:01:17.576 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.576 INFO:teuthology.orchestra.run.smithi196.stdout: "cct": { 2024-05-10T11:01:17.576 INFO:teuthology.orchestra.run.smithi196.stdout: "total_workers": 1, 2024-05-10T11:01:17.576 INFO:teuthology.orchestra.run.smithi196.stdout: "unhealthy_workers": 0 2024-05-10T11:01:17.576 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.576 INFO:teuthology.orchestra.run.smithi196.stdout: "finisher-MDSRank": { 2024-05-10T11:01:17.576 INFO:teuthology.orchestra.run.smithi196.stdout: "queue_len": 0, 2024-05-10T11:01:17.577 INFO:teuthology.orchestra.run.smithi196.stdout: "complete_latency": { 2024-05-10T11:01:17.577 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 2590, 2024-05-10T11:01:17.577 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.073036066, 2024-05-10T11:01:17.577 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000028199 2024-05-10T11:01:17.577 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:17.577 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.577 INFO:teuthology.orchestra.run.smithi196.stdout: "finisher-PurgeQueue": { 2024-05-10T11:01:17.577 INFO:teuthology.orchestra.run.smithi196.stdout: "queue_len": 0, 2024-05-10T11:01:17.577 INFO:teuthology.orchestra.run.smithi196.stdout: "complete_latency": { 2024-05-10T11:01:17.577 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.577 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.577 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.577 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:17.577 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.577 INFO:teuthology.orchestra.run.smithi196.stdout: "mds": { 2024-05-10T11:01:17.578 INFO:teuthology.orchestra.run.smithi196.stdout: "request": 0, 2024-05-10T11:01:17.578 INFO:teuthology.orchestra.run.smithi196.stdout: "reply": 0, 2024-05-10T11:01:17.578 INFO:teuthology.orchestra.run.smithi196.stdout: "reply_latency": { 2024-05-10T11:01:17.578 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.578 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.578 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.578 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.578 INFO:teuthology.orchestra.run.smithi196.stdout: "slow_reply": 0, 2024-05-10T11:01:17.578 INFO:teuthology.orchestra.run.smithi196.stdout: "forward": 0, 2024-05-10T11:01:17.578 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_fetch_complete": 0, 2024-05-10T11:01:17.578 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_fetch_keys": 0, 2024-05-10T11:01:17.578 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_commit": 0, 2024-05-10T11:01:17.578 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_split": 0, 2024-05-10T11:01:17.578 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_merge": 0, 2024-05-10T11:01:17.579 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes": 7050, 2024-05-10T11:01:17.579 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_top": 0, 2024-05-10T11:01:17.579 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_bottom": 7050, 2024-05-10T11:01:17.579 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_pin_tail": 0, 2024-05-10T11:01:17.579 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_pinned": 7050, 2024-05-10T11:01:17.579 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_expired": 0, 2024-05-10T11:01:17.579 INFO:teuthology.orchestra.run.smithi196.stdout: "inodes_with_caps": 0, 2024-05-10T11:01:17.579 INFO:teuthology.orchestra.run.smithi196.stdout: "caps": 0, 2024-05-10T11:01:17.579 INFO:teuthology.orchestra.run.smithi196.stdout: "subtrees": 1, 2024-05-10T11:01:17.579 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse": 0, 2024-05-10T11:01:17.579 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_hit": 0, 2024-05-10T11:01:17.579 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_forward": 0, 2024-05-10T11:01:17.579 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_discover": 0, 2024-05-10T11:01:17.579 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_dir_fetch": 0, 2024-05-10T11:01:17.579 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_remote_ino": 0, 2024-05-10T11:01:17.580 INFO:teuthology.orchestra.run.smithi196.stdout: "traverse_lock": 0, 2024-05-10T11:01:17.580 INFO:teuthology.orchestra.run.smithi196.stdout: "load_cent": 0, 2024-05-10T11:01:17.580 INFO:teuthology.orchestra.run.smithi196.stdout: "q": 0, 2024-05-10T11:01:17.580 INFO:teuthology.orchestra.run.smithi196.stdout: "exported": 0, 2024-05-10T11:01:17.580 INFO:teuthology.orchestra.run.smithi196.stdout: "exported_inodes": 0, 2024-05-10T11:01:17.580 INFO:teuthology.orchestra.run.smithi196.stdout: "imported": 0, 2024-05-10T11:01:17.580 INFO:teuthology.orchestra.run.smithi196.stdout: "imported_inodes": 0, 2024-05-10T11:01:17.580 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_dir_fetch": 0, 2024-05-10T11:01:17.580 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_backtrace_fetch": 0, 2024-05-10T11:01:17.580 INFO:teuthology.orchestra.run.smithi196.stdout: "openino_peer_discover": 0, 2024-05-10T11:01:17.580 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rfiles": 0, 2024-05-10T11:01:17.580 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rbytes": 0, 2024-05-10T11:01:17.580 INFO:teuthology.orchestra.run.smithi196.stdout: "root_rsnaps": 0, 2024-05-10T11:01:17.580 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_backtrace_fetch": 0, 2024-05-10T11:01:17.580 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_set_tag": 0, 2024-05-10T11:01:17.581 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_backtrace_repaired": 0, 2024-05-10T11:01:17.581 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_inotable_repaired": 0, 2024-05-10T11:01:17.581 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dir_inodes": 0, 2024-05-10T11:01:17.581 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dir_base_inodes": 0, 2024-05-10T11:01:17.581 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_dirfrag_rstats": 0, 2024-05-10T11:01:17.581 INFO:teuthology.orchestra.run.smithi196.stdout: "scrub_file_inodes": 0, 2024-05-10T11:01:17.581 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_inode_file_caps": 0, 2024-05-10T11:01:17.581 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_revoke": 0, 2024-05-10T11:01:17.581 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_grant": 0, 2024-05-10T11:01:17.581 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_trunc": 0, 2024-05-10T11:01:17.581 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-10T11:01:17.581 INFO:teuthology.orchestra.run.smithi196.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-10T11:01:17.581 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_caps": 0, 2024-05-10T11:01:17.581 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_caps_dirty": 0, 2024-05-10T11:01:17.581 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_cap_release": 0, 2024-05-10T11:01:17.582 INFO:teuthology.orchestra.run.smithi196.stdout: "process_request_cap_release": 0 2024-05-10T11:01:17.582 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.582 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_cache": { 2024-05-10T11:01:17.582 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_update": 0, 2024-05-10T11:01:17.582 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_update_receipt": 0, 2024-05-10T11:01:17.582 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_try_discover": 0, 2024-05-10T11:01:17.582 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_send_discover": 0, 2024-05-10T11:01:17.582 INFO:teuthology.orchestra.run.smithi196.stdout: "dir_handle_discover": 0, 2024-05-10T11:01:17.582 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays": 0, 2024-05-10T11:01:17.582 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays_delayed": 0, 2024-05-10T11:01:17.582 INFO:teuthology.orchestra.run.smithi196.stdout: "num_strays_enqueuing": 0, 2024-05-10T11:01:17.582 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_created": 0, 2024-05-10T11:01:17.582 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_enqueued": 0, 2024-05-10T11:01:17.582 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_reintegrated": 0, 2024-05-10T11:01:17.582 INFO:teuthology.orchestra.run.smithi196.stdout: "strays_migrated": 0, 2024-05-10T11:01:17.583 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_processing": 0, 2024-05-10T11:01:17.583 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_enqueued": 0, 2024-05-10T11:01:17.583 INFO:teuthology.orchestra.run.smithi196.stdout: "num_recovering_prioritized": 0, 2024-05-10T11:01:17.583 INFO:teuthology.orchestra.run.smithi196.stdout: "recovery_started": 0, 2024-05-10T11:01:17.583 INFO:teuthology.orchestra.run.smithi196.stdout: "recovery_completed": 0, 2024-05-10T11:01:17.583 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_quiesce_path": 0, 2024-05-10T11:01:17.583 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_quiesce_inode": 0, 2024-05-10T11:01:17.583 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_enqueue_scrub": 0, 2024-05-10T11:01:17.583 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_exportdir": 0, 2024-05-10T11:01:17.583 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_flush": 0, 2024-05-10T11:01:17.583 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_fragmentdir": 0, 2024-05-10T11:01:17.583 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_fragstats": 0, 2024-05-10T11:01:17.583 INFO:teuthology.orchestra.run.smithi196.stdout: "ireq_inodestats": 0 2024-05-10T11:01:17.583 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.583 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_log": { 2024-05-10T11:01:17.584 INFO:teuthology.orchestra.run.smithi196.stdout: "evlrg": 0, 2024-05-10T11:01:17.584 INFO:teuthology.orchestra.run.smithi196.stdout: "evadd": 0, 2024-05-10T11:01:17.584 INFO:teuthology.orchestra.run.smithi196.stdout: "evex": 0, 2024-05-10T11:01:17.584 INFO:teuthology.orchestra.run.smithi196.stdout: "evtrm": 0, 2024-05-10T11:01:17.584 INFO:teuthology.orchestra.run.smithi196.stdout: "ev": 30480, 2024-05-10T11:01:17.584 INFO:teuthology.orchestra.run.smithi196.stdout: "evexg": 0, 2024-05-10T11:01:17.584 INFO:teuthology.orchestra.run.smithi196.stdout: "evexd": 0, 2024-05-10T11:01:17.584 INFO:teuthology.orchestra.run.smithi196.stdout: "segadd": 0, 2024-05-10T11:01:17.584 INFO:teuthology.orchestra.run.smithi196.stdout: "segex": 0, 2024-05-10T11:01:17.584 INFO:teuthology.orchestra.run.smithi196.stdout: "segtrm": 0, 2024-05-10T11:01:17.584 INFO:teuthology.orchestra.run.smithi196.stdout: "seg": 39, 2024-05-10T11:01:17.584 INFO:teuthology.orchestra.run.smithi196.stdout: "segmjr": 4, 2024-05-10T11:01:17.584 INFO:teuthology.orchestra.run.smithi196.stdout: "segexg": 0, 2024-05-10T11:01:17.584 INFO:teuthology.orchestra.run.smithi196.stdout: "segexd": 0, 2024-05-10T11:01:17.584 INFO:teuthology.orchestra.run.smithi196.stdout: "expos": 4194304, 2024-05-10T11:01:17.585 INFO:teuthology.orchestra.run.smithi196.stdout: "wrpos": 63773912, 2024-05-10T11:01:17.585 INFO:teuthology.orchestra.run.smithi196.stdout: "rdpos": 63772774, 2024-05-10T11:01:17.585 INFO:teuthology.orchestra.run.smithi196.stdout: "jlat": { 2024-05-10T11:01:17.585 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.585 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.585 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.585 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.585 INFO:teuthology.orchestra.run.smithi196.stdout: "replayed": 30480 2024-05-10T11:01:17.585 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.585 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_mem": { 2024-05-10T11:01:17.585 INFO:teuthology.orchestra.run.smithi196.stdout: "ino": 13, 2024-05-10T11:01:17.585 INFO:teuthology.orchestra.run.smithi196.stdout: "ino+": 7275, 2024-05-10T11:01:17.585 INFO:teuthology.orchestra.run.smithi196.stdout: "ino-": 7262, 2024-05-10T11:01:17.585 INFO:teuthology.orchestra.run.smithi196.stdout: "dir": 11, 2024-05-10T11:01:17.585 INFO:teuthology.orchestra.run.smithi196.stdout: "dir+": 400, 2024-05-10T11:01:17.585 INFO:teuthology.orchestra.run.smithi196.stdout: "dir-": 389, 2024-05-10T11:01:17.586 INFO:teuthology.orchestra.run.smithi196.stdout: "dn": 7050, 2024-05-10T11:01:17.586 INFO:teuthology.orchestra.run.smithi196.stdout: "dn+": 10957, 2024-05-10T11:01:17.586 INFO:teuthology.orchestra.run.smithi196.stdout: "dn-": 3907, 2024-05-10T11:01:17.586 INFO:teuthology.orchestra.run.smithi196.stdout: "cap": 0, 2024-05-10T11:01:17.586 INFO:teuthology.orchestra.run.smithi196.stdout: "cap+": 0, 2024-05-10T11:01:17.586 INFO:teuthology.orchestra.run.smithi196.stdout: "cap-": 0, 2024-05-10T11:01:17.586 INFO:teuthology.orchestra.run.smithi196.stdout: "rss": 65688, 2024-05-10T11:01:17.586 INFO:teuthology.orchestra.run.smithi196.stdout: "heap": 215416 2024-05-10T11:01:17.586 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.586 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_server": { 2024-05-10T11:01:17.586 INFO:teuthology.orchestra.run.smithi196.stdout: "dispatch_client_request": 0, 2024-05-10T11:01:17.586 INFO:teuthology.orchestra.run.smithi196.stdout: "dispatch_server_request": 0, 2024-05-10T11:01:17.586 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_request": 0, 2024-05-10T11:01:17.586 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_client_session": 0, 2024-05-10T11:01:17.586 INFO:teuthology.orchestra.run.smithi196.stdout: "handle_peer_request": 0, 2024-05-10T11:01:17.587 INFO:teuthology.orchestra.run.smithi196.stdout: "req_create_latency": { 2024-05-10T11:01:17.587 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.587 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.587 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.587 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.587 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getattr_latency": { 2024-05-10T11:01:17.587 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.587 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.587 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.587 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.587 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getfilelock_latency": { 2024-05-10T11:01:17.587 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.587 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.587 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.588 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.588 INFO:teuthology.orchestra.run.smithi196.stdout: "req_link_latency": { 2024-05-10T11:01:17.588 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.588 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.588 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.588 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.588 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookup_latency": { 2024-05-10T11:01:17.588 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.588 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.588 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.588 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.588 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookuphash_latency": { 2024-05-10T11:01:17.589 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.589 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.589 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.589 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.589 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupino_latency": { 2024-05-10T11:01:17.589 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.589 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.589 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.589 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.589 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupname_latency": { 2024-05-10T11:01:17.589 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.589 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.589 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.589 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.590 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupparent_latency": { 2024-05-10T11:01:17.590 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.590 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.590 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.590 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.590 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lookupsnap_latency": { 2024-05-10T11:01:17.590 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.590 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.590 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.590 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.590 INFO:teuthology.orchestra.run.smithi196.stdout: "req_lssnap_latency": { 2024-05-10T11:01:17.590 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.590 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.590 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.590 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.591 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mkdir_latency": { 2024-05-10T11:01:17.591 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.591 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.591 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.592 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.592 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mknod_latency": { 2024-05-10T11:01:17.592 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.592 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.592 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.592 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.592 INFO:teuthology.orchestra.run.smithi196.stdout: "req_mksnap_latency": { 2024-05-10T11:01:17.592 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.592 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.592 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.592 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.592 INFO:teuthology.orchestra.run.smithi196.stdout: "req_open_latency": { 2024-05-10T11:01:17.592 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.592 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.592 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.593 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.593 INFO:teuthology.orchestra.run.smithi196.stdout: "req_readdir_latency": { 2024-05-10T11:01:17.593 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.593 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.593 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.593 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.593 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rename_latency": { 2024-05-10T11:01:17.593 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.593 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.593 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.593 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.593 INFO:teuthology.orchestra.run.smithi196.stdout: "req_renamesnap_latency": { 2024-05-10T11:01:17.593 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.593 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.593 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.594 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.594 INFO:teuthology.orchestra.run.smithi196.stdout: "req_snapdiff_latency": { 2024-05-10T11:01:17.594 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.594 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.594 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.594 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.594 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmdir_latency": { 2024-05-10T11:01:17.594 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.594 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.594 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.594 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.594 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmsnap_latency": { 2024-05-10T11:01:17.594 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.594 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.595 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.595 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.595 INFO:teuthology.orchestra.run.smithi196.stdout: "req_rmxattr_latency": { 2024-05-10T11:01:17.595 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.595 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.595 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.595 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.595 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setattr_latency": { 2024-05-10T11:01:17.595 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.595 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.595 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.595 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.595 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setdirlayout_latency": { 2024-05-10T11:01:17.595 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.595 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.596 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.596 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.596 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setfilelock_latency": { 2024-05-10T11:01:17.596 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.596 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.596 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.596 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.596 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setlayout_latency": { 2024-05-10T11:01:17.596 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.596 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.596 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.596 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.596 INFO:teuthology.orchestra.run.smithi196.stdout: "req_setxattr_latency": { 2024-05-10T11:01:17.596 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.596 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.596 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.597 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.597 INFO:teuthology.orchestra.run.smithi196.stdout: "req_symlink_latency": { 2024-05-10T11:01:17.597 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.597 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.597 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.597 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.597 INFO:teuthology.orchestra.run.smithi196.stdout: "req_unlink_latency": { 2024-05-10T11:01:17.597 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.597 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.597 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.597 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.597 INFO:teuthology.orchestra.run.smithi196.stdout: "cap_revoke_eviction": 0, 2024-05-10T11:01:17.597 INFO:teuthology.orchestra.run.smithi196.stdout: "cap_acquisition_throttle": 0, 2024-05-10T11:01:17.597 INFO:teuthology.orchestra.run.smithi196.stdout: "req_getvxattr_latency": { 2024-05-10T11:01:17.597 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.598 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.598 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.598 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:17.598 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.598 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_sessions": { 2024-05-10T11:01:17.598 INFO:teuthology.orchestra.run.smithi196.stdout: "session_count": 1, 2024-05-10T11:01:17.598 INFO:teuthology.orchestra.run.smithi196.stdout: "session_add": 1, 2024-05-10T11:01:17.598 INFO:teuthology.orchestra.run.smithi196.stdout: "session_remove": 0, 2024-05-10T11:01:17.598 INFO:teuthology.orchestra.run.smithi196.stdout: "sessions_open": 1, 2024-05-10T11:01:17.598 INFO:teuthology.orchestra.run.smithi196.stdout: "sessions_stale": 0, 2024-05-10T11:01:17.598 INFO:teuthology.orchestra.run.smithi196.stdout: "total_load": 0, 2024-05-10T11:01:17.598 INFO:teuthology.orchestra.run.smithi196.stdout: "average_load": 0, 2024-05-10T11:01:17.598 INFO:teuthology.orchestra.run.smithi196.stdout: "avg_session_uptime": 1818, 2024-05-10T11:01:17.598 INFO:teuthology.orchestra.run.smithi196.stdout: "mdthresh_evicted": 0 2024-05-10T11:01:17.598 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.599 INFO:teuthology.orchestra.run.smithi196.stdout: "mempool": { 2024-05-10T11:01:17.599 INFO:teuthology.orchestra.run.smithi196.stdout: "bloom_filter_bytes": 0, 2024-05-10T11:01:17.599 INFO:teuthology.orchestra.run.smithi196.stdout: "bloom_filter_items": 0, 2024-05-10T11:01:17.599 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_alloc_bytes": 0, 2024-05-10T11:01:17.599 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_alloc_items": 0, 2024-05-10T11:01:17.599 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_data_bytes": 0, 2024-05-10T11:01:17.599 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_data_items": 0, 2024-05-10T11:01:17.599 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-10T11:01:17.599 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_onode_items": 0, 2024-05-10T11:01:17.599 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-10T11:01:17.599 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_meta_items": 0, 2024-05-10T11:01:17.599 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_other_bytes": 0, 2024-05-10T11:01:17.599 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_other_items": 0, 2024-05-10T11:01:17.599 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-10T11:01:17.599 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_cache_buffer_items": 0, 2024-05-10T11:01:17.600 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_extent_bytes": 0, 2024-05-10T11:01:17.600 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_extent_items": 0, 2024-05-10T11:01:17.600 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_blob_bytes": 0, 2024-05-10T11:01:17.600 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_blob_items": 0, 2024-05-10T11:01:17.600 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-10T11:01:17.600 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_shared_blob_items": 0, 2024-05-10T11:01:17.600 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-10T11:01:17.600 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_inline_bl_items": 0, 2024-05-10T11:01:17.600 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_fsck_bytes": 0, 2024-05-10T11:01:17.600 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_fsck_items": 0, 2024-05-10T11:01:17.600 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_txc_bytes": 0, 2024-05-10T11:01:17.600 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_txc_items": 0, 2024-05-10T11:01:17.600 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-10T11:01:17.600 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_deferred_items": 0, 2024-05-10T11:01:17.600 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_bytes": 0, 2024-05-10T11:01:17.601 INFO:teuthology.orchestra.run.smithi196.stdout: "bluestore_writing_items": 0, 2024-05-10T11:01:17.601 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_bytes": 0, 2024-05-10T11:01:17.601 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_items": 0, 2024-05-10T11:01:17.601 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_reader_bytes": 0, 2024-05-10T11:01:17.601 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_reader_items": 0, 2024-05-10T11:01:17.601 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_writer_bytes": 0, 2024-05-10T11:01:17.601 INFO:teuthology.orchestra.run.smithi196.stdout: "bluefs_file_writer_items": 0, 2024-05-10T11:01:17.601 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_anon_bytes": 215209, 2024-05-10T11:01:17.601 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_anon_items": 67, 2024-05-10T11:01:17.601 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_meta_bytes": 0, 2024-05-10T11:01:17.601 INFO:teuthology.orchestra.run.smithi196.stdout: "buffer_meta_items": 0, 2024-05-10T11:01:17.601 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_bytes": 0, 2024-05-10T11:01:17.601 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_items": 0, 2024-05-10T11:01:17.601 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_mapbl_bytes": 0, 2024-05-10T11:01:17.601 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_mapbl_items": 0, 2024-05-10T11:01:17.602 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_pglog_bytes": 0, 2024-05-10T11:01:17.602 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_pglog_items": 0, 2024-05-10T11:01:17.602 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_bytes": 7336, 2024-05-10T11:01:17.602 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_items": 154, 2024-05-10T11:01:17.602 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_mapping_bytes": 0, 2024-05-10T11:01:17.602 INFO:teuthology.orchestra.run.smithi196.stdout: "osdmap_mapping_items": 0, 2024-05-10T11:01:17.602 INFO:teuthology.orchestra.run.smithi196.stdout: "pgmap_bytes": 0, 2024-05-10T11:01:17.602 INFO:teuthology.orchestra.run.smithi196.stdout: "pgmap_items": 0, 2024-05-10T11:01:17.602 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_co_bytes": 5006792, 2024-05-10T11:01:17.602 INFO:teuthology.orchestra.run.smithi196.stdout: "mds_co_items": 28328, 2024-05-10T11:01:17.602 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_1_bytes": 0, 2024-05-10T11:01:17.602 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_1_items": 0, 2024-05-10T11:01:17.602 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_2_bytes": 0, 2024-05-10T11:01:17.602 INFO:teuthology.orchestra.run.smithi196.stdout: "unittest_2_items": 0 2024-05-10T11:01:17.602 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.603 INFO:teuthology.orchestra.run.smithi196.stdout: "objecter": { 2024-05-10T11:01:17.603 INFO:teuthology.orchestra.run.smithi196.stdout: "op_active": 0, 2024-05-10T11:01:17.603 INFO:teuthology.orchestra.run.smithi196.stdout: "op_laggy": 0, 2024-05-10T11:01:17.603 INFO:teuthology.orchestra.run.smithi196.stdout: "op_send": 1517, 2024-05-10T11:01:17.603 INFO:teuthology.orchestra.run.smithi196.stdout: "op_send_bytes": 21, 2024-05-10T11:01:17.603 INFO:teuthology.orchestra.run.smithi196.stdout: "op_resend": 3, 2024-05-10T11:01:17.603 INFO:teuthology.orchestra.run.smithi196.stdout: "op_reply": 1517, 2024-05-10T11:01:17.603 INFO:teuthology.orchestra.run.smithi196.stdout: "op_latency": { 2024-05-10T11:01:17.603 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 1517, 2024-05-10T11:01:17.603 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.962979605, 2024-05-10T11:01:17.603 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000634792 2024-05-10T11:01:17.603 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.603 INFO:teuthology.orchestra.run.smithi196.stdout: "op_inflight": 0, 2024-05-10T11:01:17.603 INFO:teuthology.orchestra.run.smithi196.stdout: "oplen_avg": { 2024-05-10T11:01:17.603 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 1517, 2024-05-10T11:01:17.604 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 1518 2024-05-10T11:01:17.604 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.604 INFO:teuthology.orchestra.run.smithi196.stdout: "op": 1517, 2024-05-10T11:01:17.604 INFO:teuthology.orchestra.run.smithi196.stdout: "op_r": 1517, 2024-05-10T11:01:17.604 INFO:teuthology.orchestra.run.smithi196.stdout: "op_w": 0, 2024-05-10T11:01:17.604 INFO:teuthology.orchestra.run.smithi196.stdout: "op_rmw": 0, 2024-05-10T11:01:17.604 INFO:teuthology.orchestra.run.smithi196.stdout: "op_pg": 0, 2024-05-10T11:01:17.604 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_stat": 922, 2024-05-10T11:01:17.604 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_create": 0, 2024-05-10T11:01:17.604 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_read": 593, 2024-05-10T11:01:17.604 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_write": 0, 2024-05-10T11:01:17.604 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_writefull": 0, 2024-05-10T11:01:17.604 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_writesame": 0, 2024-05-10T11:01:17.604 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_append": 0, 2024-05-10T11:01:17.604 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_zero": 0, 2024-05-10T11:01:17.605 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_truncate": 0, 2024-05-10T11:01:17.605 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_delete": 0, 2024-05-10T11:01:17.605 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_mapext": 0, 2024-05-10T11:01:17.605 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_sparse_read": 0, 2024-05-10T11:01:17.605 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_clonerange": 0, 2024-05-10T11:01:17.605 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_getxattr": 1, 2024-05-10T11:01:17.605 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_setxattr": 0, 2024-05-10T11:01:17.605 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_cmpxattr": 0, 2024-05-10T11:01:17.605 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_rmxattr": 0, 2024-05-10T11:01:17.605 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_resetxattrs": 0, 2024-05-10T11:01:17.605 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_call": 0, 2024-05-10T11:01:17.605 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_watch": 0, 2024-05-10T11:01:17.605 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_notify": 0, 2024-05-10T11:01:17.605 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_src_cmpxattr": 0, 2024-05-10T11:01:17.605 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_pgls": 0, 2024-05-10T11:01:17.605 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_pgls_filter": 0, 2024-05-10T11:01:17.606 INFO:teuthology.orchestra.run.smithi196.stdout: "osdop_other": 0, 2024-05-10T11:01:17.606 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_active": 0, 2024-05-10T11:01:17.606 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_send": 0, 2024-05-10T11:01:17.606 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_resend": 0, 2024-05-10T11:01:17.606 INFO:teuthology.orchestra.run.smithi196.stdout: "linger_ping": 0, 2024-05-10T11:01:17.606 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_active": 0, 2024-05-10T11:01:17.606 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_send": 0, 2024-05-10T11:01:17.606 INFO:teuthology.orchestra.run.smithi196.stdout: "poolop_resend": 0, 2024-05-10T11:01:17.606 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_active": 0, 2024-05-10T11:01:17.606 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_send": 0, 2024-05-10T11:01:17.606 INFO:teuthology.orchestra.run.smithi196.stdout: "poolstat_resend": 0, 2024-05-10T11:01:17.606 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_active": 0, 2024-05-10T11:01:17.606 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_send": 0, 2024-05-10T11:01:17.606 INFO:teuthology.orchestra.run.smithi196.stdout: "statfs_resend": 0, 2024-05-10T11:01:17.606 INFO:teuthology.orchestra.run.smithi196.stdout: "command_active": 0, 2024-05-10T11:01:17.607 INFO:teuthology.orchestra.run.smithi196.stdout: "command_send": 0, 2024-05-10T11:01:17.607 INFO:teuthology.orchestra.run.smithi196.stdout: "command_resend": 0, 2024-05-10T11:01:17.607 INFO:teuthology.orchestra.run.smithi196.stdout: "map_epoch": 82, 2024-05-10T11:01:17.607 INFO:teuthology.orchestra.run.smithi196.stdout: "map_full": 0, 2024-05-10T11:01:17.607 INFO:teuthology.orchestra.run.smithi196.stdout: "map_inc": 2, 2024-05-10T11:01:17.607 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_sessions": 8, 2024-05-10T11:01:17.607 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_session_open": 8, 2024-05-10T11:01:17.607 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_session_close": 0, 2024-05-10T11:01:17.607 INFO:teuthology.orchestra.run.smithi196.stdout: "osd_laggy": 0, 2024-05-10T11:01:17.607 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_wr": 0, 2024-05-10T11:01:17.608 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_rd": 2, 2024-05-10T11:01:17.608 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_del": 0 2024-05-10T11:01:17.608 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.608 INFO:teuthology.orchestra.run.smithi196.stdout: "oft": { 2024-05-10T11:01:17.608 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_objs": 0, 2024-05-10T11:01:17.608 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_kv_pairs": 0, 2024-05-10T11:01:17.608 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_updates": 0, 2024-05-10T11:01:17.608 INFO:teuthology.orchestra.run.smithi196.stdout: "omap_total_removes": 0 2024-05-10T11:01:17.608 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.608 INFO:teuthology.orchestra.run.smithi196.stdout: "osd-slow-ops": { 2024-05-10T11:01:17.608 INFO:teuthology.orchestra.run.smithi196.stdout: "slow_ops_count": 0 2024-05-10T11:01:17.608 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.608 INFO:teuthology.orchestra.run.smithi196.stdout: "purge_queue": { 2024-05-10T11:01:17.608 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_ops": 0, 2024-05-10T11:01:17.608 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_ops_high_water": 0, 2024-05-10T11:01:17.609 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing": 0, 2024-05-10T11:01:17.609 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executing_high_water": 0, 2024-05-10T11:01:17.609 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executed_ops": 0, 2024-05-10T11:01:17.609 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_executed": 0, 2024-05-10T11:01:17.609 INFO:teuthology.orchestra.run.smithi196.stdout: "pq_item_in_journal": 0 2024-05-10T11:01:17.609 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.609 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-10T11:01:17.609 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:17.609 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 104857600, 2024-05-10T11:01:17.609 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:17.609 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 1702, 2024-05-10T11:01:17.609 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 60743770, 2024-05-10T11:01:17.609 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:17.609 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 1702, 2024-05-10T11:01:17.609 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-05-10T11:01:17.610 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-05-10T11:01:17.610 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 1702, 2024-05-10T11:01:17.610 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 60743770, 2024-05-10T11:01:17.610 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:17.610 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.610 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.610 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.610 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:17.610 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.610 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-objecter_bytes": { 2024-05-10T11:01:17.610 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:17.610 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 104857600, 2024-05-10T11:01:17.610 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:17.610 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-05-10T11:01:17.610 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-05-10T11:01:17.611 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:17.611 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:17.611 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 1517, 2024-05-10T11:01:17.611 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 59586800, 2024-05-10T11:01:17.611 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 1517, 2024-05-10T11:01:17.611 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 59586800, 2024-05-10T11:01:17.611 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:17.611 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.611 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.611 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.611 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:17.611 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.611 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-objecter_ops": { 2024-05-10T11:01:17.611 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:17.611 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 1024, 2024-05-10T11:01:17.612 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:17.612 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-05-10T11:01:17.612 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-05-10T11:01:17.612 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:17.612 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:17.612 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 1517, 2024-05-10T11:01:17.612 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 1517, 2024-05-10T11:01:17.612 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 1517, 2024-05-10T11:01:17.612 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 1517, 2024-05-10T11:01:17.612 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:17.612 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.612 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.612 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.612 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:17.612 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.613 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-write_buf_throttle": { 2024-05-10T11:01:17.613 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:17.613 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 3758096384, 2024-05-10T11:01:17.613 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:17.613 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-05-10T11:01:17.613 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-05-10T11:01:17.613 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:17.613 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:17.613 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-05-10T11:01:17.613 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-05-10T11:01:17.613 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 0, 2024-05-10T11:01:17.613 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 0, 2024-05-10T11:01:17.613 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:17.613 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.613 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.614 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.614 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:17.614 INFO:teuthology.orchestra.run.smithi196.stdout: }, 2024-05-10T11:01:17.614 INFO:teuthology.orchestra.run.smithi196.stdout: "throttle-write_buf_throttle-0x5622a682c6e0": { 2024-05-10T11:01:17.614 INFO:teuthology.orchestra.run.smithi196.stdout: "val": 0, 2024-05-10T11:01:17.614 INFO:teuthology.orchestra.run.smithi196.stdout: "max": 3758096384, 2024-05-10T11:01:17.614 INFO:teuthology.orchestra.run.smithi196.stdout: "get_started": 0, 2024-05-10T11:01:17.614 INFO:teuthology.orchestra.run.smithi196.stdout: "get": 0, 2024-05-10T11:01:17.614 INFO:teuthology.orchestra.run.smithi196.stdout: "get_sum": 0, 2024-05-10T11:01:17.614 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_fail": 0, 2024-05-10T11:01:17.614 INFO:teuthology.orchestra.run.smithi196.stdout: "get_or_fail_success": 0, 2024-05-10T11:01:17.614 INFO:teuthology.orchestra.run.smithi196.stdout: "take": 0, 2024-05-10T11:01:17.614 INFO:teuthology.orchestra.run.smithi196.stdout: "take_sum": 0, 2024-05-10T11:01:17.614 INFO:teuthology.orchestra.run.smithi196.stdout: "put": 0, 2024-05-10T11:01:17.615 INFO:teuthology.orchestra.run.smithi196.stdout: "put_sum": 0, 2024-05-10T11:01:17.615 INFO:teuthology.orchestra.run.smithi196.stdout: "wait": { 2024-05-10T11:01:17.615 INFO:teuthology.orchestra.run.smithi196.stdout: "avgcount": 0, 2024-05-10T11:01:17.615 INFO:teuthology.orchestra.run.smithi196.stdout: "sum": 0.000000000, 2024-05-10T11:01:17.615 INFO:teuthology.orchestra.run.smithi196.stdout: "avgtime": 0.000000000 2024-05-10T11:01:17.615 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:17.615 INFO:teuthology.orchestra.run.smithi196.stdout: } 2024-05-10T11:01:17.615 INFO:teuthology.orchestra.run.smithi196.stdout:} 2024-05-10T11:01:18.358 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-05-10T11:01:18.359 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-05-10T11:01:18.359 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-05-10T11:01:18.359 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-05-10T11:01:18.359 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-10T11:01:18.370 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-10T11:01:18.370 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T11:01:18.370 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:01:18.392 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T11:01:18.392 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:01:18.452 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd blocklist ls 2024-05-10T11:01:18.752 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T11:01:19.062 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:18 smithi196 ceph-mon[34872]: pgmap v557: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T11:01:19.138 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:18 smithi184 ceph-mon[34585]: pgmap v557: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T11:01:19.159 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:18 smithi107 ceph-mon[30373]: pgmap v557: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-10T11:01:20.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.537+0000 7fb7a100d700 1 -- 172.21.15.107:0/3003250356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c1023d0 msgr2=0x7fb79c102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:20.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.537+0000 7fb7a100d700 1 --2- 172.21.15.107:0/3003250356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c1023d0 0x7fb79c102850 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb790009990 tx=0x7fb790009ca0 comp rx=0 tx=0).stop 2024-05-10T11:01:20.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.537+0000 7fb7a100d700 1 -- 172.21.15.107:0/3003250356 shutdown_connections 2024-05-10T11:01:20.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.537+0000 7fb7a100d700 1 --2- 172.21.15.107:0/3003250356 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb79c108440 0x7fb79c108820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:20.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.537+0000 7fb7a100d700 1 --2- 172.21.15.107:0/3003250356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb79c102d90 0x7fb79c10f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:20.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.537+0000 7fb7a100d700 1 --2- 172.21.15.107:0/3003250356 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c1023d0 0x7fb79c102850 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:20.538 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.537+0000 7fb7a100d700 1 -- 172.21.15.107:0/3003250356 >> 172.21.15.107:0/3003250356 conn(0x7fb79c0793e0 msgr2=0x7fb79c0797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:01:20.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.537+0000 7fb7a100d700 1 -- 172.21.15.107:0/3003250356 shutdown_connections 2024-05-10T11:01:20.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.537+0000 7fb7a100d700 1 -- 172.21.15.107:0/3003250356 wait complete. 2024-05-10T11:01:20.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.538+0000 7fb7a100d700 1 Processor -- start 2024-05-10T11:01:20.539 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.538+0000 7fb7a100d700 1 -- start start 2024-05-10T11:01:20.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.538+0000 7fb7a100d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c1023d0 0x7fb79c19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:20.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.538+0000 7fb7a100d700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb79c102d90 0x7fb79c19afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:20.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.538+0000 7fb7a100d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb79c108440 0x7fb79c1a5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:20.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.538+0000 7fb7a100d700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c1126c0 con 0x7fb79c1023d0 2024-05-10T11:01:20.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.538+0000 7fb7a100d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c112540 con 0x7fb79c108440 2024-05-10T11:01:20.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.538+0000 7fb7a100d700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fb79c112840 con 0x7fb79c102d90 2024-05-10T11:01:20.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.538+0000 7fb79ad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c1023d0 0x7fb79c19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:20.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.538+0000 7fb79ad9d700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c1023d0 0x7fb79c19aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49368/0 (socket says 172.21.15.107:49368) 2024-05-10T11:01:20.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.538+0000 7fb79ad9d700 1 -- 172.21.15.107:0/2934574199 learned_addr learned my addr 172.21.15.107:0/2934574199 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:01:20.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.538+0000 7fb79a59c700 1 --2- 172.21.15.107:0/2934574199 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb79c102d90 0x7fb79c19afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:20.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.538+0000 7fb79b59e700 1 --2- 172.21.15.107:0/2934574199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb79c108440 0x7fb79c1a5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:20.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.539+0000 7fb79ad9d700 1 -- 172.21.15.107:0/2934574199 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb79c102d90 msgr2=0x7fb79c19afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:20.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.539+0000 7fb79ad9d700 1 --2- 172.21.15.107:0/2934574199 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb79c102d90 0x7fb79c19afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:20.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.539+0000 7fb79ad9d700 1 -- 172.21.15.107:0/2934574199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb79c108440 msgr2=0x7fb79c1a5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:20.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.539+0000 7fb79ad9d700 1 --2- 172.21.15.107:0/2934574199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb79c108440 0x7fb79c1a5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:20.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.539+0000 7fb79ad9d700 1 -- 172.21.15.107:0/2934574199 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79c1a6020 con 0x7fb79c1023d0 2024-05-10T11:01:20.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.539+0000 7fb79b59e700 1 --2- 172.21.15.107:0/2934574199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb79c108440 0x7fb79c1a5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:01:20.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.539+0000 7fb79ad9d700 1 --2- 172.21.15.107:0/2934574199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c1023d0 0x7fb79c19aa60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00d980 tx=0x7fb78c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:01:20.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.539+0000 7fb783fff700 1 -- 172.21.15.107:0/2934574199 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c017070 con 0x7fb79c1023d0 2024-05-10T11:01:20.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.539+0000 7fb783fff700 1 -- 172.21.15.107:0/2934574199 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb78c005020 con 0x7fb79c1023d0 2024-05-10T11:01:20.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.539+0000 7fb7a100d700 1 -- 172.21.15.107:0/2934574199 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79c1a6250 con 0x7fb79c1023d0 2024-05-10T11:01:20.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.539+0000 7fb783fff700 1 -- 172.21.15.107:0/2934574199 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb78c009bf0 con 0x7fb79c1023d0 2024-05-10T11:01:20.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.539+0000 7fb7a100d700 1 -- 172.21.15.107:0/2934574199 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb79c1a6790 con 0x7fb79c1023d0 2024-05-10T11:01:20.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.540+0000 7fb7a100d700 1 -- 172.21.15.107:0/2934574199 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb79c103af0 con 0x7fb79c1023d0 2024-05-10T11:01:20.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.541+0000 7fb783fff700 1 -- 172.21.15.107:0/2934574199 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7fb78c0051d0 con 0x7fb79c1023d0 2024-05-10T11:01:20.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.542+0000 7fb783fff700 1 --2- 172.21.15.107:0/2934574199 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb7840b2900 0x7fb7840b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:20.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.542+0000 7fb79a59c700 1 --2- 172.21.15.107:0/2934574199 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb7840b2900 0x7fb7840b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:20.543 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.542+0000 7fb783fff700 1 -- 172.21.15.107:0/2934574199 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7fb78c0e2370 con 0x7fb79c1023d0 2024-05-10T11:01:20.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.543+0000 7fb79a59c700 1 --2- 172.21.15.107:0/2934574199 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb7840b2900 0x7fb7840b4dc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb79c079970 tx=0x7fb79000b560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:01:20.545 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.545+0000 7fb783fff700 1 -- 172.21.15.107:0/2934574199 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb78c020020 con 0x7fb79c1023d0 2024-05-10T11:01:20.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.765+0000 7fb7a100d700 1 -- 172.21.15.107:0/2934574199 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb79c06c180 con 0x7fb79c1023d0 2024-05-10T11:01:20.766 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.765+0000 7fb783fff700 1 -- 172.21.15.107:0/2934574199 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v82) ==== 81+0+600 (secure 0 0 0) 0x7fb78c0aa1b0 con 0x7fb79c1023d0 2024-05-10T11:01:20.766 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/3518338734 2024-05-11T10:45:07.518714+0000 2024-05-10T11:01:20.766 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/892499090 2024-05-11T10:45:07.518714+0000 2024-05-10T11:01:20.766 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/4092342993 2024-05-11T10:45:07.518714+0000 2024-05-10T11:01:20.766 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/892499090 2024-05-11T10:45:07.518714+0000 2024-05-10T11:01:20.766 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6801/1956906497 2024-05-11T10:44:40.339608+0000 2024-05-10T11:01:20.766 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:6800/1956906497 2024-05-11T10:44:40.339608+0000 2024-05-10T11:01:20.767 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/3761740075 2024-05-11T10:45:07.518714+0000 2024-05-10T11:01:20.767 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2215024983 2024-05-11T10:44:40.339608+0000 2024-05-10T11:01:20.767 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/2124974715 2024-05-11T10:44:40.339608+0000 2024-05-10T11:01:20.767 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107:0/3361930986 2024-05-11T10:44:40.339608+0000 2024-05-10T11:01:20.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.768+0000 7fb7a100d700 1 -- 172.21.15.107:0/2934574199 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb7840b2900 msgr2=0x7fb7840b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:20.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.768+0000 7fb7a100d700 1 --2- 172.21.15.107:0/2934574199 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb7840b2900 0x7fb7840b4dc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb79c079970 tx=0x7fb79000b560 comp rx=0 tx=0).stop 2024-05-10T11:01:20.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.768+0000 7fb7a100d700 1 -- 172.21.15.107:0/2934574199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c1023d0 msgr2=0x7fb79c19aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:20.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.768+0000 7fb7a100d700 1 --2- 172.21.15.107:0/2934574199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c1023d0 0x7fb79c19aa60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb78c00d980 tx=0x7fb78c00dc90 comp rx=0 tx=0).stop 2024-05-10T11:01:20.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.768+0000 7fb7a100d700 1 -- 172.21.15.107:0/2934574199 shutdown_connections 2024-05-10T11:01:20.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.768+0000 7fb7a100d700 1 --2- 172.21.15.107:0/2934574199 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fb7840b2900 0x7fb7840b4dc0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:20.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.768+0000 7fb7a100d700 1 --2- 172.21.15.107:0/2934574199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb79c108440 0x7fb79c1a5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:20.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.768+0000 7fb7a100d700 1 --2- 172.21.15.107:0/2934574199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb79c1023d0 0x7fb79c19aa60 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:20.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.768+0000 7fb7a100d700 1 --2- 172.21.15.107:0/2934574199 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb79c102d90 0x7fb79c19afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:20.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.768+0000 7fb7a100d700 1 -- 172.21.15.107:0/2934574199 >> 172.21.15.107:0/2934574199 conn(0x7fb79c0793e0 msgr2=0x7fb79c100f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:01:20.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.768+0000 7fb7a100d700 1 -- 172.21.15.107:0/2934574199 shutdown_connections 2024-05-10T11:01:20.769 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:20.768+0000 7fb7a100d700 1 -- 172.21.15.107:0/2934574199 wait complete. 2024-05-10T11:01:20.770 INFO:teuthology.orchestra.run.smithi107.stderr:listed 10 entries 2024-05-10T11:01:21.062 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:20 smithi196 ceph-mon[34872]: pgmap v558: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T11:01:21.062 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:20 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/2934574199' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-10T11:01:21.121 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:20 smithi107 ceph-mon[30373]: pgmap v558: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T11:01:21.121 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:20 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/2934574199' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-10T11:01:21.138 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:20 smithi184 ceph-mon[34585]: pgmap v558: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-10T11:01:21.138 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:20 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/2934574199' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-10T11:01:21.390 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-10T11:01:21.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:01:21.391 DEBUG:teuthology.orchestra.run.smithi107:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-10T11:01:21.451 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi107.front.sepia.ceph.com 2024-05-10T11:01:21.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:01:21.451 DEBUG:teuthology.orchestra.run.smithi107:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T11:01:21.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:01:21.488 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-05-10T11:01:21.554 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T11:01:21.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:01:21.555 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T11:01:21.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:01:21.643 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-05-10T11:01:21.728 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-10T11:01:21.728 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-10T11:01:21.728 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T11:01:21.746 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056292,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19782 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/b5b75ac2b33ad2b07611a0b4d280cd63f19bb4a76a078f665a4e9d47f30efd99/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/KNGU6FSMLGR3SZ7DIEFANYA5B5:/var/lib/containers/storage/overlay/l/Y4BMIJDNPU64TTT3IUFTDIVVF7,upperdir=/var/lib/containers/storage/overlay/b5b75ac2b33ad2b07611a0b4d280cd63f19bb4a76a078f665a4e9d47f30efd99/diff,workdir=/var/lib/containers/storage/overlay/b5b75ac2b33ad2b07611a0b4d280cd63f19bb4a76a078f665a4e9d47f30efd99/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/e4f9a838e415caf30ecdf9630630089a460a961bd75d5b56ba5e16c950fdd83a/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/KNGU6FSMLGR3SZ7DIEFANYA5B5:/var/lib/containers/storage/overlay/l/Y4BMIJDNPU64TTT3IUFTDIVVF7,upperdir=/var/lib/containers/storage/overlay/e4f9a838e415caf30ecdf9630630089a460a961bd75d5b56ba5e16c950fdd83a/diff,workdir=/var/lib/containers/storage/overlay/e4f9a838e415caf30ecdf9630630089a460a961bd75d5b56ba5e16c950fdd83a/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248800k,nr_inodes=812200,mode=700,inode64 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/5908c157cd431270635e5853ee62a8fa71fd046e911b971ac9429b37145891f5/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/KNGU6FSMLGR3SZ7DIEFANYA5B5:/var/lib/containers/storage/overlay/l/Y4BMIJDNPU64TTT3IUFTDIVVF7,upperdir=/var/lib/containers/storage/overlay/5908c157cd431270635e5853ee62a8fa71fd046e911b971ac9429b37145891f5/diff,workdir=/var/lib/containers/storage/overlay/5908c157cd431270635e5853ee62a8fa71fd046e911b971ac9429b37145891f5/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f2c7968c2acc1c5ad0f4d6048fd9b494c5d2fa7e88de7e7e5c9cb4aa8964ce07/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/KNGU6FSMLGR3SZ7DIEFANYA5B5:/var/lib/containers/storage/overlay/l/Y4BMIJDNPU64TTT3IUFTDIVVF7,upperdir=/var/lib/containers/storage/overlay/f2c7968c2acc1c5ad0f4d6048fd9b494c5d2fa7e88de7e7e5c9cb4aa8964ce07/diff,workdir=/var/lib/containers/storage/overlay/f2c7968c2acc1c5ad0f4d6048fd9b494c5d2fa7e88de7e7e5c9cb4aa8964ce07/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/01b3a2dddd354521e33d73fb6bdf2bbc62336b0e4648e265c25dd27cd611ba34/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/KNGU6FSMLGR3SZ7DIEFANYA5B5:/var/lib/containers/storage/overlay/l/Y4BMIJDNPU64TTT3IUFTDIVVF7,upperdir=/var/lib/containers/storage/overlay/01b3a2dddd354521e33d73fb6bdf2bbc62336b0e4648e265c25dd27cd611ba34/diff,workdir=/var/lib/containers/storage/overlay/01b3a2dddd354521e33d73fb6bdf2bbc62336b0e4648e265c25dd27cd611ba34/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/0159ad00fc9b27193b1ffd92a4aa1cf0cc6a6041cbb76572ca77661373b4c5b3/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/KNGU6FSMLGR3SZ7DIEFANYA5B5:/var/lib/containers/storage/overlay/l/Y4BMIJDNPU64TTT3IUFTDIVVF7,upperdir=/var/lib/containers/storage/overlay/0159ad00fc9b27193b1ffd92a4aa1cf0cc6a6041cbb76572ca77661373b4c5b3/diff,workdir=/var/lib/containers/storage/overlay/0159ad00fc9b27193b1ffd92a4aa1cf0cc6a6041cbb76572ca77661373b4c5b3/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/9192a1136e8ab8bdc57b2bcaad79289507911587d9d7d41ebd831750f0780b3b/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/KNGU6FSMLGR3SZ7DIEFANYA5B5:/var/lib/containers/storage/overlay/l/Y4BMIJDNPU64TTT3IUFTDIVVF7,upperdir=/var/lib/containers/storage/overlay/9192a1136e8ab8bdc57b2bcaad79289507911587d9d7d41ebd831750f0780b3b/diff,workdir=/var/lib/containers/storage/overlay/9192a1136e8ab8bdc57b2bcaad79289507911587d9d7d41ebd831750f0780b3b/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/3e75d5a431a470aae97c89d5e3e91275afa8ff0650e68b2a6e3500bbf0c3f5a4/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/KNGU6FSMLGR3SZ7DIEFANYA5B5:/var/lib/containers/storage/overlay/l/Y4BMIJDNPU64TTT3IUFTDIVVF7,upperdir=/var/lib/containers/storage/overlay/3e75d5a431a470aae97c89d5e3e91275afa8ff0650e68b2a6e3500bbf0c3f5a4/diff,workdir=/var/lib/containers/storage/overlay/3e75d5a431a470aae97c89d5e3e91275afa8ff0650e68b2a6e3500bbf0c3f5a4/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/bee7a03ba1ada4a0a8bb1e6351cb0c59dae7d11d9f9380178343cb247b4ab16b/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/KNGU6FSMLGR3SZ7DIEFANYA5B5:/var/lib/containers/storage/overlay/l/Y4BMIJDNPU64TTT3IUFTDIVVF7,upperdir=/var/lib/containers/storage/overlay/bee7a03ba1ada4a0a8bb1e6351cb0c59dae7d11d9f9380178343cb247b4ab16b/diff,workdir=/var/lib/containers/storage/overlay/bee7a03ba1ada4a0a8bb1e6351cb0c59dae7d11d9f9380178343cb247b4ab16b/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/62e1ac48c857fb003c31fca4d77525af8a6b8cc7fd566f24646a95196998c5a8/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/KNGU6FSMLGR3SZ7DIEFANYA5B5:/var/lib/containers/storage/overlay/l/Y4BMIJDNPU64TTT3IUFTDIVVF7,upperdir=/var/lib/containers/storage/overlay/62e1ac48c857fb003c31fca4d77525af8a6b8cc7fd566f24646a95196998c5a8/diff,workdir=/var/lib/containers/storage/overlay/62e1ac48c857fb003c31fca4d77525af8a6b8cc7fd566f24646a95196998c5a8/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497604k,nr_inodes=819200,mode=755,inode64 0 0 2024-05-10T11:01:21.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:01:21.746 DEBUG:teuthology.orchestra.run.smithi107:> ip netns list 2024-05-10T11:01:21.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T11:01:21.803 DEBUG:teuthology.orchestra.run.smithi107:> sudo ip link delete ceph-brx 2024-05-10T11:01:21.871 INFO:teuthology.orchestra.run.smithi107.stderr:Cannot find device "ceph-brx" 2024-05-10T11:01:21.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:01:21.873 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-10T11:01:21.885 INFO:tasks.cephadm:Teardown begin 2024-05-10T11:01:21.885 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T11:01:21.885 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T11:01:22.164 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T11:01:23.138 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:22 smithi184 ceph-mon[34585]: pgmap v559: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-10T11:01:23.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:22 smithi107 ceph-mon[30373]: pgmap v559: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-10T11:01:23.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:22 smithi196 ceph-mon[34872]: pgmap v559: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-10T11:01:23.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.945+0000 7f071d32b700 1 -- 172.21.15.107:0/2541402384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0718106f40 msgr2=0x7f071810ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:23.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.945+0000 7f071d32b700 1 --2- 172.21.15.107:0/2541402384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0718106f40 0x7f071810ea80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f071000c210 tx=0x7f071000c520 comp rx=0 tx=0).stop 2024-05-10T11:01:23.947 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.945+0000 7f071d32b700 1 -- 172.21.15.107:0/2541402384 shutdown_connections 2024-05-10T11:01:23.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.945+0000 7f071d32b700 1 --2- 172.21.15.107:0/2541402384 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0718106f40 0x7f071810ea80 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:23.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.945+0000 7f071d32b700 1 --2- 172.21.15.107:0/2541402384 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07181020a0 0x7f0718102480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:23.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.945+0000 7f071d32b700 1 --2- 172.21.15.107:0/2541402384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0718102a50 0x7f0718106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:23.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.945+0000 7f071d32b700 1 -- 172.21.15.107:0/2541402384 >> 172.21.15.107:0/2541402384 conn(0x7f07180776c0 msgr2=0x7f0718077ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:01:23.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.945+0000 7f071d32b700 1 -- 172.21.15.107:0/2541402384 shutdown_connections 2024-05-10T11:01:23.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.945+0000 7f071d32b700 1 -- 172.21.15.107:0/2541402384 wait complete. 2024-05-10T11:01:23.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.945+0000 7f071d32b700 1 Processor -- start 2024-05-10T11:01:23.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.946+0000 7f071d32b700 1 -- start start 2024-05-10T11:01:23.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.946+0000 7f071d32b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07181020a0 0x7f0718103840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:23.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.946+0000 7f071d32b700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0718102a50 0x7f0718103d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:23.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.946+0000 7f071d32b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0718106f40 0x7f07181042c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:23.948 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.946+0000 7f071d32b700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0718111630 con 0x7f0718106f40 2024-05-10T11:01:23.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.946+0000 7f071d32b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f07181114b0 con 0x7f07181020a0 2024-05-10T11:01:23.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.946+0000 7f071d32b700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f07181117b0 con 0x7f0718102a50 2024-05-10T11:01:23.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.946+0000 7f07177fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0718106f40 0x7f07181042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:23.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.946+0000 7f07177fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0718106f40 0x7f07181042c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:49396/0 (socket says 172.21.15.107:49396) 2024-05-10T11:01:23.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.946+0000 7f07177fe700 1 -- 172.21.15.107:0/3459748736 learned_addr learned my addr 172.21.15.107:0/3459748736 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:01:23.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.946+0000 7f0716ffd700 1 --2- 172.21.15.107:0/3459748736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07181020a0 0x7f0718103840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:23.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.946+0000 7f07167fc700 1 --2- 172.21.15.107:0/3459748736 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0718102a50 0x7f0718103d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:23.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.946+0000 7f07177fe700 1 -- 172.21.15.107:0/3459748736 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0718102a50 msgr2=0x7f0718103d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:23.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.946+0000 7f07177fe700 1 --2- 172.21.15.107:0/3459748736 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0718102a50 0x7f0718103d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:23.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.946+0000 7f07177fe700 1 -- 172.21.15.107:0/3459748736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07181020a0 msgr2=0x7f0718103840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:23.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.946+0000 7f07177fe700 1 --2- 172.21.15.107:0/3459748736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07181020a0 0x7f0718103840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:23.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.946+0000 7f07177fe700 1 -- 172.21.15.107:0/3459748736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07181a80f0 con 0x7f0718106f40 2024-05-10T11:01:23.949 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.947+0000 7f07177fe700 1 --2- 172.21.15.107:0/3459748736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0718106f40 0x7f07181042c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f071000a040 tx=0x7f071000a380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:01:23.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.947+0000 7f06fffff700 1 -- 172.21.15.107:0/3459748736 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0710022070 con 0x7f0718106f40 2024-05-10T11:01:23.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.947+0000 7f071d32b700 1 -- 172.21.15.107:0/3459748736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07181a8380 con 0x7f0718106f40 2024-05-10T11:01:23.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.947+0000 7f06fffff700 1 -- 172.21.15.107:0/3459748736 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0710007970 con 0x7f0718106f40 2024-05-10T11:01:23.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.947+0000 7f06fffff700 1 -- 172.21.15.107:0/3459748736 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071001e8b0 con 0x7f0718106f40 2024-05-10T11:01:23.950 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.947+0000 7f071d32b700 1 -- 172.21.15.107:0/3459748736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07181a8830 con 0x7f0718106f40 2024-05-10T11:01:23.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.948+0000 7f071d32b700 1 -- 172.21.15.107:0/3459748736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f071806a190 con 0x7f0718106f40 2024-05-10T11:01:23.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.949+0000 7f06fffff700 1 -- 172.21.15.107:0/3459748736 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f0710025070 con 0x7f0718106f40 2024-05-10T11:01:23.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.950+0000 7f06fffff700 1 --2- 172.21.15.107:0/3459748736 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f07000b2880 0x7f07000b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:23.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.950+0000 7f0716ffd700 1 --2- 172.21.15.107:0/3459748736 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f07000b2880 0x7f07000b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:23.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.950+0000 7f06fffff700 1 -- 172.21.15.107:0/3459748736 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f0710010020 con 0x7f0718106f40 2024-05-10T11:01:23.951 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.950+0000 7f0716ffd700 1 --2- 172.21.15.107:0/3459748736 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f07000b2880 0x7f07000b4d40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0708005950 tx=0x7f070800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:01:23.953 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:23.953+0000 7f06fffff700 1 -- 172.21.15.107:0/3459748736 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f071002c020 con 0x7f0718106f40 2024-05-10T11:01:24.203 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:24.203+0000 7f071d32b700 1 -- 172.21.15.107:0/3459748736 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f071802e6d0 con 0x7f0718106f40 2024-05-10T11:01:24.204 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:24.204+0000 7f06fffff700 1 -- 172.21.15.107:0/3459748736 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11980 (secure 0 0 0) 0x7f07100abbc0 con 0x7f0718106f40 2024-05-10T11:01:24.204 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T11:01:24.204 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T10:52:17.367732+0000","modified":"2024-05-10T11:00:24.832630+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24482,"mds_1":24449,"mds_2":24442,"mds_3":24431,"mds_4":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/2332963094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":2332963094},{"type":"v1","addr":"172.21.15.107:6841","nonce":2332963094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[0,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.184:6839/16501252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":16501252},{"type":"v1","addr":"172.21.15.184:6839","nonce":16501252}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24442,24449,24482,24430,24431]},"id":1}]} 2024-05-10T11:01:24.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:24.206+0000 7f071d32b700 1 -- 172.21.15.107:0/3459748736 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f07000b2880 msgr2=0x7f07000b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:24.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:24.206+0000 7f071d32b700 1 --2- 172.21.15.107:0/3459748736 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f07000b2880 0x7f07000b4d40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0708005950 tx=0x7f070800a300 comp rx=0 tx=0).stop 2024-05-10T11:01:24.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:24.206+0000 7f071d32b700 1 -- 172.21.15.107:0/3459748736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0718106f40 msgr2=0x7f07181042c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:24.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:24.206+0000 7f071d32b700 1 --2- 172.21.15.107:0/3459748736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0718106f40 0x7f07181042c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f071000a040 tx=0x7f071000a380 comp rx=0 tx=0).stop 2024-05-10T11:01:24.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:24.206+0000 7f071d32b700 1 -- 172.21.15.107:0/3459748736 shutdown_connections 2024-05-10T11:01:24.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:24.206+0000 7f071d32b700 1 --2- 172.21.15.107:0/3459748736 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f07000b2880 0x7f07000b4d40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:24.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:24.206+0000 7f071d32b700 1 --2- 172.21.15.107:0/3459748736 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0718106f40 0x7f07181042c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:24.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:24.206+0000 7f071d32b700 1 --2- 172.21.15.107:0/3459748736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07181020a0 0x7f0718103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:24.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:24.206+0000 7f071d32b700 1 --2- 172.21.15.107:0/3459748736 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0718102a50 0x7f0718103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:24.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:24.206+0000 7f071d32b700 1 -- 172.21.15.107:0/3459748736 >> 172.21.15.107:0/3459748736 conn(0x7f07180776c0 msgr2=0x7f0718101140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:01:24.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:24.206+0000 7f071d32b700 1 -- 172.21.15.107:0/3459748736 shutdown_connections 2024-05-10T11:01:24.207 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:24.206+0000 7f071d32b700 1 -- 172.21.15.107:0/3459748736 wait complete. 2024-05-10T11:01:24.208 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 36 2024-05-10T11:01:25.138 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:24 smithi184 ceph-mon[34585]: pgmap v560: 97 pgs: 97 active+clean; 76 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-10T11:01:25.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:24 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3459748736' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T11:01:25.146 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:24 smithi107 ceph-mon[30373]: pgmap v560: 97 pgs: 97 active+clean; 76 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-10T11:01:25.146 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:24 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3459748736' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T11:01:25.181 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-10T11:01:25.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:24 smithi196 ceph-mon[34872]: pgmap v560: 97 pgs: 97 active+clean; 76 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-05-10T11:01:25.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:24 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3459748736' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T11:01:25.433 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T11:01:27.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.060+0000 7ff557889700 1 -- 172.21.15.107:0/2387647704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff550102d50 msgr2=0x7ff55010f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:27.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.060+0000 7ff557889700 1 --2- 172.21.15.107:0/2387647704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff550102d50 0x7ff55010f240 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff548009990 tx=0x7ff548009ca0 comp rx=0 tx=0).stop 2024-05-10T11:01:27.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.060+0000 7ff557889700 1 -- 172.21.15.107:0/2387647704 shutdown_connections 2024-05-10T11:01:27.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.060+0000 7ff557889700 1 --2- 172.21.15.107:0/2387647704 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff550102d50 0x7ff55010f240 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:27.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.060+0000 7ff557889700 1 --2- 172.21.15.107:0/2387647704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff550108400 0x7ff5501087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:27.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.060+0000 7ff557889700 1 --2- 172.21.15.107:0/2387647704 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff550102390 0x7ff550102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:27.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.060+0000 7ff557889700 1 -- 172.21.15.107:0/2387647704 >> 172.21.15.107:0/2387647704 conn(0x7ff550079310 msgr2=0x7ff550079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:01:27.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.060+0000 7ff557889700 1 -- 172.21.15.107:0/2387647704 shutdown_connections 2024-05-10T11:01:27.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.060+0000 7ff557889700 1 -- 172.21.15.107:0/2387647704 wait complete. 2024-05-10T11:01:27.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.061+0000 7ff557889700 1 Processor -- start 2024-05-10T11:01:27.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.061+0000 7ff557889700 1 -- start start 2024-05-10T11:01:27.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.061+0000 7ff557889700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff550102390 0x7ff55019e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:27.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.061+0000 7ff557889700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff550102d50 0x7ff55019eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:27.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.061+0000 7ff557889700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff550108400 0x7ff550198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:27.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.061+0000 7ff557889700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff550112760 con 0x7ff550102d50 2024-05-10T11:01:27.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.061+0000 7ff557889700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff5501125e0 con 0x7ff550108400 2024-05-10T11:01:27.065 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.061+0000 7ff557889700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7ff5501128e0 con 0x7ff550102390 2024-05-10T11:01:27.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.061+0000 7ff554e24700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff550102d50 0x7ff55019eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:27.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.061+0000 7ff554e24700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff550102d50 0x7ff55019eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58034/0 (socket says 172.21.15.107:58034) 2024-05-10T11:01:27.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.061+0000 7ff554e24700 1 -- 172.21.15.107:0/767709908 learned_addr learned my addr 172.21.15.107:0/767709908 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:01:27.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.061+0000 7ff555e26700 1 --2- 172.21.15.107:0/767709908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff550108400 0x7ff550198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:27.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.061+0000 7ff555625700 1 --2- 172.21.15.107:0/767709908 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff550102390 0x7ff55019e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:27.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.061+0000 7ff554e24700 1 -- 172.21.15.107:0/767709908 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff550102390 msgr2=0x7ff55019e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:27.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.061+0000 7ff554e24700 1 --2- 172.21.15.107:0/767709908 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff550102390 0x7ff55019e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:27.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.061+0000 7ff554e24700 1 -- 172.21.15.107:0/767709908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff550108400 msgr2=0x7ff550198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:27.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.061+0000 7ff554e24700 1 --2- 172.21.15.107:0/767709908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff550108400 0x7ff550198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:27.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.061+0000 7ff554e24700 1 -- 172.21.15.107:0/767709908 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff550199180 con 0x7ff550102d50 2024-05-10T11:01:27.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.062+0000 7ff554e24700 1 --2- 172.21.15.107:0/767709908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff550102d50 0x7ff55019eda0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff54000b530 tx=0x7ff54000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:01:27.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.062+0000 7ff5467fc700 1 -- 172.21.15.107:0/767709908 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540015020 con 0x7ff550102d50 2024-05-10T11:01:27.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.062+0000 7ff557889700 1 -- 172.21.15.107:0/767709908 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff550199470 con 0x7ff550102d50 2024-05-10T11:01:27.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.062+0000 7ff5467fc700 1 -- 172.21.15.107:0/767709908 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff540011d00 con 0x7ff550102d50 2024-05-10T11:01:27.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.062+0000 7ff5467fc700 1 -- 172.21.15.107:0/767709908 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540010e40 con 0x7ff550102d50 2024-05-10T11:01:27.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.062+0000 7ff557889700 1 -- 172.21.15.107:0/767709908 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5501a5730 con 0x7ff550102d50 2024-05-10T11:01:27.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.063+0000 7ff557889700 1 -- 172.21.15.107:0/767709908 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff55006a190 con 0x7ff550102d50 2024-05-10T11:01:27.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.064+0000 7ff5467fc700 1 -- 172.21.15.107:0/767709908 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7ff540018020 con 0x7ff550102d50 2024-05-10T11:01:27.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.065+0000 7ff5467fc700 1 --2- 172.21.15.107:0/767709908 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff53c0b2880 0x7ff53c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:27.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.065+0000 7ff555625700 1 --2- 172.21.15.107:0/767709908 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff53c0b2880 0x7ff53c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:27.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.065+0000 7ff5467fc700 1 -- 172.21.15.107:0/767709908 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7ff5400e1e50 con 0x7ff550102d50 2024-05-10T11:01:27.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.065+0000 7ff555625700 1 --2- 172.21.15.107:0/767709908 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff53c0b2880 0x7ff53c0b4d40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff550199b60 tx=0x7ff54c00d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:01:27.068 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.068+0000 7ff5467fc700 1 -- 172.21.15.107:0/767709908 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff54001f020 con 0x7ff550102d50 2024-05-10T11:01:27.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:26 smithi184 ceph-mon[34585]: pgmap v561: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-05-10T11:01:27.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:26 smithi107 ceph-mon[30373]: pgmap v561: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-05-10T11:01:27.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:26 smithi196 ceph-mon[34872]: pgmap v561: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-05-10T11:01:27.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.315+0000 7ff557889700 1 -- 172.21.15.107:0/767709908 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff550199f50 con 0x7ff550102d50 2024-05-10T11:01:27.316 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.316+0000 7ff5467fc700 1 -- 172.21.15.107:0/767709908 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11980 (secure 0 0 0) 0x7ff550199f50 con 0x7ff550102d50 2024-05-10T11:01:27.317 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T11:01:27.317 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6835/3020825331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3020825331},{"type":"v1","addr":"172.21.15.107:6835","nonce":3020825331}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/1680863375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6836","nonce":1680863375},{"type":"v1","addr":"172.21.15.107:6837","nonce":1680863375}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-10T10:52:17.367732+0000","modified":"2024-05-10T11:00:24.832630+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24482,"mds_1":24449,"mds_2":24442,"mds_3":24431,"mds_4":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14592":{"gid":14592,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6839/1923447762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1923447762},{"type":"v1","addr":"172.21.15.107:6839","nonce":1923447762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14604":{"gid":14604,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.107:6841/2332963094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6840","nonce":2332963094},{"type":"v1","addr":"172.21.15.107:6841","nonce":2332963094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6833/2603001203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":2603001203},{"type":"v1","addr":"172.21.15.196:6833","nonce":2603001203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24404":{"gid":24404,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/3101071828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3101071828},{"type":"v1","addr":"172.21.15.184:6833","nonce":3101071828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.196:6835/3609693196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3609693196},{"type":"v1","addr":"172.21.15.196:6835","nonce":3609693196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.196:6837/3628757645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":3628757645},{"type":"v1","addr":"172.21.15.196:6837","nonce":3628757645}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":15,"addr":"172.21.15.184:6835/872203477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":872203477},{"type":"v1","addr":"172.21.15.184:6835","nonce":872203477}]},"join_fscid":-1,"export_targets":[0,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":12,"addr":"172.21.15.196:6839/4142119667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6838","nonce":4142119667},{"type":"v1","addr":"172.21.15.196:6839","nonce":4142119667}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":12,"addr":"172.21.15.184:6837/4239260328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":4239260328},{"type":"v1","addr":"172.21.15.184:6837","nonce":4239260328}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.184:6839/16501252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":16501252},{"type":"v1","addr":"172.21.15.184:6839","nonce":16501252}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24482,"qdb_cluster":[24442,24449,24482,24430,24431]},"id":1}]} 2024-05-10T11:01:27.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.318+0000 7ff557889700 1 -- 172.21.15.107:0/767709908 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff53c0b2880 msgr2=0x7ff53c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:27.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.318+0000 7ff557889700 1 --2- 172.21.15.107:0/767709908 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff53c0b2880 0x7ff53c0b4d40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff550199b60 tx=0x7ff54c00d040 comp rx=0 tx=0).stop 2024-05-10T11:01:27.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.318+0000 7ff557889700 1 -- 172.21.15.107:0/767709908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff550102d50 msgr2=0x7ff55019eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:27.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.318+0000 7ff557889700 1 --2- 172.21.15.107:0/767709908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff550102d50 0x7ff55019eda0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff54000b530 tx=0x7ff54000b840 comp rx=0 tx=0).stop 2024-05-10T11:01:27.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.318+0000 7ff557889700 1 -- 172.21.15.107:0/767709908 shutdown_connections 2024-05-10T11:01:27.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.318+0000 7ff557889700 1 --2- 172.21.15.107:0/767709908 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7ff53c0b2880 0x7ff53c0b4d40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:27.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.318+0000 7ff557889700 1 --2- 172.21.15.107:0/767709908 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff550102390 0x7ff55019e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:27.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.318+0000 7ff557889700 1 --2- 172.21.15.107:0/767709908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff550108400 0x7ff550198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:27.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.318+0000 7ff557889700 1 --2- 172.21.15.107:0/767709908 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff550102d50 0x7ff55019eda0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:27.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.318+0000 7ff557889700 1 -- 172.21.15.107:0/767709908 >> 172.21.15.107:0/767709908 conn(0x7ff550079310 msgr2=0x7ff550100fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:01:27.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.318+0000 7ff557889700 1 -- 172.21.15.107:0/767709908 shutdown_connections 2024-05-10T11:01:27.320 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:27.318+0000 7ff557889700 1 -- 172.21.15.107:0/767709908 wait complete. 2024-05-10T11:01:27.321 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 36 2024-05-10T11:01:28.029 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:27 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/767709908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T11:01:28.056 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-10T11:01:28.138 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:27 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/767709908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T11:01:28.296 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T11:01:28.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:27 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/767709908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-10T11:01:29.138 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:28 smithi184 ceph-mon[34585]: pgmap v562: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-10T11:01:29.143 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:28 smithi107 ceph-mon[30373]: pgmap v562: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-10T11:01:29.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:28 smithi196 ceph-mon[34872]: pgmap v562: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-10T11:01:30.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.026+0000 7f3296fb3700 1 -- 172.21.15.107:0/2310172005 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32901076c0 msgr2=0x7f329010f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:30.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.026+0000 7f3296fb3700 1 --2- 172.21.15.107:0/2310172005 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32901076c0 0x7f329010f290 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f328800b0d0 tx=0x7f328800b3e0 comp rx=0 tx=0).stop 2024-05-10T11:01:30.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.026+0000 7f3296fb3700 1 -- 172.21.15.107:0/2310172005 shutdown_connections 2024-05-10T11:01:30.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.026+0000 7f3296fb3700 1 --2- 172.21.15.107:0/2310172005 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32901076c0 0x7f329010f290 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:30.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.026+0000 7f3296fb3700 1 --2- 172.21.15.107:0/2310172005 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3290102630 0x7f3290102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:30.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.026+0000 7f3296fb3700 1 --2- 172.21.15.107:0/2310172005 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3290102fe0 0x7f3290106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:30.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.026+0000 7f3296fb3700 1 -- 172.21.15.107:0/2310172005 >> 172.21.15.107:0/2310172005 conn(0x7f3290079350 msgr2=0x7f3290079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:01:30.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.027+0000 7f3296fb3700 1 -- 172.21.15.107:0/2310172005 shutdown_connections 2024-05-10T11:01:30.029 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.027+0000 7f3296fb3700 1 -- 172.21.15.107:0/2310172005 wait complete. 2024-05-10T11:01:30.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.027+0000 7f3296fb3700 1 Processor -- start 2024-05-10T11:01:30.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.027+0000 7f3296fb3700 1 -- start start 2024-05-10T11:01:30.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.027+0000 7f3296fb3700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3290102630 0x7f329019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:30.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.027+0000 7f3296fb3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3290102fe0 0x7f329019b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:30.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.027+0000 7f3296fb3700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32901076c0 0x7f32901a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:30.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.027+0000 7f3296fb3700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3290112790 con 0x7f32901076c0 2024-05-10T11:01:30.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.027+0000 7f3296fb3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3290112610 con 0x7f3290102fe0 2024-05-10T11:01:30.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.027+0000 7f3296fb3700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f3290112910 con 0x7f3290102630 2024-05-10T11:01:30.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.028+0000 7f3295550700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32901076c0 0x7f32901a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:30.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.028+0000 7f3295550700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32901076c0 0x7f32901a5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58058/0 (socket says 172.21.15.107:58058) 2024-05-10T11:01:30.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.028+0000 7f3295550700 1 -- 172.21.15.107:0/4025959872 learned_addr learned my addr 172.21.15.107:0/4025959872 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:01:30.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.028+0000 7f328ffff700 1 --2- 172.21.15.107:0/4025959872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3290102fe0 0x7f329019b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:30.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.028+0000 7f3294d4f700 1 --2- 172.21.15.107:0/4025959872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3290102630 0x7f329019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:30.030 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.028+0000 7f3295550700 1 -- 172.21.15.107:0/4025959872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3290102630 msgr2=0x7f329019abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:30.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.028+0000 7f3295550700 1 --2- 172.21.15.107:0/4025959872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3290102630 0x7f329019abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:30.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.028+0000 7f3295550700 1 -- 172.21.15.107:0/4025959872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3290102fe0 msgr2=0x7f329019b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:30.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.028+0000 7f3295550700 1 --2- 172.21.15.107:0/4025959872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3290102fe0 0x7f329019b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:30.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.028+0000 7f3295550700 1 -- 172.21.15.107:0/4025959872 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32901a61b0 con 0x7f32901076c0 2024-05-10T11:01:30.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.028+0000 7f328ffff700 1 --2- 172.21.15.107:0/4025959872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3290102fe0 0x7f329019b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:01:30.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.028+0000 7f3295550700 1 --2- 172.21.15.107:0/4025959872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32901076c0 0x7f32901a5c70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3288007a20 tx=0x7f3288007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:01:30.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.028+0000 7f328dffb700 1 -- 172.21.15.107:0/4025959872 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288021070 con 0x7f32901076c0 2024-05-10T11:01:30.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.028+0000 7f3296fb3700 1 -- 172.21.15.107:0/4025959872 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32901a6380 con 0x7f32901076c0 2024-05-10T11:01:30.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.028+0000 7f328dffb700 1 -- 172.21.15.107:0/4025959872 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3288007e10 con 0x7f32901076c0 2024-05-10T11:01:30.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.028+0000 7f328dffb700 1 -- 172.21.15.107:0/4025959872 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328801bd30 con 0x7f32901076c0 2024-05-10T11:01:30.031 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.029+0000 7f3296fb3700 1 -- 172.21.15.107:0/4025959872 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32901a6830 con 0x7f32901076c0 2024-05-10T11:01:30.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.029+0000 7f3296fb3700 1 -- 172.21.15.107:0/4025959872 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f329006a190 con 0x7f32901076c0 2024-05-10T11:01:30.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.031+0000 7f328dffb700 1 -- 172.21.15.107:0/4025959872 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f3288024070 con 0x7f32901076c0 2024-05-10T11:01:30.032 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.032+0000 7f328dffb700 1 --2- 172.21.15.107:0/4025959872 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f32800b2880 0x7f32800b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:30.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.032+0000 7f3294d4f700 1 --2- 172.21.15.107:0/4025959872 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f32800b2880 0x7f32800b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:30.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.032+0000 7f328dffb700 1 -- 172.21.15.107:0/4025959872 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f328800f020 con 0x7f32901076c0 2024-05-10T11:01:30.033 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.032+0000 7f3294d4f700 1 --2- 172.21.15.107:0/4025959872 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f32800b2880 0x7f32800b4d40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3284006fd0 tx=0x7f3284008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:01:30.036 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.035+0000 7f328dffb700 1 -- 172.21.15.107:0/4025959872 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f328802b020 con 0x7f32901076c0 2024-05-10T11:01:30.241 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.240+0000 7f3296fb3700 1 -- 172.21.15.107:0/4025959872 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f329002e510 con 0x7f32901076c0 2024-05-10T11:01:30.242 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.242+0000 7f328dffb700 1 -- 172.21.15.107:0/4025959872 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22560 (secure 0 0 0) 0x7f32880abc40 con 0x7f32901076c0 2024-05-10T11:01:30.243 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-10T11:01:30.243 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":82,"fsid":"0ba8a8e4-0eba-11ef-bc98-c7b262605968","created":"2024-05-10T10:44:13.064379+0000","modified":"2024-05-10T10:53:08.899432+0000","last_up_change":"2024-05-10T10:51:12.979718+0000","last_in_change":"2024-05-10T10:50:53.297651+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T10:47:31.600062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T10:52:10.705022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T10:52:14.377732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"503f960c-a74b-4979-9bf9-42c90a2885a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6803","nonce":4213004004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6805","nonce":4213004004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6809","nonce":4213004004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":4213004004},{"type":"v1","addr":"172.21.15.107:6807","nonce":4213004004}]},"public_addr":"172.21.15.107:6803/4213004004","cluster_addr":"172.21.15.107:6805/4213004004","heartbeat_back_addr":"172.21.15.107:6809/4213004004","heartbeat_front_addr":"172.21.15.107:6807/4213004004","state":["exists","up"]},{"osd":1,"uuid":"f0f89167-1aa1-40a1-b122-c7f203c587d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6801","nonce":3242825160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6803","nonce":3242825160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6807","nonce":3242825160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3242825160},{"type":"v1","addr":"172.21.15.184:6805","nonce":3242825160}]},"public_addr":"172.21.15.184:6801/3242825160","cluster_addr":"172.21.15.184:6803/3242825160","heartbeat_back_addr":"172.21.15.184:6807/3242825160","heartbeat_front_addr":"172.21.15.184:6805/3242825160","state":["exists","up"]},{"osd":2,"uuid":"7588b9be-b935-450a-944f-3feca69c029c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6801","nonce":137473043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6803","nonce":137473043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6807","nonce":137473043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":137473043},{"type":"v1","addr":"172.21.15.196:6805","nonce":137473043}]},"public_addr":"172.21.15.196:6801/137473043","cluster_addr":"172.21.15.196:6803/137473043","heartbeat_back_addr":"172.21.15.196:6807/137473043","heartbeat_front_addr":"172.21.15.196:6805/137473043","state":["exists","up"]},{"osd":3,"uuid":"589ec3bb-884a-4441-a9d2-1f34ab372cc4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6811","nonce":1995642021}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6813","nonce":1995642021}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6817","nonce":1995642021}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1995642021},{"type":"v1","addr":"172.21.15.107:6815","nonce":1995642021}]},"public_addr":"172.21.15.107:6811/1995642021","cluster_addr":"172.21.15.107:6813/1995642021","heartbeat_back_addr":"172.21.15.107:6817/1995642021","heartbeat_front_addr":"172.21.15.107:6815/1995642021","state":["exists","up"]},{"osd":4,"uuid":"b72cdb50-492b-4406-8f21-37e4b2cf5a89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6809","nonce":271550329}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6811","nonce":271550329}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6815","nonce":271550329}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":271550329},{"type":"v1","addr":"172.21.15.184:6813","nonce":271550329}]},"public_addr":"172.21.15.184:6809/271550329","cluster_addr":"172.21.15.184:6811/271550329","heartbeat_back_addr":"172.21.15.184:6815/271550329","heartbeat_front_addr":"172.21.15.184:6813/271550329","state":["exists","up"]},{"osd":5,"uuid":"05b6ad82-9153-44df-ae64-50c82d304429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6809","nonce":3681130435}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6811","nonce":3681130435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6815","nonce":3681130435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":3681130435},{"type":"v1","addr":"172.21.15.196:6813","nonce":3681130435}]},"public_addr":"172.21.15.196:6809/3681130435","cluster_addr":"172.21.15.196:6811/3681130435","heartbeat_back_addr":"172.21.15.196:6815/3681130435","heartbeat_front_addr":"172.21.15.196:6813/3681130435","state":["exists","up"]},{"osd":6,"uuid":"bceadd7a-20bf-4482-aaab-46a2539cf37c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6819","nonce":4223253757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6821","nonce":4223253757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6825","nonce":4223253757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":4223253757},{"type":"v1","addr":"172.21.15.107:6823","nonce":4223253757}]},"public_addr":"172.21.15.107:6819/4223253757","cluster_addr":"172.21.15.107:6821/4223253757","heartbeat_back_addr":"172.21.15.107:6825/4223253757","heartbeat_front_addr":"172.21.15.107:6823/4223253757","state":["exists","up"]},{"osd":7,"uuid":"0d9243a6-0e16-4677-a0b0-010be4162148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6817","nonce":2850715284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6819","nonce":2850715284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6823","nonce":2850715284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2850715284},{"type":"v1","addr":"172.21.15.184:6821","nonce":2850715284}]},"public_addr":"172.21.15.184:6817/2850715284","cluster_addr":"172.21.15.184:6819/2850715284","heartbeat_back_addr":"172.21.15.184:6823/2850715284","heartbeat_front_addr":"172.21.15.184:6821/2850715284","state":["exists","up"]},{"osd":8,"uuid":"24bb8ef3-f56c-4488-b3e4-ed2d12a8c5ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6817","nonce":504426486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6819","nonce":504426486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6823","nonce":504426486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":504426486},{"type":"v1","addr":"172.21.15.196:6821","nonce":504426486}]},"public_addr":"172.21.15.196:6817/504426486","cluster_addr":"172.21.15.196:6819/504426486","heartbeat_back_addr":"172.21.15.196:6823/504426486","heartbeat_front_addr":"172.21.15.196:6821/504426486","state":["exists","up"]},{"osd":9,"uuid":"8bcb03ec-1342-4679-9343-fcefd28dd69b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6827","nonce":1533051760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6829","nonce":1533051760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6833","nonce":1533051760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1533051760},{"type":"v1","addr":"172.21.15.107:6831","nonce":1533051760}]},"public_addr":"172.21.15.107:6827/1533051760","cluster_addr":"172.21.15.107:6829/1533051760","heartbeat_back_addr":"172.21.15.107:6833/1533051760","heartbeat_front_addr":"172.21.15.107:6831/1533051760","state":["exists","up"]},{"osd":10,"uuid":"78374015-aa7f-4288-b5ae-be64a5182bf0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6825","nonce":1387541139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6827","nonce":1387541139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6831","nonce":1387541139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":1387541139},{"type":"v1","addr":"172.21.15.184:6829","nonce":1387541139}]},"public_addr":"172.21.15.184:6825/1387541139","cluster_addr":"172.21.15.184:6827/1387541139","heartbeat_back_addr":"172.21.15.184:6831/1387541139","heartbeat_front_addr":"172.21.15.184:6829/1387541139","state":["exists","up"]},{"osd":11,"uuid":"4aeb2b1a-f35e-44ea-be64-f60c31a096e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6825","nonce":3861964533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6827","nonce":3861964533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6831","nonce":3861964533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":3861964533},{"type":"v1","addr":"172.21.15.196:6829","nonce":3861964533}]},"public_addr":"172.21.15.196:6825/3861964533","cluster_addr":"172.21.15.196:6827/3861964533","heartbeat_back_addr":"172.21.15.196:6831/3861964533","heartbeat_front_addr":"172.21.15.196:6829/3861964533","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:46:42.110232+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:06.232727+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:29.623425+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:47:53.466546+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:17.927564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:48:41.913454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:06.610629+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:31.048807+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:49:54.922097+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:20.727547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:50:46.072303+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T10:51:11.022775+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.107:0/3518338734":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/4092342993":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6800/892499090":"2024-05-11T10:45:07.518714+0000","172.21.15.107:6801/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:6800/1956906497":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3761740075":"2024-05-11T10:45:07.518714+0000","172.21.15.107:0/2215024983":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/2124974715":"2024-05-11T10:44:40.339608+0000","172.21.15.107:0/3361930986":"2024-05-11T10:44:40.339608+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T11:01:30.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.244+0000 7f3296fb3700 1 -- 172.21.15.107:0/4025959872 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f32800b2880 msgr2=0x7f32800b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:30.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.244+0000 7f3296fb3700 1 --2- 172.21.15.107:0/4025959872 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f32800b2880 0x7f32800b4d40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3284006fd0 tx=0x7f3284008040 comp rx=0 tx=0).stop 2024-05-10T11:01:30.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.244+0000 7f3296fb3700 1 -- 172.21.15.107:0/4025959872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32901076c0 msgr2=0x7f32901a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:30.245 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.244+0000 7f3296fb3700 1 --2- 172.21.15.107:0/4025959872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32901076c0 0x7f32901a5c70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3288007a20 tx=0x7f3288007b00 comp rx=0 tx=0).stop 2024-05-10T11:01:30.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.244+0000 7f3296fb3700 1 -- 172.21.15.107:0/4025959872 shutdown_connections 2024-05-10T11:01:30.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.244+0000 7f3296fb3700 1 --2- 172.21.15.107:0/4025959872 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f32800b2880 0x7f32800b4d40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:30.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.244+0000 7f3296fb3700 1 --2- 172.21.15.107:0/4025959872 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3290102630 0x7f329019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:30.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.244+0000 7f3296fb3700 1 --2- 172.21.15.107:0/4025959872 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32901076c0 0x7f32901a5c70 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:30.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.244+0000 7f3296fb3700 1 --2- 172.21.15.107:0/4025959872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3290102fe0 0x7f329019b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:30.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.244+0000 7f3296fb3700 1 -- 172.21.15.107:0/4025959872 >> 172.21.15.107:0/4025959872 conn(0x7f3290079350 msgr2=0x7f3290106300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:01:30.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.245+0000 7f3296fb3700 1 -- 172.21.15.107:0/4025959872 shutdown_connections 2024-05-10T11:01:30.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:30.245+0000 7f3296fb3700 1 -- 172.21.15.107:0/4025959872 wait complete. 2024-05-10T11:01:30.918 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:30 smithi107 ceph-mon[30373]: pgmap v563: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-10T11:01:30.919 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:30 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/4025959872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T11:01:30.948 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs fail cephfs 2024-05-10T11:01:31.138 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:30 smithi184 ceph-mon[34585]: pgmap v563: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-10T11:01:31.138 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:30 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/4025959872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T11:01:31.193 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T11:01:31.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:30 smithi196 ceph-mon[34872]: pgmap v563: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-10T11:01:31.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:30 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/4025959872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-10T11:01:32.887 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:32 smithi107 ceph-mon[30373]: pgmap v564: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-10T11:01:32.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.891+0000 7f1111a94700 1 -- 172.21.15.107:0/1573965000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f110c1023d0 msgr2=0x7f110c110360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:32.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.891+0000 7f1111a94700 1 --2- 172.21.15.107:0/1573965000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f110c1023d0 0x7f110c110360 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f110400b0d0 tx=0x7f110400b3e0 comp rx=0 tx=0).stop 2024-05-10T11:01:32.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.891+0000 7f1111a94700 1 -- 172.21.15.107:0/1573965000 shutdown_connections 2024-05-10T11:01:32.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.891+0000 7f1111a94700 1 --2- 172.21.15.107:0/1573965000 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f110c109590 0x7f110c109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:32.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.891+0000 7f1111a94700 1 --2- 172.21.15.107:0/1573965000 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f110c1023d0 0x7f110c110360 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:32.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.891+0000 7f1111a94700 1 --2- 172.21.15.107:0/1573965000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f110c101a10 0x7f110c101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:32.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.891+0000 7f1111a94700 1 -- 172.21.15.107:0/1573965000 >> 172.21.15.107:0/1573965000 conn(0x7f110c0789a0 msgr2=0x7f110c0ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:01:32.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.891+0000 7f1111a94700 1 -- 172.21.15.107:0/1573965000 shutdown_connections 2024-05-10T11:01:32.891 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.891+0000 7f1111a94700 1 -- 172.21.15.107:0/1573965000 wait complete. 2024-05-10T11:01:32.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.891+0000 7f1111a94700 1 Processor -- start 2024-05-10T11:01:32.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.892+0000 7f1111a94700 1 -- start start 2024-05-10T11:01:32.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.892+0000 7f1111a94700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f110c101a10 0x7f110c19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:32.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.892+0000 7f1111a94700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f110c1023d0 0x7f110c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:32.893 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.892+0000 7f1111a94700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f110c109590 0x7f110c1999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:32.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.892+0000 7f1111a94700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f110c113840 con 0x7f110c101a10 2024-05-10T11:01:32.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.892+0000 7f1111a94700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f110c1136c0 con 0x7f110c1023d0 2024-05-10T11:01:32.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.892+0000 7f1111a94700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f110c1139c0 con 0x7f110c109590 2024-05-10T11:01:32.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.892+0000 7f110b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f110c101a10 0x7f110c19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:32.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.892+0000 7f110b7fe700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f110c101a10 0x7f110c19f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58080/0 (socket says 172.21.15.107:58080) 2024-05-10T11:01:32.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.892+0000 7f110b7fe700 1 -- 172.21.15.107:0/3467382174 learned_addr learned my addr 172.21.15.107:0/3467382174 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:01:32.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.892+0000 7f110affd700 1 --2- 172.21.15.107:0/3467382174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f110c1023d0 0x7f110c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:32.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.892+0000 7f110bfff700 1 --2- 172.21.15.107:0/3467382174 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f110c109590 0x7f110c1999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:32.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.892+0000 7f110b7fe700 1 -- 172.21.15.107:0/3467382174 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f110c109590 msgr2=0x7f110c1999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:32.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.892+0000 7f110b7fe700 1 --2- 172.21.15.107:0/3467382174 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f110c109590 0x7f110c1999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:32.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.892+0000 7f110b7fe700 1 -- 172.21.15.107:0/3467382174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f110c1023d0 msgr2=0x7f110c19fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:32.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.892+0000 7f110b7fe700 1 --2- 172.21.15.107:0/3467382174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f110c1023d0 0x7f110c19fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:32.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.892+0000 7f110b7fe700 1 -- 172.21.15.107:0/3467382174 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110c19a120 con 0x7f110c101a10 2024-05-10T11:01:32.894 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.892+0000 7f110b7fe700 1 --2- 172.21.15.107:0/3467382174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f110c101a10 0x7f110c19f800 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f110000b530 tx=0x7f110000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:01:32.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.892+0000 7f1108ff9700 1 -- 172.21.15.107:0/3467382174 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100015020 con 0x7f110c101a10 2024-05-10T11:01:32.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.893+0000 7f1108ff9700 1 -- 172.21.15.107:0/3467382174 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1100011d00 con 0x7f110c101a10 2024-05-10T11:01:32.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.893+0000 7f1111a94700 1 -- 172.21.15.107:0/3467382174 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f110c19a410 con 0x7f110c101a10 2024-05-10T11:01:32.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.893+0000 7f1108ff9700 1 -- 172.21.15.107:0/3467382174 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110000f2e0 con 0x7f110c101a10 2024-05-10T11:01:32.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.893+0000 7f1111a94700 1 -- 172.21.15.107:0/3467382174 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f110c102b20 con 0x7f110c101a10 2024-05-10T11:01:32.895 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.893+0000 7f1111a94700 1 -- 172.21.15.107:0/3467382174 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f110c19aef0 con 0x7f110c101a10 2024-05-10T11:01:32.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.895+0000 7f1108ff9700 1 -- 172.21.15.107:0/3467382174 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f1100018020 con 0x7f110c101a10 2024-05-10T11:01:32.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.895+0000 7f1108ff9700 1 --2- 172.21.15.107:0/3467382174 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f10f40b6c90 0x7f10f40b9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:32.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.896+0000 7f110affd700 1 --2- 172.21.15.107:0/3467382174 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f10f40b6c90 0x7f10f40b9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:32.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.896+0000 7f1108ff9700 1 -- 172.21.15.107:0/3467382174 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8153+0+0 (secure 0 0 0) 0x7f11000e1f50 con 0x7f110c101a10 2024-05-10T11:01:32.896 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.896+0000 7f110affd700 1 --2- 172.21.15.107:0/3467382174 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f10f40b6c90 0x7f10f40b9150 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f110c108b00 tx=0x7f10fc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:01:32.899 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:32.899+0000 7f1108ff9700 1 -- 172.21.15.107:0/3467382174 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f110001f020 con 0x7f110c101a10 2024-05-10T11:01:33.138 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:32 smithi184 ceph-mon[34585]: pgmap v564: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-10T11:01:33.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:33.148+0000 7f1111a94700 1 -- 172.21.15.107:0/3467382174 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f110c1033f0 con 0x7f110c101a10 2024-05-10T11:01:33.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:33.151+0000 7f1108ff9700 1 -- 172.21.15.107:0/3467382174 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) ==== 161+0+0 (secure 0 0 0) 0x7f11000a9d10 con 0x7f110c101a10 2024-05-10T11:01:33.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:33.154+0000 7f1111a94700 1 -- 172.21.15.107:0/3467382174 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f10f40b6c90 msgr2=0x7f10f40b9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:33.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:33.154+0000 7f1111a94700 1 --2- 172.21.15.107:0/3467382174 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f10f40b6c90 0x7f10f40b9150 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f110c108b00 tx=0x7f10fc00b410 comp rx=0 tx=0).stop 2024-05-10T11:01:33.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:33.154+0000 7f1111a94700 1 -- 172.21.15.107:0/3467382174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f110c101a10 msgr2=0x7f110c19f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:33.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:33.154+0000 7f1111a94700 1 --2- 172.21.15.107:0/3467382174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f110c101a10 0x7f110c19f800 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f110000b530 tx=0x7f110000b840 comp rx=0 tx=0).stop 2024-05-10T11:01:33.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:33.155+0000 7f1111a94700 1 -- 172.21.15.107:0/3467382174 shutdown_connections 2024-05-10T11:01:33.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:33.155+0000 7f1111a94700 1 --2- 172.21.15.107:0/3467382174 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f10f40b6c90 0x7f10f40b9150 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:33.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:33.155+0000 7f1111a94700 1 --2- 172.21.15.107:0/3467382174 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f110c109590 0x7f110c1999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:33.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:33.155+0000 7f1111a94700 1 --2- 172.21.15.107:0/3467382174 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f110c101a10 0x7f110c19f800 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:33.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:33.155+0000 7f1111a94700 1 --2- 172.21.15.107:0/3467382174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f110c1023d0 0x7f110c19fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:33.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:33.155+0000 7f1111a94700 1 -- 172.21.15.107:0/3467382174 >> 172.21.15.107:0/3467382174 conn(0x7f110c0789a0 msgr2=0x7f110c0ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:01:33.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:33.155+0000 7f1111a94700 1 -- 172.21.15.107:0/3467382174 shutdown_connections 2024-05-10T11:01:33.156 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:33.155+0000 7f1111a94700 1 -- 172.21.15.107:0/3467382174 wait complete. 2024-05-10T11:01:33.157 INFO:teuthology.orchestra.run.smithi107.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T11:01:33.197 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:32 smithi196 ceph-mon[34872]: pgmap v564: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-05-10T11:01:33.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:33 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-a[30369]: 2024-05-10T11:01:33.149+0000 7f022e4e7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T11:01:33.424 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 11:01:33 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-a[72787]: ignoring --setuser ceph since I am not root 2024-05-10T11:01:33.425 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 11:01:33 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-a[72787]: ignoring --setgroup ceph since I am not root 2024-05-10T11:01:33.425 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 11:01:33 smithi107 ceph-mds[72813]: -- 172.21.15.107:0/2070835031 <== mon.0 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5623aaf8ba40 con 0x5623aaf5f000 2024-05-10T11:01:33.425 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 11:01:33 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-a[72787]: starting mds.a at 2024-05-10T11:01:33.425 INFO:journalctl@ceph.mds.g.smithi107.stdout:May 10 11:01:33 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-g[72347]: ignoring --setuser ceph since I am not root 2024-05-10T11:01:33.425 INFO:journalctl@ceph.mds.g.smithi107.stdout:May 10 11:01:33 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-g[72347]: ignoring --setgroup ceph since I am not root 2024-05-10T11:01:33.425 INFO:journalctl@ceph.mds.g.smithi107.stdout:May 10 11:01:33 smithi107 ceph-mds[72364]: -- 172.21.15.107:0/1673934107 <== mon.0 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564499c1da40 con 0x564499bf1000 2024-05-10T11:01:33.425 INFO:journalctl@ceph.mds.g.smithi107.stdout:May 10 11:01:33 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-g[72347]: starting mds.g at 2024-05-10T11:01:33.562 INFO:journalctl@ceph.mds.c.smithi196.stdout:May 10 11:01:33 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-c[65165]: ignoring --setuser ceph since I am not root 2024-05-10T11:01:33.563 INFO:journalctl@ceph.mds.c.smithi196.stdout:May 10 11:01:33 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-c[65165]: ignoring --setgroup ceph since I am not root 2024-05-10T11:01:33.563 INFO:journalctl@ceph.mds.c.smithi196.stdout:May 10 11:01:33 smithi196 ceph-mds[65169]: -- 172.21.15.196:0/3684719286 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561134dd1a40 con 0x561134da4c00 2024-05-10T11:01:33.563 INFO:journalctl@ceph.mds.c.smithi196.stdout:May 10 11:01:33 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-c[65165]: starting mds.c at 2024-05-10T11:01:33.563 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 11:01:33 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-f[64857]: ignoring --setuser ceph since I am not root 2024-05-10T11:01:33.563 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 11:01:33 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-f[64857]: ignoring --setgroup ceph since I am not root 2024-05-10T11:01:33.563 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 11:01:33 smithi196 ceph-mds[64861]: -- 172.21.15.196:0/2753297863 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fd89ab9a40 con 0x55fd89a8c800 2024-05-10T11:01:33.563 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 11:01:33 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-f[64857]: starting mds.f at 2024-05-10T11:01:33.564 INFO:journalctl@ceph.mds.i.smithi196.stdout:May 10 11:01:33 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-i[65467]: ignoring --setuser ceph since I am not root 2024-05-10T11:01:33.564 INFO:journalctl@ceph.mds.i.smithi196.stdout:May 10 11:01:33 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-i[65467]: ignoring --setgroup ceph since I am not root 2024-05-10T11:01:33.564 INFO:journalctl@ceph.mds.i.smithi196.stdout:May 10 11:01:33 smithi196 ceph-mds[65472]: -- 172.21.15.196:0/3897298751 <== mon.0 v2:172.21.15.107:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56104713fa40 con 0x561047112800 2024-05-10T11:01:33.564 INFO:journalctl@ceph.mds.i.smithi196.stdout:May 10 11:01:33 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-i[65467]: starting mds.i at 2024-05-10T11:01:33.564 INFO:journalctl@ceph.mds.l.smithi196.stdout:May 10 11:01:33 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-l[64551]: ignoring --setuser ceph since I am not root 2024-05-10T11:01:33.564 INFO:journalctl@ceph.mds.l.smithi196.stdout:May 10 11:01:33 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-l[64551]: ignoring --setgroup ceph since I am not root 2024-05-10T11:01:33.564 INFO:journalctl@ceph.mds.l.smithi196.stdout:May 10 11:01:33 smithi196 ceph-mds[64555]: -- 172.21.15.196:0/768879613 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563287e7fa40 con 0x563287e52c00 2024-05-10T11:01:33.564 INFO:journalctl@ceph.mds.l.smithi196.stdout:May 10 11:01:33 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-l[64551]: starting mds.l at 2024-05-10T11:01:33.639 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 11:01:33 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-h[64354]: ignoring --setuser ceph since I am not root 2024-05-10T11:01:33.639 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 11:01:33 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-h[64354]: ignoring --setgroup ceph since I am not root 2024-05-10T11:01:33.639 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 11:01:33 smithi184 ceph-mds[64358]: -- 172.21.15.184:0/4130831626 <== mon.2 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56493561da40 con 0x5649355f1000 2024-05-10T11:01:33.639 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 11:01:33 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-h[64354]: starting mds.h at 2024-05-10T11:01:33.639 INFO:journalctl@ceph.mds.e.smithi184.stdout:May 10 11:01:33 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-e[64042]: ignoring --setuser ceph since I am not root 2024-05-10T11:01:33.639 INFO:journalctl@ceph.mds.e.smithi184.stdout:May 10 11:01:33 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-e[64042]: ignoring --setgroup ceph since I am not root 2024-05-10T11:01:33.639 INFO:journalctl@ceph.mds.e.smithi184.stdout:May 10 11:01:33 smithi184 ceph-mds[64046]: -- 172.21.15.184:0/4221847278 <== mon.2 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564d2fed9a40 con 0x564d2feac800 2024-05-10T11:01:33.640 INFO:journalctl@ceph.mds.e.smithi184.stdout:May 10 11:01:33 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-e[64042]: starting mds.e at 2024-05-10T11:01:33.640 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 11:01:33 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-b[64672]: ignoring --setuser ceph since I am not root 2024-05-10T11:01:33.640 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 11:01:33 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-b[64672]: ignoring --setgroup ceph since I am not root 2024-05-10T11:01:33.640 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 11:01:33 smithi184 ceph-mds[64676]: -- 172.21.15.184:0/2479828532 <== mon.2 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559bd3ebba40 con 0x559bd3e8e800 2024-05-10T11:01:33.640 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 11:01:33 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-b[64672]: starting mds.b at 2024-05-10T11:01:33.640 INFO:journalctl@ceph.mds.k.smithi184.stdout:May 10 11:01:33 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-k[63726]: ignoring --setuser ceph since I am not root 2024-05-10T11:01:33.640 INFO:journalctl@ceph.mds.k.smithi184.stdout:May 10 11:01:33 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-k[63726]: ignoring --setgroup ceph since I am not root 2024-05-10T11:01:33.640 INFO:journalctl@ceph.mds.k.smithi184.stdout:May 10 11:01:33 smithi184 ceph-mds[63730]: -- 172.21.15.184:0/412108946 <== mon.1 v2:172.21.15.196:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5642a6cc5a40 con 0x5642a6c98c00 2024-05-10T11:01:33.640 INFO:journalctl@ceph.mds.k.smithi184.stdout:May 10 11:01:33 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-k[63726]: starting mds.k at 2024-05-10T11:01:33.856 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T11:01:34.105 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T11:01:34.138 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:33 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3467382174' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-10T11:01:34.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:33 smithi184 ceph-mon[34585]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-10T11:01:34.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:33 smithi184 ceph-mon[34585]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T11:01:34.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:33 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3467382174' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-10T11:01:34.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:33 smithi184 ceph-mon[34585]: osdmap e83: 12 total, 12 up, 12 in 2024-05-10T11:01:34.139 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:33 smithi184 ceph-mon[34585]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-10T11:01:34.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:33 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3467382174' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-10T11:01:34.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:33 smithi107 ceph-mon[30373]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-10T11:01:34.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:33 smithi107 ceph-mon[30373]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T11:01:34.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:33 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3467382174' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-10T11:01:34.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:33 smithi107 ceph-mon[30373]: osdmap e83: 12 total, 12 up, 12 in 2024-05-10T11:01:34.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:33 smithi107 ceph-mon[30373]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-10T11:01:34.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:33 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3467382174' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-10T11:01:34.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:33 smithi196 ceph-mon[34872]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-10T11:01:34.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:33 smithi196 ceph-mon[34872]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-10T11:01:34.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:33 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3467382174' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-10T11:01:34.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:33 smithi196 ceph-mon[34872]: osdmap e83: 12 total, 12 up, 12 in 2024-05-10T11:01:34.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:33 smithi196 ceph-mon[34872]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-10T11:01:35.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: pgmap v566: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-10T11:01:35.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.107:6838/3740431606,v1:172.21.15.107:6839/3740431606] up:boot 2024-05-10T11:01:35.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.107:6840/1448511476,v1:172.21.15.107:6841/1448511476] up:boot 2024-05-10T11:01:35.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.196:6832/2478205229,v1:172.21.15.196:6834/2478205229] up:boot 2024-05-10T11:01:35.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.196:6833/588113088,v1:172.21.15.196:6835/588113088] up:boot 2024-05-10T11:01:35.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.184:6832/1469201267,v1:172.21.15.184:6834/1469201267] up:boot 2024-05-10T11:01:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.184:6833/1585700655,v1:172.21.15.184:6835/1585700655] up:boot 2024-05-10T11:01:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.196:6836/3444983589,v1:172.21.15.196:6837/3444983589] up:boot 2024-05-10T11:01:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.196:6838/751555755,v1:172.21.15.196:6839/751555755] up:boot 2024-05-10T11:01:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.184:6836/2359904930,v1:172.21.15.184:6837/2359904930] up:boot 2024-05-10T11:01:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: mds.? [v2:172.21.15.184:6838/808880504,v1:172.21.15.184:6839/808880504] up:boot 2024-05-10T11:01:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-10T11:01:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-10T11:01:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-10T11:01:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-10T11:01:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-10T11:01:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-10T11:01:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-10T11:01:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-10T11:01:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-10T11:01:35.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-10T11:01:35.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-10T11:01:35.426 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:35 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T11:01:35.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: pgmap v566: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-10T11:01:35.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.107:6838/3740431606,v1:172.21.15.107:6839/3740431606] up:boot 2024-05-10T11:01:35.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.107:6840/1448511476,v1:172.21.15.107:6841/1448511476] up:boot 2024-05-10T11:01:35.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.196:6832/2478205229,v1:172.21.15.196:6834/2478205229] up:boot 2024-05-10T11:01:35.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.196:6833/588113088,v1:172.21.15.196:6835/588113088] up:boot 2024-05-10T11:01:35.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.184:6832/1469201267,v1:172.21.15.184:6834/1469201267] up:boot 2024-05-10T11:01:35.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.184:6833/1585700655,v1:172.21.15.184:6835/1585700655] up:boot 2024-05-10T11:01:35.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.196:6836/3444983589,v1:172.21.15.196:6837/3444983589] up:boot 2024-05-10T11:01:35.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.196:6838/751555755,v1:172.21.15.196:6839/751555755] up:boot 2024-05-10T11:01:35.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.184:6836/2359904930,v1:172.21.15.184:6837/2359904930] up:boot 2024-05-10T11:01:35.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: mds.? [v2:172.21.15.184:6838/808880504,v1:172.21.15.184:6839/808880504] up:boot 2024-05-10T11:01:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-10T11:01:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-10T11:01:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-10T11:01:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-10T11:01:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-10T11:01:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-10T11:01:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-10T11:01:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-10T11:01:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-10T11:01:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-10T11:01:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-10T11:01:35.564 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:35 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T11:01:35.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: pgmap v566: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-05-10T11:01:35.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.107:6838/3740431606,v1:172.21.15.107:6839/3740431606] up:boot 2024-05-10T11:01:35.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.107:6840/1448511476,v1:172.21.15.107:6841/1448511476] up:boot 2024-05-10T11:01:35.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.196:6832/2478205229,v1:172.21.15.196:6834/2478205229] up:boot 2024-05-10T11:01:35.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.196:6833/588113088,v1:172.21.15.196:6835/588113088] up:boot 2024-05-10T11:01:35.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.184:6832/1469201267,v1:172.21.15.184:6834/1469201267] up:boot 2024-05-10T11:01:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.184:6833/1585700655,v1:172.21.15.184:6835/1585700655] up:boot 2024-05-10T11:01:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.196:6836/3444983589,v1:172.21.15.196:6837/3444983589] up:boot 2024-05-10T11:01:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.196:6838/751555755,v1:172.21.15.196:6839/751555755] up:boot 2024-05-10T11:01:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.184:6836/2359904930,v1:172.21.15.184:6837/2359904930] up:boot 2024-05-10T11:01:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: mds.? [v2:172.21.15.184:6838/808880504,v1:172.21.15.184:6839/808880504] up:boot 2024-05-10T11:01:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-10T11:01:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-10T11:01:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-10T11:01:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-10T11:01:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-10T11:01:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-10T11:01:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-10T11:01:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-10T11:01:35.640 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-10T11:01:35.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-10T11:01:35.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-10T11:01:35.641 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:35 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-10T11:01:35.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.720+0000 7f756c3ee700 1 -- 172.21.15.107:0/2886410338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7564103780 msgr2=0x7f7564103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:35.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.720+0000 7f756c3ee700 1 --2- 172.21.15.107:0/2886410338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7564103780 0x7f7564103b60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f75600099c0 tx=0x7f7560009cd0 comp rx=0 tx=0).stop 2024-05-10T11:01:35.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.720+0000 7f756c3ee700 1 -- 172.21.15.107:0/2886410338 shutdown_connections 2024-05-10T11:01:35.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.720+0000 7f756c3ee700 1 --2- 172.21.15.107:0/2886410338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7564108870 0x7f75641103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:35.727 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.720+0000 7f756c3ee700 1 --2- 172.21.15.107:0/2886410338 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7564103780 0x7f7564103b60 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.720+0000 7f756c3ee700 1 --2- 172.21.15.107:0/2886410338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7564104130 0x7f7564108140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.720+0000 7f756c3ee700 1 -- 172.21.15.107:0/2886410338 >> 172.21.15.107:0/2886410338 conn(0x7f756407a610 msgr2=0x7f756407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:01:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.720+0000 7f756c3ee700 1 -- 172.21.15.107:0/2886410338 shutdown_connections 2024-05-10T11:01:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.720+0000 7f756c3ee700 1 -- 172.21.15.107:0/2886410338 wait complete. 2024-05-10T11:01:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.720+0000 7f756c3ee700 1 Processor -- start 2024-05-10T11:01:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.720+0000 7f756c3ee700 1 -- start start 2024-05-10T11:01:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f756c3ee700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7564103780 0x7f7564199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f756c3ee700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7564104130 0x7f756419a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f756c3ee700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7564108870 0x7f756419e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f756c3ee700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7564113780 con 0x7f7564108870 2024-05-10T11:01:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f756c3ee700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7564113600 con 0x7f7564104130 2024-05-10T11:01:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f756c3ee700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f7564113900 con 0x7f7564103780 2024-05-10T11:01:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f756a98b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7564108870 0x7f756419e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:35.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f756a98b700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7564108870 0x7f756419e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:58138/0 (socket says 172.21.15.107:58138) 2024-05-10T11:01:35.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f756a98b700 1 -- 172.21.15.107:0/1607716067 learned_addr learned my addr 172.21.15.107:0/1607716067 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:01:35.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f7569989700 1 --2- 172.21.15.107:0/1607716067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7564104130 0x7f756419a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:35.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f756a18a700 1 --2- 172.21.15.107:0/1607716067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7564103780 0x7f7564199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:35.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f756a98b700 1 -- 172.21.15.107:0/1607716067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7564103780 msgr2=0x7f7564199c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:35.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f756a98b700 1 --2- 172.21.15.107:0/1607716067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7564103780 0x7f7564199c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:35.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f756a98b700 1 -- 172.21.15.107:0/1607716067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7564104130 msgr2=0x7f756419a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:35.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f756a98b700 1 --2- 172.21.15.107:0/1607716067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7564104130 0x7f756419a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:35.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f756a98b700 1 -- 172.21.15.107:0/1607716067 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756419ec00 con 0x7f7564108870 2024-05-10T11:01:35.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f756a98b700 1 --2- 172.21.15.107:0/1607716067 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7564108870 0x7f756419e500 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f755c007ee0 tx=0x7f755c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:01:35.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f755b7fe700 1 -- 172.21.15.107:0/1607716067 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c004bb0 con 0x7f7564108870 2024-05-10T11:01:35.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f756c3ee700 1 -- 172.21.15.107:0/1607716067 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f756419eef0 con 0x7f7564108870 2024-05-10T11:01:35.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f755b7fe700 1 -- 172.21.15.107:0/1607716067 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f755c004d50 con 0x7f7564108870 2024-05-10T11:01:35.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f755b7fe700 1 -- 172.21.15.107:0/1607716067 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c0059e0 con 0x7f7564108870 2024-05-10T11:01:35.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.721+0000 7f756c3ee700 1 -- 172.21.15.107:0/1607716067 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75641a67b0 con 0x7f7564108870 2024-05-10T11:01:35.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.722+0000 7f756c3ee700 1 -- 172.21.15.107:0/1607716067 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f756410bab0 con 0x7f7564108870 2024-05-10T11:01:35.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.724+0000 7f755b7fe700 1 -- 172.21.15.107:0/1607716067 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f755c01a020 con 0x7f7564108870 2024-05-10T11:01:35.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.724+0000 7f755b7fe700 1 --2- 172.21.15.107:0/1607716067 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f75500b2880 0x7f75500b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:35.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.725+0000 7f756a18a700 1 --2- 172.21.15.107:0/1607716067 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f75500b2880 0x7f75500b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:35.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.725+0000 7f755b7fe700 1 -- 172.21.15.107:0/1607716067 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8583+0+0 (secure 0 0 0) 0x7f755c0e1ff0 con 0x7f7564108870 2024-05-10T11:01:35.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.725+0000 7f756a18a700 1 --2- 172.21.15.107:0/1607716067 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f75500b2880 0x7f75500b4d40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7560000c00 tx=0x7f7560009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:01:35.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:35.728+0000 7f755b7fe700 1 -- 172.21.15.107:0/1607716067 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f755c010070 con 0x7f7564108870 2024-05-10T11:01:36.026 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:36.026+0000 7f756c3ee700 1 -- 172.21.15.107:0/1607716067 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f756419af60 con 0x7f7564108870 2024-05-10T11:01:36.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T11:01:36.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T11:01:36.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:36 smithi107 ceph-mon[30373]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T11:01:36.425 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:36 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1607716067' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-10T11:01:36.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:36 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:36 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:36 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:36 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:36 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:36 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:36 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:36 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:36 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T11:01:36.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:36 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T11:01:36.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:36 smithi196 ceph-mon[34872]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T11:01:36.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:36 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1607716067' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-10T11:01:36.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:36 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:36 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:36 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:36 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:36 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:36 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:36 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:36 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-10T11:01:36.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:36 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-10T11:01:36.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:36 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-10T11:01:36.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:36 smithi184 ceph-mon[34585]: from='mgr.14152 172.21.15.107:0/2187897124' entity='mgr.x' 2024-05-10T11:01:36.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:36 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1607716067' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-10T11:01:36.969 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:36.969+0000 7f755b7fe700 1 -- 172.21.15.107:0/1607716067 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) ==== 104+0+0 (secure 0 0 0) 0x7f755c0a9bb0 con 0x7f7564108870 2024-05-10T11:01:36.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:36.972+0000 7f756c3ee700 1 -- 172.21.15.107:0/1607716067 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f75500b2880 msgr2=0x7f75500b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:36.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:36.972+0000 7f756c3ee700 1 --2- 172.21.15.107:0/1607716067 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f75500b2880 0x7f75500b4d40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7560000c00 tx=0x7f7560009f10 comp rx=0 tx=0).stop 2024-05-10T11:01:36.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:36.972+0000 7f756c3ee700 1 -- 172.21.15.107:0/1607716067 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7564108870 msgr2=0x7f756419e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:36.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:36.972+0000 7f756c3ee700 1 --2- 172.21.15.107:0/1607716067 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7564108870 0x7f756419e500 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f755c007ee0 tx=0x7f755c00d3b0 comp rx=0 tx=0).stop 2024-05-10T11:01:36.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:36.972+0000 7f756c3ee700 1 -- 172.21.15.107:0/1607716067 shutdown_connections 2024-05-10T11:01:36.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:36.972+0000 7f756c3ee700 1 --2- 172.21.15.107:0/1607716067 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f75500b2880 0x7f75500b4d40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:36.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:36.972+0000 7f756c3ee700 1 --2- 172.21.15.107:0/1607716067 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7564103780 0x7f7564199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:36.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:36.972+0000 7f756c3ee700 1 --2- 172.21.15.107:0/1607716067 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7564108870 0x7f756419e500 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:36.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:36.972+0000 7f756c3ee700 1 --2- 172.21.15.107:0/1607716067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7564104130 0x7f756419a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:36.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:36.972+0000 7f756c3ee700 1 -- 172.21.15.107:0/1607716067 >> 172.21.15.107:0/1607716067 conn(0x7f756407a610 msgr2=0x7f7564101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:01:36.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:36.972+0000 7f756c3ee700 1 -- 172.21.15.107:0/1607716067 shutdown_connections 2024-05-10T11:01:36.973 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:36.972+0000 7f756c3ee700 1 -- 172.21.15.107:0/1607716067 wait complete. 2024-05-10T11:01:37.289 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:37 smithi107 ceph-mon[30373]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-05-10T11:01:37.289 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:37 smithi107 ceph-mon[30373]: Unable to set osd_memory_target on smithi196 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-05-10T11:01:37.289 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:37 smithi107 ceph-mon[30373]: Adjusting osd_memory_target on smithi184 to 176.2M 2024-05-10T11:01:37.289 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:37 smithi107 ceph-mon[30373]: Unable to set osd_memory_target on smithi184 to 184791040: error parsing value: Value '184791040' is below minimum 939524096 2024-05-10T11:01:37.289 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:37 smithi107 ceph-mon[30373]: pgmap v567: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-10T11:01:37.289 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:37 smithi107 ceph-mon[30373]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-10T11:01:37.289 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:37 smithi107 ceph-mon[30373]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-10T11:01:37.290 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:37 smithi107 ceph-mon[30373]: Cluster is now healthy 2024-05-10T11:01:37.290 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:37 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/1607716067' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-10T11:01:37.290 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:37 smithi107 ceph-mon[30373]: fsmap 12 up:standby 2024-05-10T11:01:37.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:37 smithi196 ceph-mon[34872]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-05-10T11:01:37.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:37 smithi196 ceph-mon[34872]: Unable to set osd_memory_target on smithi196 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-05-10T11:01:37.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:37 smithi196 ceph-mon[34872]: Adjusting osd_memory_target on smithi184 to 176.2M 2024-05-10T11:01:37.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:37 smithi196 ceph-mon[34872]: Unable to set osd_memory_target on smithi184 to 184791040: error parsing value: Value '184791040' is below minimum 939524096 2024-05-10T11:01:37.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:37 smithi196 ceph-mon[34872]: pgmap v567: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-10T11:01:37.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:37 smithi196 ceph-mon[34872]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-10T11:01:37.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:37 smithi196 ceph-mon[34872]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-10T11:01:37.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:37 smithi196 ceph-mon[34872]: Cluster is now healthy 2024-05-10T11:01:37.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:37 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/1607716067' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-10T11:01:37.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:37 smithi196 ceph-mon[34872]: fsmap 12 up:standby 2024-05-10T11:01:37.629 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T11:01:37.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:37 smithi184 ceph-mon[34585]: Adjusting osd_memory_target on smithi196 to 176.2M 2024-05-10T11:01:37.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:37 smithi184 ceph-mon[34585]: Unable to set osd_memory_target on smithi196 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-05-10T11:01:37.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:37 smithi184 ceph-mon[34585]: Adjusting osd_memory_target on smithi184 to 176.2M 2024-05-10T11:01:37.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:37 smithi184 ceph-mon[34585]: Unable to set osd_memory_target on smithi184 to 184791040: error parsing value: Value '184791040' is below minimum 939524096 2024-05-10T11:01:37.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:37 smithi184 ceph-mon[34585]: pgmap v567: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-10T11:01:37.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:37 smithi184 ceph-mon[34585]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-10T11:01:37.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:37 smithi184 ceph-mon[34585]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-10T11:01:37.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:37 smithi184 ceph-mon[34585]: Cluster is now healthy 2024-05-10T11:01:37.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:37 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/1607716067' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-10T11:01:37.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:37 smithi184 ceph-mon[34585]: fsmap 12 up:standby 2024-05-10T11:01:37.877 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T11:01:39.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:39 smithi107 ceph-mon[30373]: pgmap v568: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-10T11:01:39.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.431+0000 7fc04ea7a700 1 -- 172.21.15.107:0/3039093371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc048109570 msgr2=0x7fc048109950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:39.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.431+0000 7fc04ea7a700 1 --2- 172.21.15.107:0/3039093371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc048109570 0x7fc048109950 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc04400b0d0 tx=0x7fc04400b3e0 comp rx=0 tx=0).stop 2024-05-10T11:01:39.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.431+0000 7fc04ea7a700 1 -- 172.21.15.107:0/3039093371 shutdown_connections 2024-05-10T11:01:39.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.431+0000 7fc04ea7a700 1 --2- 172.21.15.107:0/3039093371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0481023b0 0x7fc048110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:39.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.431+0000 7fc04ea7a700 1 --2- 172.21.15.107:0/3039093371 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc048109570 0x7fc048109950 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:39.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.431+0000 7fc04ea7a700 1 --2- 172.21.15.107:0/3039093371 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0481019f0 0x7fc048101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:39.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.431+0000 7fc04ea7a700 1 -- 172.21.15.107:0/3039093371 >> 172.21.15.107:0/3039093371 conn(0x7fc0480789a0 msgr2=0x7fc0480ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:01:39.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.431+0000 7fc04ea7a700 1 -- 172.21.15.107:0/3039093371 shutdown_connections 2024-05-10T11:01:39.442 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.431+0000 7fc04ea7a700 1 -- 172.21.15.107:0/3039093371 wait complete. 2024-05-10T11:01:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.432+0000 7fc04ea7a700 1 Processor -- start 2024-05-10T11:01:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.432+0000 7fc04ea7a700 1 -- start start 2024-05-10T11:01:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.432+0000 7fc04ea7a700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0481019f0 0x7fc04819f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.432+0000 7fc04ea7a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0481023b0 0x7fc04819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.432+0000 7fc04ea7a700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc048109570 0x7fc048199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.432+0000 7fc04ea7a700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc048113820 con 0x7fc048109570 2024-05-10T11:01:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.432+0000 7fc04ea7a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc0481136a0 con 0x7fc0481023b0 2024-05-10T11:01:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.432+0000 7fc04ea7a700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7fc0481139a0 con 0x7fc0481019f0 2024-05-10T11:01:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.432+0000 7fc04d017700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc048109570 0x7fc048199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.432+0000 7fc04d017700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc048109570 0x7fc048199aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60256/0 (socket says 172.21.15.107:60256) 2024-05-10T11:01:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.432+0000 7fc04d017700 1 -- 172.21.15.107:0/3378023259 learned_addr learned my addr 172.21.15.107:0/3378023259 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:01:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.432+0000 7fc03ffff700 1 --2- 172.21.15.107:0/3378023259 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0481023b0 0x7fc04819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:39.443 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.432+0000 7fc04c816700 1 --2- 172.21.15.107:0/3378023259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0481019f0 0x7fc04819f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:39.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.432+0000 7fc04d017700 1 -- 172.21.15.107:0/3378023259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0481019f0 msgr2=0x7fc04819f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:39.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.432+0000 7fc04d017700 1 --2- 172.21.15.107:0/3378023259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0481019f0 0x7fc04819f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:39.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.432+0000 7fc04d017700 1 -- 172.21.15.107:0/3378023259 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0481023b0 msgr2=0x7fc04819fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:39.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.432+0000 7fc04d017700 1 --2- 172.21.15.107:0/3378023259 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0481023b0 0x7fc04819fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:39.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.432+0000 7fc04d017700 1 -- 172.21.15.107:0/3378023259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc04819a200 con 0x7fc048109570 2024-05-10T11:01:39.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.432+0000 7fc03ffff700 1 --2- 172.21.15.107:0/3378023259 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0481023b0 0x7fc04819fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T11:01:39.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.433+0000 7fc04d017700 1 --2- 172.21.15.107:0/3378023259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc048109570 0x7fc048199aa0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc04000c970 tx=0x7fc04000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:01:39.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.433+0000 7fc03dffb700 1 -- 172.21.15.107:0/3378023259 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc040007b00 con 0x7fc048109570 2024-05-10T11:01:39.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.433+0000 7fc04ea7a700 1 -- 172.21.15.107:0/3378023259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc04819a4f0 con 0x7fc048109570 2024-05-10T11:01:39.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.433+0000 7fc03dffb700 1 -- 172.21.15.107:0/3378023259 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc040004d00 con 0x7fc048109570 2024-05-10T11:01:39.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.433+0000 7fc03dffb700 1 -- 172.21.15.107:0/3378023259 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc040005680 con 0x7fc048109570 2024-05-10T11:01:39.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.433+0000 7fc04ea7a700 1 -- 172.21.15.107:0/3378023259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0481a6760 con 0x7fc048109570 2024-05-10T11:01:39.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.434+0000 7fc04ea7a700 1 -- 172.21.15.107:0/3378023259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc04810ba00 con 0x7fc048109570 2024-05-10T11:01:39.444 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.435+0000 7fc03dffb700 1 -- 172.21.15.107:0/3378023259 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7fc040004750 con 0x7fc048109570 2024-05-10T11:01:39.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.436+0000 7fc03dffb700 1 --2- 172.21.15.107:0/3378023259 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc0300b2900 0x7fc0300b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:39.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.436+0000 7fc04c816700 1 --2- 172.21.15.107:0/3378023259 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc0300b2900 0x7fc0300b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:39.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.436+0000 7fc03dffb700 1 -- 172.21.15.107:0/3378023259 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8583+0+0 (secure 0 0 0) 0x7fc0400e1fb0 con 0x7fc048109570 2024-05-10T11:01:39.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.436+0000 7fc04c816700 1 --2- 172.21.15.107:0/3378023259 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc0300b2900 0x7fc0300b4dc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc04400d010 tx=0x7fc04400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:01:39.445 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.440+0000 7fc03dffb700 1 -- 172.21.15.107:0/3378023259 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc040014030 con 0x7fc048109570 2024-05-10T11:01:39.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:39 smithi196 ceph-mon[34872]: pgmap v568: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-10T11:01:39.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:39 smithi184 ceph-mon[34585]: pgmap v568: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-10T11:01:39.645 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:39.645+0000 7fc04ea7a700 1 -- 172.21.15.107:0/3378023259 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc04806a190 con 0x7fc048109570 2024-05-10T11:01:40.173 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:40.173+0000 7fc03dffb700 1 -- 172.21.15.107:0/3378023259 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) ==== 181+0+0 (secure 0 0 0) 0x7fc0400a9b10 con 0x7fc048109570 2024-05-10T11:01:40.176 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:40.176+0000 7fc04ea7a700 1 -- 172.21.15.107:0/3378023259 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc0300b2900 msgr2=0x7fc0300b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:40.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:40.176+0000 7fc04ea7a700 1 --2- 172.21.15.107:0/3378023259 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc0300b2900 0x7fc0300b4dc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc04400d010 tx=0x7fc04400b040 comp rx=0 tx=0).stop 2024-05-10T11:01:40.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:40.176+0000 7fc04ea7a700 1 -- 172.21.15.107:0/3378023259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc048109570 msgr2=0x7fc048199aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:40.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:40.176+0000 7fc04ea7a700 1 --2- 172.21.15.107:0/3378023259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc048109570 0x7fc048199aa0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc04000c970 tx=0x7fc04000cd30 comp rx=0 tx=0).stop 2024-05-10T11:01:40.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:40.176+0000 7fc04ea7a700 1 -- 172.21.15.107:0/3378023259 shutdown_connections 2024-05-10T11:01:40.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:40.176+0000 7fc04ea7a700 1 --2- 172.21.15.107:0/3378023259 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7fc0300b2900 0x7fc0300b4dc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:40.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:40.176+0000 7fc04ea7a700 1 --2- 172.21.15.107:0/3378023259 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0481019f0 0x7fc04819f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:40.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:40.176+0000 7fc04ea7a700 1 --2- 172.21.15.107:0/3378023259 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc048109570 0x7fc048199aa0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:40.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:40.176+0000 7fc04ea7a700 1 --2- 172.21.15.107:0/3378023259 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0481023b0 0x7fc04819fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:40.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:40.176+0000 7fc04ea7a700 1 -- 172.21.15.107:0/3378023259 >> 172.21.15.107:0/3378023259 conn(0x7fc0480789a0 msgr2=0x7fc048100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:01:40.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:40.176+0000 7fc04ea7a700 1 -- 172.21.15.107:0/3378023259 shutdown_connections 2024-05-10T11:01:40.177 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:40.176+0000 7fc04ea7a700 1 -- 172.21.15.107:0/3378023259 wait complete. 2024-05-10T11:01:40.178 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_metadata' removed 2024-05-10T11:01:40.424 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:40 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3378023259' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-10T11:01:40.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:40 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3378023259' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-10T11:01:40.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:40 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3378023259' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-10T11:01:40.924 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b shell --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T11:01:41.166 INFO:teuthology.orchestra.run.smithi107.stderr:Inferring config /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/mon.a/config 2024-05-10T11:01:41.441 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:41 smithi107 ceph-mon[30373]: pgmap v569: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-05-10T11:01:41.441 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:41 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3378023259' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-10T11:01:41.441 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:41 smithi107 ceph-mon[30373]: osdmap e84: 12 total, 12 up, 12 in 2024-05-10T11:01:41.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:41 smithi196 ceph-mon[34872]: pgmap v569: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-05-10T11:01:41.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:41 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3378023259' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-10T11:01:41.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:41 smithi196 ceph-mon[34872]: osdmap e84: 12 total, 12 up, 12 in 2024-05-10T11:01:41.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:41 smithi184 ceph-mon[34585]: pgmap v569: 97 pgs: 97 active+clean; 76 MiB data, 653 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-05-10T11:01:41.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:41 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3378023259' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-10T11:01:41.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:41 smithi184 ceph-mon[34585]: osdmap e84: 12 total, 12 up, 12 in 2024-05-10T11:01:42.871 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.871+0000 7f8fc8ac0700 1 -- 172.21.15.107:0/1479070367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fc4109510 msgr2=0x7f8fc41098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:42.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.871+0000 7f8fc8ac0700 1 --2- 172.21.15.107:0/1479070367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fc4109510 0x7f8fc41098f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009990 tx=0x7f8fb4009ca0 comp rx=0 tx=0).stop 2024-05-10T11:01:42.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.871+0000 7f8fc8ac0700 1 -- 172.21.15.107:0/1479070367 shutdown_connections 2024-05-10T11:01:42.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.871+0000 7f8fc8ac0700 1 --2- 172.21.15.107:0/1479070367 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8fc406bb40 0x7f8fc4110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:42.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.871+0000 7f8fc8ac0700 1 --2- 172.21.15.107:0/1479070367 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fc4109510 0x7f8fc41098f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:42.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.871+0000 7f8fc8ac0700 1 --2- 172.21.15.107:0/1479070367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fc406b180 0x7f8fc406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:42.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.871+0000 7f8fc8ac0700 1 -- 172.21.15.107:0/1479070367 >> 172.21.15.107:0/1479070367 conn(0x7f8fc4079350 msgr2=0x7f8fc4079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:01:42.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.871+0000 7f8fc8ac0700 1 -- 172.21.15.107:0/1479070367 shutdown_connections 2024-05-10T11:01:42.872 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.871+0000 7f8fc8ac0700 1 -- 172.21.15.107:0/1479070367 wait complete. 2024-05-10T11:01:42.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.872+0000 7f8fc8ac0700 1 Processor -- start 2024-05-10T11:01:42.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.872+0000 7f8fc8ac0700 1 -- start start 2024-05-10T11:01:42.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.872+0000 7f8fc8ac0700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fc406b180 0x7f8fc4102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:42.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.872+0000 7f8fc8ac0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fc406bb40 0x7f8fc41029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:42.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.872+0000 7f8fc8ac0700 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8fc4109510 0x7f8fc4102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:42.874 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.872+0000 7f8fc8ac0700 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc4113800 con 0x7f8fc406b180 2024-05-10T11:01:42.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.872+0000 7f8fc8ac0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc4113680 con 0x7f8fc406bb40 2024-05-10T11:01:42.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.872+0000 7f8fc8ac0700 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc4113980 con 0x7f8fc4109510 2024-05-10T11:01:42.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.872+0000 7f8fc259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fc406b180 0x7f8fc4102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:42.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.872+0000 7f8fc259c700 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fc406b180 0x7f8fc4102470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:60274/0 (socket says 172.21.15.107:60274) 2024-05-10T11:01:42.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.872+0000 7f8fc259c700 1 -- 172.21.15.107:0/3115044693 learned_addr learned my addr 172.21.15.107:0/3115044693 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-10T11:01:42.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.872+0000 7f8fc2d9d700 1 --2- 172.21.15.107:0/3115044693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8fc4109510 0x7f8fc4102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:42.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.873+0000 7f8fb9d9b700 1 --2- 172.21.15.107:0/3115044693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fc406bb40 0x7f8fc41029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:42.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.873+0000 7f8fc259c700 1 -- 172.21.15.107:0/3115044693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8fc4109510 msgr2=0x7f8fc4102ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:42.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.873+0000 7f8fc259c700 1 --2- 172.21.15.107:0/3115044693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8fc4109510 0x7f8fc4102ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:42.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.873+0000 7f8fc259c700 1 -- 172.21.15.107:0/3115044693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fc406bb40 msgr2=0x7f8fc41029b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:42.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.873+0000 7f8fc259c700 1 --2- 172.21.15.107:0/3115044693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fc406bb40 0x7f8fc41029b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:42.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.873+0000 7f8fc259c700 1 -- 172.21.15.107:0/3115044693 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc41a81c0 con 0x7f8fc406b180 2024-05-10T11:01:42.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.873+0000 7f8fc259c700 1 --2- 172.21.15.107:0/3115044693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fc406b180 0x7f8fc4102470 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4000c00 tx=0x7f8fb4009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:01:42.875 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.873+0000 7f8fbbfff700 1 -- 172.21.15.107:0/3115044693 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4027070 con 0x7f8fc406b180 2024-05-10T11:01:42.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.873+0000 7f8fc8ac0700 1 -- 172.21.15.107:0/3115044693 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc41a8450 con 0x7f8fc406b180 2024-05-10T11:01:42.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.873+0000 7f8fbbfff700 1 -- 172.21.15.107:0/3115044693 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8fb4003fb0 con 0x7f8fc406b180 2024-05-10T11:01:42.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.873+0000 7f8fbbfff700 1 -- 172.21.15.107:0/3115044693 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4022e10 con 0x7f8fc406b180 2024-05-10T11:01:42.876 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.873+0000 7f8fc8ac0700 1 -- 172.21.15.107:0/3115044693 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc41a8900 con 0x7f8fc406b180 2024-05-10T11:01:42.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.874+0000 7f8fc8ac0700 1 -- 172.21.15.107:0/3115044693 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fc410b9f0 con 0x7f8fc406b180 2024-05-10T11:01:42.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.876+0000 7f8fbbfff700 1 -- 172.21.15.107:0/3115044693 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 20) ==== 149653+0+0 (secure 0 0 0) 0x7f8fb402a070 con 0x7f8fc406b180 2024-05-10T11:01:42.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.876+0000 7f8fbbfff700 1 --2- 172.21.15.107:0/3115044693 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8fb00b2880 0x7f8fb00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T11:01:42.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.876+0000 7f8fb9d9b700 1 --2- 172.21.15.107:0/3115044693 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8fb00b2880 0x7f8fb00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T11:01:42.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.876+0000 7f8fbbfff700 1 -- 172.21.15.107:0/3115044693 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8087+0+0 (secure 0 0 0) 0x7f8fb40e2e90 con 0x7f8fc406b180 2024-05-10T11:01:42.877 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.877+0000 7f8fb9d9b700 1 --2- 172.21.15.107:0/3115044693 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8fb00b2880 0x7f8fb00b4d40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8fac006fd0 tx=0x7f8fac008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T11:01:42.881 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:42.881+0000 7f8fbbfff700 1 -- 172.21.15.107:0/3115044693 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8fb4013070 con 0x7f8fc406b180 2024-05-10T11:01:43.083 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:43.083+0000 7f8fc8ac0700 1 -- 172.21.15.107:0/3115044693 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8fc410b3d0 con 0x7f8fc406b180 2024-05-10T11:01:43.183 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:43.183+0000 7f8fbbfff700 1 -- 172.21.15.107:0/3115044693 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) ==== 169+0+0 (secure 0 0 0) 0x7f8fb40aad20 con 0x7f8fc406b180 2024-05-10T11:01:43.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:43.187+0000 7f8fc8ac0700 1 -- 172.21.15.107:0/3115044693 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8fb00b2880 msgr2=0x7f8fb00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:43.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:43.187+0000 7f8fc8ac0700 1 --2- 172.21.15.107:0/3115044693 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8fb00b2880 0x7f8fb00b4d40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8fac006fd0 tx=0x7f8fac008040 comp rx=0 tx=0).stop 2024-05-10T11:01:43.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:43.187+0000 7f8fc8ac0700 1 -- 172.21.15.107:0/3115044693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fc406b180 msgr2=0x7f8fc4102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T11:01:43.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:43.187+0000 7f8fc8ac0700 1 --2- 172.21.15.107:0/3115044693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fc406b180 0x7f8fc4102470 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4000c00 tx=0x7f8fb4009f50 comp rx=0 tx=0).stop 2024-05-10T11:01:43.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:43.187+0000 7f8fc8ac0700 1 -- 172.21.15.107:0/3115044693 shutdown_connections 2024-05-10T11:01:43.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:43.187+0000 7f8fc8ac0700 1 --2- 172.21.15.107:0/3115044693 >> [v2:172.21.15.107:6800/2062256859,v1:172.21.15.107:6801/2062256859] conn(0x7f8fb00b2880 0x7f8fb00b4d40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:43.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:43.187+0000 7f8fc8ac0700 1 --2- 172.21.15.107:0/3115044693 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8fc4109510 0x7f8fc4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:43.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:43.187+0000 7f8fc8ac0700 1 --2- 172.21.15.107:0/3115044693 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fc406b180 0x7f8fc4102470 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:43.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:43.187+0000 7f8fc8ac0700 1 --2- 172.21.15.107:0/3115044693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fc406bb40 0x7f8fc41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T11:01:43.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:43.187+0000 7f8fc8ac0700 1 -- 172.21.15.107:0/3115044693 >> 172.21.15.107:0/3115044693 conn(0x7f8fc4079350 msgr2=0x7f8fc4100f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T11:01:43.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:43.187+0000 7f8fc8ac0700 1 -- 172.21.15.107:0/3115044693 shutdown_connections 2024-05-10T11:01:43.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-10T11:01:43.187+0000 7f8fc8ac0700 1 -- 172.21.15.107:0/3115044693 wait complete. 2024-05-10T11:01:43.189 INFO:teuthology.orchestra.run.smithi107.stderr:pool 'cephfs_data' removed 2024-05-10T11:01:43.510 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:43 smithi107 ceph-mon[30373]: pgmap v571: 65 pgs: 65 active+clean; 577 KiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T11:01:43.510 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:43 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3115044693' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-10T11:01:43.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:43 smithi196 ceph-mon[34872]: pgmap v571: 65 pgs: 65 active+clean; 577 KiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T11:01:43.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:43 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3115044693' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-10T11:01:43.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:43 smithi184 ceph-mon[34585]: pgmap v571: 65 pgs: 65 active+clean; 577 KiB data, 645 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-10T11:01:43.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:43 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3115044693' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-10T11:01:43.830 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-10T11:01:43.858 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-10T11:01:43.888 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-10T11:01:43.920 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-10T11:01:43.920 DEBUG:teuthology.orchestra.run.smithi107:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-10T11:01:43.935 DEBUG:teuthology.orchestra.run.smithi184:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-10T11:01:43.952 DEBUG:teuthology.orchestra.run.smithi196:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-10T11:01:43.976 INFO:tasks.cephadm:Stopping all daemons... 2024-05-10T11:01:43.976 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-10T11:01:43.977 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mon.a 2024-05-10T11:01:44.174 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:44 smithi107 systemd[1]: Stopping Ceph mon.a for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:01:44.562 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:44 smithi196 ceph-mon[34872]: from='client.? 172.21.15.107:0/3115044693' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-10T11:01:44.563 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:44 smithi196 ceph-mon[34872]: osdmap e85: 12 total, 12 up, 12 in 2024-05-10T11:01:44.616 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:44 smithi107 ceph-mon[30373]: from='client.? 172.21.15.107:0/3115044693' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-10T11:01:44.616 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:44 smithi107 ceph-mon[30373]: osdmap e85: 12 total, 12 up, 12 in 2024-05-10T11:01:44.616 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:44 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-a[30369]: 2024-05-10T11:01:44.256+0000 7f0233cf2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:01:44.616 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:44 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-a[30369]: 2024-05-10T11:01:44.256+0000 7f0233cf2700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-10T11:01:44.616 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:44 smithi107 podman[96680]: 2024-05-10 11:01:44.309486397 +0000 UTC m=+0.148337058 container died 69577f9caecb2731fbce95497d20bb4fe187c7a6f89bfc0c47037bcb4a6af545 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-a, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5) 2024-05-10T11:01:44.638 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:44 smithi184 ceph-mon[34585]: from='client.? 172.21.15.107:0/3115044693' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-10T11:01:44.639 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:44 smithi184 ceph-mon[34585]: osdmap e85: 12 total, 12 up, 12 in 2024-05-10T11:01:44.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:44 smithi107 podman[96680]: 2024-05-10 11:01:44.715660198 +0000 UTC m=+0.554510865 container cleanup 69577f9caecb2731fbce95497d20bb4fe187c7a6f89bfc0c47037bcb4a6af545 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-10T11:01:44.924 INFO:journalctl@ceph.mon.a.smithi107.stdout:May 10 11:01:44 smithi107 bash[96680]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-a 2024-05-10T11:01:45.080 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mon.a.service' 2024-05-10T11:01:45.133 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:01:45.133 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-10T11:01:45.133 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-10T11:01:45.134 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mon.b 2024-05-10T11:01:45.567 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:45 smithi184 systemd[1]: Stopping Ceph mon.b for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:01:45.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:45 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-b[34581]: 2024-05-10T11:01:45.567+0000 7fee029c8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:01:45.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:45 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-b[34581]: 2024-05-10T11:01:45.567+0000 7fee029c8700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-10T11:01:45.889 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:45 smithi184 podman[68306]: 2024-05-10 11:01:45.700075148 +0000 UTC m=+0.374408319 container died fbb3f76a98f1231faa5592af0223ec96cba43c448c2fa67c4f7904103c92367e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240507, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-10T11:01:46.209 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:46 smithi184 podman[68306]: 2024-05-10 11:01:46.033935847 +0000 UTC m=+0.708269017 container cleanup fbb3f76a98f1231faa5592af0223ec96cba43c448c2fa67c4f7904103c92367e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-b, CEPH_POINT_RELEASE=, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-10T11:01:46.209 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:46 smithi184 bash[68306]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-b 2024-05-10T11:01:46.460 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:46 smithi184 podman[68320]: 2024-05-10 11:01:46.210078584 +0000 UTC m=+0.505223130 container remove fbb3f76a98f1231faa5592af0223ec96cba43c448c2fa67c4f7904103c92367e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507) 2024-05-10T11:01:46.460 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:46 smithi184 systemd[1]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mon.b.service: Deactivated successfully. 2024-05-10T11:01:46.460 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:46 smithi184 systemd[1]: Stopped Ceph mon.b for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T11:01:46.460 INFO:journalctl@ceph.mon.b.smithi184.stdout:May 10 11:01:46 smithi184 systemd[1]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mon.b.service: Consumed 9.623s CPU time. 2024-05-10T11:01:46.461 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mon.b.service' 2024-05-10T11:01:46.520 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:01:46.520 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-10T11:01:46.520 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-10T11:01:46.520 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mon.c 2024-05-10T11:01:46.813 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:46 smithi196 systemd[1]: Stopping Ceph mon.c for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:01:47.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:46 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-c[34863]: 2024-05-10T11:01:46.845+0000 7fb4dfcd6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:01:47.312 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:46 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-c[34863]: 2024-05-10T11:01:46.845+0000 7fb4dfcd6700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-10T11:01:47.313 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:47 smithi196 podman[69227]: 2024-05-10 11:01:47.060503807 +0000 UTC m=+0.337843435 container died f3ec729d9d06f14cf8d4076b94b1372d04b95871cde667c540dbff1cfe4a58bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-c, org.label-schema.build-date=20240507, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-10T11:01:47.595 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:47 smithi196 podman[69227]: 2024-05-10 11:01:47.402815005 +0000 UTC m=+0.680154687 container cleanup f3ec729d9d06f14cf8d4076b94b1372d04b95871cde667c540dbff1cfe4a58bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-10T11:01:47.595 INFO:journalctl@ceph.mon.c.smithi196.stdout:May 10 11:01:47 smithi196 bash[69227]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mon-c 2024-05-10T11:01:47.822 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mon.c.service' 2024-05-10T11:01:47.866 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:01:47.867 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-10T11:01:47.867 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-10T11:01:47.867 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mgr.x 2024-05-10T11:01:48.174 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 11:01:47 smithi107 systemd[1]: Stopping Ceph mgr.x for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:01:48.503 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 11:01:48 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T11:01:48.185+0000 7f6426ef6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:01:48.503 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 11:01:48 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x[30602]: 2024-05-10T11:01:48.185+0000 7f6426ef6700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-05-10T11:01:48.503 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 11:01:48 smithi107 podman[96801]: 2024-05-10 11:01:48.217509136 +0000 UTC m=+0.153273940 container died 7d5fa17006738b0e2e3236d34529bdaf4163c001c1f37da68031a3f102c3f8ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-10T11:01:48.924 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 11:01:48 smithi107 podman[96801]: 2024-05-10 11:01:48.686747667 +0000 UTC m=+0.622512467 container cleanup 7d5fa17006738b0e2e3236d34529bdaf4163c001c1f37da68031a3f102c3f8ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d39fa08867836ac070c47cb66c782fa559fd480b, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-10T11:01:48.924 INFO:journalctl@ceph.mgr.x.smithi107.stdout:May 10 11:01:48 smithi107 bash[96801]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-x 2024-05-10T11:01:49.028 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mgr.x.service' 2024-05-10T11:01:49.063 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:01:49.063 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-10T11:01:49.064 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-10T11:01:49.064 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mgr.y 2024-05-10T11:01:49.388 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 11:01:49 smithi184 systemd[1]: Stopping Ceph mgr.y for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:01:49.689 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 11:01:49 smithi184 podman[68428]: 2024-05-10 11:01:49.409628068 +0000 UTC m=+0.154648123 container died a48a616a3765a2c1b13872b0c8983f1b4601785b45e5c984aa483c9af7492991 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y, org.label-schema.build-date=20240507, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-05-10T11:01:50.056 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 11:01:49 smithi184 podman[68428]: 2024-05-10 11:01:49.788817623 +0000 UTC m=+0.533837669 container cleanup a48a616a3765a2c1b13872b0c8983f1b4601785b45e5c984aa483c9af7492991 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-10T11:01:50.056 INFO:journalctl@ceph.mgr.y.smithi184.stdout:May 10 11:01:49 smithi184 bash[68428]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-y 2024-05-10T11:01:50.211 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mgr.y.service' 2024-05-10T11:01:50.244 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:01:50.244 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-10T11:01:50.244 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-10T11:01:50.244 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mgr.z 2024-05-10T11:01:50.561 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 11:01:50 smithi196 systemd[1]: Stopping Ceph mgr.z for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:01:50.812 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 11:01:50 smithi196 podman[69349]: 2024-05-10 11:01:50.561550538 +0000 UTC m=+0.120371789 container died eda6c7673d353db5d1b3a348e375b7fee6d47669b1fcc7879b009768f16c279f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-05-10T11:01:51.196 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 11:01:50 smithi196 podman[69349]: 2024-05-10 11:01:50.915702974 +0000 UTC m=+0.474524218 container cleanup eda6c7673d353db5d1b3a348e375b7fee6d47669b1fcc7879b009768f16c279f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z, GIT_CLEAN=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-05-10T11:01:51.196 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 11:01:50 smithi196 bash[69349]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z 2024-05-10T11:01:51.196 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 11:01:51 smithi196 podman[69364]: 2024-05-10 11:01:51.091927955 +0000 UTC m=+0.518711741 container remove eda6c7673d353db5d1b3a348e375b7fee6d47669b1fcc7879b009768f16c279f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-10T11:01:51.196 INFO:journalctl@ceph.mgr.z.smithi196.stdout:May 10 11:01:51 smithi196 systemd[1]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-05-10T11:01:51.210 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mgr.z.service' 2024-05-10T11:01:51.243 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:01:51.244 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-10T11:01:51.244 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-10T11:01:51.244 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.0 2024-05-10T11:01:51.540 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 11:01:51 smithi107 systemd[1]: Stopping Ceph osd.0 for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:01:51.924 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 11:01:51 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-0[45596]: 2024-05-10T11:01:51.540+0000 7f1a83db8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:01:51.924 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 11:01:51 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-0[45596]: 2024-05-10T11:01:51.540+0000 7f1a83db8700 -1 osd.0 85 *** Got signal Terminated *** 2024-05-10T11:01:51.924 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 11:01:51 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-0[45596]: 2024-05-10T11:01:51.540+0000 7f1a83db8700 -1 osd.0 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T11:01:57.308 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 11:01:56 smithi107 podman[96923]: 2024-05-10 11:01:56.996783791 +0000 UTC m=+5.561509017 container died 07bc68e33822672213c70d55a649e8b2184e572134a651bceda14743e29ce5d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-10T11:01:57.659 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 11:01:57 smithi107 podman[96923]: 2024-05-10 11:01:57.415814572 +0000 UTC m=+5.980539793 container cleanup 07bc68e33822672213c70d55a649e8b2184e572134a651bceda14743e29ce5d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-0, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, ceph=True, GIT_CLEAN=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-05-10T11:01:57.659 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 11:01:57 smithi107 bash[96923]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-0 2024-05-10T11:01:57.924 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 11:01:57 smithi107 podman[96943]: 2024-05-10 11:01:57.658922071 +0000 UTC m=+0.660735282 container remove 07bc68e33822672213c70d55a649e8b2184e572134a651bceda14743e29ce5d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507) 2024-05-10T11:01:58.361 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 11:01:58 smithi107 podman[97034]: 2024-05-10 11:01:58.076330721 +0000 UTC m=+0.104412131 container create 59808b6a291100ae7bbd34e8777530bddeb1df3a267550d9eb29262781a57440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-10T11:01:58.362 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 11:01:58 smithi107 podman[97034]: 2024-05-10 11:01:57.990290199 +0000 UTC m=+0.018371619 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T11:01:58.362 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 11:01:58 smithi107 podman[97034]: 2024-05-10 11:01:58.303697365 +0000 UTC m=+0.331778772 container init 59808b6a291100ae7bbd34e8777530bddeb1df3a267550d9eb29262781a57440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e) 2024-05-10T11:01:58.362 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 11:01:58 smithi107 podman[97034]: 2024-05-10 11:01:58.307164889 +0000 UTC m=+0.335246296 container start 59808b6a291100ae7bbd34e8777530bddeb1df3a267550d9eb29262781a57440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-0-deactivate, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-10T11:01:58.362 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 11:01:58 smithi107 podman[97034]: 2024-05-10 11:01:58.361786538 +0000 UTC m=+0.389867957 container attach 59808b6a291100ae7bbd34e8777530bddeb1df3a267550d9eb29262781a57440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-10T11:01:58.674 INFO:journalctl@ceph.osd.0.smithi107.stdout:May 10 11:01:58 smithi107 podman[97034]: 2024-05-10 11:01:58.606007336 +0000 UTC m=+0.634088744 container died 59808b6a291100ae7bbd34e8777530bddeb1df3a267550d9eb29262781a57440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-0-deactivate, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS) 2024-05-10T11:01:59.209 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.0.service' 2024-05-10T11:01:59.250 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:01:59.250 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-10T11:01:59.250 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-10T11:01:59.250 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.1 2024-05-10T11:01:59.593 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 11:01:59 smithi184 systemd[1]: Stopping Ceph osd.1 for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:01:59.889 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 11:01:59 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-1[39173]: 2024-05-10T11:01:59.592+0000 7fd20b052700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:01:59.889 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 11:01:59 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-1[39173]: 2024-05-10T11:01:59.592+0000 7fd20b052700 -1 osd.1 85 *** Got signal Terminated *** 2024-05-10T11:01:59.889 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 11:01:59 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-1[39173]: 2024-05-10T11:01:59.592+0000 7fd20b052700 -1 osd.1 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T11:02:05.277 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 11:02:05 smithi184 podman[68562]: 2024-05-10 11:02:05.003482597 +0000 UTC m=+5.559338966 container died 8a956c60fe477ded96ec2583e44913defce9bb99d21fb5278d1787f5a742b508 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-1, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.schema-version=1.0) 2024-05-10T11:02:05.628 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 11:02:05 smithi184 podman[68562]: 2024-05-10 11:02:05.369020391 +0000 UTC m=+5.924876762 container cleanup 8a956c60fe477ded96ec2583e44913defce9bb99d21fb5278d1787f5a742b508 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-1, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.license=GPLv2) 2024-05-10T11:02:05.629 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 11:02:05 smithi184 bash[68562]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-1 2024-05-10T11:02:05.888 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 11:02:05 smithi184 podman[68580]: 2024-05-10 11:02:05.629401335 +0000 UTC m=+0.622305790 container remove 8a956c60fe477ded96ec2583e44913defce9bb99d21fb5278d1787f5a742b508 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240507, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e) 2024-05-10T11:02:06.242 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 11:02:05 smithi184 podman[68673]: 2024-05-10 11:02:05.889182842 +0000 UTC m=+0.017866624 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T11:02:06.242 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 11:02:06 smithi184 podman[68673]: 2024-05-10 11:02:06.005876221 +0000 UTC m=+0.134560035 container create 5d455e9190f1c62d7c2b446c7a5859117847ea1bd2ffec5dba040db3268e83c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-1-deactivate, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-10T11:02:06.242 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 11:02:06 smithi184 podman[68673]: 2024-05-10 11:02:06.242080354 +0000 UTC m=+0.370764136 container init 5d455e9190f1c62d7c2b446c7a5859117847ea1bd2ffec5dba040db3268e83c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-1-deactivate, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_CLEAN=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-05-10T11:02:06.534 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 11:02:06 smithi184 podman[68673]: 2024-05-10 11:02:06.245953112 +0000 UTC m=+0.374636884 container start 5d455e9190f1c62d7c2b446c7a5859117847ea1bd2ffec5dba040db3268e83c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-05-10T11:02:06.534 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 11:02:06 smithi184 podman[68673]: 2024-05-10 11:02:06.316907421 +0000 UTC m=+0.445591196 container attach 5d455e9190f1c62d7c2b446c7a5859117847ea1bd2ffec5dba040db3268e83c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e) 2024-05-10T11:02:06.827 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 11:02:06 smithi184 podman[68673]: 2024-05-10 11:02:06.535012749 +0000 UTC m=+0.663696527 container died 5d455e9190f1c62d7c2b446c7a5859117847ea1bd2ffec5dba040db3268e83c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-10T11:02:07.104 INFO:journalctl@ceph.osd.1.smithi184.stdout:May 10 11:02:07 smithi184 podman[68699]: 2024-05-10 11:02:07.103641326 +0000 UTC m=+0.563551456 container remove 5d455e9190f1c62d7c2b446c7a5859117847ea1bd2ffec5dba040db3268e83c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-05-10T11:02:07.136 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.1.service' 2024-05-10T11:02:07.176 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:02:07.177 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-10T11:02:07.177 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-10T11:02:07.177 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.2 2024-05-10T11:02:07.477 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 11:02:07 smithi196 systemd[1]: Stopping Ceph osd.2 for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:02:07.812 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 11:02:07 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-2[40057]: 2024-05-10T11:02:07.476+0000 7fd479203700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:02:07.812 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 11:02:07 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-2[40057]: 2024-05-10T11:02:07.476+0000 7fd479203700 -1 osd.2 85 *** Got signal Terminated *** 2024-05-10T11:02:07.812 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 11:02:07 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-2[40057]: 2024-05-10T11:02:07.476+0000 7fd479203700 -1 osd.2 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T11:02:13.062 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 11:02:12 smithi196 podman[69485]: 2024-05-10 11:02:12.80881519 +0000 UTC m=+5.430307231 container died 906214e9a96eca8520770bcd042bbbe138542b1b291f264ed997c412dd92a463 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-2, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.license=GPLv2, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, CEPH_POINT_RELEASE=) 2024-05-10T11:02:13.418 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 11:02:13 smithi196 podman[69485]: 2024-05-10 11:02:13.159771988 +0000 UTC m=+5.781264036 container cleanup 906214e9a96eca8520770bcd042bbbe138542b1b291f264ed997c412dd92a463 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-10T11:02:13.418 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 11:02:13 smithi196 bash[69485]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-2 2024-05-10T11:02:13.769 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 11:02:13 smithi196 podman[69502]: 2024-05-10 11:02:13.419150951 +0000 UTC m=+0.613205022 container remove 906214e9a96eca8520770bcd042bbbe138542b1b291f264ed997c412dd92a463 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-2, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-10T11:02:14.047 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 11:02:13 smithi196 podman[69591]: 2024-05-10 11:02:13.769925977 +0000 UTC m=+0.114574412 container create 66bb65bb8ad5827148cb572eae2a97e2e383ff6ab47060c135bed9d4b51dd89a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-10T11:02:14.048 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 11:02:13 smithi196 podman[69591]: 2024-05-10 11:02:13.6732315 +0000 UTC m=+0.017879950 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T11:02:14.048 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 11:02:13 smithi196 podman[69591]: 2024-05-10 11:02:13.947778974 +0000 UTC m=+0.292427413 container init 66bb65bb8ad5827148cb572eae2a97e2e383ff6ab47060c135bed9d4b51dd89a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507) 2024-05-10T11:02:14.048 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 11:02:13 smithi196 podman[69591]: 2024-05-10 11:02:13.951164286 +0000 UTC m=+0.295812721 container start 66bb65bb8ad5827148cb572eae2a97e2e383ff6ab47060c135bed9d4b51dd89a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-10T11:02:14.048 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 11:02:14 smithi196 podman[69591]: 2024-05-10 11:02:14.047368012 +0000 UTC m=+0.392016445 container attach 66bb65bb8ad5827148cb572eae2a97e2e383ff6ab47060c135bed9d4b51dd89a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-10T11:02:14.313 INFO:journalctl@ceph.osd.2.smithi196.stdout:May 10 11:02:14 smithi196 podman[69591]: 2024-05-10 11:02:14.239238054 +0000 UTC m=+0.583886490 container died 66bb65bb8ad5827148cb572eae2a97e2e383ff6ab47060c135bed9d4b51dd89a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08) 2024-05-10T11:02:14.784 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.2.service' 2024-05-10T11:02:14.823 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:02:14.823 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-10T11:02:14.823 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-10T11:02:14.824 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.3 2024-05-10T11:02:15.109 INFO:journalctl@ceph.osd.3.smithi107.stdout:May 10 11:02:14 smithi107 systemd[1]: Stopping Ceph osd.3 for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:02:15.424 INFO:journalctl@ceph.osd.3.smithi107.stdout:May 10 11:02:15 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-3[52118]: 2024-05-10T11:02:15.107+0000 7f2c891e8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:02:15.424 INFO:journalctl@ceph.osd.3.smithi107.stdout:May 10 11:02:15 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-3[52118]: 2024-05-10T11:02:15.107+0000 7f2c891e8700 -1 osd.3 85 *** Got signal Terminated *** 2024-05-10T11:02:15.424 INFO:journalctl@ceph.osd.3.smithi107.stdout:May 10 11:02:15 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-3[52118]: 2024-05-10T11:02:15.107+0000 7f2c891e8700 -1 osd.3 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T11:02:17.812 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:17 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:17.489+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.428958+0000 front 2024-05-10T11:01:55.428996+0000 (oldest deadline 2024-05-10T11:02:17.129004+0000) 2024-05-10T11:02:18.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:18 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:18.023+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:18.424 INFO:journalctl@ceph.osd.3.smithi107.stdout:May 10 11:02:17 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-3[52118]: 2024-05-10T11:02:17.992+0000 7f2c857dc700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:52.943729+0000 front 2024-05-10T11:01:52.943699+0000 (oldest deadline 2024-05-10T11:02:17.044011+0000) 2024-05-10T11:02:18.812 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:18 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:18.520+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.428958+0000 front 2024-05-10T11:01:55.428996+0000 (oldest deadline 2024-05-10T11:02:17.129004+0000) 2024-05-10T11:02:18.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:18 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:18.569+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:18.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:18 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:18.434+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:19.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:19 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:19.051+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:19.413 INFO:journalctl@ceph.osd.3.smithi107.stdout:May 10 11:02:18 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-3[52118]: 2024-05-10T11:02:18.956+0000 7f2c857dc700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:52.943729+0000 front 2024-05-10T11:01:52.943699+0000 (oldest deadline 2024-05-10T11:02:17.044011+0000) 2024-05-10T11:02:19.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:19 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:19.413+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:19.812 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:19 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:19.500+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.428958+0000 front 2024-05-10T11:01:55.428996+0000 (oldest deadline 2024-05-10T11:02:17.129004+0000) 2024-05-10T11:02:19.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:19 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:19.542+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:20.386 INFO:journalctl@ceph.osd.3.smithi107.stdout:May 10 11:02:20 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-3[52118]: 2024-05-10T11:02:20.002+0000 7f2c857dc700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:52.943729+0000 front 2024-05-10T11:01:52.943699+0000 (oldest deadline 2024-05-10T11:02:17.044011+0000) 2024-05-10T11:02:20.520 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:20 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:20.094+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:20.674 INFO:journalctl@ceph.osd.3.smithi107.stdout:May 10 11:02:20 smithi107 podman[97157]: 2024-05-10 11:02:20.539422099 +0000 UTC m=+5.517248904 container died 3ab695621f8e644bc70b83361ead76d6fea2ce7528828a4971a6bbd7bf554c0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-10T11:02:20.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:20 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:20.385+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:20.812 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:20 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:20.520+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.428958+0000 front 2024-05-10T11:01:55.428996+0000 (oldest deadline 2024-05-10T11:02:17.129004+0000) 2024-05-10T11:02:20.888 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:20 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:20.529+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:21.142 INFO:journalctl@ceph.osd.3.smithi107.stdout:May 10 11:02:20 smithi107 podman[97157]: 2024-05-10 11:02:20.916185307 +0000 UTC m=+5.894012110 container cleanup 3ab695621f8e644bc70b83361ead76d6fea2ce7528828a4971a6bbd7bf554c0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-10T11:02:21.142 INFO:journalctl@ceph.osd.3.smithi107.stdout:May 10 11:02:20 smithi107 bash[97157]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-3 2024-05-10T11:02:21.421 INFO:journalctl@ceph.osd.3.smithi107.stdout:May 10 11:02:21 smithi107 podman[97175]: 2024-05-10 11:02:21.142760371 +0000 UTC m=+0.597759054 container remove 3ab695621f8e644bc70b83361ead76d6fea2ce7528828a4971a6bbd7bf554c0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-10T11:02:21.422 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:21 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:21.372+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:21.537 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:21 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:21.089+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:21.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:21 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:21.421+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:21.674 INFO:journalctl@ceph.osd.3.smithi107.stdout:May 10 11:02:21 smithi107 podman[97266]: 2024-05-10 11:02:21.485653418 +0000 UTC m=+0.018156462 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T11:02:21.675 INFO:journalctl@ceph.osd.3.smithi107.stdout:May 10 11:02:21 smithi107 podman[97266]: 2024-05-10 11:02:21.601996021 +0000 UTC m=+0.134499051 container create 94782875d77f0c1fa4a563e41d4403dce7b346e68f7e7b9dbbbdc91b50b8f941 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08) 2024-05-10T11:02:21.812 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:21 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:21.537+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.428958+0000 front 2024-05-10T11:01:55.428996+0000 (oldest deadline 2024-05-10T11:02:17.129004+0000) 2024-05-10T11:02:21.888 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:21 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:21.495+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:22.154 INFO:journalctl@ceph.osd.3.smithi107.stdout:May 10 11:02:21 smithi107 podman[97266]: 2024-05-10 11:02:21.854379154 +0000 UTC m=+0.386882191 container init 94782875d77f0c1fa4a563e41d4403dce7b346e68f7e7b9dbbbdc91b50b8f941 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-3-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-10T11:02:22.154 INFO:journalctl@ceph.osd.3.smithi107.stdout:May 10 11:02:21 smithi107 podman[97266]: 2024-05-10 11:02:21.857767039 +0000 UTC m=+0.390270070 container start 94782875d77f0c1fa4a563e41d4403dce7b346e68f7e7b9dbbbdc91b50b8f941 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.build-date=20240507, io.buildah.version=1.33.5) 2024-05-10T11:02:22.154 INFO:journalctl@ceph.osd.3.smithi107.stdout:May 10 11:02:21 smithi107 podman[97266]: 2024-05-10 11:02:21.92076476 +0000 UTC m=+0.453267805 container attach 94782875d77f0c1fa4a563e41d4403dce7b346e68f7e7b9dbbbdc91b50b8f941 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-10T11:02:22.414 INFO:journalctl@ceph.osd.3.smithi107.stdout:May 10 11:02:22 smithi107 podman[97266]: 2024-05-10 11:02:22.154927137 +0000 UTC m=+0.687430167 container died 94782875d77f0c1fa4a563e41d4403dce7b346e68f7e7b9dbbbdc91b50b8f941 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08) 2024-05-10T11:02:22.414 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:22 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:22.392+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:22.514 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:22.066+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:22.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:22 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:22.413+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:22.781 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.3.service' 2024-05-10T11:02:22.812 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:22.514+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.428958+0000 front 2024-05-10T11:01:55.428996+0000 (oldest deadline 2024-05-10T11:02:17.129004+0000) 2024-05-10T11:02:22.821 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:02:22.821 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-10T11:02:22.821 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-10T11:02:22.821 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.4 2024-05-10T11:02:22.847 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:22 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:22.528+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:23.131 INFO:journalctl@ceph.osd.4.smithi184.stdout:May 10 11:02:22 smithi184 systemd[1]: Stopping Ceph osd.4 for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:02:23.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:23 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:23.040+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:23.388 INFO:journalctl@ceph.osd.4.smithi184.stdout:May 10 11:02:23 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-4[46001]: 2024-05-10T11:02:23.130+0000 7f5830a77700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:02:23.389 INFO:journalctl@ceph.osd.4.smithi184.stdout:May 10 11:02:23 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-4[46001]: 2024-05-10T11:02:23.130+0000 7f5830a77700 -1 osd.4 85 *** Got signal Terminated *** 2024-05-10T11:02:23.389 INFO:journalctl@ceph.osd.4.smithi184.stdout:May 10 11:02:23 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-4[46001]: 2024-05-10T11:02:23.130+0000 7f5830a77700 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T11:02:23.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:23 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:23.383+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:23.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:23 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:23.402+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:23.812 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:23 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:23.529+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.428958+0000 front 2024-05-10T11:01:55.428996+0000 (oldest deadline 2024-05-10T11:02:17.129004+0000) 2024-05-10T11:02:23.888 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:23 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:23.576+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:24.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:24 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:24.035+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:24.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:24 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:24.385+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:24.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:24 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:24.407+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:24.812 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:24 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:24.496+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.428958+0000 front 2024-05-10T11:01:55.428996+0000 (oldest deadline 2024-05-10T11:02:17.129004+0000) 2024-05-10T11:02:24.888 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:24 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:24.538+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:25.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:24 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:24.988+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:25.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:25 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:25.449+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:25.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:25 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:25.388+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:25.812 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:25 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:25.520+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.428958+0000 front 2024-05-10T11:01:55.428996+0000 (oldest deadline 2024-05-10T11:02:17.129004+0000) 2024-05-10T11:02:25.888 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:25 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:25.543+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:26.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:25 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:25.966+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:26.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:25 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:25.966+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:26.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:26 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:26.037+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:26.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:26 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:26.424+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:26.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:26 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:26.424+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:26.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:26 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:26.424+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:26.850 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:26 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:26.570+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.428958+0000 front 2024-05-10T11:01:55.428996+0000 (oldest deadline 2024-05-10T11:02:17.129004+0000) 2024-05-10T11:02:26.888 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:26 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:26.592+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:27.312 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:26 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:26.849+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:27.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:26 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:26.984+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:27.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:26 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:26.984+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:27.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:27 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:27.048+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:27.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:27 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:27.413+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:27.675 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:27 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:27.431+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:27.675 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:27 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:27.431+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:27.812 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:27 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:27.557+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.428958+0000 front 2024-05-10T11:01:55.428996+0000 (oldest deadline 2024-05-10T11:02:17.129004+0000) 2024-05-10T11:02:28.053 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:27 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:27.638+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:28.053 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:27 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:27.638+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:28.312 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:27 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:27.876+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:28.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:28 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:28.009+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:28.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:28 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:28.009+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:28.341 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:28 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:28.053+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:28.639 INFO:journalctl@ceph.osd.4.smithi184.stdout:May 10 11:02:28 smithi184 podman[68779]: 2024-05-10 11:02:28.495070621 +0000 UTC m=+5.482600784 container died ec2f58381e9087b6351fdab05f6328ce4d122ec2487e147929bb15079fb713d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-10T11:02:28.812 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:28 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:28.555+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.428958+0000 front 2024-05-10T11:01:55.428996+0000 (oldest deadline 2024-05-10T11:02:17.129004+0000) 2024-05-10T11:02:28.924 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:28 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:28.448+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:28.924 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:28 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:28.448+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:01.675412+0000 front 2024-05-10T11:02:01.675280+0000 (oldest deadline 2024-05-10T11:02:27.575191+0000) 2024-05-10T11:02:28.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:28 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:28.478+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:28.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:28 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:28.478+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:29.074 INFO:journalctl@ceph.osd.4.smithi184.stdout:May 10 11:02:28 smithi184 podman[68779]: 2024-05-10 11:02:28.88151445 +0000 UTC m=+5.869044609 container cleanup ec2f58381e9087b6351fdab05f6328ce4d122ec2487e147929bb15079fb713d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e) 2024-05-10T11:02:29.075 INFO:journalctl@ceph.osd.4.smithi184.stdout:May 10 11:02:28 smithi184 bash[68779]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-4 2024-05-10T11:02:29.075 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:28 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:28.644+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:29.075 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:28 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:28.644+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:29.312 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:28 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:28.890+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:29.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:29 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:29.037+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:29.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:29 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:29.037+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:29.324 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:29 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:29.074+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:29.325 INFO:journalctl@ceph.osd.4.smithi184.stdout:May 10 11:02:29 smithi184 podman[68801]: 2024-05-10 11:02:29.099407638 +0000 UTC m=+0.607764591 container remove ec2f58381e9087b6351fdab05f6328ce4d122ec2487e147929bb15079fb713d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.build-date=20240507) 2024-05-10T11:02:29.591 INFO:journalctl@ceph.osd.4.smithi184.stdout:May 10 11:02:29 smithi184 podman[68902]: 2024-05-10 11:02:29.361752654 +0000 UTC m=+0.017666018 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T11:02:29.592 INFO:journalctl@ceph.osd.4.smithi184.stdout:May 10 11:02:29 smithi184 podman[68902]: 2024-05-10 11:02:29.467917732 +0000 UTC m=+0.123831115 container create fecd197e84896ce30c8f05ca774f7c34eb44872b4eaa1463ad6cf312421fd1a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-10T11:02:29.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:29 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:29.401+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:29.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:29 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:29.401+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:01.675412+0000 front 2024-05-10T11:02:01.675280+0000 (oldest deadline 2024-05-10T11:02:27.575191+0000) 2024-05-10T11:02:29.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:29 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:29.475+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:29.675 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:29 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:29.475+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:29.862 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:29 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:29.572+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.428958+0000 front 2024-05-10T11:01:55.428996+0000 (oldest deadline 2024-05-10T11:02:17.129004+0000) 2024-05-10T11:02:30.011 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:29 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:29.651+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:30.011 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:29 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:29.651+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:30.012 INFO:journalctl@ceph.osd.4.smithi184.stdout:May 10 11:02:29 smithi184 podman[68902]: 2024-05-10 11:02:29.712603514 +0000 UTC m=+0.368516859 container init fecd197e84896ce30c8f05ca774f7c34eb44872b4eaa1463ad6cf312421fd1a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-4-deactivate, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.build-date=20240507) 2024-05-10T11:02:30.012 INFO:journalctl@ceph.osd.4.smithi184.stdout:May 10 11:02:29 smithi184 podman[68902]: 2024-05-10 11:02:29.715751354 +0000 UTC m=+0.371664692 container start fecd197e84896ce30c8f05ca774f7c34eb44872b4eaa1463ad6cf312421fd1a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-4-deactivate, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_CLEAN=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-10T11:02:30.012 INFO:journalctl@ceph.osd.4.smithi184.stdout:May 10 11:02:29 smithi184 podman[68902]: 2024-05-10 11:02:29.804147576 +0000 UTC m=+0.460060913 container attach fecd197e84896ce30c8f05ca774f7c34eb44872b4eaa1463ad6cf312421fd1a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-05-10T11:02:30.312 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:29 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:29.862+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:30.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:30 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:30.028+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:30.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:30 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:30.028+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:30.315 INFO:journalctl@ceph.osd.4.smithi184.stdout:May 10 11:02:30 smithi184 podman[68902]: 2024-05-10 11:02:30.012481508 +0000 UTC m=+0.668394848 container died fecd197e84896ce30c8f05ca774f7c34eb44872b4eaa1463ad6cf312421fd1a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_CLEAN=True, org.label-schema.build-date=20240507, io.buildah.version=1.33.5) 2024-05-10T11:02:30.316 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:30 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:30.122+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:30.600 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.4.service' 2024-05-10T11:02:30.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:30 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:30.523+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:30.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:30 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:30.523+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:30.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:30 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:30.381+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:30.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:30 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:30.381+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:01.675412+0000 front 2024-05-10T11:02:01.675280+0000 (oldest deadline 2024-05-10T11:02:27.575191+0000) 2024-05-10T11:02:30.678 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:02:30.679 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-10T11:02:30.679 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-10T11:02:30.679 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.5 2024-05-10T11:02:30.885 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:30 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:30.616+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.428958+0000 front 2024-05-10T11:01:55.428996+0000 (oldest deadline 2024-05-10T11:02:17.129004+0000) 2024-05-10T11:02:30.885 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:30 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:30.616+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:02.430189+0000 front 2024-05-10T11:02:02.430155+0000 (oldest deadline 2024-05-10T11:02:30.030841+0000) 2024-05-10T11:02:30.885 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:30 smithi196 systemd[1]: Stopping Ceph osd.5 for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:02:30.888 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:30 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:30.689+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:30.888 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:30 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:30.689+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:31.312 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:30 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:30.884+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:31.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:31 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:31.006+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:31.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:31 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:31.006+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:31.313 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:30 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:30.977+0000 7fb975e57700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:02:31.313 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:30 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:30.977+0000 7fb975e57700 -1 osd.5 85 *** Got signal Terminated *** 2024-05-10T11:02:31.313 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:30 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:30.977+0000 7fb975e57700 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T11:02:31.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:31 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:31.111+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:31.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:31 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:31.339+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:31.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:31 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:31.339+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:01.675412+0000 front 2024-05-10T11:02:01.675280+0000 (oldest deadline 2024-05-10T11:02:27.575191+0000) 2024-05-10T11:02:31.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:31 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:31.528+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:31.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:31 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:31.528+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:31.933 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:31 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:31.584+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.428958+0000 front 2024-05-10T11:01:55.428996+0000 (oldest deadline 2024-05-10T11:02:17.129004+0000) 2024-05-10T11:02:31.933 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:31 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:31.584+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:02.430189+0000 front 2024-05-10T11:02:02.430155+0000 (oldest deadline 2024-05-10T11:02:30.030841+0000) 2024-05-10T11:02:32.074 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:31 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:31.639+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:32.074 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:31 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:31.639+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:32.313 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:31 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:31.933+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:32.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:31 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:31.971+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:32.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:31 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:31.971+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:32.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:32 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:32.074+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:32.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:32 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:32.299+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:32.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:32 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:32.299+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:01.675412+0000 front 2024-05-10T11:02:01.675280+0000 (oldest deadline 2024-05-10T11:02:27.575191+0000) 2024-05-10T11:02:32.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:32 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:32.527+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:32.675 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:32 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:32.527+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:32.924 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:32 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:32.612+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.428958+0000 front 2024-05-10T11:01:55.428996+0000 (oldest deadline 2024-05-10T11:02:17.129004+0000) 2024-05-10T11:02:32.924 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:32 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:32.612+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:02.430189+0000 front 2024-05-10T11:02:02.430155+0000 (oldest deadline 2024-05-10T11:02:30.030841+0000) 2024-05-10T11:02:33.099 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:32 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:32.685+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:33.099 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:32 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:32.685+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:33.312 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:32 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:32.924+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:33.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:32 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:32.970+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:33.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:32 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:32.970+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:33.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:33 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:33.100+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:33.572 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:33 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:33.294+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:33.572 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:33 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:33.294+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:01.675412+0000 front 2024-05-10T11:02:01.675280+0000 (oldest deadline 2024-05-10T11:02:27.575191+0000) 2024-05-10T11:02:33.903 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:33 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:33.610+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.428958+0000 front 2024-05-10T11:01:55.428996+0000 (oldest deadline 2024-05-10T11:02:17.129004+0000) 2024-05-10T11:02:33.903 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:33 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:33.610+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:02.430189+0000 front 2024-05-10T11:02:02.430155+0000 (oldest deadline 2024-05-10T11:02:30.030841+0000) 2024-05-10T11:02:33.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:33 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:33.572+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:33.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:33 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:33.572+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:34.115 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:33 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:33.696+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:34.115 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:33 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:33.696+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:34.115 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:33 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:33.696+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:34.312 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:33 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:33.903+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:34.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:33 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:33.955+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:34.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:33 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:33.955+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:34.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:33 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:33.955+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:34.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:34 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:34.115+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:34.572 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:34 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:34.271+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:34.572 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:34 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:34.271+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:01.675412+0000 front 2024-05-10T11:02:01.675280+0000 (oldest deadline 2024-05-10T11:02:27.575191+0000) 2024-05-10T11:02:34.572 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:34 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:34.271+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.575717+0000 front 2024-05-10T11:02:07.575674+0000 (oldest deadline 2024-05-10T11:02:33.475736+0000) 2024-05-10T11:02:34.917 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:34 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:34.578+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.428958+0000 front 2024-05-10T11:01:55.428996+0000 (oldest deadline 2024-05-10T11:02:17.129004+0000) 2024-05-10T11:02:34.917 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:34 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:34.578+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:02.430189+0000 front 2024-05-10T11:02:02.430155+0000 (oldest deadline 2024-05-10T11:02:30.030841+0000) 2024-05-10T11:02:34.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:34 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:34.572+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:34.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:34 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:34.572+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:35.133 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:34 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:34.714+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:35.134 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:34 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:34.714+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:35.134 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:34 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:34.714+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:35.312 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:34 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:34.946+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:35.313 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:34 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:34.946+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:35.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:34 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:34.917+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:35.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:34 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:34.917+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:35.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:34 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:34.917+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:35.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:35 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:35.134+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:35.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:35 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:35.134+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.395127+0000 front 2024-05-10T11:02:10.395159+0000 (oldest deadline 2024-05-10T11:02:34.495080+0000) 2024-05-10T11:02:35.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:35 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:35.528+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:35.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:35 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:35.528+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:35.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:35 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:35.528+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:35.675 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:35 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:35.306+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:35.675 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:35 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:35.306+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:01.675412+0000 front 2024-05-10T11:02:01.675280+0000 (oldest deadline 2024-05-10T11:02:27.575191+0000) 2024-05-10T11:02:35.675 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:35 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:35.306+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.575717+0000 front 2024-05-10T11:02:07.575674+0000 (oldest deadline 2024-05-10T11:02:33.475736+0000) 2024-05-10T11:02:35.868 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:35 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:35.602+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.428958+0000 front 2024-05-10T11:01:55.428996+0000 (oldest deadline 2024-05-10T11:02:17.129004+0000) 2024-05-10T11:02:35.868 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:35 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:35.602+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:02.430189+0000 front 2024-05-10T11:02:02.430155+0000 (oldest deadline 2024-05-10T11:02:30.030841+0000) 2024-05-10T11:02:35.868 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:35 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5[47013]: 2024-05-10T11:02:35.602+0000 7fb96e443700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.031310+0000 front 2024-05-10T11:02:10.031339+0000 (oldest deadline 2024-05-10T11:02:35.331495+0000) 2024-05-10T11:02:36.138 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:35 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:35.748+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:36.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:35 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:35.748+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:36.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:35 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:35.748+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:36.313 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:35 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:35.996+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:36.313 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:35 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:35.996+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:36.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:35 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:35.868+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:36.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:35 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:35.868+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:36.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:35 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:35.868+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:36.638 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:36 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:36.142+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:36.639 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:36 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:36.142+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.395127+0000 front 2024-05-10T11:02:10.395159+0000 (oldest deadline 2024-05-10T11:02:34.495080+0000) 2024-05-10T11:02:36.670 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:36 smithi196 podman[69709]: 2024-05-10 11:02:36.387700177 +0000 UTC m=+5.510729346 container died c09902da73e8cc586381a7615b202f80709531d6c3e6c02327bca7325b1c3346 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-10T11:02:36.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:36 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:36.342+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:36.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:36 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:36.342+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:01.675412+0000 front 2024-05-10T11:02:01.675280+0000 (oldest deadline 2024-05-10T11:02:27.575191+0000) 2024-05-10T11:02:36.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:36 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:36.342+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.575717+0000 front 2024-05-10T11:02:07.575674+0000 (oldest deadline 2024-05-10T11:02:33.475736+0000) 2024-05-10T11:02:36.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:36 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:36.560+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:36.675 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:36 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:36.561+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:36.675 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:36 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:36.561+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:36.929 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:36 smithi196 podman[69709]: 2024-05-10 11:02:36.671061783 +0000 UTC m=+5.794090992 container cleanup c09902da73e8cc586381a7615b202f80709531d6c3e6c02327bca7325b1c3346 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-05-10T11:02:36.930 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:36 smithi196 bash[69709]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5 2024-05-10T11:02:36.930 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:36 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:36.826+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:36.930 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:36 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:36.826+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:36.930 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:36 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:36.826+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:37.138 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:36 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:36.724+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:37.138 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:36 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:36.724+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:37.138 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:36 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:36.724+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:37.246 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:36 smithi196 podman[69726]: 2024-05-10 11:02:36.930403337 +0000 UTC m=+0.542824047 container remove c09902da73e8cc586381a7615b202f80709531d6c3e6c02327bca7325b1c3346 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-10T11:02:37.246 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:36 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:36.961+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:37.246 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:36 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:36.961+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:37.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:37 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:37.138+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:37.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:37 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:37.138+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.395127+0000 front 2024-05-10T11:02:10.395159+0000 (oldest deadline 2024-05-10T11:02:34.495080+0000) 2024-05-10T11:02:37.508 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:37 smithi196 podman[69817]: 2024-05-10 11:02:37.149376398 +0000 UTC m=+0.018018194 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T11:02:37.508 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:37 smithi196 podman[69817]: 2024-05-10 11:02:37.273019376 +0000 UTC m=+0.141661159 container create 0770613b63083865d91c9752211b731f223a75368ea1910a0ae2357f5eaf06c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, ceph=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-10T11:02:37.570 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:37 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:37.308+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:37.570 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:37 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:37.308+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:01.675412+0000 front 2024-05-10T11:02:01.675280+0000 (oldest deadline 2024-05-10T11:02:27.575191+0000) 2024-05-10T11:02:37.571 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:37 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:37.308+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.575717+0000 front 2024-05-10T11:02:07.575674+0000 (oldest deadline 2024-05-10T11:02:33.475736+0000) 2024-05-10T11:02:37.807 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:37 smithi196 podman[69817]: 2024-05-10 11:02:37.50882002 +0000 UTC m=+0.377461803 container init 0770613b63083865d91c9752211b731f223a75368ea1910a0ae2357f5eaf06c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-10T11:02:37.807 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:37 smithi196 podman[69817]: 2024-05-10 11:02:37.511897668 +0000 UTC m=+0.380539452 container start 0770613b63083865d91c9752211b731f223a75368ea1910a0ae2357f5eaf06c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, ceph=True, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-10T11:02:37.807 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:37 smithi196 podman[69817]: 2024-05-10 11:02:37.591935581 +0000 UTC m=+0.460577382 container attach 0770613b63083865d91c9752211b731f223a75368ea1910a0ae2357f5eaf06c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e) 2024-05-10T11:02:37.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:37 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:37.570+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:37.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:37 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:37.570+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:37.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:37 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:37.570+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:38.062 INFO:journalctl@ceph.osd.5.smithi196.stdout:May 10 11:02:37 smithi196 podman[69817]: 2024-05-10 11:02:37.807937254 +0000 UTC m=+0.676579044 container died 0770613b63083865d91c9752211b731f223a75368ea1910a0ae2357f5eaf06c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, maintainer=Guillaume Abrioux , RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True) 2024-05-10T11:02:38.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:37 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:37.979+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:38.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:37 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:37.979+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:38.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:37 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:37.831+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:38.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:37 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:37.831+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:38.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:37 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:37.831+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:38.117 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:37 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:37.699+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:38.117 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:37 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:37.699+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:38.117 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:37 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:37.699+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:38.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:38 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:38.118+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:38.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:38 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:38.118+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.395127+0000 front 2024-05-10T11:02:10.395159+0000 (oldest deadline 2024-05-10T11:02:34.495080+0000) 2024-05-10T11:02:38.403 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.5.service' 2024-05-10T11:02:38.441 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:02:38.442 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-10T11:02:38.442 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-10T11:02:38.442 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.6 2024-05-10T11:02:38.621 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:38.298+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:38.622 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:38.298+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:01.675412+0000 front 2024-05-10T11:02:01.675280+0000 (oldest deadline 2024-05-10T11:02:27.575191+0000) 2024-05-10T11:02:38.622 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:38.298+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.575717+0000 front 2024-05-10T11:02:07.575674+0000 (oldest deadline 2024-05-10T11:02:33.475736+0000) 2024-05-10T11:02:38.622 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:38 smithi107 systemd[1]: Stopping Ceph osd.6 for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:02:38.924 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:38.750+0000 7fad293e5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:02:38.924 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:38.750+0000 7fad293e5700 -1 osd.6 85 *** Got signal Terminated *** 2024-05-10T11:02:38.924 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:38.750+0000 7fad293e5700 -1 osd.6 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T11:02:38.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:38.618+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:38.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:38.618+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:38.925 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:38.618+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:39.134 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:38 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:38.713+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:39.134 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:38 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:38.713+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:39.134 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:38 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:38.713+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:39.313 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:38 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:38.985+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:39.313 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:38 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:38.985+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:39.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:38 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:38.845+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:39.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:38 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:38.845+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:39.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:38 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:38.845+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:39.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:39 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:39.134+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:39.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:39 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:39.134+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.395127+0000 front 2024-05-10T11:02:10.395159+0000 (oldest deadline 2024-05-10T11:02:34.495080+0000) 2024-05-10T11:02:39.665 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:39 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:39.265+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:39.665 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:39 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:39.265+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:01.675412+0000 front 2024-05-10T11:02:01.675280+0000 (oldest deadline 2024-05-10T11:02:27.575191+0000) 2024-05-10T11:02:39.665 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:39 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:39.265+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.575717+0000 front 2024-05-10T11:02:07.575674+0000 (oldest deadline 2024-05-10T11:02:33.475736+0000) 2024-05-10T11:02:39.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:39 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:39.664+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:39.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:39 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:39.664+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:39.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:39 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:39.664+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:40.134 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:39 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:39.728+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:40.135 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:39 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:39.728+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:40.135 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:39 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:39.728+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:40.312 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:39 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:39.936+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:40.312 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:39 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:39.936+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:40.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:39 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:39.825+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:40.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:39 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:39.825+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:40.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:39 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:39.825+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:40.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:40 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:40.135+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:40.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:40 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:40.135+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.395127+0000 front 2024-05-10T11:02:10.395159+0000 (oldest deadline 2024-05-10T11:02:34.495080+0000) 2024-05-10T11:02:40.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:40 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:40.292+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:40.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:40 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:40.292+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:01.675412+0000 front 2024-05-10T11:02:01.675280+0000 (oldest deadline 2024-05-10T11:02:27.575191+0000) 2024-05-10T11:02:40.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:40 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:40.292+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.575717+0000 front 2024-05-10T11:02:07.575674+0000 (oldest deadline 2024-05-10T11:02:33.475736+0000) 2024-05-10T11:02:40.957 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:40 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:40.697+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:40.957 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:40 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:40.697+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:40.957 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:40 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:40.697+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:41.138 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:40 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:40.682+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:41.138 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:40 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:40.682+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:41.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:40 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:40.682+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:41.312 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:40 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:40.892+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:41.312 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:40 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:40.892+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:41.313 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:40 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:40.892+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:18.448040+0000 front 2024-05-10T11:02:18.447916+0000 (oldest deadline 2024-05-10T11:02:40.747947+0000) 2024-05-10T11:02:41.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:40 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:40.849+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:41.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:40 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:40.849+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:41.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:40 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:40.849+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:41.639 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:41 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:41.151+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:41.639 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:41 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:41.151+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.395127+0000 front 2024-05-10T11:02:10.395159+0000 (oldest deadline 2024-05-10T11:02:34.495080+0000) 2024-05-10T11:02:41.639 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:41 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:41.151+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:19.196146+0000 front 2024-05-10T11:02:19.196127+0000 (oldest deadline 2024-05-10T11:02:40.896030+0000) 2024-05-10T11:02:41.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:41 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:41.321+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:41.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:41 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:41.321+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:01.675412+0000 front 2024-05-10T11:02:01.675280+0000 (oldest deadline 2024-05-10T11:02:27.575191+0000) 2024-05-10T11:02:41.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:41 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:41.321+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.575717+0000 front 2024-05-10T11:02:07.575674+0000 (oldest deadline 2024-05-10T11:02:33.475736+0000) 2024-05-10T11:02:42.127 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:41 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:41.719+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:42.128 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:41 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:41.719+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:42.128 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:41 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:41.719+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:42.128 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:41 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:41.719+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:02:42.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:41 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:41.728+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:42.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:41 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:41.728+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:42.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:41 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:41.728+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:42.314 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:41 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:41.941+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:42.314 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:41 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:41.941+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:42.314 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:41 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:41.941+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:18.448040+0000 front 2024-05-10T11:02:18.447916+0000 (oldest deadline 2024-05-10T11:02:40.747947+0000) 2024-05-10T11:02:42.314 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:41 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:41.817+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:42.315 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:41 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:41.817+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:42.315 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:41 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:41.817+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:42.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:42 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:42.127+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:42.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:42 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:42.127+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.395127+0000 front 2024-05-10T11:02:10.395159+0000 (oldest deadline 2024-05-10T11:02:34.495080+0000) 2024-05-10T11:02:42.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:42 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:42.127+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:19.196146+0000 front 2024-05-10T11:02:19.196127+0000 (oldest deadline 2024-05-10T11:02:40.896030+0000) 2024-05-10T11:02:42.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:42 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:42.290+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:42.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:42 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:42.290+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:01.675412+0000 front 2024-05-10T11:02:01.675280+0000 (oldest deadline 2024-05-10T11:02:27.575191+0000) 2024-05-10T11:02:42.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:42 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:42.290+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.575717+0000 front 2024-05-10T11:02:07.575674+0000 (oldest deadline 2024-05-10T11:02:33.475736+0000) 2024-05-10T11:02:43.062 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:42 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:42.942+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:43.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:42 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:42.942+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:43.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:42 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:42.942+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:18.448040+0000 front 2024-05-10T11:02:18.447916+0000 (oldest deadline 2024-05-10T11:02:40.747947+0000) 2024-05-10T11:02:43.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:42 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:42.802+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:43.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:42 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:42.802+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:43.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:42 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:42.802+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:43.085 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:42 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:42.725+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:43.085 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:42 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:42.725+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:43.085 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:42 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:42.725+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:43.085 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:42 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:42.725+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:02:43.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:42 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:42.725+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:43.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:42 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:42.725+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:43.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:42 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:42.725+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:43.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:43 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:43.084+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:43.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:43 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:43.084+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.395127+0000 front 2024-05-10T11:02:10.395159+0000 (oldest deadline 2024-05-10T11:02:34.495080+0000) 2024-05-10T11:02:43.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:43 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:43.084+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:19.196146+0000 front 2024-05-10T11:02:19.196127+0000 (oldest deadline 2024-05-10T11:02:40.896030+0000) 2024-05-10T11:02:43.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:43 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:43.318+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.373603+0000 front 2024-05-10T11:01:55.373513+0000 (oldest deadline 2024-05-10T11:02:20.673644+0000) 2024-05-10T11:02:43.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:43 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:43.318+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:01.675412+0000 front 2024-05-10T11:02:01.675280+0000 (oldest deadline 2024-05-10T11:02:27.575191+0000) 2024-05-10T11:02:43.674 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:43 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6[59059]: 2024-05-10T11:02:43.318+0000 7fad259d9700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.575717+0000 front 2024-05-10T11:02:07.575674+0000 (oldest deadline 2024-05-10T11:02:33.475736+0000) 2024-05-10T11:02:44.046 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:43 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:43.711+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:44.046 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:43 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:43.711+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:44.047 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:43 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:43.711+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:44.047 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:43 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:43.711+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:02:44.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:43 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:43.901+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:44.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:43 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:43.901+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:44.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:43 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:43.901+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:18.448040+0000 front 2024-05-10T11:02:18.447916+0000 (oldest deadline 2024-05-10T11:02:40.747947+0000) 2024-05-10T11:02:44.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:43 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:43.799+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:44.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:43 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:43.799+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:44.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:43 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:43.799+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:44.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:43 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:43.766+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:44.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:43 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:43.766+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:44.175 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:43 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:43.766+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:44.175 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:43 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:43.766+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:02:44.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:44 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:44.046+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:44.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:44 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:44.046+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.395127+0000 front 2024-05-10T11:02:10.395159+0000 (oldest deadline 2024-05-10T11:02:34.495080+0000) 2024-05-10T11:02:44.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:44 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:44.046+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:19.196146+0000 front 2024-05-10T11:02:19.196127+0000 (oldest deadline 2024-05-10T11:02:40.896030+0000) 2024-05-10T11:02:44.542 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:44 smithi107 podman[97383]: 2024-05-10 11:02:44.282412059 +0000 UTC m=+5.637136949 container died be69aae6e7b85d581955c339abddb5c24d2e181b9253b65c3c0cc58019f26fde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240507, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e) 2024-05-10T11:02:44.900 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:44 smithi107 podman[97383]: 2024-05-10 11:02:44.683382895 +0000 UTC m=+6.038107784 container cleanup be69aae6e7b85d581955c339abddb5c24d2e181b9253b65c3c0cc58019f26fde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-10T11:02:44.901 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:44 smithi107 bash[97383]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6 2024-05-10T11:02:44.901 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:44 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:44.748+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:44.901 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:44 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:44.748+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:44.901 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:44 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:44.748+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:44.901 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:44 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:44.748+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:02:45.062 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:44 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:44.906+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:45.062 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:44 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:44.906+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:45.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:44 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:44.906+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:18.448040+0000 front 2024-05-10T11:02:18.447916+0000 (oldest deadline 2024-05-10T11:02:40.747947+0000) 2024-05-10T11:02:45.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:44 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:44.767+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:45.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:44 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:44.767+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:45.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:44 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:44.767+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:45.076 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:44 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:44.664+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:45.076 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:44 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:44.664+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:45.076 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:44 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:44.664+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:45.076 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:44 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:44.664+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:02:45.174 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:44 smithi107 podman[97399]: 2024-05-10 11:02:44.901245205 +0000 UTC m=+0.620566995 container remove be69aae6e7b85d581955c339abddb5c24d2e181b9253b65c3c0cc58019f26fde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD) 2024-05-10T11:02:45.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:45 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:45.075+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:45.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:45 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:45.075+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.395127+0000 front 2024-05-10T11:02:10.395159+0000 (oldest deadline 2024-05-10T11:02:34.495080+0000) 2024-05-10T11:02:45.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:45 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:45.075+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:19.196146+0000 front 2024-05-10T11:02:19.196127+0000 (oldest deadline 2024-05-10T11:02:40.896030+0000) 2024-05-10T11:02:45.512 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:45 smithi107 podman[97496]: 2024-05-10 11:02:45.134817614 +0000 UTC m=+0.017974676 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T11:02:45.512 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:45 smithi107 podman[97496]: 2024-05-10 11:02:45.260434045 +0000 UTC m=+0.143591094 container create a2c7eafc0e51bdebafedb4b52283b53b1bd7a1cac66429b8fd1bdf96d9621aa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6-deactivate, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-05-10T11:02:45.512 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:45 smithi107 podman[97496]: 2024-05-10 11:02:45.512927618 +0000 UTC m=+0.396084672 container init a2c7eafc0e51bdebafedb4b52283b53b1bd7a1cac66429b8fd1bdf96d9621aa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-10T11:02:45.776 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:45 smithi107 podman[97496]: 2024-05-10 11:02:45.516269923 +0000 UTC m=+0.399426981 container start a2c7eafc0e51bdebafedb4b52283b53b1bd7a1cac66429b8fd1bdf96d9621aa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, ceph=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.license=GPLv2) 2024-05-10T11:02:45.776 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:45 smithi107 podman[97496]: 2024-05-10 11:02:45.604621074 +0000 UTC m=+0.487778125 container attach a2c7eafc0e51bdebafedb4b52283b53b1bd7a1cac66429b8fd1bdf96d9621aa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6-deactivate, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-05-10T11:02:45.888 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:45 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:45.618+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:45.888 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:45 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:45.618+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:45.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:45 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:45.618+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:45.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:45 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:45.618+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:02:46.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:45 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:45.943+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:46.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:45 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:45.943+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:46.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:45 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:45.943+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:18.448040+0000 front 2024-05-10T11:02:18.447916+0000 (oldest deadline 2024-05-10T11:02:40.747947+0000) 2024-05-10T11:02:46.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:45 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:45.778+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:46.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:45 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:45.778+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:46.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:45 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:45.778+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:46.098 INFO:journalctl@ceph.osd.6.smithi107.stdout:May 10 11:02:45 smithi107 podman[97496]: 2024-05-10 11:02:45.810928593 +0000 UTC m=+0.694085646 container died a2c7eafc0e51bdebafedb4b52283b53b1bd7a1cac66429b8fd1bdf96d9621aa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-10T11:02:46.099 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:45.776+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:46.099 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:45.776+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:46.099 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:45.776+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:46.099 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:45 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:45.776+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:02:46.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:46 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:46.047+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:46.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:46 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:46.047+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.395127+0000 front 2024-05-10T11:02:10.395159+0000 (oldest deadline 2024-05-10T11:02:34.495080+0000) 2024-05-10T11:02:46.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:46 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:46.047+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:19.196146+0000 front 2024-05-10T11:02:19.196127+0000 (oldest deadline 2024-05-10T11:02:40.896030+0000) 2024-05-10T11:02:46.464 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.6.service' 2024-05-10T11:02:46.506 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:02:46.507 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-10T11:02:46.507 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-10T11:02:46.507 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.7 2024-05-10T11:02:46.810 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:46 smithi184 systemd[1]: Stopping Ceph osd.7 for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:02:46.810 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:46 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:46.569+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:46.811 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:46 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:46.569+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:46.811 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:46 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:46.569+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:46.811 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:46 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:46.569+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:02:47.062 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:46 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:46.935+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:47.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:46 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:46.935+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:47.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:46 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:46.935+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:18.448040+0000 front 2024-05-10T11:02:18.447916+0000 (oldest deadline 2024-05-10T11:02:40.747947+0000) 2024-05-10T11:02:47.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:46 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:46.742+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:47.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:46 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:46.742+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:47.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:46 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:46.742+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:47.073 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:46 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:46.810+0000 7fdb3884c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:02:47.073 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:46 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:46.810+0000 7fdb3884c700 -1 osd.7 85 *** Got signal Terminated *** 2024-05-10T11:02:47.074 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:46 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:46.810+0000 7fdb3884c700 -1 osd.7 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T11:02:47.074 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:47 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:47.073+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:47.074 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:47 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:47.073+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.395127+0000 front 2024-05-10T11:02:10.395159+0000 (oldest deadline 2024-05-10T11:02:34.495080+0000) 2024-05-10T11:02:47.074 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:47 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:47.073+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:19.196146+0000 front 2024-05-10T11:02:19.196127+0000 (oldest deadline 2024-05-10T11:02:40.896030+0000) 2024-05-10T11:02:47.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:46 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:46.821+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:47.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:46 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:46.821+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:47.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:46 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:46.821+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:47.175 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:46 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:46.821+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:02:47.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:47 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:47.612+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:47.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:47 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:47.612+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:47.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:47 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:47.612+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:47.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:47 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:47.612+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:02:47.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:47 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:47.847+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:47.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:47 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:47.847+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:47.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:47 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:47.847+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:47.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:47 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:47.847+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:02:48.062 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:47 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:47.927+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:48.062 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:47 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:47.927+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:48.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:47 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:47.927+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:18.448040+0000 front 2024-05-10T11:02:18.447916+0000 (oldest deadline 2024-05-10T11:02:40.747947+0000) 2024-05-10T11:02:48.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:47 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:47.786+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:48.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:47 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:47.786+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:48.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:47 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:47.786+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:48.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:48 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:48.123+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:48.432 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:48 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:48.123+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.395127+0000 front 2024-05-10T11:02:10.395159+0000 (oldest deadline 2024-05-10T11:02:34.495080+0000) 2024-05-10T11:02:48.432 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:48 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:48.123+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:19.196146+0000 front 2024-05-10T11:02:19.196127+0000 (oldest deadline 2024-05-10T11:02:40.896030+0000) 2024-05-10T11:02:48.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:48 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:48.624+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:48.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:48 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:48.624+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:48.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:48 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:48.624+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:48.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:48 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:48.624+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:02:49.062 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:48 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:48.900+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:49.062 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:48 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:48.900+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:49.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:48 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:48.900+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:18.448040+0000 front 2024-05-10T11:02:18.447916+0000 (oldest deadline 2024-05-10T11:02:40.747947+0000) 2024-05-10T11:02:49.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:48 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:48.742+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:49.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:48 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:48.742+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:49.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:48 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:48.742+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:49.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:48 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:48.844+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:49.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:48 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:48.844+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:49.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:48 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:48.844+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:49.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:48 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:48.844+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:02:49.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:49 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:49.110+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:49.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:49 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:49.110+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.395127+0000 front 2024-05-10T11:02:10.395159+0000 (oldest deadline 2024-05-10T11:02:34.495080+0000) 2024-05-10T11:02:49.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:49 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:49.110+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:19.196146+0000 front 2024-05-10T11:02:19.196127+0000 (oldest deadline 2024-05-10T11:02:40.896030+0000) 2024-05-10T11:02:49.888 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:49 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:49.631+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:49.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:49 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:49.631+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:49.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:49 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:49.631+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:49.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:49 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:49.631+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:02:50.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:49 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:49.867+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:50.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:49 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:49.867+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:50.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:49 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:49.867+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:18.448040+0000 front 2024-05-10T11:02:18.447916+0000 (oldest deadline 2024-05-10T11:02:40.747947+0000) 2024-05-10T11:02:50.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:49 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:49.867+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:26.649109+0000 front 2024-05-10T11:02:26.649047+0000 (oldest deadline 2024-05-10T11:02:49.549114+0000) 2024-05-10T11:02:50.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:49 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:49.786+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:50.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:49 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:49.786+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:50.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:49 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:49.786+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:50.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:49 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:49.786+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:02:50.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:49 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:49.894+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:50.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:49 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:49.894+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:50.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:49 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:49.894+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:50.175 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:49 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:49.894+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:02:50.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:50 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:50.098+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:50.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:50 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:50.098+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.395127+0000 front 2024-05-10T11:02:10.395159+0000 (oldest deadline 2024-05-10T11:02:34.495080+0000) 2024-05-10T11:02:50.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:50 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:50.098+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:19.196146+0000 front 2024-05-10T11:02:19.196127+0000 (oldest deadline 2024-05-10T11:02:40.896030+0000) 2024-05-10T11:02:51.062 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:50 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:50.881+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:51.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:50 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:50.881+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:51.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:50 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:50.881+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:18.448040+0000 front 2024-05-10T11:02:18.447916+0000 (oldest deadline 2024-05-10T11:02:40.747947+0000) 2024-05-10T11:02:51.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:50 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:50.881+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:26.649109+0000 front 2024-05-10T11:02:26.649047+0000 (oldest deadline 2024-05-10T11:02:49.549114+0000) 2024-05-10T11:02:51.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:50 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:50.792+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:51.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:50 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:50.792+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:51.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:50 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:50.792+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:51.064 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:50 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:50.792+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:02:51.092 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:50 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:50.660+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:51.092 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:50 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:50.660+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:51.092 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:50 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:50.660+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:51.092 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:50 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:50.660+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:02:51.092 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:50 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:50.660+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:02:51.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:50 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:50.854+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:51.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:50 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:50.854+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:51.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:50 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:50.854+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:51.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:50 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:50.854+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:02:51.175 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:50 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:50.854+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:25.823416+0000 front 2024-05-10T11:02:25.823519+0000 (oldest deadline 2024-05-10T11:02:50.523425+0000) 2024-05-10T11:02:51.388 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:51 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:51.091+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.993790+0000 front 2024-05-10T11:02:00.994074+0000 (oldest deadline 2024-05-10T11:02:25.094028+0000) 2024-05-10T11:02:51.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:51 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:51.091+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.395127+0000 front 2024-05-10T11:02:10.395159+0000 (oldest deadline 2024-05-10T11:02:34.495080+0000) 2024-05-10T11:02:51.389 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:51 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7[52715]: 2024-05-10T11:02:51.091+0000 7fdb34e40700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:19.196146+0000 front 2024-05-10T11:02:19.196127+0000 (oldest deadline 2024-05-10T11:02:40.896030+0000) 2024-05-10T11:02:52.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:51 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:51.651+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:52.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:51 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:51.651+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:52.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:51 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:51.651+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:52.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:51 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:51.651+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:02:52.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:51 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:51.651+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:02:52.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:51 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:51.862+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:52.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:51 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:51.862+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:52.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:51 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:51.862+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:52.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:51 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:51.862+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:02:52.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:51 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:51.862+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:25.823416+0000 front 2024-05-10T11:02:25.823519+0000 (oldest deadline 2024-05-10T11:02:50.523425+0000) 2024-05-10T11:02:52.230 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:51 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:51.870+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:52.230 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:51 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:51.870+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:52.230 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:51 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:51.870+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:18.448040+0000 front 2024-05-10T11:02:18.447916+0000 (oldest deadline 2024-05-10T11:02:40.747947+0000) 2024-05-10T11:02:52.230 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:51 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:51.870+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:26.649109+0000 front 2024-05-10T11:02:26.649047+0000 (oldest deadline 2024-05-10T11:02:49.549114+0000) 2024-05-10T11:02:52.230 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:51 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:51.813+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:52.230 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:51 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:51.813+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:52.230 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:51 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:51.813+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:52.230 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:51 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:51.813+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:02:52.585 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:52 smithi184 podman[69007]: 2024-05-10 11:02:52.307044046 +0000 UTC m=+5.603937665 container died 3a4f3d1d0fa1006fa625f6350dcaca550211c9dfd239bd507f975fe328d39748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7, org.label-schema.schema-version=1.0, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-05-10T11:02:52.585 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:52 smithi184 podman[69007]: 2024-05-10 11:02:52.585620961 +0000 UTC m=+5.882514611 container cleanup 3a4f3d1d0fa1006fa625f6350dcaca550211c9dfd239bd507f975fe328d39748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-10T11:02:52.886 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:52 smithi184 bash[69007]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7 2024-05-10T11:02:52.886 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:52 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:52.665+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:52.886 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:52 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:52.665+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:52.887 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:52 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:52.665+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:52.887 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:52 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:52.665+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:02:52.887 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:52 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:52.666+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:02:53.062 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:52 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:52.852+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:53.062 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:52 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:52.852+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:53.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:52 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:52.852+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:18.448040+0000 front 2024-05-10T11:02:18.447916+0000 (oldest deadline 2024-05-10T11:02:40.747947+0000) 2024-05-10T11:02:53.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:52 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:52.852+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:26.649109+0000 front 2024-05-10T11:02:26.649047+0000 (oldest deadline 2024-05-10T11:02:49.549114+0000) 2024-05-10T11:02:53.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:52 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:52.768+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:53.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:52 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:52.768+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:53.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:52 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:52.768+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:53.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:52 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:52.768+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:02:53.138 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:52 smithi184 podman[69026]: 2024-05-10 11:02:52.887072873 +0000 UTC m=+0.574287526 container remove 3a4f3d1d0fa1006fa625f6350dcaca550211c9dfd239bd507f975fe328d39748 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e) 2024-05-10T11:02:53.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:52 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:52.866+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:53.175 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:52 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:52.866+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:53.175 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:52 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:52.866+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:53.175 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:52 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:52.866+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:02:53.175 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:52 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:52.866+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:25.823416+0000 front 2024-05-10T11:02:25.823519+0000 (oldest deadline 2024-05-10T11:02:50.523425+0000) 2024-05-10T11:02:53.507 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:53 smithi184 podman[69116]: 2024-05-10 11:02:53.22138174 +0000 UTC m=+0.095146418 container create 5c309143aabdc84abed6a44b10c6c28dd755ae37d364f16ee086f1873ccde3b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-10T11:02:53.507 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:53 smithi184 podman[69116]: 2024-05-10 11:02:53.143683443 +0000 UTC m=+0.017448086 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T11:02:53.507 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:53 smithi184 podman[69116]: 2024-05-10 11:02:53.432697415 +0000 UTC m=+0.306462047 container init 5c309143aabdc84abed6a44b10c6c28dd755ae37d364f16ee086f1873ccde3b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e) 2024-05-10T11:02:53.507 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:53 smithi184 podman[69116]: 2024-05-10 11:02:53.435691316 +0000 UTC m=+0.309455954 container start 5c309143aabdc84abed6a44b10c6c28dd755ae37d364f16ee086f1873ccde3b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-10T11:02:53.507 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:53 smithi184 podman[69116]: 2024-05-10 11:02:53.507582812 +0000 UTC m=+0.381347444 container attach 5c309143aabdc84abed6a44b10c6c28dd755ae37d364f16ee086f1873ccde3b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-10T11:02:53.888 INFO:journalctl@ceph.osd.7.smithi184.stdout:May 10 11:02:53 smithi184 podman[69116]: 2024-05-10 11:02:53.72952 +0000 UTC m=+0.603284634 container died 5c309143aabdc84abed6a44b10c6c28dd755ae37d364f16ee086f1873ccde3b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-10T11:02:53.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:53 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:53.643+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:53.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:53 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:53.643+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:53.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:53 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:53.643+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:53.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:53 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:53.643+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:02:53.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:53 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:53.643+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:02:54.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:53 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:53.880+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:54.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:53 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:53.880+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:54.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:53 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:53.880+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:18.448040+0000 front 2024-05-10T11:02:18.447916+0000 (oldest deadline 2024-05-10T11:02:40.747947+0000) 2024-05-10T11:02:54.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:53 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:53.880+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:26.649109+0000 front 2024-05-10T11:02:26.649047+0000 (oldest deadline 2024-05-10T11:02:49.549114+0000) 2024-05-10T11:02:54.064 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:53 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:53.744+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:54.064 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:53 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:53.744+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:54.064 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:53 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:53.744+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:54.064 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:53 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:53.744+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:02:54.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:53 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:53.820+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:54.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:53 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:53.820+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:54.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:53 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:53.820+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:54.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:53 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:53.820+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:02:54.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:53 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:53.820+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:25.823416+0000 front 2024-05-10T11:02:25.823519+0000 (oldest deadline 2024-05-10T11:02:50.523425+0000) 2024-05-10T11:02:54.295 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.7.service' 2024-05-10T11:02:54.334 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:02:54.334 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-10T11:02:54.334 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-10T11:02:54.334 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.8 2024-05-10T11:02:54.647 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:54 smithi196 systemd[1]: Stopping Ceph osd.8 for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:02:54.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:54 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:54.647+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:54.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:54 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:54.647+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:54.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:54 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:54.647+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:54.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:54 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:54.647+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:02:54.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:54 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:54.647+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:02:54.898 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:54 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:54.729+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:54.898 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:54 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:54.730+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:54.898 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:54 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:54.730+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:54.898 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:54 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:54.730+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:02:54.898 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:54 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:54.646+0000 7f356e12f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:02:54.898 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:54 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:54.646+0000 7f356e12f700 -1 osd.8 85 *** Got signal Terminated *** 2024-05-10T11:02:54.898 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:54 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:54.646+0000 7f356e12f700 -1 osd.8 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T11:02:55.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:54 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:54.851+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:55.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:54 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:54.851+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:55.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:54 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:54.851+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:55.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:54 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:54.851+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:02:55.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:54 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:54.851+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:25.823416+0000 front 2024-05-10T11:02:25.823519+0000 (oldest deadline 2024-05-10T11:02:50.523425+0000) 2024-05-10T11:02:55.312 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:54 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:54.898+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:55.312 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:54 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:54.898+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:55.312 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:54 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:54.898+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:18.448040+0000 front 2024-05-10T11:02:18.447916+0000 (oldest deadline 2024-05-10T11:02:40.747947+0000) 2024-05-10T11:02:55.312 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:54 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:54.898+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:26.649109+0000 front 2024-05-10T11:02:26.649047+0000 (oldest deadline 2024-05-10T11:02:49.549114+0000) 2024-05-10T11:02:55.888 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:55 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:55.602+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:55.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:55 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:55.602+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:55.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:55 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:55.602+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:55.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:55 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:55.602+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:02:55.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:55 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:55.602+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:02:56.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:55 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:55.877+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:56.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:55 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:55.877+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:56.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:55 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:55.877+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:18.448040+0000 front 2024-05-10T11:02:18.447916+0000 (oldest deadline 2024-05-10T11:02:40.747947+0000) 2024-05-10T11:02:56.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:55 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:55.877+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:26.649109+0000 front 2024-05-10T11:02:26.649047+0000 (oldest deadline 2024-05-10T11:02:49.549114+0000) 2024-05-10T11:02:56.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:55 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:55.723+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:56.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:55 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:55.723+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:56.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:55 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:55.723+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:56.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:55 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:55.723+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:02:56.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:55 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:55.876+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:56.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:55 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:55.876+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:56.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:55 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:55.876+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:56.175 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:55 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:55.876+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:02:56.175 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:55 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:55.876+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:25.823416+0000 front 2024-05-10T11:02:25.823519+0000 (oldest deadline 2024-05-10T11:02:50.523425+0000) 2024-05-10T11:02:57.062 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:56 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:56.726+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:57.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:56 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:56.726+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:57.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:56 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:56.726+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:57.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:56 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:56.726+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:02:57.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:56 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:56.893+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:57.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:56 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:56.893+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:57.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:56 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:56.893+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:18.448040+0000 front 2024-05-10T11:02:18.447916+0000 (oldest deadline 2024-05-10T11:02:40.747947+0000) 2024-05-10T11:02:57.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:56 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:56.893+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:26.649109+0000 front 2024-05-10T11:02:26.649047+0000 (oldest deadline 2024-05-10T11:02:49.549114+0000) 2024-05-10T11:02:57.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:56 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:56.893+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:34.250115+0000 front 2024-05-10T11:02:34.250153+0000 (oldest deadline 2024-05-10T11:02:56.550267+0000) 2024-05-10T11:02:57.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:56 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:56.640+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:57.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:56 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:56.640+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:57.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:56 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:56.640+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:57.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:56 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:56.640+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:02:57.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:56 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:56.640+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:02:57.163 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:56 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:56.872+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:57.163 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:56 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:56.872+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:57.163 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:56 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:56.872+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:57.163 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:56 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:56.872+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:02:57.164 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:56 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:56.872+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:25.823416+0000 front 2024-05-10T11:02:25.823519+0000 (oldest deadline 2024-05-10T11:02:50.523425+0000) 2024-05-10T11:02:57.888 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:57 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:57.597+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:57.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:57 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:57.597+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:57.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:57 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:57.597+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:57.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:57 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:57.597+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:02:57.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:57 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:57.597+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:02:58.062 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:57 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:57.750+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:58.062 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:57 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:57.750+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:58.062 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:57 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:57.750+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:58.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:57 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:57.750+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:02:58.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:57 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:57.853+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:58.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:57 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:57.853+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:58.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:57 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:57.853+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:18.448040+0000 front 2024-05-10T11:02:18.447916+0000 (oldest deadline 2024-05-10T11:02:40.747947+0000) 2024-05-10T11:02:58.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:57 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:57.853+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:26.649109+0000 front 2024-05-10T11:02:26.649047+0000 (oldest deadline 2024-05-10T11:02:49.549114+0000) 2024-05-10T11:02:58.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:57 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:57.853+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:34.250115+0000 front 2024-05-10T11:02:34.250153+0000 (oldest deadline 2024-05-10T11:02:56.550267+0000) 2024-05-10T11:02:58.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:57 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:57.844+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:58.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:57 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:57.844+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:58.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:57 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:57.844+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:58.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:57 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:57.844+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:02:58.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:57 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:57.844+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:25.823416+0000 front 2024-05-10T11:02:25.823519+0000 (oldest deadline 2024-05-10T11:02:50.523425+0000) 2024-05-10T11:02:58.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:58 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:58.587+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:58.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:58 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:58.587+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:58.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:58 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:58.587+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:58.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:58 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:58.587+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:02:58.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:58 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:58.587+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:02:59.062 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:58 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:58.883+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.945246+0000 front 2024-05-10T11:02:00.945465+0000 (oldest deadline 2024-05-10T11:02:26.245255+0000) 2024-05-10T11:02:59.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:58 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:58.883+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.946252+0000 front 2024-05-10T11:02:10.946270+0000 (oldest deadline 2024-05-10T11:02:34.346971+0000) 2024-05-10T11:02:59.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:58 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:58.883+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:18.448040+0000 front 2024-05-10T11:02:18.447916+0000 (oldest deadline 2024-05-10T11:02:40.747947+0000) 2024-05-10T11:02:59.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:58 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:58.883+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:26.649109+0000 front 2024-05-10T11:02:26.649047+0000 (oldest deadline 2024-05-10T11:02:49.549114+0000) 2024-05-10T11:02:59.063 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:02:58 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8[53568]: 2024-05-10T11:02:58.883+0000 7f356a723700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:34.250115+0000 front 2024-05-10T11:02:34.250153+0000 (oldest deadline 2024-05-10T11:02:56.550267+0000) 2024-05-10T11:02:59.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:58 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:58.727+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:02:59.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:58 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:58.727+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:02:59.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:58 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:58.727+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:02:59.064 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:58 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:58.727+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:02:59.064 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:58 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:58.727+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:02:59.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:58 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:58.866+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:02:59.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:58 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:58.866+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:02:59.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:58 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:58.866+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:02:59.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:58 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:58.866+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:02:59.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:58 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:58.866+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:25.823416+0000 front 2024-05-10T11:02:25.823519+0000 (oldest deadline 2024-05-10T11:02:50.523425+0000) 2024-05-10T11:02:59.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:58 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:58.866+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:32.725187+0000 front 2024-05-10T11:02:32.725094+0000 (oldest deadline 2024-05-10T11:02:58.024851+0000) 2024-05-10T11:02:59.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:59 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:59.598+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:02:59.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:59 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:59.598+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:02:59.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:59 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:59.598+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:02:59.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:59 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:59.598+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:02:59.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:59 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:59.598+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:02:59.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:02:59 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:02:59.598+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:33.324409+0000 front 2024-05-10T11:02:33.324453+0000 (oldest deadline 2024-05-10T11:02:58.624335+0000) 2024-05-10T11:03:00.005 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:59 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:59.691+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:00.005 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:59 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:59.691+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:00.005 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:59 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:59.691+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:00.005 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:59 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:59.691+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:00.005 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:02:59 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:02:59.691+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:00.174 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:59 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:59.903+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:03:00.175 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:59 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:59.903+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:03:00.175 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:59 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:59.903+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:03:00.175 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:59 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:59.903+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:03:00.175 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:59 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:59.903+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:25.823416+0000 front 2024-05-10T11:02:25.823519+0000 (oldest deadline 2024-05-10T11:02:50.523425+0000) 2024-05-10T11:03:00.175 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:02:59 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:02:59.903+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:32.725187+0000 front 2024-05-10T11:02:32.725094+0000 (oldest deadline 2024-05-10T11:02:58.024851+0000) 2024-05-10T11:03:00.312 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:03:00 smithi196 podman[69934]: 2024-05-10 11:03:00.005250808 +0000 UTC m=+5.472765293 container died 0c3bdda7ab0b75bdfbb13192a3b9122d1b941753695de86cacf93c5d5a5d33c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-05-10T11:03:00.312 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:03:00 smithi196 podman[69934]: 2024-05-10 11:03:00.313165493 +0000 UTC m=+5.780679968 container cleanup 0c3bdda7ab0b75bdfbb13192a3b9122d1b941753695de86cacf93c5d5a5d33c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS) 2024-05-10T11:03:00.562 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:03:00 smithi196 bash[69934]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8 2024-05-10T11:03:00.563 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:03:00 smithi196 podman[69951]: 2024-05-10 11:03:00.547979612 +0000 UTC m=+0.540665664 container remove 0c3bdda7ab0b75bdfbb13192a3b9122d1b941753695de86cacf93c5d5a5d33c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, ceph=True, CEPH_POINT_RELEASE=) 2024-05-10T11:03:00.987 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:00 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:00.691+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:00.987 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:00 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:00.691+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:00.988 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:00 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:00.691+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:00.988 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:00 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:00.691+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:00.988 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:00 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:00.691+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:01.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:00 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:00.646+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:03:01.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:00 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:00.646+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:03:01.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:00 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:00.646+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:03:01.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:00 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:00.646+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:03:01.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:00 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:00.646+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:03:01.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:00 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:00.646+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:33.324409+0000 front 2024-05-10T11:02:33.324453+0000 (oldest deadline 2024-05-10T11:02:58.624335+0000) 2024-05-10T11:03:01.292 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:03:00 smithi196 podman[70041]: 2024-05-10 11:03:00.891427679 +0000 UTC m=+0.018089338 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T11:03:01.292 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:03:00 smithi196 podman[70041]: 2024-05-10 11:03:00.990229379 +0000 UTC m=+0.116891028 container create 74a592fc71084b49a619419d98614d435e8643e771d69de4283a9e65a3d28902 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-05-10T11:03:01.292 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:03:01 smithi196 podman[70041]: 2024-05-10 11:03:01.20107488 +0000 UTC m=+0.327736531 container init 74a592fc71084b49a619419d98614d435e8643e771d69de4283a9e65a3d28902 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e) 2024-05-10T11:03:01.292 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:03:01 smithi196 podman[70041]: 2024-05-10 11:03:01.204020631 +0000 UTC m=+0.330682281 container start 74a592fc71084b49a619419d98614d435e8643e771d69de4283a9e65a3d28902 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240507, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-05-10T11:03:01.292 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:03:01 smithi196 podman[70041]: 2024-05-10 11:03:01.29259639 +0000 UTC m=+0.419258053 container attach 74a592fc71084b49a619419d98614d435e8643e771d69de4283a9e65a3d28902 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8-deactivate, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_BRANCH=HEAD, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.schema-version=1.0) 2024-05-10T11:03:01.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:00 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:00.945+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:03:01.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:00 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:00.945+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:03:01.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:00 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:00.945+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:03:01.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:00 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:00.945+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:03:01.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:00 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:00.945+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:25.823416+0000 front 2024-05-10T11:02:25.823519+0000 (oldest deadline 2024-05-10T11:02:50.523425+0000) 2024-05-10T11:03:01.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:00 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:00.945+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:32.725187+0000 front 2024-05-10T11:02:32.725094+0000 (oldest deadline 2024-05-10T11:02:58.024851+0000) 2024-05-10T11:03:01.563 INFO:journalctl@ceph.osd.8.smithi196.stdout:May 10 11:03:01 smithi196 podman[70041]: 2024-05-10 11:03:01.506908413 +0000 UTC m=+0.633570061 container died 74a592fc71084b49a619419d98614d435e8643e771d69de4283a9e65a3d28902 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-10T11:03:02.062 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:01 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:01.732+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:02.062 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:01 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:01.732+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:02.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:01 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:01.732+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:02.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:01 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:01.732+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:02.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:01 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:01.732+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:02.137 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.8.service' 2024-05-10T11:03:02.138 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:01 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:01.656+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:03:02.138 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:01 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:01.656+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:03:02.138 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:01 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:01.656+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:03:02.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:01 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:01.656+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:03:02.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:01 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:01.656+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:03:02.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:01 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:01.656+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:33.324409+0000 front 2024-05-10T11:02:33.324453+0000 (oldest deadline 2024-05-10T11:02:58.624335+0000) 2024-05-10T11:03:02.174 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:03:02.174 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-10T11:03:02.175 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-10T11:03:02.175 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.9 2024-05-10T11:03:02.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:01 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:01.983+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:03:02.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:01 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:01.983+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:03:02.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:01 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:01.983+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:03:02.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:01 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:01.983+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:03:02.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:01 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:01.983+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:25.823416+0000 front 2024-05-10T11:02:25.823519+0000 (oldest deadline 2024-05-10T11:02:50.523425+0000) 2024-05-10T11:03:02.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:01 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:01.983+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:32.725187+0000 front 2024-05-10T11:02:32.725094+0000 (oldest deadline 2024-05-10T11:02:58.024851+0000) 2024-05-10T11:03:02.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:02 smithi107 systemd[1]: Stopping Ceph osd.9 for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:03:02.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:02 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:02.475+0000 7f780a9d7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:03:02.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:02 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:02.475+0000 7f780a9d7700 -1 osd.9 85 *** Got signal Terminated *** 2024-05-10T11:03:02.924 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:02 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:02.475+0000 7f780a9d7700 -1 osd.9 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T11:03:03.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:02 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:02.737+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:03.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:02 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:02.737+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:03.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:02 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:02.737+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:03.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:02 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:02.737+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:03.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:02 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:02.737+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:03.138 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:02 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:02.680+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:03:03.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:02 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:02.680+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:03:03.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:02 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:02.680+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:03:03.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:02 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:02.680+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:03:03.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:02 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:02.680+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:03:03.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:02 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:02.680+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:33.324409+0000 front 2024-05-10T11:02:33.324453+0000 (oldest deadline 2024-05-10T11:02:58.624335+0000) 2024-05-10T11:03:03.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:02 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:02.956+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:03:03.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:02 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:02.956+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:03:03.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:02 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:02.956+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:03:03.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:02 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:02.956+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:03:03.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:02 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:02.956+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:25.823416+0000 front 2024-05-10T11:02:25.823519+0000 (oldest deadline 2024-05-10T11:02:50.523425+0000) 2024-05-10T11:03:03.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:02 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:02.956+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:32.725187+0000 front 2024-05-10T11:02:32.725094+0000 (oldest deadline 2024-05-10T11:02:58.024851+0000) 2024-05-10T11:03:04.062 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:03 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:03.763+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:04.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:03 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:03.763+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:04.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:03 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:03.763+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:04.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:03 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:03.763+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:04.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:03 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:03.764+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:04.138 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:03 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:03.727+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:03:04.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:03 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:03.727+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:03:04.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:03 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:03.727+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:03:04.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:03 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:03.727+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:03:04.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:03 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:03.727+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:03:04.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:03 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:03.727+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:33.324409+0000 front 2024-05-10T11:02:33.324453+0000 (oldest deadline 2024-05-10T11:02:58.624335+0000) 2024-05-10T11:03:04.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:03 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:03.937+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:03:04.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:03 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:03.937+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:03:04.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:03 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:03.937+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:03:04.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:03 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:03.937+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:03:04.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:03 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:03.937+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:25.823416+0000 front 2024-05-10T11:02:25.823519+0000 (oldest deadline 2024-05-10T11:02:50.523425+0000) 2024-05-10T11:03:04.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:03 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:03.937+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:32.725187+0000 front 2024-05-10T11:02:32.725094+0000 (oldest deadline 2024-05-10T11:02:58.024851+0000) 2024-05-10T11:03:05.062 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:04 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:04.781+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:05.062 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:04 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:04.781+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:05.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:04 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:04.781+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:05.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:04 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:04.781+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:05.063 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:04 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:04.781+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:05.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:04 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:04.740+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:03:05.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:04 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:04.740+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:03:05.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:04 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:04.740+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:03:05.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:04 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:04.740+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:03:05.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:04 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:04.740+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:03:05.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:04 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:04.740+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:33.324409+0000 front 2024-05-10T11:02:33.324453+0000 (oldest deadline 2024-05-10T11:02:58.624335+0000) 2024-05-10T11:03:05.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:04 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:04.948+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:03:05.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:04 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:04.948+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:03:05.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:04 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:04.948+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:03:05.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:04 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:04.948+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:03:05.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:04 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:04.948+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:25.823416+0000 front 2024-05-10T11:02:25.823519+0000 (oldest deadline 2024-05-10T11:02:50.523425+0000) 2024-05-10T11:03:05.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:04 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:04.948+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:32.725187+0000 front 2024-05-10T11:02:32.725094+0000 (oldest deadline 2024-05-10T11:02:58.024851+0000) 2024-05-10T11:03:06.138 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:05 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:05.762+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:03:06.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:05 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:05.762+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:03:06.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:05 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:05.762+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:03:06.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:05 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:05.762+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:03:06.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:05 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:05.762+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:03:06.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:05 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:05.762+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:33.324409+0000 front 2024-05-10T11:02:33.324453+0000 (oldest deadline 2024-05-10T11:02:58.624335+0000) 2024-05-10T11:03:06.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:05 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:05.823+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:06.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:05 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:05.823+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:06.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:05 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:05.823+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:06.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:05 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:05.823+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:06.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:05 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:05.823+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:06.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:05 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:05.976+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:03:06.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:05 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:05.976+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:03:06.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:05 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:05.977+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:03:06.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:05 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:05.977+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:03:06.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:05 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:05.977+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:25.823416+0000 front 2024-05-10T11:02:25.823519+0000 (oldest deadline 2024-05-10T11:02:50.523425+0000) 2024-05-10T11:03:06.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:05 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:05.977+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:32.725187+0000 front 2024-05-10T11:02:32.725094+0000 (oldest deadline 2024-05-10T11:02:58.024851+0000) 2024-05-10T11:03:07.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:06 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:06.770+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:03:07.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:06 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:06.770+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:03:07.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:06 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:06.770+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:03:07.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:06 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:06.770+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:03:07.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:06 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:06.770+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:03:07.140 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:06 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:06.770+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:33.324409+0000 front 2024-05-10T11:02:33.324453+0000 (oldest deadline 2024-05-10T11:02:58.624335+0000) 2024-05-10T11:03:07.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:06 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:06.854+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:07.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:06 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:06.854+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:07.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:06 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:06.854+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:07.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:06 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:06.854+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:07.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:06 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:06.854+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:07.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:06 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:06.854+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:43.592465+0000 front 2024-05-10T11:02:43.592415+0000 (oldest deadline 2024-05-10T11:03:06.492460+0000) 2024-05-10T11:03:07.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:06 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:06.929+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.017971+0000 front 2024-05-10T11:01:55.017933+0000 (oldest deadline 2024-05-10T11:02:17.918083+0000) 2024-05-10T11:03:07.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:06 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:06.929+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:00.219133+0000 front 2024-05-10T11:02:00.219059+0000 (oldest deadline 2024-05-10T11:02:25.519030+0000) 2024-05-10T11:03:07.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:06 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:06.929+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:10.120687+0000 front 2024-05-10T11:02:10.120670+0000 (oldest deadline 2024-05-10T11:02:34.820845+0000) 2024-05-10T11:03:07.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:06 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:06.929+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:14.821290+0000 front 2024-05-10T11:02:14.821335+0000 (oldest deadline 2024-05-10T11:02:43.022068+0000) 2024-05-10T11:03:07.424 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:06 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:06.929+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:25.823416+0000 front 2024-05-10T11:02:25.823519+0000 (oldest deadline 2024-05-10T11:02:50.523425+0000) 2024-05-10T11:03:07.425 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:06 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9[65630]: 2024-05-10T11:03:06.929+0000 7f7802fc3700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:32.725187+0000 front 2024-05-10T11:02:32.725094+0000 (oldest deadline 2024-05-10T11:02:58.024851+0000) 2024-05-10T11:03:08.138 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:07 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:07.787+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:03:08.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:07 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:07.787+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:03:08.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:07 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:07.787+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:03:08.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:07 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:07.787+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:03:08.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:07 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:07.787+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:03:08.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:07 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:07.787+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:33.324409+0000 front 2024-05-10T11:02:33.324453+0000 (oldest deadline 2024-05-10T11:02:58.624335+0000) 2024-05-10T11:03:08.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:07 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:07.899+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:08.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:07 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:07.899+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:08.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:07 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:07.899+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:08.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:07 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:07.899+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:08.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:07 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:07.899+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:08.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:07 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:07.899+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:43.592465+0000 front 2024-05-10T11:02:43.592415+0000 (oldest deadline 2024-05-10T11:03:06.492460+0000) 2024-05-10T11:03:08.333 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:07 smithi107 podman[97614]: 2024-05-10 11:03:07.996578468 +0000 UTC m=+5.625178003 container died 843dd78f920ae9acf55853a974606ae13defd8022ee215832e14485cf2f4acc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, io.buildah.version=1.33.5) 2024-05-10T11:03:08.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:08 smithi107 podman[97614]: 2024-05-10 11:03:08.508580815 +0000 UTC m=+6.137180390 container cleanup 843dd78f920ae9acf55853a974606ae13defd8022ee215832e14485cf2f4acc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-10T11:03:08.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:08 smithi107 bash[97614]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9 2024-05-10T11:03:09.139 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:08 smithi107 podman[97631]: 2024-05-10 11:03:08.734819265 +0000 UTC m=+0.740976259 container remove 843dd78f920ae9acf55853a974606ae13defd8022ee215832e14485cf2f4acc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-10T11:03:09.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:08 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:08.747+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:03:09.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:08 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:08.747+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:03:09.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:08 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:08.747+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:03:09.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:08 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:08.747+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:03:09.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:08 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:08.747+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:03:09.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:08 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:08.747+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:33.324409+0000 front 2024-05-10T11:02:33.324453+0000 (oldest deadline 2024-05-10T11:02:58.624335+0000) 2024-05-10T11:03:09.140 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:08 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:08.747+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:42.725418+0000 front 2024-05-10T11:02:42.725486+0000 (oldest deadline 2024-05-10T11:03:08.625088+0000) 2024-05-10T11:03:09.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:08 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:08.889+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:09.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:08 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:08.889+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:09.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:08 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:08.889+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:09.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:08 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:08.889+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:09.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:08 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:08.889+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:09.314 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:08 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:08.889+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:43.592465+0000 front 2024-05-10T11:02:43.592415+0000 (oldest deadline 2024-05-10T11:03:06.492460+0000) 2024-05-10T11:03:09.390 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:09 smithi107 podman[97725]: 2024-05-10 11:03:09.041898281 +0000 UTC m=+0.017324632 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T11:03:09.391 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:09 smithi107 podman[97725]: 2024-05-10 11:03:09.152111276 +0000 UTC m=+0.127537614 container create 4f65c24d27a54b3c1d37cebdc67f182a17a1b71a6b803f7f940654b7a2cb2385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-10T11:03:09.391 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:09 smithi107 podman[97725]: 2024-05-10 11:03:09.387687901 +0000 UTC m=+0.363114238 container init 4f65c24d27a54b3c1d37cebdc67f182a17a1b71a6b803f7f940654b7a2cb2385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, ceph=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_BRANCH=HEAD) 2024-05-10T11:03:09.391 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:09 smithi107 podman[97725]: 2024-05-10 11:03:09.39099211 +0000 UTC m=+0.366418447 container start 4f65c24d27a54b3c1d37cebdc67f182a17a1b71a6b803f7f940654b7a2cb2385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, ceph=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-10T11:03:09.674 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:09 smithi107 podman[97725]: 2024-05-10 11:03:09.487839319 +0000 UTC m=+0.463265658 container attach 4f65c24d27a54b3c1d37cebdc67f182a17a1b71a6b803f7f940654b7a2cb2385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-05-10T11:03:09.973 INFO:journalctl@ceph.osd.9.smithi107.stdout:May 10 11:03:09 smithi107 podman[97725]: 2024-05-10 11:03:09.680472976 +0000 UTC m=+0.655899321 container died 4f65c24d27a54b3c1d37cebdc67f182a17a1b71a6b803f7f940654b7a2cb2385 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240507, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-10T11:03:10.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:09 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:09.701+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:03:10.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:09 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:09.701+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:03:10.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:09 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:09.701+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:03:10.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:09 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:09.701+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:03:10.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:09 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:09.701+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:03:10.140 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:09 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:09.701+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:33.324409+0000 front 2024-05-10T11:02:33.324453+0000 (oldest deadline 2024-05-10T11:02:58.624335+0000) 2024-05-10T11:03:10.140 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:09 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:09.701+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:42.725418+0000 front 2024-05-10T11:02:42.725486+0000 (oldest deadline 2024-05-10T11:03:08.625088+0000) 2024-05-10T11:03:10.264 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.9.service' 2024-05-10T11:03:10.303 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:03:10.303 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-10T11:03:10.303 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-10T11:03:10.303 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.10 2024-05-10T11:03:10.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:09 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:09.926+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:10.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:09 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:09.926+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:10.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:09 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:09.926+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:10.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:09 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:09.926+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:10.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:09 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:09.926+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:10.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:09 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:09.926+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:43.592465+0000 front 2024-05-10T11:02:43.592415+0000 (oldest deadline 2024-05-10T11:03:06.492460+0000) 2024-05-10T11:03:10.605 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:10 smithi184 systemd[1]: Stopping Ceph osd.10 for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:03:10.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:10 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:10.604+0000 7f087f5aa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:03:10.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:10 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:10.605+0000 7f087f5aa700 -1 osd.10 85 *** Got signal Terminated *** 2024-05-10T11:03:10.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:10 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:10.605+0000 7f087f5aa700 -1 osd.10 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T11:03:10.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:10 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:10.716+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:03:10.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:10 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:10.716+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:03:10.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:10 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:10.716+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:03:10.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:10 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:10.716+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:03:10.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:10 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:10.716+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:03:10.889 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:10 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:10.716+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:33.324409+0000 front 2024-05-10T11:02:33.324453+0000 (oldest deadline 2024-05-10T11:02:58.624335+0000) 2024-05-10T11:03:10.890 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:10 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:10.716+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:42.725418+0000 front 2024-05-10T11:02:42.725486+0000 (oldest deadline 2024-05-10T11:03:08.625088+0000) 2024-05-10T11:03:11.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:10 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:10.954+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:11.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:10 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:10.954+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:11.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:10 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:10.954+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:11.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:10 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:10.954+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:11.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:10 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:10.954+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:11.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:10 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:10.954+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:43.592465+0000 front 2024-05-10T11:02:43.592415+0000 (oldest deadline 2024-05-10T11:03:06.492460+0000) 2024-05-10T11:03:12.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:11 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:11.732+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:03:12.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:11 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:11.732+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:03:12.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:11 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:11.732+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:03:12.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:11 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:11.732+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:03:12.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:11 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:11.732+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:03:12.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:11 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:11.732+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:33.324409+0000 front 2024-05-10T11:02:33.324453+0000 (oldest deadline 2024-05-10T11:02:58.624335+0000) 2024-05-10T11:03:12.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:11 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:11.732+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:42.725418+0000 front 2024-05-10T11:02:42.725486+0000 (oldest deadline 2024-05-10T11:03:08.625088+0000) 2024-05-10T11:03:12.193 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:11 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:11.905+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:12.193 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:11 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:11.905+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:12.193 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:11 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:11.905+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:12.193 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:11 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:11.905+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:12.193 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:11 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:11.905+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:12.193 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:11 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:11.905+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:43.592465+0000 front 2024-05-10T11:02:43.592415+0000 (oldest deadline 2024-05-10T11:03:06.492460+0000) 2024-05-10T11:03:13.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:12 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:12.711+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:03:13.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:12 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:12.711+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:03:13.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:12 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:12.711+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:03:13.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:12 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:12.711+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:03:13.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:12 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:12.711+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:03:13.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:12 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:12.711+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:33.324409+0000 front 2024-05-10T11:02:33.324453+0000 (oldest deadline 2024-05-10T11:02:58.624335+0000) 2024-05-10T11:03:13.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:12 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:12.711+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:42.725418+0000 front 2024-05-10T11:02:42.725486+0000 (oldest deadline 2024-05-10T11:03:08.625088+0000) 2024-05-10T11:03:13.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:12 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:12.899+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:13.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:12 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:12.899+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:13.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:12 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:12.899+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:13.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:12 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:12.899+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:13.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:12 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:12.899+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:13.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:12 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:12.899+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:43.592465+0000 front 2024-05-10T11:02:43.592415+0000 (oldest deadline 2024-05-10T11:03:06.492460+0000) 2024-05-10T11:03:14.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:13 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:13.701+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:03:14.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:13 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:13.701+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:03:14.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:13 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:13.701+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:03:14.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:13 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:13.701+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:03:14.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:13 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:13.701+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:03:14.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:13 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:13.701+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:33.324409+0000 front 2024-05-10T11:02:33.324453+0000 (oldest deadline 2024-05-10T11:02:58.624335+0000) 2024-05-10T11:03:14.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:13 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:13.701+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:42.725418+0000 front 2024-05-10T11:02:42.725486+0000 (oldest deadline 2024-05-10T11:03:08.625088+0000) 2024-05-10T11:03:14.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:13 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:13.924+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:14.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:13 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:13.924+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:14.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:13 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:13.924+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:14.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:13 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:13.924+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:14.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:13 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:13.924+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:14.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:13 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:13.924+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:43.592465+0000 front 2024-05-10T11:02:43.592415+0000 (oldest deadline 2024-05-10T11:03:06.492460+0000) 2024-05-10T11:03:15.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:14 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:14.669+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:55.919352+0000 front 2024-05-10T11:01:55.919185+0000 (oldest deadline 2024-05-10T11:02:17.619241+0000) 2024-05-10T11:03:15.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:14 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:14.669+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:02:03.520341+0000 front 2024-05-10T11:02:03.520390+0000 (oldest deadline 2024-05-10T11:02:27.620609+0000) 2024-05-10T11:03:15.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:14 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:14.669+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:07.621075+0000 front 2024-05-10T11:02:07.620964+0000 (oldest deadline 2024-05-10T11:02:33.521156+0000) 2024-05-10T11:03:15.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:14 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:14.669+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6814 osd.3 since back 2024-05-10T11:02:16.322860+0000 front 2024-05-10T11:02:16.322792+0000 (oldest deadline 2024-05-10T11:02:41.022558+0000) 2024-05-10T11:03:15.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:14 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:14.669+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:23.923275+0000 front 2024-05-10T11:02:23.923288+0000 (oldest deadline 2024-05-10T11:02:49.823288+0000) 2024-05-10T11:03:15.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:14 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:14.669+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:33.324409+0000 front 2024-05-10T11:02:33.324453+0000 (oldest deadline 2024-05-10T11:02:58.624335+0000) 2024-05-10T11:03:15.139 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:14 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10[59311]: 2024-05-10T11:03:14.669+0000 7f0877b96700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:42.725418+0000 front 2024-05-10T11:02:42.725486+0000 (oldest deadline 2024-05-10T11:03:08.625088+0000) 2024-05-10T11:03:15.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:14 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:14.881+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:15.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:14 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:14.881+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:15.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:14 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:14.881+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:15.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:14 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:14.881+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:15.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:14 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:14.881+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:15.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:14 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:14.881+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:43.592465+0000 front 2024-05-10T11:02:43.592415+0000 (oldest deadline 2024-05-10T11:03:06.492460+0000) 2024-05-10T11:03:16.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:15 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:15.924+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:16.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:15 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:15.924+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:16.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:15 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:15.924+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:16.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:15 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:15.924+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:16.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:15 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:15.924+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:16.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:15 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:15.924+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:43.592465+0000 front 2024-05-10T11:02:43.592415+0000 (oldest deadline 2024-05-10T11:03:06.492460+0000) 2024-05-10T11:03:16.313 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:15 smithi184 podman[69234]: 2024-05-10 11:03:15.982493824 +0000 UTC m=+5.483208113 container died 7d0475d8c8a1704c9b67d620527d027285a53b5454c30b2487425d2b55306463 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507) 2024-05-10T11:03:16.313 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:16 smithi184 podman[69234]: 2024-05-10 11:03:16.313839212 +0000 UTC m=+5.814553500 container cleanup 7d0475d8c8a1704c9b67d620527d027285a53b5454c30b2487425d2b55306463 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240507) 2024-05-10T11:03:16.638 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:16 smithi184 bash[69234]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10 2024-05-10T11:03:16.639 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:16 smithi184 podman[69253]: 2024-05-10 11:03:16.523316636 +0000 UTC m=+0.532923297 container remove 7d0475d8c8a1704c9b67d620527d027285a53b5454c30b2487425d2b55306463 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, ceph=True, GIT_CLEAN=True) 2024-05-10T11:03:17.210 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:16 smithi184 podman[69344]: 2024-05-10 11:03:16.826659632 +0000 UTC m=+0.018033090 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T11:03:17.210 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:16 smithi184 podman[69344]: 2024-05-10 11:03:16.940981608 +0000 UTC m=+0.132355101 container create a164cdd94f828db3fdeabcfe58d55b04843e87ea04c47e2dc4a5fe53c42daf26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, io.buildah.version=1.33.5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-10T11:03:17.210 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:17 smithi184 podman[69344]: 2024-05-10 11:03:17.134957869 +0000 UTC m=+0.326331316 container init a164cdd94f828db3fdeabcfe58d55b04843e87ea04c47e2dc4a5fe53c42daf26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.build-date=20240507, GIT_CLEAN=True) 2024-05-10T11:03:17.210 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:17 smithi184 podman[69344]: 2024-05-10 11:03:17.137965948 +0000 UTC m=+0.329339401 container start a164cdd94f828db3fdeabcfe58d55b04843e87ea04c47e2dc4a5fe53c42daf26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-05-10T11:03:17.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:16 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:16.900+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:17.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:16 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:16.900+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:17.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:16 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:16.900+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:17.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:16 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:16.900+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:17.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:16 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:16.900+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:17.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:16 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:16.900+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:43.592465+0000 front 2024-05-10T11:02:43.592415+0000 (oldest deadline 2024-05-10T11:03:06.492460+0000) 2024-05-10T11:03:17.639 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:17 smithi184 podman[69344]: 2024-05-10 11:03:17.210101137 +0000 UTC m=+0.401474600 container attach a164cdd94f828db3fdeabcfe58d55b04843e87ea04c47e2dc4a5fe53c42daf26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10-deactivate, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-10T11:03:17.639 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:17 smithi184 podman[69344]: 2024-05-10 11:03:17.436936501 +0000 UTC m=+0.628309951 container died a164cdd94f828db3fdeabcfe58d55b04843e87ea04c47e2dc4a5fe53c42daf26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-10T11:03:17.966 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.10.service' 2024-05-10T11:03:17.988 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:17 smithi184 podman[69370]: 2024-05-10 11:03:17.946896576 +0000 UTC m=+0.500115909 container remove a164cdd94f828db3fdeabcfe58d55b04843e87ea04c47e2dc4a5fe53c42daf26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True) 2024-05-10T11:03:17.988 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:17 smithi184 systemd[1]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.10.service: Deactivated successfully. 2024-05-10T11:03:17.988 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:17 smithi184 systemd[1]: Stopped Ceph osd.10 for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T11:03:17.988 INFO:journalctl@ceph.osd.10.smithi184.stdout:May 10 11:03:17 smithi184 systemd[1]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.10.service: Consumed 16.893s CPU time. 2024-05-10T11:03:18.003 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:03:18.003 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-10T11:03:18.003 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-10T11:03:18.004 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.11 2024-05-10T11:03:18.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:17 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:17.946+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:18.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:17 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:17.946+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:18.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:17 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:17.946+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:18.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:17 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:17.946+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:18.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:17 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:17.946+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:18.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:17 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:17.946+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:43.592465+0000 front 2024-05-10T11:02:43.592415+0000 (oldest deadline 2024-05-10T11:03:06.492460+0000) 2024-05-10T11:03:18.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:17 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:17.946+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6820 osd.7 since back 2024-05-10T11:02:51.793675+0000 front 2024-05-10T11:02:51.793613+0000 (oldest deadline 2024-05-10T11:03:17.693522+0000) 2024-05-10T11:03:18.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:18 smithi196 systemd[1]: Stopping Ceph osd.11 for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:03:18.812 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:18 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:18.314+0000 7fece9a2f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:03:18.812 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:18 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:18.314+0000 7fece9a2f700 -1 osd.11 85 *** Got signal Terminated *** 2024-05-10T11:03:18.813 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:18 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:18.314+0000 7fece9a2f700 -1 osd.11 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-10T11:03:19.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:18 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:18.972+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:19.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:18 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:18.972+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:19.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:18 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:18.972+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:19.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:18 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:18.972+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:19.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:18 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:18.972+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:19.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:18 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:18.972+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:43.592465+0000 front 2024-05-10T11:02:43.592415+0000 (oldest deadline 2024-05-10T11:03:06.492460+0000) 2024-05-10T11:03:19.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:18 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:18.972+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6820 osd.7 since back 2024-05-10T11:02:51.793675+0000 front 2024-05-10T11:02:51.793613+0000 (oldest deadline 2024-05-10T11:03:17.693522+0000) 2024-05-10T11:03:20.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:19 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:19.975+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:20.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:19 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:19.975+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:20.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:19 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:19.975+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:20.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:19 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:19.975+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:20.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:19 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:19.975+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:20.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:19 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:19.975+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:43.592465+0000 front 2024-05-10T11:02:43.592415+0000 (oldest deadline 2024-05-10T11:03:06.492460+0000) 2024-05-10T11:03:20.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:19 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:19.975+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6820 osd.7 since back 2024-05-10T11:02:51.793675+0000 front 2024-05-10T11:02:51.793613+0000 (oldest deadline 2024-05-10T11:03:17.693522+0000) 2024-05-10T11:03:21.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:20 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:20.996+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:21.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:20 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:20.996+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:21.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:20 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:20.996+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:21.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:20 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:20.996+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:21.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:20 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:20.996+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:21.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:20 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:20.996+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:43.592465+0000 front 2024-05-10T11:02:43.592415+0000 (oldest deadline 2024-05-10T11:03:06.492460+0000) 2024-05-10T11:03:21.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:20 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:20.996+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6820 osd.7 since back 2024-05-10T11:02:51.793675+0000 front 2024-05-10T11:02:51.793613+0000 (oldest deadline 2024-05-10T11:03:17.693522+0000) 2024-05-10T11:03:22.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:22.022+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:22.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:22.022+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:22.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:22.022+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:22.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:22.022+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:22.314 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:22.022+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:22.314 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:22.022+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:43.592465+0000 front 2024-05-10T11:02:43.592415+0000 (oldest deadline 2024-05-10T11:03:06.492460+0000) 2024-05-10T11:03:22.314 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:22.022+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6820 osd.7 since back 2024-05-10T11:02:51.793675+0000 front 2024-05-10T11:02:51.793613+0000 (oldest deadline 2024-05-10T11:03:17.693522+0000) 2024-05-10T11:03:22.314 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:22.022+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6820 osd.8 since back 2024-05-10T11:02:58.194386+0000 front 2024-05-10T11:02:58.194409+0000 (oldest deadline 2024-05-10T11:03:21.694444+0000) 2024-05-10T11:03:23.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:22.998+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6806 osd.0 since back 2024-05-10T11:01:51.283509+0000 front 2024-05-10T11:01:51.283473+0000 (oldest deadline 2024-05-10T11:02:17.183367+0000) 2024-05-10T11:03:23.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:22.998+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6804 osd.1 since back 2024-05-10T11:01:59.484526+0000 front 2024-05-10T11:01:59.484458+0000 (oldest deadline 2024-05-10T11:02:25.384587+0000) 2024-05-10T11:03:23.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:22.998+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6804 osd.2 since back 2024-05-10T11:02:11.186340+0000 front 2024-05-10T11:02:11.186515+0000 (oldest deadline 2024-05-10T11:02:33.486260+0000) 2024-05-10T11:03:23.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:22.998+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6812 osd.4 since back 2024-05-10T11:02:27.289904+0000 front 2024-05-10T11:02:27.289929+0000 (oldest deadline 2024-05-10T11:02:48.989778+0000) 2024-05-10T11:03:23.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:22.998+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6812 osd.5 since back 2024-05-10T11:02:31.890484+0000 front 2024-05-10T11:02:31.890437+0000 (oldest deadline 2024-05-10T11:02:57.790478+0000) 2024-05-10T11:03:23.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:22.998+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.107:6822 osd.6 since back 2024-05-10T11:02:43.592465+0000 front 2024-05-10T11:02:43.592415+0000 (oldest deadline 2024-05-10T11:03:06.492460+0000) 2024-05-10T11:03:23.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:22.998+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.184:6820 osd.7 since back 2024-05-10T11:02:51.793675+0000 front 2024-05-10T11:02:51.793613+0000 (oldest deadline 2024-05-10T11:03:17.693522+0000) 2024-05-10T11:03:23.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:22 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11[60172]: 2024-05-10T11:03:22.998+0000 7fece6023700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.196:6820 osd.8 since back 2024-05-10T11:02:58.194386+0000 front 2024-05-10T11:02:58.194409+0000 (oldest deadline 2024-05-10T11:03:21.694444+0000) 2024-05-10T11:03:23.996 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:23 smithi196 podman[70147]: 2024-05-10 11:03:23.676711234 +0000 UTC m=+5.485231674 container died 439b905f56a29c37422b6f32ed5a4499a1a8aad7bd1b6d4aacc60a82a3eafaef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, io.buildah.version=1.33.5) 2024-05-10T11:03:24.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:23 smithi196 podman[70147]: 2024-05-10 11:03:23.997218569 +0000 UTC m=+5.805738989 container cleanup 439b905f56a29c37422b6f32ed5a4499a1a8aad7bd1b6d4aacc60a82a3eafaef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507) 2024-05-10T11:03:24.312 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:23 smithi196 bash[70147]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11 2024-05-10T11:03:24.313 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:24 smithi196 podman[70164]: 2024-05-10 11:03:24.165085423 +0000 UTC m=+0.488949211 container remove 439b905f56a29c37422b6f32ed5a4499a1a8aad7bd1b6d4aacc60a82a3eafaef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, io.buildah.version=1.33.5, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-10T11:03:24.812 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:24 smithi196 podman[70254]: 2024-05-10 11:03:24.557388773 +0000 UTC m=+0.112401315 container create 75cb1d1adc8d37c4248af7ad251bfb4c58fc3945a142539e31f80cc18dc06e46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-10T11:03:24.813 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:24 smithi196 podman[70254]: 2024-05-10 11:03:24.463093844 +0000 UTC m=+0.018106400 image pull ee5e4f21ef58047cb638cccd5cfbe8f6f43412b56c94b1d7fbd9cf3cb90a53a5 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f 2024-05-10T11:03:24.813 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:24 smithi196 podman[70254]: 2024-05-10 11:03:24.776748601 +0000 UTC m=+0.331761144 container init 75cb1d1adc8d37c4248af7ad251bfb4c58fc3945a142539e31f80cc18dc06e46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-10T11:03:24.813 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:24 smithi196 podman[70254]: 2024-05-10 11:03:24.779711844 +0000 UTC m=+0.334724387 container start 75cb1d1adc8d37c4248af7ad251bfb4c58fc3945a142539e31f80cc18dc06e46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507) 2024-05-10T11:03:25.296 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:24 smithi196 podman[70254]: 2024-05-10 11:03:24.860013678 +0000 UTC m=+0.415026253 container attach 75cb1d1adc8d37c4248af7ad251bfb4c58fc3945a142539e31f80cc18dc06e46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-05-10T11:03:25.296 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:25 smithi196 podman[70280]: 2024-05-10 11:03:25.096316853 +0000 UTC m=+0.019064846 container died 75cb1d1adc8d37c4248af7ad251bfb4c58fc3945a142539e31f80cc18dc06e46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11-deactivate, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-10T11:03:25.537 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.11.service' 2024-05-10T11:03:25.558 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:25 smithi196 podman[70280]: 2024-05-10 11:03:25.513424451 +0000 UTC m=+0.436172429 container remove 75cb1d1adc8d37c4248af7ad251bfb4c58fc3945a142539e31f80cc18dc06e46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-10T11:03:25.558 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:25 smithi196 systemd[1]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.11.service: Deactivated successfully. 2024-05-10T11:03:25.558 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:25 smithi196 systemd[1]: Stopped Ceph osd.11 for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T11:03:25.559 INFO:journalctl@ceph.osd.11.smithi196.stdout:May 10 11:03:25 smithi196 systemd[1]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@osd.11.service: Consumed 13.182s CPU time. 2024-05-10T11:03:25.573 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:03:25.574 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-10T11:03:25.574 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-10T11:03:25.574 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.a 2024-05-10T11:03:25.877 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 11:03:25 smithi107 systemd[1]: Stopping Ceph mds.a for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:03:26.174 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 11:03:25 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-a[72787]: 2024-05-10T11:03:25.876+0000 7fc6d4a87700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:03:26.174 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 11:03:25 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-a[72787]: 2024-05-10T11:03:25.876+0000 7fc6d4a87700 -1 mds.a *** got signal Terminated *** 2024-05-10T11:03:29.467 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 11:03:29 smithi107 podman[97832]: 2024-05-10 11:03:29.216749386 +0000 UTC m=+3.445913289 container died 0cb620bb952d4047a4eaff1e1343efba1b2fd2a5b71ac7a8387aec26d6fa8374 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True) 2024-05-10T11:03:29.834 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 11:03:29 smithi107 podman[97832]: 2024-05-10 11:03:29.650589504 +0000 UTC m=+3.879753406 container cleanup 0cb620bb952d4047a4eaff1e1343efba1b2fd2a5b71ac7a8387aec26d6fa8374 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-a, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-05-10T11:03:29.835 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 11:03:29 smithi107 bash[97832]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-a 2024-05-10T11:03:30.075 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.a.service' 2024-05-10T11:03:30.097 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 11:03:29 smithi107 podman[97844]: 2024-05-10 11:03:29.83515306 +0000 UTC m=+0.614069112 container remove 0cb620bb952d4047a4eaff1e1343efba1b2fd2a5b71ac7a8387aec26d6fa8374 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-a, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.build-date=20240507, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-10T11:03:30.097 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 11:03:30 smithi107 systemd[1]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.a.service: Deactivated successfully. 2024-05-10T11:03:30.097 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 11:03:30 smithi107 systemd[1]: Stopped Ceph mds.a for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T11:03:30.097 INFO:journalctl@ceph.mds.a.smithi107.stdout:May 10 11:03:30 smithi107 systemd[1]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.a.service: Consumed 1.981s CPU time. 2024-05-10T11:03:30.110 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:03:30.110 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-10T11:03:30.110 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-10T11:03:30.110 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.d 2024-05-10T11:03:30.424 INFO:journalctl@ceph.mds.d.smithi107.stdout:May 10 11:03:30 smithi107 systemd[1]: Stopping Ceph mds.d for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:03:30.924 INFO:journalctl@ceph.mds.d.smithi107.stdout:May 10 11:03:30 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-d[71403]: 2024-05-10T11:03:30.437+0000 7f0aac6cd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:03:30.924 INFO:journalctl@ceph.mds.d.smithi107.stdout:May 10 11:03:30 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-d[71403]: 2024-05-10T11:03:30.437+0000 7f0aac6cd700 -1 mds.d *** got signal Terminated *** 2024-05-10T11:03:33.174 INFO:journalctl@ceph.mds.d.smithi107.stdout:May 10 11:03:32 smithi107 podman[97951]: 2024-05-10 11:03:32.915084122 +0000 UTC m=+2.589345974 container died 81890e334935a114d42ecbdce48a0a3541e3a3fb4df72f4f63ad90142a9759a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-d, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, ceph=True) 2024-05-10T11:03:33.555 INFO:journalctl@ceph.mds.d.smithi107.stdout:May 10 11:03:33 smithi107 podman[97951]: 2024-05-10 11:03:33.304433123 +0000 UTC m=+2.978694977 container cleanup 81890e334935a114d42ecbdce48a0a3541e3a3fb4df72f4f63ad90142a9759a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e) 2024-05-10T11:03:33.555 INFO:journalctl@ceph.mds.d.smithi107.stdout:May 10 11:03:33 smithi107 bash[97951]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-d 2024-05-10T11:03:33.725 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.d.service' 2024-05-10T11:03:33.761 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:03:33.761 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-10T11:03:33.762 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-10T11:03:33.762 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.g 2024-05-10T11:03:34.074 INFO:journalctl@ceph.mds.g.smithi107.stdout:May 10 11:03:33 smithi107 systemd[1]: Stopping Ceph mds.g for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:03:34.424 INFO:journalctl@ceph.mds.g.smithi107.stdout:May 10 11:03:34 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-g[72347]: 2024-05-10T11:03:34.074+0000 7f19cb7ad700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:03:34.424 INFO:journalctl@ceph.mds.g.smithi107.stdout:May 10 11:03:34 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-g[72347]: 2024-05-10T11:03:34.074+0000 7f19cb7ad700 -1 mds.g *** got signal Terminated *** 2024-05-10T11:03:37.523 INFO:journalctl@ceph.mds.g.smithi107.stdout:May 10 11:03:37 smithi107 podman[98082]: 2024-05-10 11:03:37.221287218 +0000 UTC m=+3.242309691 container died 3687aec8903906ce7739e12511492d173f3d895c94ee339bd2b5efd0f3c76a7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-g, GIT_CLEAN=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.license=GPLv2) 2024-05-10T11:03:37.924 INFO:journalctl@ceph.mds.g.smithi107.stdout:May 10 11:03:37 smithi107 podman[98082]: 2024-05-10 11:03:37.524181026 +0000 UTC m=+3.545203509 container cleanup 3687aec8903906ce7739e12511492d173f3d895c94ee339bd2b5efd0f3c76a7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-10T11:03:37.924 INFO:journalctl@ceph.mds.g.smithi107.stdout:May 10 11:03:37 smithi107 bash[98082]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-g 2024-05-10T11:03:37.924 INFO:journalctl@ceph.mds.g.smithi107.stdout:May 10 11:03:37 smithi107 podman[98096]: 2024-05-10 11:03:37.72536685 +0000 UTC m=+0.505705653 container remove 3687aec8903906ce7739e12511492d173f3d895c94ee339bd2b5efd0f3c76a7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-g, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True) 2024-05-10T11:03:37.947 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.g.service' 2024-05-10T11:03:37.981 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:03:37.982 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-10T11:03:37.982 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-10T11:03:37.982 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.j 2024-05-10T11:03:38.286 INFO:journalctl@ceph.mds.j.smithi107.stdout:May 10 11:03:38 smithi107 systemd[1]: Stopping Ceph mds.j for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:03:38.674 INFO:journalctl@ceph.mds.j.smithi107.stdout:May 10 11:03:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-j[71096]: 2024-05-10T11:03:38.285+0000 7f19a5006700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:03:38.674 INFO:journalctl@ceph.mds.j.smithi107.stdout:May 10 11:03:38 smithi107 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-j[71096]: 2024-05-10T11:03:38.285+0000 7f19a5006700 -1 mds.j *** got signal Terminated *** 2024-05-10T11:03:42.527 INFO:journalctl@ceph.mds.j.smithi107.stdout:May 10 11:03:42 smithi107 podman[98204]: 2024-05-10 11:03:42.211563457 +0000 UTC m=+4.016619079 container died 900920d0ceec1cbe9a5b02167488499f3ca7a0bcffcf6ba2429256aeb85ad3d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-j, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.schema-version=1.0, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-10T11:03:42.924 INFO:journalctl@ceph.mds.j.smithi107.stdout:May 10 11:03:42 smithi107 podman[98204]: 2024-05-10 11:03:42.52757691 +0000 UTC m=+4.332632528 container cleanup 900920d0ceec1cbe9a5b02167488499f3ca7a0bcffcf6ba2429256aeb85ad3d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-j, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-10T11:03:42.924 INFO:journalctl@ceph.mds.j.smithi107.stdout:May 10 11:03:42 smithi107 bash[98204]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-j 2024-05-10T11:03:42.924 INFO:journalctl@ceph.mds.j.smithi107.stdout:May 10 11:03:42 smithi107 podman[98218]: 2024-05-10 11:03:42.703457973 +0000 UTC m=+0.488218234 container remove 900920d0ceec1cbe9a5b02167488499f3ca7a0bcffcf6ba2429256aeb85ad3d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-05-10T11:03:42.965 DEBUG:teuthology.orchestra.run.smithi107:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.j.service' 2024-05-10T11:03:42.998 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:03:42.998 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-10T11:03:42.998 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-10T11:03:42.998 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.b 2024-05-10T11:03:43.304 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 11:03:43 smithi184 systemd[1]: Stopping Ceph mds.b for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:03:43.563 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 11:03:43 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-b[64672]: 2024-05-10T11:03:43.304+0000 7ff724901700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:03:43.563 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 11:03:43 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-b[64672]: 2024-05-10T11:03:43.304+0000 7ff724901700 -1 mds.b *** got signal Terminated *** 2024-05-10T11:03:45.480 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 11:03:45 smithi184 podman[69449]: 2024-05-10 11:03:45.229962725 +0000 UTC m=+2.033955668 container died c3a0475128d67b95715942f511cbe972dd092e016d0c33d04fa7318419ea00af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, maintainer=Guillaume Abrioux , RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507) 2024-05-10T11:03:45.747 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 11:03:45 smithi184 podman[69449]: 2024-05-10 11:03:45.571333893 +0000 UTC m=+2.375326853 container cleanup c3a0475128d67b95715942f511cbe972dd092e016d0c33d04fa7318419ea00af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-b, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5) 2024-05-10T11:03:45.747 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 11:03:45 smithi184 bash[69449]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-b 2024-05-10T11:03:45.987 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.b.service' 2024-05-10T11:03:46.008 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 11:03:45 smithi184 podman[69475]: 2024-05-10 11:03:45.747630938 +0000 UTC m=+0.515708383 container remove c3a0475128d67b95715942f511cbe972dd092e016d0c33d04fa7318419ea00af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-b, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-10T11:03:46.008 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 11:03:45 smithi184 systemd[1]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.b.service: Deactivated successfully. 2024-05-10T11:03:46.008 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 11:03:45 smithi184 systemd[1]: Stopped Ceph mds.b for 0ba8a8e4-0eba-11ef-bc98-c7b262605968. 2024-05-10T11:03:46.008 INFO:journalctl@ceph.mds.b.smithi184.stdout:May 10 11:03:45 smithi184 systemd[1]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.b.service: Consumed 54.306s CPU time. 2024-05-10T11:03:46.021 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:03:46.021 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-10T11:03:46.021 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-10T11:03:46.021 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.e 2024-05-10T11:03:46.334 INFO:journalctl@ceph.mds.e.smithi184.stdout:May 10 11:03:46 smithi184 systemd[1]: Stopping Ceph mds.e for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:03:46.638 INFO:journalctl@ceph.mds.e.smithi184.stdout:May 10 11:03:46 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-e[64042]: 2024-05-10T11:03:46.333+0000 7f4534875700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:03:46.639 INFO:journalctl@ceph.mds.e.smithi184.stdout:May 10 11:03:46 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-e[64042]: 2024-05-10T11:03:46.333+0000 7f4534875700 -1 mds.e *** got signal Terminated *** 2024-05-10T11:03:49.492 INFO:journalctl@ceph.mds.e.smithi184.stdout:May 10 11:03:49 smithi184 podman[69582]: 2024-05-10 11:03:49.225625153 +0000 UTC m=+2.989821535 container died 80f2671169082307ad7654587e85c750bf75db6b839afc3d8e6405ba4e1b805c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507) 2024-05-10T11:03:49.851 INFO:journalctl@ceph.mds.e.smithi184.stdout:May 10 11:03:49 smithi184 podman[69582]: 2024-05-10 11:03:49.592273676 +0000 UTC m=+3.356470065 container cleanup 80f2671169082307ad7654587e85c750bf75db6b839afc3d8e6405ba4e1b805c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240507) 2024-05-10T11:03:49.855 INFO:journalctl@ceph.mds.e.smithi184.stdout:May 10 11:03:49 smithi184 bash[69582]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-e 2024-05-10T11:03:50.013 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.e.service' 2024-05-10T11:03:50.044 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:03:50.045 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-10T11:03:50.045 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-10T11:03:50.045 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.h 2024-05-10T11:03:50.362 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 11:03:50 smithi184 systemd[1]: Stopping Ceph mds.h for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:03:50.638 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 11:03:50 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-h[64354]: 2024-05-10T11:03:50.361+0000 7fe381928700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:03:50.639 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 11:03:50 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-h[64354]: 2024-05-10T11:03:50.361+0000 7fe381928700 -1 mds.h *** got signal Terminated *** 2024-05-10T11:03:53.504 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 11:03:53 smithi184 podman[69702]: 2024-05-10 11:03:53.216382222 +0000 UTC m=+2.957504764 container died 06982656a9f6667587d81827925974c86ee3fc038553227acd6fc1ae72ddafb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-h, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-10T11:03:53.888 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 11:03:53 smithi184 podman[69702]: 2024-05-10 11:03:53.56481206 +0000 UTC m=+3.305934603 container cleanup 06982656a9f6667587d81827925974c86ee3fc038553227acd6fc1ae72ddafb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-h, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, io.buildah.version=1.33.5) 2024-05-10T11:03:53.889 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 11:03:53 smithi184 bash[69702]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-h 2024-05-10T11:03:53.889 INFO:journalctl@ceph.mds.h.smithi184.stdout:May 10 11:03:53 smithi184 podman[69717]: 2024-05-10 11:03:53.749323409 +0000 UTC m=+0.527667576 container remove 06982656a9f6667587d81827925974c86ee3fc038553227acd6fc1ae72ddafb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-h, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_CLEAN=True) 2024-05-10T11:03:53.984 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.h.service' 2024-05-10T11:03:54.016 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:03:54.016 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-10T11:03:54.017 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-10T11:03:54.017 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.k 2024-05-10T11:03:54.326 INFO:journalctl@ceph.mds.k.smithi184.stdout:May 10 11:03:54 smithi184 systemd[1]: Stopping Ceph mds.k for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:03:54.639 INFO:journalctl@ceph.mds.k.smithi184.stdout:May 10 11:03:54 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-k[63726]: 2024-05-10T11:03:54.325+0000 7fca02a46700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:03:54.639 INFO:journalctl@ceph.mds.k.smithi184.stdout:May 10 11:03:54 smithi184 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-k[63726]: 2024-05-10T11:03:54.325+0000 7fca02a46700 -1 mds.k *** got signal Terminated *** 2024-05-10T11:03:57.518 INFO:journalctl@ceph.mds.k.smithi184.stdout:May 10 11:03:57 smithi184 podman[69823]: 2024-05-10 11:03:57.227191743 +0000 UTC m=+3.002057591 container died ff95ca875577f4b3c53f970317cf9e432b051a1322d460e8a90efa81d711af89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-k, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08) 2024-05-10T11:03:57.818 INFO:journalctl@ceph.mds.k.smithi184.stdout:May 10 11:03:57 smithi184 podman[69823]: 2024-05-10 11:03:57.601610224 +0000 UTC m=+3.376476082 container cleanup ff95ca875577f4b3c53f970317cf9e432b051a1322d460e8a90efa81d711af89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, maintainer=Guillaume Abrioux , RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-10T11:03:57.818 INFO:journalctl@ceph.mds.k.smithi184.stdout:May 10 11:03:57 smithi184 bash[69823]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-k 2024-05-10T11:03:57.956 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.k.service' 2024-05-10T11:03:57.987 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:03:57.987 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-10T11:03:57.987 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-10T11:03:57.987 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.c 2024-05-10T11:03:58.266 INFO:journalctl@ceph.mds.c.smithi196.stdout:May 10 11:03:58 smithi196 systemd[1]: Stopping Ceph mds.c for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:03:58.562 INFO:journalctl@ceph.mds.c.smithi196.stdout:May 10 11:03:58 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-c[65165]: 2024-05-10T11:03:58.286+0000 7f8bf7f72700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:03:58.562 INFO:journalctl@ceph.mds.c.smithi196.stdout:May 10 11:03:58 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-c[65165]: 2024-05-10T11:03:58.286+0000 7f8bf7f72700 -1 mds.c *** got signal Terminated *** 2024-05-10T11:04:01.553 INFO:journalctl@ceph.mds.c.smithi196.stdout:May 10 11:04:01 smithi196 podman[70360]: 2024-05-10 11:04:01.219417587 +0000 UTC m=+3.039671236 container died e6c2d4962e753997c3af5ce6ce585ec37fa4d9801d48c5fad38b29ae7e1c3b22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-10T11:04:01.812 INFO:journalctl@ceph.mds.c.smithi196.stdout:May 10 11:04:01 smithi196 podman[70360]: 2024-05-10 11:04:01.653001075 +0000 UTC m=+3.473254723 container cleanup e6c2d4962e753997c3af5ce6ce585ec37fa4d9801d48c5fad38b29ae7e1c3b22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-c, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-10T11:04:01.813 INFO:journalctl@ceph.mds.c.smithi196.stdout:May 10 11:04:01 smithi196 bash[70360]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-c 2024-05-10T11:04:02.031 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.c.service' 2024-05-10T11:04:02.066 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:04:02.067 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-10T11:04:02.068 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-10T11:04:02.068 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.f 2024-05-10T11:04:02.382 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 11:04:02 smithi196 systemd[1]: Stopping Ceph mds.f for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:04:02.812 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 11:04:02 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-f[64857]: 2024-05-10T11:04:02.381+0000 7ff7de251700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:04:02.812 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 11:04:02 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-f[64857]: 2024-05-10T11:04:02.381+0000 7ff7de251700 -1 mds.f *** got signal Terminated *** 2024-05-10T11:04:05.551 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 11:04:05 smithi196 podman[70492]: 2024-05-10 11:04:05.231274488 +0000 UTC m=+2.948583270 container died 6dba30ac6ec5deae97409a5fd0f06344f3b66913e2c8ef5d2dff49689d9475d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-f, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-10T11:04:05.551 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 11:04:05 smithi196 podman[70492]: 2024-05-10 11:04:05.550739813 +0000 UTC m=+3.268048601 container cleanup 6dba30ac6ec5deae97409a5fd0f06344f3b66913e2c8ef5d2dff49689d9475d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-f, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240507) 2024-05-10T11:04:05.812 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 11:04:05 smithi196 bash[70492]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-f 2024-05-10T11:04:05.812 INFO:journalctl@ceph.mds.f.smithi196.stdout:May 10 11:04:05 smithi196 podman[70506]: 2024-05-10 11:04:05.732836881 +0000 UTC m=+0.500926096 container remove 6dba30ac6ec5deae97409a5fd0f06344f3b66913e2c8ef5d2dff49689d9475d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-f, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-10T11:04:05.981 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.f.service' 2024-05-10T11:04:06.013 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:04:06.013 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-10T11:04:06.014 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-10T11:04:06.014 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.i 2024-05-10T11:04:06.312 INFO:journalctl@ceph.mds.i.smithi196.stdout:May 10 11:04:06 smithi196 systemd[1]: Stopping Ceph mds.i for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:04:06.812 INFO:journalctl@ceph.mds.i.smithi196.stdout:May 10 11:04:06 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-i[65467]: 2024-05-10T11:04:06.335+0000 7effce81c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:04:06.812 INFO:journalctl@ceph.mds.i.smithi196.stdout:May 10 11:04:06 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-i[65467]: 2024-05-10T11:04:06.335+0000 7effce81c700 -1 mds.i *** got signal Terminated *** 2024-05-10T11:04:09.493 INFO:journalctl@ceph.mds.i.smithi196.stdout:May 10 11:04:09 smithi196 podman[70612]: 2024-05-10 11:04:09.233121036 +0000 UTC m=+3.001811516 container died 3e5cf6aa9a3066a68d1c10f8ac60632e50deb07a2d9a091545a986f7b70546af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-i, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240507) 2024-05-10T11:04:09.813 INFO:journalctl@ceph.mds.i.smithi196.stdout:May 10 11:04:09 smithi196 podman[70612]: 2024-05-10 11:04:09.60165907 +0000 UTC m=+3.370349561 container cleanup 3e5cf6aa9a3066a68d1c10f8ac60632e50deb07a2d9a091545a986f7b70546af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-i, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-10T11:04:09.813 INFO:journalctl@ceph.mds.i.smithi196.stdout:May 10 11:04:09 smithi196 bash[70612]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-i 2024-05-10T11:04:09.991 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.i.service' 2024-05-10T11:04:10.022 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:04:10.022 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-10T11:04:10.023 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-10T11:04:10.023 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.l 2024-05-10T11:04:10.312 INFO:journalctl@ceph.mds.l.smithi196.stdout:May 10 11:04:10 smithi196 systemd[1]: Stopping Ceph mds.l for 0ba8a8e4-0eba-11ef-bc98-c7b262605968... 2024-05-10T11:04:10.813 INFO:journalctl@ceph.mds.l.smithi196.stdout:May 10 11:04:10 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-l[64551]: 2024-05-10T11:04:10.349+0000 7f7cc0bfa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-10T11:04:10.813 INFO:journalctl@ceph.mds.l.smithi196.stdout:May 10 11:04:10 smithi196 ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-l[64551]: 2024-05-10T11:04:10.349+0000 7f7cc0bfa700 -1 mds.l *** got signal Terminated *** 2024-05-10T11:04:13.489 INFO:journalctl@ceph.mds.l.smithi196.stdout:May 10 11:04:13 smithi196 podman[70732]: 2024-05-10 11:04:13.219461564 +0000 UTC m=+2.978588680 container died 586970b0899147fbfc34be8c10267feac9f3016526d1fff8994dc3a199f0bd84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-l, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-10T11:04:13.812 INFO:journalctl@ceph.mds.l.smithi196.stdout:May 10 11:04:13 smithi196 podman[70732]: 2024-05-10 11:04:13.589283106 +0000 UTC m=+3.348410221 container cleanup 586970b0899147fbfc34be8c10267feac9f3016526d1fff8994dc3a199f0bd84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:c77785140a1aa226ee46fbc1bec1768a7bea4786cdf8c717e77f2b0ad3d7725f, name=ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-l, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-63896-from-wip-rishabh-testing-20240501.193033-d39fa08, GIT_COMMIT=26c185c6730a227e8afae88cfa8b303d6e5c470e) 2024-05-10T11:04:13.812 INFO:journalctl@ceph.mds.l.smithi196.stdout:May 10 11:04:13 smithi196 bash[70732]: ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968-mds-l 2024-05-10T11:04:14.013 DEBUG:teuthology.orchestra.run.smithi196:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ba8a8e4-0eba-11ef-bc98-c7b262605968@mds.l.service' 2024-05-10T11:04:14.043 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-10T11:04:14.044 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-10T11:04:14.044 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 --force --keep-logs 2024-05-10T11:04:14.235 INFO:teuthology.orchestra.run.smithi107.stdout:Deleting cluster with fsid: 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T11:04:16.627 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 --force --keep-logs 2024-05-10T11:04:16.818 INFO:teuthology.orchestra.run.smithi184.stdout:Deleting cluster with fsid: 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T11:04:19.273 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 --force --keep-logs 2024-05-10T11:04:19.458 INFO:teuthology.orchestra.run.smithi196.stdout:Deleting cluster with fsid: 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T11:04:21.814 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-10T11:04:21.847 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-10T11:04:21.879 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-10T11:04:21.904 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-10T11:04:21.906 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/crash to /home/teuthworker/archive/dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700915/remote/smithi107/crash 2024-05-10T11:04:21.907 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/crash -- . 2024-05-10T11:04:21.935 INFO:teuthology.orchestra.run.smithi107.stderr:tar: /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/crash: Cannot open: No such file or directory 2024-05-10T11:04:21.936 INFO:teuthology.orchestra.run.smithi107.stderr:tar: Error is not recoverable: exiting now 2024-05-10T11:04:21.937 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/crash to /home/teuthworker/archive/dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700915/remote/smithi184/crash 2024-05-10T11:04:21.938 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/crash -- . 2024-05-10T11:04:22.000 INFO:teuthology.orchestra.run.smithi184.stderr:tar: /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/crash: Cannot open: No such file or directory 2024-05-10T11:04:22.001 INFO:teuthology.orchestra.run.smithi184.stderr:tar: Error is not recoverable: exiting now 2024-05-10T11:04:22.002 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/crash to /home/teuthworker/archive/dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700915/remote/smithi196/crash 2024-05-10T11:04:22.003 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/crash -- . 2024-05-10T11:04:22.035 INFO:teuthology.orchestra.run.smithi196.stderr:tar: /var/lib/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/crash: Cannot open: No such file or directory 2024-05-10T11:04:22.035 INFO:teuthology.orchestra.run.smithi196.stderr:tar: Error is not recoverable: exiting now 2024-05-10T11:04:22.036 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-10T11:04:22.037 DEBUG:teuthology.orchestra.run.smithi107:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-05-10T11:04:22.071 INFO:tasks.cephadm:Compressing logs... 2024-05-10T11:04:22.071 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-10T11:04:22.114 DEBUG:teuthology.orchestra.run.smithi184:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-10T11:04:22.116 DEBUG:teuthology.orchestra.run.smithi196:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-10T11:04:22.138 INFO:teuthology.orchestra.run.smithi107.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.log 2024-05-10T11:04:22.138 INFO:teuthology.orchestra.run.smithi107.stderr:: No such file or directory 2024-05-10T11:04:22.138 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.audit.log 2024-05-10T11:04:22.152 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.g.log 2024-05-10T11:04:22.152 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.log: /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.j.log 2024-05-10T11:04:22.152 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.3.log 2024-05-10T11:04:22.152 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.0.log 2024-05-10T11:04:22.152 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.j.log: /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mgr.x.log 2024-05-10T11:04:22.152 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mon.a.log 2024-05-10T11:04:22.152 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.6.log 2024-05-10T11:04:22.152 INFO:teuthology.orchestra.run.smithi107.stderr: 86.8% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.log.gz 2024-05-10T11:04:22.152 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.cephadm.log 2024-05-10T11:04:22.152 INFO:teuthology.orchestra.run.smithi107.stderr: 90.3% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.audit.log.gz 2024-05-10T11:04:22.152 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mon.a.log: /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.a.log 2024-05-10T11:04:22.152 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.cephadm.log: 82.7% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.cephadm.log.gz 2024-05-10T11:04:22.152 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-volume.log 2024-05-10T11:04:22.153 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.a.log: 94.7% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.j.log.gz 2024-05-10T11:04:22.153 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.d.log 2024-05-10T11:04:22.153 INFO:teuthology.orchestra.run.smithi196.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.log 2024-05-10T11:04:22.153 INFO:teuthology.orchestra.run.smithi196.stderr:: No such file or directory 2024-05-10T11:04:22.153 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.2.log 2024-05-10T11:04:22.153 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.f.log 2024-05-10T11:04:22.154 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.audit.log 2024-05-10T11:04:22.154 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.5.log 2024-05-10T11:04:22.154 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.c.log 2024-05-10T11:04:22.154 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.audit.log: /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mon.c.log 2024-05-10T11:04:22.154 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mgr.z.log 2024-05-10T11:04:22.154 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.i.log 2024-05-10T11:04:22.154 INFO:teuthology.orchestra.run.smithi196.stderr: 86.8% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.log.gz 2024-05-10T11:04:22.154 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.cephadm.log 2024-05-10T11:04:22.154 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.i.log: 90.5% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.audit.log.gz 2024-05-10T11:04:22.154 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.11.log 2024-05-10T11:04:22.154 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.cephadm.log: 82.4% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.cephadm.log.gz 2024-05-10T11:04:22.154 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.8.log 2024-05-10T11:04:22.154 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.11.log: 92.7% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mgr.z.log.gz 2024-05-10T11:04:22.157 INFO:teuthology.orchestra.run.smithi184.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.log 2024-05-10T11:04:22.158 INFO:teuthology.orchestra.run.smithi184.stderr:: No such file or directory 2024-05-10T11:04:22.158 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.audit.log 2024-05-10T11:04:22.158 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.7.log 2024-05-10T11:04:22.158 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.log: /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.b.log 2024-05-10T11:04:22.158 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.4.log 2024-05-10T11:04:22.158 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.1.log 2024-05-10T11:04:22.158 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.b.log: /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mgr.y.log 2024-05-10T11:04:22.158 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.h.log 2024-05-10T11:04:22.158 INFO:teuthology.orchestra.run.smithi184.stderr: 86.8%/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mgr.y.log: -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.log.gz 2024-05-10T11:04:22.158 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.10.log 2024-05-10T11:04:22.158 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.cephadm.log 2024-05-10T11:04:22.158 INFO:teuthology.orchestra.run.smithi184.stderr: 90.5% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.audit.log.gz 2024-05-10T11:04:22.158 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.e.log 2024-05-10T11:04:22.158 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.cephadm.log: 82.4% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph.cephadm.log.gz 2024-05-10T11:04:22.159 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-volume.log 2024-05-10T11:04:22.159 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.e.log: 92.6% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mgr.y.log.gz 2024-05-10T11:04:22.159 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mon.b.log 2024-05-10T11:04:22.160 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.k.log 2024-05-10T11:04:22.161 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-volume.log: 91.1% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-volume.log.gz 2024-05-10T11:04:22.161 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.9.log 2024-05-10T11:04:22.161 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-volume.log 2024-05-10T11:04:22.164 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.d.log: 94.6% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.d.log.gz 2024-05-10T11:04:22.165 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-10T11:04:22.166 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-volume.log.gz 2024-05-10T11:04:22.166 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-10T11:04:22.170 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.l.log 2024-05-10T11:04:22.177 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-10T11:04:22.180 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-10T11:04:22.197 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.l.log: 91.0% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-volume.log.gz 2024-05-10T11:04:22.198 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.9.log: /var/log/ceph/cephadm.log: 93.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-10T11:04:22.205 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-10T11:04:22.297 INFO:teuthology.orchestra.run.smithi107.stderr: 94.2% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.g.log.gz 2024-05-10T11:04:22.308 INFO:teuthology.orchestra.run.smithi107.stderr: 94.5% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.a.log.gz 2024-05-10T11:04:22.312 INFO:teuthology.orchestra.run.smithi184.stderr: 94.3% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.k.log.gz 2024-05-10T11:04:22.358 INFO:teuthology.orchestra.run.smithi107.stderr: 89.9% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mgr.x.log.gz 2024-05-10T11:04:22.456 INFO:teuthology.orchestra.run.smithi196.stderr: 91.9% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mon.c.log.gz 2024-05-10T11:04:22.544 INFO:teuthology.orchestra.run.smithi184.stderr: 91.9% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mon.b.log.gz 2024-05-10T11:04:23.118 INFO:teuthology.orchestra.run.smithi107.stderr: 90.4% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mon.a.log.gz 2024-05-10T11:04:23.391 INFO:teuthology.orchestra.run.smithi107.stderr: 93.5% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.9.log.gz 2024-05-10T11:04:23.621 INFO:teuthology.orchestra.run.smithi107.stderr: 93.5% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.6.log.gz 2024-05-10T11:04:23.661 INFO:teuthology.orchestra.run.smithi184.stderr: 94.0% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.h.log.gz 2024-05-10T11:04:23.683 INFO:teuthology.orchestra.run.smithi107.stderr: 93.6% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.0.log.gz 2024-05-10T11:04:23.686 INFO:teuthology.orchestra.run.smithi196.stderr: 93.9% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.c.log.gz 2024-05-10T11:04:23.756 INFO:teuthology.orchestra.run.smithi184.stderr: 93.6% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.4.log.gz 2024-05-10T11:04:23.778 INFO:teuthology.orchestra.run.smithi184.stderr: 93.7% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.10.log.gz 2024-05-10T11:04:23.879 INFO:teuthology.orchestra.run.smithi184.stderr: 94.0% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.e.log.gz 2024-05-10T11:04:23.965 INFO:teuthology.orchestra.run.smithi107.stderr: 93.5% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.3.log.gz 2024-05-10T11:04:23.967 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-05-10T11:04:23.967 INFO:teuthology.orchestra.run.smithi107.stderr:real 0m1.839s 2024-05-10T11:04:23.967 INFO:teuthology.orchestra.run.smithi107.stderr:user 0m7.360s 2024-05-10T11:04:23.967 INFO:teuthology.orchestra.run.smithi107.stderr:sys 0m0.273s 2024-05-10T11:04:23.968 INFO:teuthology.orchestra.run.smithi196.stderr: 95.2% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.f.log.gz 2024-05-10T11:04:24.125 INFO:teuthology.orchestra.run.smithi196.stderr: 93.5% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.5.log.gz 2024-05-10T11:04:24.136 INFO:teuthology.orchestra.run.smithi196.stderr: 93.7% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.8.log.gz 2024-05-10T11:04:24.175 INFO:teuthology.orchestra.run.smithi184.stderr: 93.6% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.1.log.gz 2024-05-10T11:04:24.232 INFO:teuthology.orchestra.run.smithi196.stderr: 93.5% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.2.log.gz 2024-05-10T11:04:24.234 INFO:teuthology.orchestra.run.smithi196.stderr: 93.7% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.11.log.gz 2024-05-10T11:04:24.359 INFO:teuthology.orchestra.run.smithi184.stderr: 93.7% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-osd.7.log.gz 2024-05-10T11:04:24.411 INFO:teuthology.orchestra.run.smithi196.stderr: 95.4% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.l.log.gz 2024-05-10T11:04:38.474 INFO:teuthology.orchestra.run.smithi184.stderr: 93.2% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.b.log.gz 2024-05-10T11:04:38.476 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-05-10T11:04:38.476 INFO:teuthology.orchestra.run.smithi184.stderr:real 0m16.346s 2024-05-10T11:04:38.476 INFO:teuthology.orchestra.run.smithi184.stderr:user 0m26.579s 2024-05-10T11:04:38.476 INFO:teuthology.orchestra.run.smithi184.stderr:sys 0m0.884s 2024-05-10T11:04:42.285 INFO:teuthology.orchestra.run.smithi196.stderr: 93.3% -- replaced with /var/log/ceph/0ba8a8e4-0eba-11ef-bc98-c7b262605968/ceph-mds.i.log.gz 2024-05-10T11:04:42.287 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-05-10T11:04:42.287 INFO:teuthology.orchestra.run.smithi196.stderr:real 0m20.157s 2024-05-10T11:04:42.287 INFO:teuthology.orchestra.run.smithi196.stderr:user 0m32.887s 2024-05-10T11:04:42.287 INFO:teuthology.orchestra.run.smithi196.stderr:sys 0m1.012s 2024-05-10T11:04:42.287 INFO:tasks.cephadm:Archiving logs... 2024-05-10T11:04:42.288 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700915/remote/smithi107/log 2024-05-10T11:04:42.289 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T11:04:43.322 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700915/remote/smithi184/log 2024-05-10T11:04:43.323 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T11:04:47.082 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/log/ceph to /home/teuthworker/archive/dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700915/remote/smithi196/log 2024-05-10T11:04:47.083 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T11:04:51.468 INFO:tasks.cephadm:Removing cluster... 2024-05-10T11:04:51.468 DEBUG:teuthology.orchestra.run.smithi107:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 --force 2024-05-10T11:04:51.663 INFO:teuthology.orchestra.run.smithi107.stdout:Deleting cluster with fsid: 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T11:04:51.997 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 --force 2024-05-10T11:04:52.190 INFO:teuthology.orchestra.run.smithi184.stdout:Deleting cluster with fsid: 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T11:04:52.467 DEBUG:teuthology.orchestra.run.smithi196:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0ba8a8e4-0eba-11ef-bc98-c7b262605968 --force 2024-05-10T11:04:52.655 INFO:teuthology.orchestra.run.smithi196.stdout:Deleting cluster with fsid: 0ba8a8e4-0eba-11ef-bc98-c7b262605968 2024-05-10T11:04:52.941 INFO:tasks.cephadm:Removing cephadm ... 2024-05-10T11:04:52.941 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-10T11:04:52.957 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-10T11:04:52.973 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-10T11:04:52.989 INFO:tasks.cephadm:Teardown complete 2024-05-10T11:04:52.989 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-10T11:04:53.002 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-10T11:04:53.002 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T11:04:53.004 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T11:04:53.015 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T11:04:53.119 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-10T11:04:53.133 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-10T11:04:53.133 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T11:04:53.135 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T11:04:53.138 DEBUG:teuthology.orchestra.run.smithi196:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T11:04:53.147 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-05-10T11:04:53.149 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-05-10T11:04:53.151 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T11:04:53.151 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-05-10T11:04:53.151 INFO:teuthology.orchestra.run.smithi107.stdout:^* hv01.front.sepia.ceph.com 3 6 377 13 +1117us[+1125us] +/- 49ms 2024-05-10T11:04:53.151 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 13 -1605us[-1605us] +/- 52ms 2024-05-10T11:04:53.151 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 +426us[ +426us] +/- 72ms 2024-05-10T11:04:53.151 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T11:04:53.151 INFO:teuthology.orchestra.run.smithi196.stderr:bash: line 1: ntpq: command not found 2024-05-10T11:04:53.153 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T11:04:53.153 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-05-10T11:04:53.153 INFO:teuthology.orchestra.run.smithi184.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 +1113us[+1097us] +/- 49ms 2024-05-10T11:04:53.153 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 15 -1602us[-1602us] +/- 52ms 2024-05-10T11:04:53.153 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 +419us[ +402us] +/- 72ms 2024-05-10T11:04:53.153 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T11:04:53.155 INFO:teuthology.orchestra.run.smithi196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T11:04:53.155 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================== 2024-05-10T11:04:53.155 INFO:teuthology.orchestra.run.smithi196.stdout:^* hv01.front.sepia.ceph.com 3 6 377 14 +1095us[+1090us] +/- 49ms 2024-05-10T11:04:53.155 INFO:teuthology.orchestra.run.smithi196.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 13 -1636us[-1636us] +/- 52ms 2024-05-10T11:04:53.155 INFO:teuthology.orchestra.run.smithi196.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 +400us[ +400us] +/- 72ms 2024-05-10T11:04:53.155 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T11:04:53.156 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-10T11:04:53.169 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-10T11:04:53.169 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-10T11:04:53.206 DEBUG:teuthology.orchestra.run.smithi107:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-10T11:04:53.281 DEBUG:teuthology.orchestra.run.smithi184:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-10T11:04:53.345 DEBUG:teuthology.orchestra.run.smithi196:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-10T11:04:53.408 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-10T11:04:53.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:04:53.437 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-10T11:04:53.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:04:53.464 DEBUG:teuthology.orchestra.run.smithi196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-10T11:04:53.491 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:04:53.492 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-10T11:04:53.503 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-10T11:04:53.549 INFO:teuthology.task.internal:Duration was 1704.863164 seconds 2024-05-10T11:04:53.549 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-10T11:04:53.586 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-10T11:04:53.587 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T11:04:53.589 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T11:04:53.592 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T11:04:53.625 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T11:04:53.626 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T11:04:53.628 INFO:teuthology.orchestra.run.smithi196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T11:04:54.100 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-10T11:04:54.100 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-05-10T11:04:54.100 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T11:04:54.121 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2024-05-10T11:04:54.121 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T11:04:54.145 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi196.front.sepia.ceph.com 2024-05-10T11:04:54.145 DEBUG:teuthology.orchestra.run.smithi196:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T11:04:54.171 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-10T11:04:54.171 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T11:04:54.174 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T11:04:54.187 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T11:04:54.236 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-10T11:04:54.236 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T11:04:54.241 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T11:04:54.252 DEBUG:teuthology.orchestra.run.smithi196:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T11:04:54.883 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-10T11:04:54.896 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-10T11:04:54.897 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T11:04:54.921 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T11:04:54.946 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T11:04:54.971 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-10T11:04:54.988 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T11:04:54.990 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T11:04:54.993 DEBUG:teuthology.orchestra.run.smithi196:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T11:04:55.011 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-05-10T11:04:55.013 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2024-05-10T11:04:55.034 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = core 2024-05-10T11:04:55.054 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T11:04:55.079 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:04:55.080 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T11:04:55.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:04:55.097 DEBUG:teuthology.orchestra.run.smithi196:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T11:04:55.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T11:04:55.111 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-10T11:04:55.126 INFO:teuthology.task.internal:Transferring archived files... 2024-05-10T11:04:55.126 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700915/remote/smithi107 2024-05-10T11:04:55.127 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T11:04:55.177 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700915/remote/smithi184 2024-05-10T11:04:55.177 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T11:04:55.213 DEBUG:teuthology.misc:Transferring archived files from smithi196:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700915/remote/smithi196 2024-05-10T11:04:55.213 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T11:04:55.248 INFO:teuthology.task.internal:Removing archive directory... 2024-05-10T11:04:55.249 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T11:04:55.251 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T11:04:55.254 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T11:04:55.296 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-10T11:04:55.310 INFO:teuthology.task.internal:Not uploading archives. 2024-05-10T11:04:55.310 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-10T11:04:55.338 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-10T11:04:55.338 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T11:04:55.341 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T11:04:55.343 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T11:04:55.353 INFO:teuthology.orchestra.run.smithi107.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 11:04 /home/ubuntu/cephtest 2024-05-10T11:04:55.355 INFO:teuthology.orchestra.run.smithi184.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 11:04 /home/ubuntu/cephtest 2024-05-10T11:04:55.357 INFO:teuthology.orchestra.run.smithi196.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 11:04 /home/ubuntu/cephtest 2024-05-10T11:04:55.358 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-10T11:04:55.379 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-10T11:04:55.463 INFO:teuthology.nuke:Checking targets against current locks 2024-05-10T11:04:55.485 DEBUG:teuthology.nuke:shortname: smithi107 2024-05-10T11:04:55.486 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T11:04:55.507 DEBUG:teuthology.nuke:shortname: smithi184 2024-05-10T11:04:55.508 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T11:04:55.512 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 10:26:46.583473', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMV5MEjPhTQSzUUTIHUiqBqyM+uEu7jb5JArOrBnXiUPr1WlVYdSLjfG4nuKOcVjcaCyTWACEavhnQJPKp/s1AM='} 2024-05-10T11:04:55.524 DEBUG:teuthology.nuke:shortname: smithi196 2024-05-10T11:04:55.524 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T11:04:55.528 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 10:26:46.580457', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDMNR7AHP1fiDIHr+z43RNTJmurZbAU2HN7ZBk+CiEsmBMuvyLdI2hCYloNqYZ5jRfwT4RgcK1iunpz0b1jjFCc='} 2024-05-10T11:04:55.543 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2024-05-10_07:35:43-fs-wip-63896-from-wip-rishabh-testing-20240501.193033-distro-default-smithi/7700915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 10:26:46.582095', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNJ0lfv2iwCKuQZSKwTLyZiQAGuO46l5lQW9AzIdTyjpyfduPrvpXNhNQdVWwOC5n73BXwdXRGdYTWUleZhjq/M='} 2024-05-10T11:04:55.555 INFO:teuthology.orchestra.console.smithi107:Power off 2024-05-10T11:04:55.555 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-10T11:04:55.582 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2024-05-10T11:04:55.582 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T11:04:55.602 INFO:teuthology.orchestra.console.smithi184:Power off 2024-05-10T11:04:55.602 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-10T11:04:55.617 INFO:teuthology.orchestra.console.smithi196:Power off 2024-05-10T11:04:55.618 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-10T11:04:55.626 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-05-10T11:04:55.628 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2024-05-10T11:04:55.628 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T11:04:55.640 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2024-05-10T11:04:55.640 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T11:04:55.652 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-05-10T11:04:55.667 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-05-10T11:04:59.627 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T11:04:59.654 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T11:04:59.669 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T11:04:59.737 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-05-10T11:04:59.764 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-05-10T11:04:59.782 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-05-10T11:05:03.742 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T11:05:03.765 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T11:05:03.783 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T11:05:03.852 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-05-10T11:05:03.875 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2024-05-10T11:05:03.895 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-05-10T11:05:03.954 INFO:teuthology.orchestra.console.smithi107:Power off completed 2024-05-10T11:05:03.976 INFO:teuthology.orchestra.console.smithi184:Power off completed 2024-05-10T11:05:07.898 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-10T11:05:08.009 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-05-10T11:05:08.110 INFO:teuthology.orchestra.console.smithi196:Power off completed 2024-05-10T11:05:08.215 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} duration: 1704.8631644248962 failure_reason: 'error during quiesce thrashing: Error releasing set ''25edc73'': 1 (EPERM)' flavor: default owner: scheduled_dparmar@teuthology status: fail success: false 2024-05-10T11:05:08.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T11:05:08.302 INFO:teuthology.run:FAIL